Overview

• Labs are timed and cannot be paused. The timer starts when you click Start Lab.

• The included cloud terminal is preconfigured with the gcloud SDK.

• Use the terminal to execute commands and then click Check my progress to verify your work.

Challenge scenario

You are managing Google BigQuery, a data warehouse service that lets you store, manage, and analyze large datasets. In this scenario, you need to create a dataset and a table within BigQuery to store employee details. The dataset will act as a container for your tables, while the table will hold the actual employee information.

• You need to complete the following tasks:

  • Create a big query dataset: Dataset_name_filled_after_lab_start

  • Create a table with Table_name_filled_after_lab_start the following schema details:

    | column | Type | | --- | --- | | employee_id | INTEGER | | device_id | STRING | | username | STRING | | department | STRING | | office | STRING |

  • Import the csv data in your newly created table from pre-created cloud storage bucket named as bucket_name_filled_after_lab_start. The precreated bucket already has employees.csv file.

Click Check my progress to verify the objective.

Create BigQuery Schema and upload csv data

---

Solution of Lab

curl -LO raw.githubusercontent.com/ePlus-DEV/storage/refs/heads/main/labs/data-ingestion-into-bigquery-from-cloud-storage/lab.sh
source lab.sh

Script Alternative

bq mk work_day && bq load --source_format=CSV --skip_leading_rows=1 work_day.employee gs://qwiklabs-gcp-01-235725ab6f2a-gp06-bucket/employees.csv employee_id:INTEGER,device_id:STRING,username:STRING,department:STRING,office:STRING