For this question, refer to the TerramEarth case study. A new architecture that writes all incoming data to BigQuery has been introduced. You notice that the data is dirty, and want to ensure data quality on an automated daily basis while managing cost.
What should you do?
A . Set up a streaming Cloud Dataflow job, receiving data by the ingestion process. Clean the data in a Cloud Dataflow pipeline.
B . Create a Cloud Function that reads data from BigQuery and cleans it. Trigger it. Trigger the Cloud Function from a Compute Engine instance.
C . Create a SQL statement on the data in BigQuery, and save it as a view. Run the view daily, and save the result to a new table.
D . Use Cloud Dataprep and configure the BigQuery tables as the source. Schedule a daily job to clean the data.
Answer: D
Leave a Reply