You have data pipelines running on BigQuery, Cloud Dataflow, and Cloud Dataproc. You need to perform health checks and monitor their behavior, and then notify the team managing the pipelines if they fail. You also need to be able to work across multiple projects. Your preference is to use managed products of features of the platform. What should you do?
A) Export the information to Cloud Stackdriver, and set up an Alerting policy
B) Run a Virtual Machine in Compute Engine with Airflow, and export the information to Stackdriver
C) Export the logs to BigQuery, and set up App Engine to read that information and send emails if you find a failure in the logs
D) Develop an App Engine application to consume logs using GCP API calls, and send emails if you find a failure in the logs

Question

Quizplus · Accepted Answer

The Answer of You have data pipelines running on BigQuery, Cloud Dataflow, and Cloud Dataproc. You need to perform health checks and monitor their behavior, and then notify the team managing the pipelines if they fail. You also need to be able to work across multiple projects. Your preference is to use managed products of features of the platform. What should you do?
A) Export the information to Cloud Stackdriver, and set up an Alerting policy
B) Run a Virtual Machine in Compute Engine with Airflow, and export the information to Stackdriver
C) Export the logs to BigQuery, and set up App Engine to read that information and send emails if you find a failure in the logs
D) Develop an App Engine application to consume logs using GCP API calls, and send emails if you find a failure in the logs

You Have Data Pipelines Running on BigQuery, Cloud Dataflow, and Cloud