Processing streaming data is becoming increasingly popular as streaming enables businesses to get real-time metrics on business operations. This course covers how to build streaming data pipelines on Google Cloud. Pub/Sub is described for handling incoming streaming data. The course also covers how to apply aggregations and transformations to streaming data using Dataflow, and how to store processed records to BigQuery or Cloud Bigtable for analysis. Learners will get hands-on experience building streaming data pipeline components on Google Cloud using QwikLabs.
Overview
Processing streaming data is becoming increasingly popular as streaming enables businesses to get real-time metrics on business operations. This course covers how to build streaming data pipelines on Google Cloud. Pub/Sub is described for handling incoming streaming data. The course also covers how to apply aggregations and transformations to streaming data using Dataflow, and how to store processed records to BigQuery or Cloud Bigtable for analysis. Learners will get hands-on experience building streaming data pipeline components on Google Cloud using QwikLabs.
Syllabus
- Introduction 1min
- Introduction to Processing Streaming Data 6mins
- Serverless Messaging with Pub/Sub 25mins
- Dataflow Streaming Features 11mins
- High-Throughput BigQuery and Bigtable Streaming Features 27mins
- Advanced BigQuery Functionality and Performance 42mins
- Course Summary 1min
- Course Resources 0mins
Taught by
Google Cloud