In this lab you spin up a virtual machine, configure its security, access it remotely, and then carry out the steps of an ingest-transform-and-publish data pipeline manually. This lab is part of a series of labs on processing scientific data.
Overview
Syllabus
- GSP008
- Overview
- Setup
- Task 1. Create Compute Engine instance with the necessary API access
- Task 2. SSH into the instance
- Task 3. Install software
- Task 4. Ingest USGS data
- Task 5. Transform the data
- Task 6. Create a Cloud Storage bucket
- Task 7. Store data
- Task 8. Publish Cloud Storage files to web
- Congratulations!
