Rapid Storage on Colossus: High-Performance Cloud Storage by Google Cloud

In this 26-minute tech presentation, learn about Rapid Storage, Google Cloud's innovative zonal storage product built on the Colossus distributed file system. Discover how Principal Engineer Michal Szymaniak and the Google Cloud team designed a revolutionary storage solution that combines block storage's low latency, parallel file systems' high throughput, and object storage's ease of use and scalability. Explore how Rapid Storage addresses customer limitations with Google Cloud Storage by offering impressive performance metrics: 20 million requests per second, six terabytes per second throughput, 11 nines of durability within a zone, three nines of availability, and sub-millisecond latency for random reads and appends. Understand the technical architecture that minimizes latency through direct access with only one RPC hop to data, integration of gRPC for stateful streaming, and implementation of hierarchical namespace for enhanced file system operations. Get insights into this private preview product scheduled for allow-list general availability later this year, as presented at AI Infrastructure Field Day in Santa Clara, California.