Overview
This course focuses on introducing a large-scale cloud-native-oriented file system designed to address challenges faced by traditional file systems in cloud-native environments. The learning outcomes and goals of the course include understanding the shift to cloud-native, identifying bottlenecks in traditional file systems, and exploring the key designs of the new cloud-native-oriented file system.
Participants will learn about the lightweight file system client in containers, DPU-based hardware offloading, storage-aware mechanisms, and full path QoS mechanisms. The course teaches skills such as designing file systems for cloud-native applications, implementing storage-aware mechanisms, and ensuring Quality of Service (QoS) for hybrid applications.
The teaching method involves presenting the challenges faced by traditional file systems, introducing the key designs of the new file system, discussing its deployment in production, and analyzing performance results. The course is intended for cloud engineers, system architects, software developers, and anyone interested in cloud-native file systems and improving I/O performance in cloud environments.
Syllabus
Intro
Change in Cloud: Evolving To Cloud-native
Bottleneck 1: Heavy Clients
Bottleneck 2: Unsuitable Network Load Balancer
Design Goals
Fisc Architecture
Lightweight Clients : VRPC
Software and Hardware Co-design
Storage-aware Distributed Gateway
File-based Route Table & Locality-aware Read
Microbenchmark: Lightweight Fisc Clients
In Production: Lightweight Fisc Clients
E2E Latency and SLA in Production
Discussion: what's more
Conclusion
Taught by
USENIX