Storage JuiceFS Appliances for AI Platforms - Building Cost-Effective Storage Solutions
OpenInfra Foundation via YouTube
Overview
Learn about implementing cost-effective storage solutions for AI platforms in this 26-minute conference talk from the OpenInfra Foundation. Explore how NAVER addressed storage challenges in their Kubernetes and Kubeflow-based AI platform "AiSuite" by implementing JuiceFS. Discover solutions for handling large-scale data requirements of LLM models, supporting distributed learning with multi-node access, and enabling easy integration of emerging open-source LLM frameworks like Llama 2 and MPT. Understand the cost considerations between different storage options and learn how JuiceFS provides an efficient alternative for in-house AI platforms that cannot utilize external cloud storage services.
Syllabus
Storage JuiceFS Appliances for AI Platforms
Taught by
OpenInfra Foundation