Explore a 29-minute conference talk on Shopify's highly available search platform, which indexes petabytes of data for millions of merchants. Learn how Kafka messaging service enables real-time indexing of millions of documents per minute to Elasticsearch across multiple global regions, ensuring high availability. Discover strategies for handling varying write loads, implementing storage autoscaling, and using Envoy for disaster recovery and regional failover. Gain insights into building a complex infrastructure that meets key requirements such as scalability, data residency compliance, and efficient search query performance in a large-scale commerce platform.
Highly Available Search Platform for Data Resilience and Compliance at Shopify
CNCF [Cloud Native Computing Foundation] via YouTube
Overview
Syllabus
Search at Shopify: Highly Available Platform for Data Resilience and Compliance - Leila Vayghan
Taught by
CNCF [Cloud Native Computing Foundation]