Embark on a deep dive into the complex world of Kafka with this comprehensive conference talk. Explore the hidden traps, monsters, and treasures of the Kafka kingdom from both developer and operations perspectives. Discover advanced concepts that influence the development of well-behaving Kafka applications and learn how cloud providers handle Kafka at scale. Gain insights into client-side app development challenges, including serialization, partitioning in polyglot environments, rebalancing impacts, retry and order management, assignment policies, commit strategies, and schema loss. Delve into operational aspects such as cluster configuration, performance validation, useful metrics, guarantee management, and resource sharing implications. Through a fun and practical recipe format, uncover dev and ops traps while benefiting from the speakers' extensive experience in Kafka library development and cloud management. Equip yourself with the knowledge to navigate Kafka's complexities and optimize your applications for better performance and reliability.
Overview
Syllabus
Kafka: a map of traps for the enlightened dev and op by Emmanuel Bernard And Clement Escoffier
Taught by
Devoxx