Real-time Logs Processing with Apache Airflow, Kafka and Elasticsearch - Part 1
CodeWithYu via YouTube
Overview
Learn to build a production-grade system for processing billions of real-time logs in this detailed video tutorial. Master the fundamentals of system architecture, website log production, and cloud infrastructure setup while exploring the integration of Apache Airflow, Kafka, and Elasticsearch. Follow along with hands-on demonstrations covering system architecture design, implementing log generation from websites, configuring a free Kafka cluster, and establishing a free Elasticsearch cluster. Gain practical experience through step-by-step instructions and comprehensive explanations that bridge the gap between theory and real-world implementation.
Syllabus
Introduction
System Architecture
Producing Logs from Websites
Setting up Free Kafka Cluster
Setting up Free Elasticsearch Cluster
Taught by
CodeWithYu