This course teaches learners how to build a streaming data pipeline using Apache Kafka and KSQL. The learning outcomes include understanding the architectural reasoning for Apache Kafka, integrating Kafka with various data stores, and building stream processing applications at scale using KSQL. The course covers skills such as creating Kafka topics, writing Kafka applications, using Kafka Connect to connect to databases, and performing real-time stream processing with KSQL. The teaching method involves hands-on demonstrations and practical examples. This course is intended for individuals interested in stream processing, real-time data integration, and building streaming data pipelines.
Apache Kafka and KSQL in Action - Let’s Build a Streaming Data Pipeline
Overview
Syllabus
Introduction
What is Apache Kafka
Moving from an older system to a new one
Writing new services in Kafka
Kafka API
Kafka Applications
Platform
Stream Processing
Create a Kafka Topic
KSQL Topics
Deserialize Messages
Viewing Live Messages
Streams
Stream Schema
Continuous Queries
Create Stream
Extended Ratings
Power Ratings
CaseEqual
Filter Messages
Aggregate Messages
transform
Kafka Connect
Pair JSON
Connectors
In Action
Demo
Kafka Topic
Kafka Model
Connecting to the Database
Model a Kafka Topic
Before and After
Half Go Summit
Outro
Taught by
Devoxx
Related Courses
-
Data Ingestion with Kafka and Kafka Streaming
-
Data Streaming
3.5 -
Apache Kafka and KSQL in Action - Let's Build a Streaming Data Pipeline
-
Getting Started with Apache Kafka and Confluent Platform on Google Cloud
-
Creating a Streaming Data Pipeline With Apache Kafka
-
Structured Streaming in Apache Spark 2
