Learn how to set up and utilize Airflow effectively in just 1 hour and 30 minutes. This course covers installing and running Airflow, creating Directed Acyclic Graphs (DAGs) with PythonOperator, handling task retries, passing metadata between tasks, branching tasks, using sensors to detect files, and connecting to file sources using hooks. The teaching method involves practical hands-on exercises to ensure a comprehensive understanding. This course is designed for beginners looking to master Airflow for workflow automation and scheduling tasks.
Overview
Syllabus
[Getting started with Airflow - 1] Installing and running Airflow using docker and docker-compose.
[Getting started with Airflow - 2] Core concepts and creating your first DAG with PythonOperator.
[Getting started with Airflow - 3] Understanding task retries.
[Getting started with Airflow - 4] Passing metadata in between tasks with XCOM.
[Getting started with Airflow - 5] Using BranchPythonOperator to branch between tasks.
[Getting started with Airflow - 6] Using sensors to sense files.
[Getting started with Airflow - 7] Using hooks to connect to file sources.
Taught by
RocketMan
Related Courses
Reviews
5.0 rating, based on 1 Class Central review
-
Ganesh DoppaniGood video it helped me to understand several unknown topics in airflow. Videos are clear. Trainer did a good job on briefing about the idea of airflow and many concepts in it along with sensors and hooks.
