This course on Apache Airflow aims to teach learners how to effectively use Apache Airflow through tutorials and hands-on videos. The course covers topics such as defining variables, fixing dependencies errors, scaling with Kubernetes Executors, authentication, and filtering. Students will also learn about variables, macros, templating, metrics monitoring, timezones, DockerOperator, PostgreSQL hooks, creating operators and Dags, minimizing Dags with SubDags, using different operators, storing logs in AWS S3, and more. The course employs a hands-on teaching method with practical examples and demonstrations. It is suitable for individuals interested in learning about Apache Airflow and its various functionalities.
Overview
Syllabus
Apache Airflow: The ExternalTaskSensor demystified.
Apache Airflow: How to define variables through environment variables.
Apache Airflow: How to fix dependencies errors.
Scaling Apache Airflow with the Kubernetes Executors.
Password authentication and filtering by owner in Apache Airflow.
Variables, Macros and Templating in Apache Airflow.
Introduction to metrics for monitoring Apache Airflow.
How to use timezones in Apache Airflow.
Apache Airflow | How to Use the DockerOperator with Airflow.
Apache Airflow | Building And Running Your First Airflow Docker Image.
Apache Airflow | Running Airflow Using Sequential Executor With Docker.
Apache Airflow | Getting Results From PostgreSQL Using Hooks.
Apache Airflow | How to Create an Operator.
Apache Airflow | Coding Your First Dag.
Apache Airflow | What Is a DAG?.
Apache Airflow | Minimising DAGs With SubDAGs.
Apache Airflow | How to Use Operators.
Apache Airflow | What Is An Operator.
Apache Airflow: Storing logs in AWS S3.
Apache Airflow: Storing logs in AWS S3.
Airflow 2.0: What to expect?.
Running Apache Airflow with the KubernetesExecutor on a multi-node Kubernetes cluster locally.
Running Apache Airflow with the KubernetesExecutor on a multi-node Kubernetes cluster locally.
Apache Airflow with AWS RDS.
Airflow XCom for Beginners - All you have to know in 10 mins.
The Airflow BranchPythonOperator for Beginners in 10 mins.
Apache Airflow: Adios SubDAGs! Welcome TaskGroups!.
The TriggerDagRunOperator in Airflow! Create DAG dependencies at ease.
Running Airflow 2.0 with Docker in 5 mins.
Airflow DAG: Coding your first DAG for Beginners.
Big data in Airflow? Discover the XCom Backends with AWS S3!.
Configure Airflow 2.0 with LDAP in 15 mins.
Airflow Helm Chart : Quick Start For Beginners in 10mins.
Airflow Sensors : Get started in 10 mins.
Taught by
Marc Lamberti
