Streaming with Kafka
Topics, Producers/consumers, Stream processing, and more.
Course 9 of 11
DAGs, Operators, Scheduling, and more.
Yiga AI
Intermediate · Course · 4 weeks at 5 hrs/week
What you’ll learn
Data Engineering Foundations
Advanced SQL for Engineers
Python for Data Engineering
Data Warehousing
Syllabus
4 modules · 25 lessons · 17 hours · 1 graded project
1000 minutes of guided lesson time.
Sign in and enrol to unlock every lesson. The first lesson is open as a preview.
Overview and set-up
Overview and set-up — DAGs in Workflow Orchestration with Airflow.
Lesson
Core concepts
Core concepts — DAGs in Workflow Orchestration with Airflow.
Lesson · Locked
Worked example
Worked example — DAGs in Workflow Orchestration with Airflow.
Lesson · Locked
Hands-on practice
Hands-on practice — DAGs in Workflow Orchestration with Airflow.
Lesson · Locked
Common pitfalls
Common pitfalls — DAGs in Workflow Orchestration with Airflow.
Lesson · Locked
Module quiz: DAGs
Check what you learned in DAGs before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Operators in Workflow Orchestration with Airflow.
Lesson · Locked
Core concepts
Core concepts — Operators in Workflow Orchestration with Airflow.
Lesson · Locked
Worked example
Worked example — Operators in Workflow Orchestration with Airflow.
Lesson · Locked
Hands-on practice
Hands-on practice — Operators in Workflow Orchestration with Airflow.
Lesson · Locked
Common pitfalls
Common pitfalls — Operators in Workflow Orchestration with Airflow.
Lesson · Locked
Module quiz: Operators
Check what you learned in Operators before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Scheduling in Workflow Orchestration with Airflow.
Lesson · Locked
Core concepts
Core concepts — Scheduling in Workflow Orchestration with Airflow.
Lesson · Locked
Worked example
Worked example — Scheduling in Workflow Orchestration with Airflow.
Lesson · Locked
Hands-on practice
Hands-on practice — Scheduling in Workflow Orchestration with Airflow.
Lesson · Locked
Common pitfalls
Common pitfalls — Scheduling in Workflow Orchestration with Airflow.
Lesson · Locked
Module quiz: Scheduling
Check what you learned in Scheduling before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Monitoring in Workflow Orchestration with Airflow.
Lesson · Locked
Core concepts
Core concepts — Monitoring in Workflow Orchestration with Airflow.
Lesson · Locked
Worked example
Worked example — Monitoring in Workflow Orchestration with Airflow.
Lesson · Locked
Hands-on practice
Hands-on practice — Monitoring in Workflow Orchestration with Airflow.
Lesson · Locked
Common pitfalls
Common pitfalls — Monitoring in Workflow Orchestration with Airflow.
Lesson · Locked
Module quiz: Monitoring
Check what you learned in Monitoring before moving on.
Quiz · Locked
Graded project: Workflow Orchestration with Airflow
Apply everything from Workflow Orchestration with Airflow in one graded, portfolio-ready build.
Graded project · Locked
Applied learning project
Use Graded project: Workflow Orchestration with Airflow to apply this course to a practical challenge. You’ll finish with a clear solution and the reasoning behind your choices.

Your instructor
Data & analytics
Turns real African data problems into practical lessons learners can apply immediately.

“The course content made machine learning understandable, and the practice kept me moving.”
Continue with
Following the order of Data Engineer.
Next lesson
Overview and set-up
Workflow Orchestration with Airflow
40 min · Resume
Course 10 in the track
Data Warehousing
Dimensional modelling, BigQuery/Snowflake, Loading, and more.
Intermediate · Course · 4 weeks at 5 hrs/week
Course 11 in the track
Project: National Health Data Pipeline
Ingest, Transform, Warehouse, and more.
Advanced · Course · 4 weeks at 5 hrs/week
Learner reviews
Sign in to share your experience with this course.
Sign in to reviewLoading reviews…
Keep going
Topics, Producers/consumers, Stream processing, and more.
AWS/GCP/Azure services, Storage, IAM, and more.
ETL scripts, Logging, Testing, and more.
Performance, Partitioning, Transactions, and more.