Streaming with Kafka
Topics, Producers/consumers, Stream processing, and more.
Course 3 of 11
ETL scripts, Logging, Testing, and more.
Yiga AI
Intermediate · Course · 3 weeks at 5 hrs/week
What you’ll learn
Data Engineering Foundations
Advanced SQL for Engineers
Python for Data Engineering
Data Warehousing
Syllabus
4 modules · 21 lessons · 14 hours · 1 graded project
840 minutes of guided lesson time.
Sign in and enrol to unlock every lesson. The first lesson is open as a preview.
Overview and set-up
Overview and set-up — ETL scripts in Python for Data Engineering.
Lesson
Core concepts
Core concepts — ETL scripts in Python for Data Engineering.
Lesson · Locked
Worked example
Worked example — ETL scripts in Python for Data Engineering.
Lesson · Locked
Hands-on practice
Hands-on practice — ETL scripts in Python for Data Engineering.
Lesson · Locked
Module quiz: ETL scripts
Check what you learned in ETL scripts before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Logging in Python for Data Engineering.
Lesson · Locked
Core concepts
Core concepts — Logging in Python for Data Engineering.
Lesson · Locked
Worked example
Worked example — Logging in Python for Data Engineering.
Lesson · Locked
Hands-on practice
Hands-on practice — Logging in Python for Data Engineering.
Lesson · Locked
Module quiz: Logging
Check what you learned in Logging before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Testing in Python for Data Engineering.
Lesson · Locked
Core concepts
Core concepts — Testing in Python for Data Engineering.
Lesson · Locked
Worked example
Worked example — Testing in Python for Data Engineering.
Lesson · Locked
Hands-on practice
Hands-on practice — Testing in Python for Data Engineering.
Lesson · Locked
Module quiz: Testing
Check what you learned in Testing before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Packaging in Python for Data Engineering.
Lesson · Locked
Core concepts
Core concepts — Packaging in Python for Data Engineering.
Lesson · Locked
Worked example
Worked example — Packaging in Python for Data Engineering.
Lesson · Locked
Hands-on practice
Hands-on practice — Packaging in Python for Data Engineering.
Lesson · Locked
Module quiz: Packaging
Check what you learned in Packaging before moving on.
Quiz · Locked
Graded project: Python for Data Engineering
Apply everything from Python for Data Engineering in one graded, portfolio-ready build.
Graded project · Locked
Applied learning project
Use Graded project: Python for Data Engineering to apply this course to a practical challenge. You’ll finish with a clear solution and the reasoning behind your choices.

Your instructor
AI for professions
Shows working professionals how to use AI responsibly inside everyday workflows.

“The examples felt relevant to public service and worked on the connection I actually have.”
Continue with
Following the order of Data Engineer.
Next lesson
Overview and set-up
Python for Data Engineering
40 min · Resume
Course 4 in the track
Advanced SQL for Engineers
Performance, Partitioning, Transactions, and more.
Intermediate · Course · 4 weeks at 5 hrs/week
Course 5 in the track
Data Quality & Governance
Validation, Lineage, Privacy, and more.
Intermediate · Course · 3 weeks at 5 hrs/week
Course 6 in the track
Data Engineering Foundations
Roles, Architectures, Batch vs streaming, and more.
Beginner · Course · 3 weeks at 5 hrs/week
Learner reviews
Sign in to share your experience with this course.
Sign in to reviewLoading reviews…
Keep going
Topics, Producers/consumers, Stream processing, and more.
AWS/GCP/Azure services, Storage, IAM, and more.
Performance, Partitioning, Transactions, and more.
Validation, Lineage, Privacy, and more.