Streaming with Kafka
Topics, Producers/consumers, Stream processing, and more.
Course 11 of 11
Ingest, Transform, Warehouse, and more.
Yiga AI
Advanced · Course · 4 weeks at 5 hrs/week
What you’ll learn
Data Engineering Foundations
Advanced SQL for Engineers
Python for Data Engineering
Data Warehousing
Syllabus
4 modules · 29 lessons · 19 hours · 1 graded project
1160 minutes of guided lesson time.
Sign in and enrol to unlock every lesson. The first lesson is open as a preview.
Overview and set-up
Overview and set-up — Ingest in Project: National Health Data Pipeline.
Lesson
Core concepts
Core concepts — Ingest in Project: National Health Data Pipeline.
Lesson · Locked
Worked example
Worked example — Ingest in Project: National Health Data Pipeline.
Lesson · Locked
Hands-on practice
Hands-on practice — Ingest in Project: National Health Data Pipeline.
Lesson · Locked
Common pitfalls
Common pitfalls — Ingest in Project: National Health Data Pipeline.
Lesson · Locked
Applying it at work
Applying it at work — Ingest in Project: National Health Data Pipeline.
Lesson · Locked
Module quiz: Ingest
Check what you learned in Ingest before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Transform in Project: National Health Data Pipeline.
Lesson · Locked
Core concepts
Core concepts — Transform in Project: National Health Data Pipeline.
Lesson · Locked
Worked example
Worked example — Transform in Project: National Health Data Pipeline.
Lesson · Locked
Hands-on practice
Hands-on practice — Transform in Project: National Health Data Pipeline.
Lesson · Locked
Common pitfalls
Common pitfalls — Transform in Project: National Health Data Pipeline.
Lesson · Locked
Applying it at work
Applying it at work — Transform in Project: National Health Data Pipeline.
Lesson · Locked
Module quiz: Transform
Check what you learned in Transform before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Warehouse in Project: National Health Data Pipeline.
Lesson · Locked
Core concepts
Core concepts — Warehouse in Project: National Health Data Pipeline.
Lesson · Locked
Worked example
Worked example — Warehouse in Project: National Health Data Pipeline.
Lesson · Locked
Hands-on practice
Hands-on practice — Warehouse in Project: National Health Data Pipeline.
Lesson · Locked
Common pitfalls
Common pitfalls — Warehouse in Project: National Health Data Pipeline.
Lesson · Locked
Applying it at work
Applying it at work — Warehouse in Project: National Health Data Pipeline.
Lesson · Locked
Module quiz: Warehouse
Check what you learned in Warehouse before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Dashboard in Project: National Health Data Pipeline.
Lesson · Locked
Core concepts
Core concepts — Dashboard in Project: National Health Data Pipeline.
Lesson · Locked
Worked example
Worked example — Dashboard in Project: National Health Data Pipeline.
Lesson · Locked
Hands-on practice
Hands-on practice — Dashboard in Project: National Health Data Pipeline.
Lesson · Locked
Common pitfalls
Common pitfalls — Dashboard in Project: National Health Data Pipeline.
Lesson · Locked
Applying it at work
Applying it at work — Dashboard in Project: National Health Data Pipeline.
Lesson · Locked
Module quiz: Dashboard
Check what you learned in Dashboard before moving on.
Quiz · Locked
Graded project: Project: National Health Data Pipeline
Apply everything from Project: National Health Data Pipeline in one graded, portfolio-ready build.
Graded project · Locked
Applied learning project
Use Graded project: Project: National Health Data Pipeline to apply this course to a practical challenge. You’ll finish with a clear solution and the reasoning behind your choices.

Your instructor
AI for professions
Shows working professionals how to use AI responsibly inside everyday workflows.

“The examples felt relevant to public service and worked on the connection I actually have.”
Continue with
Following the order of Data Engineer.
Learner reviews
Sign in to share your experience with this course.
Sign in to reviewLoading reviews…
Keep going
Topics, Producers/consumers, Stream processing, and more.
AWS/GCP/Azure services, Storage, IAM, and more.
ETL scripts, Logging, Testing, and more.
Performance, Partitioning, Transactions, and more.