Streaming with Kafka
Topics, Producers/consumers, Stream processing, and more.
Course 5 of 11
Validation, Lineage, Privacy, and more.
Yiga AI
Intermediate · Course · 3 weeks at 5 hrs/week
What you’ll learn
Data Engineering Foundations
Advanced SQL for Engineers
Python for Data Engineering
Data Warehousing
Syllabus
4 modules · 21 lessons · 14 hours · 1 graded project
840 minutes of guided lesson time.
Sign in and enrol to unlock every lesson. The first lesson is open as a preview.
Overview and set-up
Overview and set-up — Validation in Data Quality & Governance.
Lesson
Core concepts
Core concepts — Validation in Data Quality & Governance.
Lesson · Locked
Worked example
Worked example — Validation in Data Quality & Governance.
Lesson · Locked
Hands-on practice
Hands-on practice — Validation in Data Quality & Governance.
Lesson · Locked
Module quiz: Validation
Check what you learned in Validation before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Lineage in Data Quality & Governance.
Lesson · Locked
Core concepts
Core concepts — Lineage in Data Quality & Governance.
Lesson · Locked
Worked example
Worked example — Lineage in Data Quality & Governance.
Lesson · Locked
Hands-on practice
Hands-on practice — Lineage in Data Quality & Governance.
Lesson · Locked
Module quiz: Lineage
Check what you learned in Lineage before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Privacy in Data Quality & Governance.
Lesson · Locked
Core concepts
Core concepts — Privacy in Data Quality & Governance.
Lesson · Locked
Worked example
Worked example — Privacy in Data Quality & Governance.
Lesson · Locked
Hands-on practice
Hands-on practice — Privacy in Data Quality & Governance.
Lesson · Locked
Module quiz: Privacy
Check what you learned in Privacy before moving on.
Quiz · Locked
Overview and set-up
Overview and set-up — Documentation in Data Quality & Governance.
Lesson · Locked
Core concepts
Core concepts — Documentation in Data Quality & Governance.
Lesson · Locked
Worked example
Worked example — Documentation in Data Quality & Governance.
Lesson · Locked
Hands-on practice
Hands-on practice — Documentation in Data Quality & Governance.
Lesson · Locked
Module quiz: Documentation
Check what you learned in Documentation before moving on.
Quiz · Locked
Graded project: Data Quality & Governance
Apply everything from Data Quality & Governance in one graded, portfolio-ready build.
Graded project · Locked
Applied learning project
Use Graded project: Data Quality & Governance to apply this course to a practical challenge. You’ll finish with a clear solution and the reasoning behind your choices.

Your instructor
Data & analytics
Turns real African data problems into practical lessons learners can apply immediately.

“The course content made machine learning understandable, and the practice kept me moving.”
Continue with
Following the order of Data Engineer.
Next lesson
Overview and set-up
Data Quality & Governance
40 min · Resume
Course 6 in the track
Data Engineering Foundations
Roles, Architectures, Batch vs streaming, and more.
Beginner · Course · 3 weeks at 5 hrs/week
Course 7 in the track
Big Data with Spark
RDDs & DataFrames, Transformations, Optimisation, and more.
Intermediate · Course · 4 weeks at 5 hrs/week
Course 8 in the track
dbt & Analytics Engineering
Models, Tests, Docs, and more.
Intermediate · Course · 4 weeks at 5 hrs/week
Learner reviews
Sign in to share your experience with this course.
Sign in to reviewLoading reviews…
Keep going
Topics, Producers/consumers, Stream processing, and more.
AWS/GCP/Azure services, Storage, IAM, and more.
ETL scripts, Logging, Testing, and more.
Performance, Partitioning, Transactions, and more.