Lessons
1Join the snapshot to the change log25 min read
Explain a gap-free CDC snapshot and streaming handoff.
- →Explain a gap-free CDC snapshot and streaming handoff
- →Protect source systems during ingestion failure
2Evolve schemas without silently changing meaning25 min read
Plan schema changes with reader and writer compatibility.
- →Plan schema changes with reader and writer compatibility
3Publish data only when its contract passes25 min read
Build data-quality gates with actionable failure rows.
- →Build data-quality gates with actionable failure rows
- →Choose publication gates from business invariants
4Tune the pipeline from an execution profile25 min read
Identify skew and wasted work before increasing compute.
- →Identify skew and wasted work before increasing compute
Skills in this course
- 01Explain a gap-free CDC snapshot and streaming handoffExplain a gap-free CDC snapshot and streaming handoff.
- 02Plan schema changes with reader and writer compatibilityPlan schema changes with reader and writer compatibility.
- 03Build data-quality gates with actionable failure rowsBuild data-quality gates with actionable failure rows.
- 04Identify skew and wasted work before increasing computeIdentify skew and wasted work before increasing compute.
- 05Protect source systems during ingestion failureProtect source systems during ingestion failure.
- 06Choose publication gates from business invariantsChoose publication gates from business invariants.