Data Engineering

This specialization covers moving and shaping data so that analysis and machine learning have something reliable to run on: batch and streaming ingestion, data modelling for warehouses and lakes, distributed processing with engines such as Spark, and workflow orchestration. Expect strong SQL throughout, along with the less glamorous core of the discipline -- schema evolution, data quality checks, idempotent reprocessing and backfills.