CY-703 (C) · Data Engineering/Official Syllabus
Data Engineering (CY-703 (C)) - Official Syllabus
1
Unit 1
Introduction to Data Engineering
- Definition, Evolution, Life Cycle
- Data Engineering skills and activities, Data Maturity
- Data Lifecycle Versus the Data Engineering Lifecycle, Security, Data Management, DataOps
2
Unit 2
Source Systems and Data Ingestion
- Types of Data Architecture, Data Lake, Data Lakehouses, Modern Data Stack
- Lambda Architecture, Kappa Architecture
3
Unit 3
Data Platforms, Storage Architecture, Data Modeling
- Data Platforms, Stream-to-Batch Storage Architecture, Data Catalog, Data Sharing
- Data Modeling, Dimensional Modeling, Creating Tables, Schema Migration, Building the data warehouse
4
Unit 4
Data Ingestion, Business Intelligence Tools and Data Governance
- Data Ingestion, SFTP and SCP, Webhooks, Web Interface, Web Scraping Business Intelligence Tools
- Introduction to Superset, Creating visualizations
- Data Quality, Data Catalogs, Data Lineage, and Data Governance
5
Unit 5
ETL, Security, Privacy, and the Future of Data Engineering
- ETL, Reverse ETL, Security, Privacy, and the Future of Data Engineering
- Patch and Update Systems, Logging, Monitoring, and Alerting
Reference Books
- Fundamentals of Data Engineering — Joe Reis, Matt Housley — O'Reilly Media, Inc., June 2022
- Data Engineering with Python: Work with Massive Datasets to Design Data Models and Automate Data Pipelines Using Python — Paul Crickard
Go to where you left off?
Quick Add to Notes
Save questions, your own notes and screenshots into notes filed by unit. It takes a free account.
Create free accountHave an account? Log in
Notes Panel