Data Engineering (CY-703 (C)) - Important Questions

What do you understand by Data Engineering? Draw the data engineering lifecycle and explain each of its components.

Explain data lineage tracking in DataOps with suitable examples.

Explain Gartner Data Maturity Model in detail with help of examples.

Explain different types of data architectures with their advantages and disadvantages.

What do you understand by data lake patterns? Mention its merits and applications.

Explain in detail how you will process real-time data with Lambda Architecture.

How will you detect patterns in time-series data using streaming data architecture?

What do you understand by schema migration? Explain with the help of an example.

Explain step-by-step approach to build a data warehouse for a university setup.

What are webhooks and how do they work? Explain with help of examples.

Illustrate web scraping by considering a hypothetical website scenario to extract press releases about regulation of data science industry.

Explain Pattern-Based Lineage and Lineage by Data Tagging with the help of suitable example.

Explain how you will Extract, Transform, and Load data from a retail database to a data warehouse with the help of example.

Explain the working of Logging, Monitoring, and Alerting with the help of examples.

Write short notes on any two of the following: (i) Data Quality (ii) Data Catalogs (iii) Data Governance and Data Lineage