Data Engineering (CY-703 (C)) - Important Questions

What do you understand by Data Engineering? Draw the data engineering lifecycle and explain each of its components.

Explain data lineage tracking in DataOps with suitable examples.

Explain Gartner Data Maturity Model in detail with help of examples.

Explain different types of data architectures with their advantages and disadvantages.

Explain data lake patterns with their merits and applications.

Explain in detail, how you will process Real-Time Data with Lambda Architecture.

How you will detect patterns in time-series data using streaming data architecture.

Explain what is meant by schema migration with an example.

Explain the step-by-step approach to build a data warehouse for a university setup.

Write a short note on any two :

What are webhooks and how do they work, with examples?

Illustrate web scraping applied to a hypothetical website scenario to extract press releases about a topic.

Explain Pattern-Based Lineage and Lineage by Data Tagging with the help of suitable example.

Explain how you will Extract, Transform, and Load Data from a Retail Database to a Data Warehouse with the help of example.

Explain the working of Logging, Monitoring, and Alerting with the help of examples.