Data Engineering (CY-703 (C))-CSE-Cyber Security /Cyber Security (VII) | RGPV

---

• Syllabus

• Syllabus - Data Engineering (CY-703 (C))

• Introduction to Data Engineering

• Definition, Evolution, Life Cycle
• Data Engineering skills and activities
• Data Maturity, Data Lifecycle Versus the Data Engineering Lifecycle
• Security, Data Management, DataOps

• Source Systems and Data Ingestion

• Types of Data Architecture, Data Lake, Data Lakehouses
• Modern Data Stack, Lambda Architecture, Kappa Architecture

• Data Platforms, Stream-to-Batch Storage Architecture

• Data Catalog, Data Sharing
• Data Modeling, Dimensional Modeling
• Creating Tables, Schema Migration, Building the data warehouse

• Data Ingestion, SFTP and SCP, Webhooks, Web Interface, Web Scraping

• Business Intelligence Tools, Introduction to Superset, Creating visualizations
• Data Quality, Data Catalogs, Data Lineage, and Data Governance

• ETL, Reverse ETL, Security, Privacy, and the Future of Data Engineering

• Patch and Update Systems, Logging, Monitoring, and Alerting