35
Getting started with Anaconda Notebooks
Data Engineering Overview
Data Engineering History
Rise and Fall of Big Data
Data Science vs. Data Engineering
Tools for Data Engineering
Data Maturity
Exercise: An Executive Data Strategy
Data Engineering Lifecycle Overview
Generation, Storage, and Ingestion
Transformation, and Serving and Data Consumption
Undercurrents: Security, Data Management, and DataOps
Undercurrents: Data Architecture, Orchestration, and Software Engineering
Exercise: Standing Up a Data Project
Data Engineer Skills and Responsibilities
Programming Language Skills
Databases, Data Warehouses, and Data Lakes
Cloud Solutions
Data Meshes and Data Fabrics
Exercise: Should We Switch Platforms?
Operating Domain Overview
Data Generation
Evaluating Source Systems
Sampling Bias, Outliers, and Data Drift
Data Entry and Correction
The S-Curve
Synthetic Outliers and Operating Domain Considerations
Exercise: John Deere Success Story
Machine Learning Engineers
Data Science and Machine Learning
Analytics Users
Why Self-Service is Hard
Exercise: A Data Entry Nightmare
Summary
End of course survey
img