Data Engineer
A data engineer builds the pipelines and platforms that move data reliably to where it's needed.
- Build batch and streaming pipelines
- Model data in warehouses
- Schedule and monitor jobs
- Keep data correct and on time
- A pipeline in Python and SQL
- A warehouse model
- An orchestrated, containerised job
Where it leads: Senior data engineer, platform or analytics engineering.
Every skill, at the level the job needs
Updating… · change the level or company to see how it shifts
python
core- Type casting
- Basic Syntax
- Exceptions
- Exception handling
- Basic data types
- Variables
sql
core- Relational DB theory
- Relational Data Model
- RDBMS Benefits and Limitations
- SQL and Databases
- NoSQL DBs
- Basics SQL
git-github
core- git init
- What is Version Control?
- Why use Version Control?
- git config
- Local vs Global Config
- Git
data-engineer
core- What is Data Engineering?
- Data Engineering vs Data Science
- Roles and responsibilities in a development team
- Data Engineering Lifecycle
- Choosing the Right Technologies
- Python
datastructures-and-algorithms
core- Language Syntax
- Control Structures
- Python
- Pseudocode
- Pseudocode basics
- Functions
What the levels mean
- L1 · AwareKnows what it is and when it's used
- L2 · BasicsCan use it with guidance
- L3 · WorkingUses it independently on the job
- L4 · StrongHandles hard cases, reviews others
- L5 · ExpertDesigns with it, teaches it
Interviews, by kind of company
Your route adds an interview track that matches the company you choose.
Large IT services firms: aptitude, fundamentals, technical and HR rounds.
Online assessment, coding rounds, a design round.
Hard timed coding rounds, system design, behavioural interviews.
Questions
What does a Data Engineer need to know?
Data Engineer Roadmap, Python Developer, SQL Roadmap at a working level, plus Docker Roadmap. The skills section above lists every one with its level.
How long does it take to become a Data Engineer?
About 222 hours of study from scratch. At 10 hours a week that's roughly 23 weeks; anything you already know is skipped after the readiness test.
I already know some of this. Do I start from zero?
No. The optional readiness test finds what you already know and your route skips it.
Does the route change for product companies or senior roles?
Yes. Choose your level and the kind of company above: the skills and target levels adjust, for example deeper data structures and system design for product companies.
Other roles in the Data & AI track
They share many skills with this one, so progress carries over if you switch.
Answer questions with SQL, Python and dashboards.
Models and analyses with Python and machine learning.
Applications built on AI models: assistants, agents, AI features.
Deploy and run machine-learning systems in production.