Data Nerds! This repo contains all the projects needed to follow along with my free course: SQL for Data Engineering
Support the course and get practice problems, course certificate, and more!
ππΌββοΈ Course Leader: Luke Barousse
π¬ Course Producer: Kelly Adams
π» Content Developer: Rikki Singh
πΊ Video Editor: Brannon Linder
- Project #1: Exploratory Data Analysis β Job market analytics with SQL
- Project #2: Data Warehouse & Mart Build β Production ETL pipeline from raw CSVs to star schema and data marts
- Project #3: Flat to Warehouse Build β Transform flat job posting data into a normalized star schema (bonus project, not covered in video)
- Sign up for MotherDuck (free): lukeb.co/motherduck
- Use MotherDuck Studio in your browser β no installation required
- Attach the course database by running this command:
ATTACH 'md:_share/data_jobs/87603155-cdc7-4c80-85ad-3a6b0d760d93'- For running project files: Not recommended β the cloud UI works like a Jupyter notebook (run queries cell-by-cell; no direct file execution). Best for ad hoc analysis. To run full project files, use Option 2 below.
-
Install DuckDB from the official MotherDuck install page β follow the instructions for your OS to install the correct version that supports MotherDuck.
-
Launch DuckDB in your terminal:
duckdb
-
Attach and connect to the course database β either specify the database when launching DuckDB (
duckdb "md:data_jobs"), or in your session runATTACHthenUSEto switch to the attached database:ATTACH 'md:_share/data_jobs/87603155-cdc7-4c80-85ad-3a6b0d760d93'; USE data_jobs; -
For running project files: Follow the instructions outlined in each project section.
- If you find an error in this repo, please feel free to make a pull request by:
- Forking the repo
- Making any changes
- Submitting a pull request
A special thanks to SerpApi, whose generous credits made it possible to gather the job postings data used in this course.
If you're interested in using SerpApi for your own data projects, sign up here and mention Luke sent you to get an additional 20% off paid plans!
