Building Automated Data Pipelines with Spark,dbt,and Airflow
Grow your skills with Coursera Plus for $239/year (usually $399). Save now.
Building Automated Data Pipelines with Spark,dbt,and Airflow
This course is part of Open source Data Engineering with Spark, dbt & Airflow Professional Certificate
Instructor: Professionals from the Industry
Included with
Recommended experience
What you'll learn
Build end-to-end data pipelines that automatically ingest from databases, APIs, and streams using Spark, dbt, and Airflow tools.
Design data models with historical tracking using SCD Type 2 patterns to preserve complete change history for analytics.
Create automated workflows with intelligent retry logic, SLA monitoring, and parameterization for production reliability.
Optimize Spark job performance using partitioning and caching strategies to achieve 30%+ runtime improvements.
Skills you'll gain
Tools you'll learn
Details to know
Add to your LinkedIn profile
March 2026
See how employees at top companies are mastering in-demand skills
Build your Data Analysis expertise
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate from Coursera
Explore more from Data Analysis
Why people choose Coursera for their career
Felipe M.
Jennifer J.
Larry W.
Chaitanya A.
Open new doors with Coursera Plus
Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose Coursera for Business
Upskill your employees to excel in the digital economy