Data engineering
Build and operate robust data pipelines: ingestion, transformation, orchestration, analytical storage, and practices to ensure quality, observability, and scalability of data flows.
Subcategories
Sort by:
52:02
Your ETL Pipelines Are Broken | Fix Them with Dagster
In this video, we integrate Dagster into our End-to-End Spoilage Risk and Waste Minimization Prediction project to build a production-ready....
Minich Vertex Analyticsโข25 viewsโข2 mo ago
24:16
Streaming Data Interview Questions by Sr Data Architect | Kafka + Spark Streaming + Project Scenerio
Prepare for your Data Engineering interview with the ultimate Streaming Data Interview Guide This video covers the most frequently asked Str...
DataBeliโข6.7k viewsโข2 mo ago
7:03
Dagster Tutorial: Real-Time Marketing Attribution Pipeline (Full Walkthrough + Code)
Learn how to build a real-time marketing attribution pipeline using Dagster โ the asset-based data orchestrator. This is a complete, code-fi...
Mukesh Singhโข23 viewsโข3 mo ago
1:58:51
OneLake, Lakehouse, and Shortcuts in Microsoft Fabric - Session 03
Hello guys, I'm sharing the recordings of the Microsoft Fabric course along with preparation for the international exams Fabric Analytics En...
Aprendiendo con Leandroโข212 viewsโข3 mo ago
4:40:04
End-to-End Spark Streaming Project | Databricks + Kafka + PostgreSQL + Real-Time Dashboard
Learn Spark Structured Streaming by building a complete real-world Data Engineering project from scratch! In this hands-on tutorial, a Sr Da...
DataBeliโข44.5k viewsโข3 mo ago
3:45
Microsoft Fabric Tutorial 2026 | The Big Picture | Think Like a Solution Architect
๐ Microsoft Fabric Masterclass | Episode 1 Welcome to the first episode of the Microsoft Fabric Masterclass! In this video, we answer one o...
Ravi Chauhanโข38 viewsโข3 mo ago
3:27
Most Teams Choose the Wrong Data Architecture in Microsoft Fabric
veryone wants to know: **Should I use a Lakehouse, a Warehouse, or an Eventhouse in Microsoft Fabric?** But thatโs the wrong place to start....
Guy in a Cubeโข8.5k viewsโข4 mo ago
10:53
๐ฅ ADLS to Microsoft Fabric Lakehouse | End-to-End Data Engineering Tutorial
Welcome to Part-2 of the Azure Data Engineering Series! In this hands-on Microsoft Fabric tutorial, we continue our real-world Azure Data En...
NubiEdge Tutorialsโข91 viewsโข5 mo ago
2:07:32
End-to-End Microsoft Fabric Project: SQL Server, Lakehouse, Pipelines & Power BI
Master Microsoft Fabric with this 2-hour, end-to-end HR Analytics project designed to make your portfolio job-ready. Weโll cover everything....
Analytics With Priyamโข1.2k viewsโข5 mo ago
40:31
Deep Dive: Building a Cross-Workspace Control Plane for Databricks
Your Databricks workspaces run great in isolation. But what happens between them? That's where things get messy. In this Deep Dive, Alex Noo...
Dagsterโข421 viewsโข6 mo ago
4:26:16
Real-Time Traffic Data Engineering Project | Kafka + Spark + Delta Lake
I built a complete End-to-End Real-Time Traffic Data Engineering Project using Kafka, PySpark, and Delta Lake, This project simulates a real...
Data with Jayโข7.3k viewsโข6 mo ago
2:12:57
Microsoft Fabric + Power BI + SQL Project | Capstone Project | For Beginners | edition 2026 #fabric
#fabric #powerbi #sql #microsoft #dataanalysis Part 2 - https://youtu.be/cr4tWy_0_hE Packages Course- โญ SQL Complete Course - https://topmat...
Data Tutorialsโข26.2k viewsโข7 mo ago
1:32:33
PyFlink Stream Processing Tutorial: Build a Real-Time Pipeline with Kafka, Redpanda and Python
In this workshop, Alexey Grigorev breaks down the complexities of real-time data engineering, moving from basic Python-based Kafka consumers...
DataTalksClub โฌโข7.9k viewsโข7 mo ago
1:49:36
Last Minute Data Modeling and Warehousing Interview Prep Kit : Complete Revision in 2 Hours
In this video we will cover all important interview questions asked around data modeling and data warehousing for data analyst and data engi...
Ankit Bansalโข56.1k viewsโข7 mo ago
8:12
What Is Fabric IQ?! Microsoft Fabricโs NEW Ontology Explained
๐ฅ Confused about Fabric IQ? Youโre not alone. When Fabric IQ was announced at Ignite, it looked powerfulโฆ but what does it actually DO? In....
Guy in a Cubeโข41.7k viewsโข7 mo ago
11:15
Introduction to Microsoft Fabric Data Agents
Are Microsoft Fabric Data Agents just another buzzword, or can they actually change how your users get answers from their data? In this vide...
Pragmatic Worksโข18.8k viewsโข8 mo ago
15:21
Databricks Lakeflow vs. Apache Airflow: The Ultimate Comparison
In this video, we'll take a look at Databricks Lakeflow and Apache Airflow to help you decide which orchestrator is best for you! Join My Pa...
The Data and AI Guyโข994 viewsโข8 mo ago
3:37:38
Real-Time E-Commerce Data Engineering Project with Kafka
๐ฅ Real-Time E-Commerce Data Engineering Project using Apache Kafka, Python & Snowflake ๐ฅ In this video, I build a production-style, end-to...
Data with Jayโข11.2k viewsโข8 mo ago
22:44
Stream Real-Time Data from Kafka to PostgreSQL using Apache NiFi
In this Apache NiFi ETL tutorial, you will learn how to read streaming data from Apache Kafka and store it into a PostgreSQL database using....
IOT Stationโข722 viewsโข9 mo ago
11:41
DBT Orchestration and Scheduling with Airflow, Dagster, Prefect
Welcome to ZoomInData ๐ In this video, we cover important dbt (Data Build Tool) interview questions and answers to help data analysts, anal...
ZoomInDataโข216 viewsโข9 mo ago
7:36
Data Warehouse Fundamentals โ The Backbone of Modern Analytics | Uplatz
Uplatz Explainer โ Every data-driven organization needs a strong foundation โ and that foundation is the Data Warehouse. It powers business....
Uplatzโข29 viewsโข10 mo ago
6:35
Dagster: The Modern Orchestration Engine for Data Pipelines | Uplatz
Dagster is a next-generation data orchestration platform built for modern data teams who need reliability, observability, and clean software...
Uplatzโข177 viewsโข11 mo ago
12:40
99% of Developers Don't Get PostgreSQL
๐ค Check out Supabase: https://supabase.plug.dev/qnxeTMY โค๏ธ Get 40% OFF CodeCrafters: https://app.codecrafters.io/join?via=the-coding-gopher...
The Coding Gopherโข347.8k viewsโข1y ago
16:18
Data Warehouse vs Data Lake vs Data Lakehouse | ETL, OLAP vs OLTP
In this video, we will clearly understand what is data warehouse, data lake and data lakehouse using simple explanation. We will also go ove...
codebasicsโข231.9k viewsโข1y ago
16:57
Modern data stack dagster to orchestrate dlt, dbt and duckdb data pipeline
Switching from Snowflake to DuckDB: Automating Data Pipelines with Dagster, dlt, and dbt In this video, we demonstrate how to transition fro...
AIgineerโข562 viewsโข1y ago
50:01
Modern data stack - automating dlt and dbt pipeline with dagster
In this instructional video, we explore how to use Dagster to automate and orchestrate your data pipeline. We demonstrate extracting and loa...
AIgineerโข2.7k viewsโข1y ago
58:54
Microsoft Fabric + Power Bi : HR Data Analytics Project | Complete End to End Tutorial
๐ HR Data Project in Microsoft Fabric | End-to-End Tutorial In this video, Iโll walk you through a complete HR Data Analytics Project using...
Analytics With Priyamโข1.3k viewsโข1y ago
1:24:07
Microsoft Fabric End-to-End Project | Medallion Architecture Demo | Pyspark Notebook | Data Pipeline
In this video, we build a hands-on End-to-End Data Solution in Microsoft Fabric using the Medallion Architecture (Bronze, Silver, Gold layer...
Data World Solutionโข20.4k viewsโข1y ago
5:07
How to Build a Data Warehouse (Full Lifecycle Explained)
๐ฆ๐ถ๐ด๐ป ๐๐ฝ ๐ณ๐ผ๐ฟ ๐ผ๐๐ฟ ๐ฐ๐ผ๐บ๐ฝ๐น๐ฒ๐๐ฒ ๐๐ฎ๐๐ฎ ๐ฆ๐ฐ๐ถ๐ฒ๐ป๐ฐ๐ฒ ๐๐ฟ๐ฎ๐ถ๐ป๐ถ๐ป๐ดโ๐ฆ๐๐ฌ๐ญ๐๐ซ ๐๐ฒ๐ญ๐ก๐จ๐ง, ๐๐๐, ๐ฆ๐๐๐ก๐ข๐ง๐ ๐ฅ๐...
365 Data Scienceโข8.3k viewsโข1y ago
18:35
Streaming Data to Databricks Using Lakeflow | Kafka, Kinesis, EventHub | End-To-End Project #1
๐ In this hands-on tutorial, we kick off a full end-to-end Databricks project for a smart car insurance use case. You'll learn how to inges...
Thomas Hassโข9.0k viewsโข1y ago
4:11:48
Master Real-Time Stock Analytics with Microsoft Fabric | FULL Course with REAL Project (4+ Hours)
๐ Want Resources + Hands-On Support from Expert mentors? Unlock: - Downloadable notebooks, KQL scripts, and Power BI dashboards - Structure...
Datavionโข2.2k viewsโข1y ago
35:46
A Comprehensive Guide to Streaming on the Data Intelligence Platform
Is stream processing the future? We think so โ and weโre building it with you using the latest capabilities in Apache Sparkโข Structured Stre...
Databricksโข2.9k viewsโข1y ago
17:08
Real-Time Data Pipeline: Kafka to Snowflake using snowflake connector
In this video, I walk through how to build a real-time data pipeline that streams events from Apache Kafka into Snowflake using the Kafka Co...
MyDataEngineeringโข1.2k viewsโข1y ago
5:48
๐ฅ Streaming Data Architecture: Build Real-Time Systems with Kafka & Stream Processing
Dive into the world of streaming data architecture and learn how to build real-time data processing systems from scratch! ๐ This video prov...
CodeLuckyโข2.7k viewsโข1y ago
44:37
Webinar: Deploying Microsoft Fabric A blueprint for success
An insightful webinar on deploying Microsoft Fabric. This webinar provides expert guidance on unlocking the full value of your data with Mic...
Codec Irelandโข55 viewsโข1y ago
28:13
Dagster - Data Orchestration and Pipelines with Python & DAGs
๐ Join our channel to get access to perks: https://www.youtube.com/channel/UCTwxaBjziKfy6y_uWu30orA/join โ๏ธ ๐๐๐ ๐บ๐ฒ ๐ฎ ๐ฐ๐ผ๐ณ๐ณ๐ฒ๐ฒ: To...
BugBytesโข14.8k viewsโข1y ago
1:25:37
MICROSOFT FABRIC Tutorial with End-To-End Data Project | Master Fabric for Beginners (90 MINUTES!)
Welcome to series on Microsoft Fabric! In this video tutorial, we'll cover all the important Fabric components & concepts with end-to-end da...
NextGen Dataโข40.1k viewsโข1y ago
21:02
How to Build a Data Mesh in Microsoft Fabric | Step-by-Step Tutorial
Welcome back to The BI Masters! In todayโs video, we dive deep into a powerful concept in Microsoft Fabric: Data Mesh Architecture. What You...
TheBiMastersโข508 viewsโข1y ago
1:41:39
Getting Started with Microsoft Fabric: A Practical Case from A to Z
๐ Let's talk about your project โ https://www.stalx-services.com/ Dive with me into Fabric, Microsoft's new Data & AI platform! In this vid...
Alexandre STEVENSโข20.2k viewsโข1y ago
9:06
What is Microsoft Fabric | Fabric Architecture | Data Lake, Lakehouse, One Lake introduction
In this video, we dive deep into Microsoft Fabric and its architecture, providing an overview of Azure Data Fabric. Learn about key concepts...
Data Engineering with Azureโข231 viewsโข1y ago
54:27
Microsoft Fabric - A Comprehensive Workshop on Data Analytics and AI
Centrilogic's Shane Castle delivers a comprehensive workshop exploring the powerful data analytics and AI capabilities of Microsoft Fabric.....
Centrilogicโข105 viewsโข1y ago
18:33
Kafka Tutorial for Beginners | Everything you need to get started
โบ Step by Step DevOps Roadmap PDF: https://bit.ly/4jv2qDH Apache Kafka Tutorial | Everything you need to know: What is Kafka, Real Life Kafk...
TechWorld with Nanaโข1.4M viewsโข1y ago
15:24
Create a Streaming Data Pipeline with Google Cloud Dataflow : Pub/Sub to BigQuery
Create a Streaming Data Pipeline with Google Cloud Dataflow : Pub/Sub to BigQuery In this video, you'll learn how to create a streaming data...
TechTraptureโข30.9k viewsโข1y ago
52:39
Real-Time Data Pipeline with Apache Kafka and AWS | AWS MSK | Hands-on Data Engineering Project
This is a hands-on end to end data engineering project on AWS. In this project we have demonstrated how you can build real time data streami...
AWS Made Easyโข23.4k viewsโข1y ago
9:10:59
Microsoft Fabric Tutorial (9+ HOURS) | Microsoft Fabric for Beginners
Microsoft Fabric Tutorial | Fabric Data Engineering | Fabric Data Factory | Fabric Data Warehouse Welcome to our 9+ hour full course on Micr...
Ansh Lambaโข375.1k viewsโข1y ago
8:20
Microsoft Fabric: Creating a Data Warehouse | What's the difference between Lakehouse and Warehouse?
*FREE IT certification study plans:* https://training.cbt.gg/h08 In Microsoft Fabric, data warehouses get their own unique experience even i...
CBT Nuggetsโข7.6k viewsโข1y ago
2:41:36
Master Real-time Data Pipelines with Kafka and Flink - 3 hr Course - DataExpert.io Free Boot Camp
Join the free boot camp here: https://bootcamp.techcreator.io Join the discord to get help here: https://discord.gg/dQbZMTBj5q The code for....
DataExpertโข67.9k viewsโข1y ago
4:55
Apache Kafka Fundamentals You Should Know
Get a Free System Design PDF with 158 pages by subscribing to our weekly newsletter: https://bit.ly/bbg-social Animation tools: Adobe Illust...
ByteByteGoโข436.4k viewsโข1y ago