Create an account to use AI

Create a free account to unlock all features:

Ask questions about videos with AI
Use smart search (AI)
Save your favorite videos
Bookmark your favorite categories
Organize your favorite subcategories
Access your personalized favorites page
Access your conversation history
Personalize your homepage with your favorites

Create an account

Already have an account? Log in

Design a Data Warehouse | System Design

Interview Pen

Visit Our Website: https://interviewpen.com/?utm_campaign=warehouse

Join Our Discord (24/7 help): https://discord.gg/Qy85PT9wj6

Like & Subscribe: https://youtube.com/@interviewpen

Many large companies wind up with several sources of data and want to use all of them together to make business decisions. This video dives into the low-level details of designing a data warehousing system to bring in these data sources, transform them, and analyze them in aggregate.

If you liked this video and want to learn more about fundamental systems and how they can be used to solve problems, check out our full course on https://interviewpen.com/?utm_campaign=warehouse !

Table of Contents:

0:00 - Introduction

0:35 - Requirements

1:33 - Data Sources

2:28 - Batch Ingestion System

4:40 - Batch Ingestion Strategies

7:31 - Streaming Ingestion

8:16 - Third-Party Services

9:40 - Transformation

11:09 - SQL Analysis

11:30 - Overview

12:22 - Overview using Snowflake

13:44 - interviewpen.com

Socials:

Twitter: https://twitter.com/InterviewPen

LinkedIn: https://www.linkedin.com/company/interviewpen

Website: https://interviewpen.com/?utm_campaign=warehouse

Design a Data Warehouse | System Design | Knoovi