Create an account to use AI

Create a free account to unlock all features:

Ask questions about videos with AI
Use smart search (AI)
Save your favorite videos
Bookmark your favorite categories
Organize your favorite subcategories
Access your personalized favorites page
Access your conversation history
Personalize your homepage with your favorites

Already have an account? Log in

Data Orchestration Using Python & DAGSTER IO | Hands On Preview

Name: Data Orchestration Using Python & DAGSTER IO | Hands On Preview
Uploaded: 2021-01-21T18:30:14+00:00
Duration: 22 min 49 s

Viet Phan

Do you want to know if DAGSTER.IO, an open source python data pipeline orchestration library is the right ETL data pipeline orchestration tool for you? Then watch this video.

I decided to demo open source python data orchestration tool for scientists, dagster.io because I wanted to know, if it is worth to migrate my python data flows into DAG based data pipeline tool.

I was after a tool with in-build scheduler, a nice dashboard and a easy to install documentation. So is dagster.io superior to Apache Airflow or prefect.io? We will see. So far my impressions are positive.

Buy me a coffee

○ https://buymeacoffee.com/vietphananh

Also make sure you subscribe to my channel!

VIDEO PRODUCTION GEAR USED:

○ My camera - Sony A6400 - https://amzn.to/3ikLQbc

○ My main lens - Sigma 16mm f1.4 - https://amzn.to/36xHKtZ

○ My B camera - Sony ZV-1 - https://amzn.to/3IoHxpV

○ My C camera - iPhone 12 Pro - https://amzn.to/3KU0l1W

○ My lav mic - Rode SmartLav+ - https://amzn.to/3Jvr05c

○ Joby GripTight tripod - https://amzn.to/3wnxLlx

○ 13’ MacBook Pro - https://amzn.to/3tlZNfr

○ Elgato Green Screen - https://amzn.to/3imGrAB

○ Elgato Cam Link 4K - https://amzn.to/36eOmNV

○ Neewer RGB Lights - https://amzn.to/3IkzSct

COME SAY HI!

Blog:

○ https://vietphanx.com/

Instagram:

○ https://www.instagram.com/chillifunk/

Twitter:

○ https://twitter.com/vietphanx

MY MUSIC CHANNEL

Good House Music:

○ https://www.youtube.com/channel/UC4Dv6nLAdVPWhmKSthMYMXQ

DISCLAIMER: Links included in this description might be affiliate links. If you purchase a product or service with the links that I provide I may receive a small commission. There is no additional charge to you! Thank you for supporting me so I can continue to provide you with free content each week!