Web scraping
Web scraping involves automating the collection of publicly available data from websites by simulating requests, navigating pages, and extracting useful content for structuring and analysis. This includes mastering HTTP requests, HTML/JSON parsing, libraries and frameworks (BeautifulSoup, Scrapy, Puppeteer/Playwright), managing JavaScript rendering, proxies, throttling, and CAPTCHAs, as well as data cleaning, storage (CSV, databases), and the legal and ethical issues related to data collection.
Subcategories
Sort by:
3:16
Web Scraping API Tutorial — Scrape Any Site With One HTTP Request
Learn to scrape any website through a simple HTTP API: POST /surf with a JavaScript expression, and a real Chrome on your server does the re...
Aubin•22 views•2w ago
51:11
How Websites Really Work — Taking Pages Apart with Web Scraping | FlyRank Backend Track
Most projects never scrape anything — so why a whole lecture on web scraping? Because nothing teaches you how the web actually works faster....
FlyRank AI•525 views•2w ago
12:02
Why Your WhatsApp Scraping Keeps Getting Blocked
WhatsApp Scraping the safe way, I show you the exact clean setup I use to collect message text, sender, timestamp, and chat name without get...
JayJay Earns •705 views•2w ago
9:36
Python Web Scraping Tutorial: Extract Social Media Data
Learn how to scrape social media data using Python and standard libraries without heavy third-party frameworks. This step-by-step tutorial c...
Life Skills•7 views•2w ago
11:30
Rotating proxies without losing your session
Rotating proxies without losing your session full written guides + tested proxy picks at proxyscraping.org: https://proxyscraping.org/?utm_s...
proxyscraping•3 views•3w ago
19:29
Car Price Prediction Using Web Scraping and Linear Regression | QatarSale Dataset
In this video, I explain a complete project applying Machine Learning to car data, starting from collecting data from the QatarSale website....
نور عمر حسين ابو حمدان•1 views•3w ago
3:02
Lesson 05 - How to Create an Infinite Scroll Scraping Workflow in Selfotix?
Learn how to create an Infinite Scroll, Load More, or Show More scraping workflow in Selfotix. In this tutorial, you'll discover how to scra...
Selfotix•1 views•3w ago
12:49
Web Scraping at Scale with Mobile Proxies (Playwright + Rotation)
Web Scraping at Scale with Mobile Proxies (Playwright + Rotation) full operator walkthrough: https://singaporemobileproxy.com/?utm_source=yo...
xavier•4 views•3w ago
5:03
Why Your Web Scraper Is Getting Blocked (TLS Fingerprinting Explained)
Learn the details about the new anti-bot method and ways to bypass it, so you can scrape the data you need for your business. Timestamps: 0:...
DataImpulse•62 views•3w ago
8:26
Crawl4AI Deep Dive: Nested Schemas & Complex Scraping
🚀 Master Advanced JSON/CSS Extraction with Crawl4AI! 🚀 Stop struggling with messy HTML parsing and start using JSON CSS extraction to targ...
JUST CODE IT•39 views•3w ago
7:45
Day 64: Python Web Scraping Multiple Pages & Rate Limits | Python Tutorial
[5:38 pm, 03/08/2026] VENUKUMAR PALLINTI: Day 64: Python Web Scraping Multiple Pages & Rate Limits | Python Tutorial [5:38 pm, 03/08/2026] V...
Edulexis•4 views•3w ago
11:55
Rotating vs Sticky Sessions: Proxy Rotation Done Right for Scraping
Rotating vs Sticky Sessions: Proxy Rotation Done Right for Scraping full written guides + tested picks at dataresearchtools.com: https://dat...
Xavier Fok•12 views•3w ago
10:24
Scheduling Scrapers: Cron vs Airflow vs Dagster
Scheduling Scrapers: Cron vs Airflow vs Dagster full written guides + tested picks at dataresearchtools.com: https://dataresearchtools.com/?...
Xavier Fok•5 views•3w ago
10:57
Scraping API Showdown 2026: ScraperAPI vs Zyte vs Web Unlocker (tested)
Scraping API Showdown 2026: ScraperAPI vs Zyte vs Web Unlocker (tested) full written guides + tested picks at dataresearchtools.com: https:/...
Xavier Fok•24 views•4w ago
12:24
Headless Browser vs HTTP Client: When You Actually Need Playwright
Headless Browser vs HTTP Client: When You Actually Need Playwright full written guides + tested picks at dataresearchtools.com: https://data...
Xavier Fok•84 views•1 mo ago
How To Scrape Reddit? | Reddit Web Scraping
Start extract data from X / Twitter 👉🏻 https://scrape.do/blog/reddit-scraping/?utm_source=youtube&utm_medium=reddit Reddit is one of the b...
Scrapedo•42 views•1 mo ago
11:31
How Many Proxies Does Your Scraper Actually Need
How Many Proxies Does Your Scraper Actually Need full written guides + tested picks at dataresearchtools.com: https://dataresearchtools.com/...
Xavier Fok•5 views•1 mo ago
9:51
Session Cookie Security: Step-by-Step Guide for 2026
Session authentication turns one login event into a continuing browser relationship, so the real security work is lifecycle control. This ep...
CipherVibe•11 views•1 mo ago
34:11
Importing & Exporting Data in R: CSVs, SQL, APIs & Web Scraping | Computational Statistics (32)
Welcome to the thirty-second lesson in our Computational Statistics series. What is R without data? In order to perform rigorous statistical...
Houston We Have a Problem•30 views•1 mo ago
4:56
How Amazon Scrapers Avoid Getting Blocked 🤯 | Proxy Rotation & Web Scraping Explained
🔥 How do Amazon price trackers monitor millions of products without getting blocked? The answer lies in web scraping, proxy rotation, and a...
Proxyaxis•58 views•1 mo ago
11:03
Building a Scalable Data Pipeline | System Design for a Web Scraping Project | TechPulse #2
TechPulse – Building a Scalable Tech News Analytics Platform | Phase II: System Design Before writing a single line of scraping code, we ans...
Wajahath Zaman•31 views•1 mo ago
11:30
Rate Limits and Retries: the Polite Scraper's Playbook
Rate Limits and Retries: the Polite Scraper's Playbook full written guides + tested picks at dataresearchtools.com: https://dataresearchtool...
Xavier Fok•6 views•1 mo ago
12:26
Web Scraping 101: Why Beginners Get Blocked
Web Scraping 101: Why Beginners Get Blocked 🚫 (And How to Fix It Fast! ⚡) Web Scraping 101, explained from zero — I show you the exact clea...
Adam Shelton•12.9k views•1 mo ago
10:47
Scraping APIs in 2026: When to Buy One and When to Build Your Own
Scraping APIs in 2026: When to Buy One and When to Build Your Own full written guides + tested picks at dataresearchtools.com: https://datar...
Xavier Fok•5 views•1 mo ago
4:00
Python Day 143: The Legal and Ethical Side of Web Scraping
Welcome to Day 143 of The Complete Python Bootcamp. In this session, you will explore the legal and ethical considerations of web scraping a...
The Industry Portal•29 views•1 mo ago
11:23
Building a Scraping Pipeline That Survives Failure (Dagster and Prefect)
Building a Scraping Pipeline That Survives Failure (Dagster and Prefect) full written guides + tested picks at dataresearchtools.com: https:...
Xavier Fok•16 views•1 mo ago
8:18
Design a Web Crawler: Bloom Filters, the URL Frontier, and Politeness — Real-Run
Last time we designed the Twitter timeline; this time we go upstream — the front half of a search engine: a web crawler. A program that down...
Borrow My Brain•8 views•1 mo ago
12:26
Stop Getting Rate Limited While Scraping
In this video I break down handling rate limits scraping without getting blocked, and I show you the exact clean setup I run — fresh fingerp...
Adam Shelton•15.1k views•1 mo ago
8:29
Playwright XPath Explained | Complete Guide for Beginners
In this video, you'll learn everything about XPath, one of the most commonly used locator strategies in web automation testing. We'll cover....
Next IT Career•29 views•1 mo ago
11:31
How Websites Detect Bots in 2026 (and How Scrapers Stay Compliant)
How Websites Detect Bots in 2026 (and How Scrapers Stay Compliant) full written guides + tested picks at dataresearchtools.com: https://data...
Xavier Fok•20 views•1 mo ago
5:47
Proxy Rotation Explained: How Web Scraping Avoids IP Bans (Beginner to Pro Guide)
How do professional web scrapers collect millions of pages without getting blocked? In this video, you'll learn the fundamentals of proxy ro...
Proxyaxis•74 views•1 mo ago
6:25
Playwright _ Relative XPath Explained | Complete Guide for Beginners
In this video, you'll learn everything about Relative XPath, one of the most commonly used locator strategies in web automation testing. We'...
Next IT Career•42 views•1 mo ago
4:56
Autonomous Market Research Agent Blueprint (LangChain/Playwright)
Stop manually researching. This is the complete technical blueprint for building a production-grade, multi-step autonomous web agent capable...
Krisvik AI•13 views•1 mo ago
27:18
Authenticated Web Scraping | Access Any Required Data with Login in Python
On many sites, you won't be able to scrape data without being logged in! In this video, you'll learn: ✅ How login works: POST Request + Cook...
أكاديمية دعم - Daam Academy•33 views•1 mo ago
27:56
XPath Explained in Detail with Selenium Examples | Complete XPath Tutorial for Beginners
Related Links: 1. Automation Demo URL - https://www.testingtalkslatest.com/automation-demo-student-registration-form/ 2. JavaScriptExecutor....
Testing Talks Latest•87 views•1 mo ago
17:33
Netflix Went Down in 4 Minutes: The Story of the Circuit Breaker (Patterns Ep.1)
Netflix, 2012. Over 30 million subscribers. An API that stops responding. Every service retries — as it should. In 4 minutes, everything cra...
Juan Morales Pestana - Automatización Resiliente•4 views•1 mo ago
12:14
Why Scraping G2 Gets You Blocked Fast.
I show you how to scrape G2 the clean way without getting blocked, limited, or hit with a CAPTCHA wall the second you start. I walk through....
AddToCart•13.7k views•1 mo ago
5:04
Web Scraping in 2026: Is It Legal? Complete Beginner's Guide (Python, Playwright & AI)
Want to learn web scraping the right way in 2026? In this video, you'll discover how to scrape websites legally, ethically, and efficiently....
Proxyaxis•49.5k views•1 mo ago
9:27
2026 Guide to CAPTCHA Solving and Bypassing for Web Scraping
This comprehensive guide explores the evolving landscape of CAPTCHA solving for web scraping as of 2026. The text details various security m...
Sendwin - Manage Multiple Accounts in Cloud!•136 views•1 mo ago
19:50
Web Scraping AI Agent | How To Build An AI Web Scraping Agent | Web Scraping Tutorial | Simplilearn
🔥Microsoft Applied Agentic AI: Systems Design & Impact - https://www.simplilearn.com/agentic-ai-course-training?utm_campaign=8-H0D1IQuOU&ut...
Simplilearn•1.4k views•2 mo ago
13:58
12 - How to Use XPath in Selenium & Playwright | Java Examples
Welcome to the final video of the XPath tutorial series! In this video, we'll put everything we've learned into practice by using XPath expr...
NextGen Automation•30 views•2 mo ago
7:17
04 - XPath starts-with(), AND Operator & Wildcard (*) | Selenium & Playwright
Welcome to the fourth video of the XPath tutorial series! In this video, we'll explore three powerful XPath techniques that help create more...
NextGen Automation•31 views•2 mo ago
8:12
The Complete 2026 Rotating Proxy Setup Guide
This comprehensive guide explores the evolving landscape of web scraping in 2026, highlighting the sophisticated anti-bot technologies that....
Sendwin - Manage Multiple Accounts in Cloud!•48 views•2 mo ago
8:55
Puppeteer Tutorial: Web Scraping & Browser Automation (2026)
👉 Try Oxylabs Web Scraper API for free: https://oxy.yt/SmlS In this Puppeteer tutorial, learn how to automate browsers and scrape dynamic w...
Oxylabs•4.6k views•2 mo ago
38:40
How to collect information from Linkedin and Website ?
How to collect information from Linkedin and Website ? Collecting information from LinkedIn and websites should always be done ethically and...
Web Spider BD•48 views•2 mo ago
Web Scraping APIs Explained: Data Collection Guide 2026
What is a web scraping API, and how does it bridge the gap between official data sources and online data collection? In this video, we explo...
Oxylabs•2.1k views•2 mo ago
31:53
Xpath in selenium Java || Relative vs Absolute Xpath in Selenium Java || Contains, Text method
In this video, we’ll dive deep into XPath in Selenium Java — one of the most powerful ways to locate elements in automation testing. 🔑 Key....
Automation Tester Hub•32 views•2 mo ago
6:32
Session 26 - AutomationEdge Intermediate Training - Writing Dynamic Xpath
Welcome to Session 26 of the AutomationEdge Intermediate Training! In this video, you'll learn how to write your own XPath expressions and c...
AutomationEdge Academy•114 views•2 mo ago