Welcome to this video on Web Scraping with Python Requests and BeautifulSoup.
Web scraping allows us to extract valuable data from websites, automating the process of gathering information for analysis or other purposes. We'll cover the basics of web scraping, starting with an introduction to HTTP requests using the Requests library and then introduce Beautiful Soup, a popular Python library for parsing HTML and XML documents.
You'll learn how to extract specific elements from web pages, such as headings, paragraphs and lists. We'll demonstrate various techniques to navigate and search the parsed document tree, allowing you to locate the data you need efficiently.
PROJECT FILES
SUPPORT THE CHANNEL
Patreon: [work in progress...]
Don't forget to like, subscribe, and leave your questions or comments below. Let's get started with web scraping in Python today!
(Links are not clickable for now since this is a new channel and YouTube requires having a channel history to make links clickable. Please copy and paste if required.)
The topics covered in this video:
00:00 Introduction
00:17 Requirements
00:29 Objectives
00:40 Out of Scope
00:56 Social Media
01:13 Integrated Development Environment (IDE) - PyCharm
01:17 Visual Studio Code
01:20 PyCharm Community Edition
01:26 Installing Requirements
01:29 Python Programming Language
01:34 Python Requests
01:37 Beautiful Soup 4
01:41 Selenium 4
01:52 Requirements.txt
01:56 python -r pip install requirements.txt
02:14 The Project
02:18 Books to Scrape
02:59 Code
03:03 Create a new Python file
03:08 Import the libraries
03:21 GET Requests
03:39 Run in Python Console
03:53 Terminal
04:08 Response 200
04:21 Soup object
05:03 beautiful soup parser
05:16 Understanding the HTML
05:24 Browser Developer Tools / Console
07:06 Extracting the title
08:02 soup.select_one
08:53 String Strip=True
10:31 Extract the remaining data
10:46 Extract a link
10:54 Extract image
11:19 Extract visual elements like rating
12:30 All Data
12:44 Summary
13:05 Next Video
13:22 Thank You
13:24 Comment
13:30 Like the Video
13:33 Subscribe for more video
13:39 Code Crafters Corner
Disclaimer: The information presented in this video is for educational purposes only.
Tags: #python #requests #beautifulsoup #programming #tutorial #webscraping #sharvin #extractdata #tutorial