Create an account to use AI

Create a free account to unlock all features:

Ask questions about videos with AI
Save your favorite videos
Bookmark your favorite categories
Organize your favorite subcategories
Access your personalized favorites page
Access your conversation history
Personalize your homepage with your favorites

Create an account

Already have an account? Log in

Web Scraping with Python - Beautiful Soup Crash Course

freeCodeCamp.org

Learn how to perform web scraping with Python using the Beautiful Soup library.

✏️ Tutorial by JimShapedCoding. Check out his YouTube Channel:

https://www.youtube.com/channel/UCU8d7rcShA7MGuDyYH1aWGg

🔗 You can get code snippets here: https://github.com/jimdevops19/codesnippets/tree/main/Python%20Web%20Scraping

❤️ Try interactive Python courses we love, right in your browser: https://scrimba.com/freeCodeCamp-Python (Made possible by a grant from our friends at Scrimba)

⭐️ Course Contents ⭐️

Local HTML Scraping:

⌨️ (00:00) Basic HTML Structure, HTML Tags Explanation

⌨️ (05:35) Packages Installation

⌨️ (07:23) Scraping Usage, Local files

⌨️ (12:41) Beautiful Soup find & find_all() methods

⌨️ (16:22) Web Browser Inspect tool

⌨️ (18:30) Grab all Prices, Basic Scraping Project

Website Scraping:

⌨️ (24:48) Using the Requests Library to see a Website's HTML

⌨️ (30:10) Scraping a Production Website, Best practices for pulling info

⌨️ (44:05) Looping through similar soup.find_all() objects

Features addition:

⌨️ (48:26) Prettifying the Jobs paragraph

⌨️ (54:05) Jobs Filtration by owned skills

⌨️ (57:45) Setting up the Project to scrape every 10 minutes

⌨️ (1:01:53) Storing the jobs paragraph in text files

Web Scraping with Python - Beautiful Soup Crash Course | Knoovi