Hey what's up guys, this video is inspired by a custom request of one of my subscribers. We'll learn to scrape infinite scroll pages via faking ajax request to the API and store results to CSV file. The toolchain used in this video is python programming language along with scrapy framework.
Source code
Web scraping tutorial request example
data: title, brand, price, quantity, image url
pages: all | pages 1-3 | infinite scroll all or 1-2 pages
output: CSV | JSON | MySQL | etc.
toolchain: Requests + BeautifulSoup | Scrapy
💖 Become a Patron 💖