How to make PUT requests with SCRAPY to handle infinite scroll | Yahoo Answers web scraping tutorial

Hey what's up guys, recently I got an on demand web scraping tutorial request in the commentaries below the previous video, so today we gonna learn how to make HTTP PUT requests to scrape data from the infinite scroll page to obtain the list of question IDs from Yahoo Answers to generate and crawl through the answer URLs and scrape all the available data regarding each answer.

Source code

Example datasets