Web Scraping with Python: Scrapy, Selenium or Beautiful Soup?

Question

I am currently on the Machine Learning and Data Science module and one of the ways to get your data for analysis is to scrape websites for data. Which of these three would you advise I use for the Scraping exercise?

Answer 1

For Browser Automation: Use Selenium;

For API Requests Use: Requests and Beautiful Soup;

For Device Automation (eg. auto-opening an app) Use: Pyautogui;

Answer 2

bs4, idk bout scrapy, and selenium is a programmable browser

Answer 3

Use selenium