Scrapping websites with Python 2 publication (Web Scraping with Python: Collecting More Data from the Modern Web 2nd Edition)

A few years ago, I read this book, which was designed for the level of a beginner. I wasn't upset because I bought it as a beginner's tutorial. The first half of the book is called “Building Scrappers” and is the equivalent of “Hello World” in the Python scraper world. The main focus here is on the mechanics of web scraping: how to use Python to request information from a web server, perform basic processing of server response and organize automated interaction with sites. The second part is called “Advanced Scraping”, where more specific tools and applications are considered that will be useful in any web scraping scenario. But this advanced scraping is advanced only with respect to the first part of the same book:)

Plus, I really liked the checklist-like list of questions to ask when a scraping project appears: What question do I want to answer or what problem do I want to solve? What data will help me achieve this and where are they?

• In what form is this data presented on the site? How can I separate the necessary data from the unnecessary and extract it? What processing and analysis operations need to be performed to make the most of the data? How can I make this process better, faster, more reliable?

#SoftwareDevelopment #Software #Architecture #Engineering