Web Scraping with Python: Edition 3

Ryan Mitchell

Feb 2024 · "O'Reilly Media, Inc."

Ebook

352

Pages

Eligible

About this ebook

If programming is magic, then web scraping is surely a form of wizardry. By writing a simple automated program, you can query web servers, request data, and parse it to extract the information you need. This thoroughly updated third edition not only introduces you to web scraping but also serves as a comprehensive guide to scraping almost every type of data from the modern web.

Part I focuses on web scraping mechanics: using Python to request information from a web server, performing basic handling of the server's response, and interacting with sites in an automated fashion. Part II explores a variety of more specific tools and applications to fit any web scraping scenario you're likely to encounter.

Parse complicated HTML pages
Develop crawlers with the Scrapy framework
Learn methods to store the data you scrape
Read and extract data from documents
Clean and normalize badly formatted data
Read and write natural languages
Crawl through forms and logins
Scrape JavaScript and crawl through APIs
Use and write image-to-text software
Avoid scraping traps and bot blockers
Use scrapers to test your website

About the author

Ryan Mitchell is a senior software engineer at GLG, as well as a speaker and author.An expert in web scraping, web security, and data science, Ryan has hosted workshops and spoken at many events, including Data Day and DEF CON. She has also taught web programming and data science and consulted on coursework at a variety of institutions. Ryan holds a master's degree in software engineering from Harvard University Extension School and is currently a senior software engineer at GLG where she creates data analysis tools. Ryan is the author of Web Scraping with Python (O'Reilly), as well as Instant Web Scraping with Java (Packt Publishing).

Rate this ebook

Tell us what you think.

Reading information

Smartphones and tablets

Install the Google Play Books app for Android and iPad/iPhone. It syncs automatically with your account and allows you to read online or offline wherever you are.

Laptops and computers

You can listen to audiobooks purchased on Google Play using your computer's web browser.

eReaders and other devices

To read on e-ink devices like Kobo eReaders, you'll need to download a file and transfer it to your device. Follow the detailed Help Center instructions to transfer the files to supported eReaders.