Web Scraping Tutorials

LEARN HOW TO USE WEB SCRAPING TO ENHANCE PRODUCTIVITY AND AUTOMATION

We provide many step-by-step tutorials with source code for web scraping, web crawling, data extraction, headless browsers, etc.

Our web scraping tutorials are usually written in Python using libraries such as LXML, Beautiful Soup, Selectorlib and occasionally in Node.js.

The full source code is also available to download in most cases or available to be easily cloned using Git.

We also provide various in-depth articles about Web Scraping tips, techniques and the latest technologies which include the latest anti-bot technologies, methods used to safely and responsibly gather publicly available data from the Internet.

The community that has coalesced around these tutorials and their comments help anyone from a beginner hobbyist person to an advanced programmer solve some of the issues they face with web scraping.

These tutorials are frequently linked to as StackOverflow solutions and discussed on Reddit.

Please feel free to read and participate in the discussions with your comments.

All Tutorials

How to Scrape TikTok Using Python Playwright

Learn to scrape data from TikTok with the browser automation tool Playwright.

How do Websites Detect Bots Using Bot Mitigation Tools

Learn how websites detect and block bots with various bot mitigation tools and methods.

A Step-by-Step Guide to Web Scraping With Google Sheets

Explore different methods of web scraping with Google Sheets’ built-in functions.

How to Scrape Glassdoor Job Data Using Python and LXML

A tutorial on web scraping job posts from Glassdoor using Python and LXML.

Web Scraping MercadoLibre Using Python

Learn how to scrape MercadoLibre with Python requests and BeautifulSoup.

Essential Guide to Asynchronous Web Scraping With Python and AIOHTTP

Learn asynchronous web scraping to send multiple requests simultaneously and extract data from various sources at once.