The Scrapingdog Blog
Designed with you in mind, our web scraping tutorials cater to any skill level. Each guide is straightforward and packed with useful insights.
Node-Unblocker for Web Scraping (Comprehensive Tutorial)
Learn how to use a Node Unblocker to bypass restrictions during web scraping. Enhance your data extraction process with practical Node.js techniques.
Nov 15, 2024 9 min readWeb Scraping Amazon Reviews using Python
Recently, Amazon has applied some restrictions wherein when you scrape reviews you are taken to login screen & hence to scrape reviews you need an Amazon Review Scraper API.
Nov 14, 2024 5 min read7 Challenges in Large Scale Web Scraping & How To Overcome Them
In this read, we have listed out some of the challenges that you may have during large scale data extraction. You can build a hassle free data pipeline using a Web Scraping API.
Nov 12, 2024 7 min readScrape Google Ads Data using Python
In this read, we have used Scrapingdog's Google Search Result Scraper API and Python to extract competitor's data from Google Ads.
Nov 11, 2024 10 min readBuild Amazon Price Tracker using Python (Get Email Alerts on Price Drop)
In this guide, we have explained how you can use Amazon Scraping API and Python to build a price tracker. Get notified with email alert every time price drops!!
Nov 10, 2024 7 min readA Comprehensive Guide on Web Scraping with C#
In this read, we have used C# to scrape data from website. We have used Selenium Library here and divided it into two parts for easy understanding.
Nov 5, 2024 12 min readHow To Scrape Email Addresses From Any Website
In this blog, we have explained how you can scrape email address from websites. We have used Google Sheets and scraped Google search results to get the email data.
Nov 5, 2024 12 min readHow To Use A Proxy With Python Requests
We will learn, how to use a proxy request with Python. Further, we have told, how you can use Scrapingdog rotating proxies with Python requests.
Nov 3, 2024 8 min readA Complete Guide on User-Agents in Web Scraping (+Best User-Agent List)
In this comprehensive tutorial we have discussed what are user agents in web scraping, how to use them effectively and why you should use them when scraping.
Nov 1, 2024 5 min readScrape LinkedIn Jobs using Python (Save Data in CSV)
In this tutorial we will be scraping LinkedIn job posting using python. We will create a LinkedIn Job scraper to fetch data points from the job.
Oct 31, 2024 13 min readScrape Redfin.com using Python (Save Data in CSV)
In this post, we are going to extract property data from redfin.com. Further we will save this data in CSV file.
Oct 28, 2024 14 min readScrape Google Autocomplete Suggestions using Nodejs (Store Data in CSV)
In this read, we have scraped Google Autocomplete using Nodejs, further we have stored it in CSV File. Further, we have used Scrapingdog's dedicated API to scale this process.
Oct 26, 2024 3 min read
Try Scrapingdog for Free!
Get 200 free credits to spin the API. No credit card required!
Try Scrapingdog for Free!
Get 200 free credits to spin the API. No credit card required!