🚀 New: Try our EnrichmentAPI, Enrich leads with verified emails, company & person data🚀 New: Try our EnrichmentAPITry it now

The Scrapingdog Blog

Designed with you in mind, our web scraping tutorials cater to any skill level. Each guide is straightforward and packed with useful insights.

Most popular articles

Web Scraping in Python

Java Web Scraping

Web Scraping in C#

Web Scraping with Rust

Web Scraping in PHP

Web Scraping in NodeJS

Web Scraping in Ruby

Web Scraping in GO

Google Sheet for Scraping

Build Amazon Price Tracker

Web Scraping with R

Scraping with Scrapy

Scrape Emails From Any Website

Latest articles

General

A Comprehensive Guide on Web Scraping with C#

In this read, we have used C# to scrape data from website. We have used Selenium Library here and divided it into two parts for easy understanding.

Nov 5, 2024 · 12 min read Read

General

How To Scrape Email Addresses From Any Website

In this blog, we have explained how you can scrape email address from websites. We have used Google Sheets and scraped Google search results to get the email data.

Nov 5, 2024 · 12 min read Read

General

How To Use A Proxy With Python Requests

We will learn, how to use a proxy request with Python. Further, we have told, how you can use Scrapingdog rotating proxies with Python requests.

Nov 3, 2024 · 8 min read Read

General

A Complete Guide on User-Agents in Web Scraping (+Best User-Agent List)

In this comprehensive tutorial we have discussed what are user agents in web scraping, how to use them effectively and why you should use them when scraping.

Nov 1, 2024 · 5 min read Read

General

Scrape LinkedIn Jobs using Python (Save Data in CSV)

In this tutorial we will be scraping LinkedIn job posting using python. We will create a LinkedIn Job scraper to fetch data points from the job.

Oct 31, 2024 · 13 min read Read

General

Scrape Redfin.com using Python (Save Data in CSV)

In this post, we are going to extract property data from redfin.com. Further we will save this data in CSV file.

Oct 28, 2024 · 14 min read Read

General

Scrape Google Autocomplete Suggestions using Nodejs (Store Data in CSV)

In this read, we have scraped Google Autocomplete using Nodejs, further we have stored it in CSV File. Further, we have used Scrapingdog's dedicated API to scale this process.

Oct 26, 2024 · 3 min read Read

General

How To Scrape Google Jobs Data using Python

In this blog, we have scraped google jobs data using Python. Further, we have demonstrated how you scale this process.

Oct 22, 2024 · 13 min read Read

General

Is Scraping LinkedIn Legal? (Know Limitation, Challenges & Solution)

In this blog, we have answered if scraping LinkedIn is legal or not, we have gone through the past instances and looked at what the CFAA has to say about it.

Oct 21, 2024 · 6 min read Read

General

How to scrape Google Patents using Python

In this blog, we have scraped Google Patents using Python. Further, we have used Scrapingdog's API to scale the process.

Oct 21, 2024 · 6 min read Read

General

How To Scrape Google Scholar using Python

In this blog, we have scraped Google Scholar Patents using Python. Further, to scale this method we have used Scrapingdog's dedicated Google Scholar API.

Oct 21, 2024 · 15 min read Read