Add Your Heading Text Here

I am the founder of Scrapingdog, with blogs I write on here, I try to give unique ideas that you can use while scraping. Each blog is a recipe blended with my experience in this domain. Now I am not an expert, since it is a vast field, it keeps growing, and I just write what I have learned. And if you like my work, do share on social media.

Latest

Cloudscraper can be used to bypass cloudflare protection while web scraping. In this guide, you will learn how to effectively use it & what are its limitations.

Automating Scraping & Summarizing Research Papers with Python & OpenAI

In this article, we have scraped relevant researches from Google scholars, summarized them using Python, Open AI & Scrapingdog Google Scholar API.
scraping google trends

Scraping Google Trends using Nodejs (Storing Data in CSV)

In this blog, we have used Nodejs and Google Trends API from Scrapingdog to extract trends data.
how to use playwright with nodejs

Complete Guide on Using Playwright with Nodejs

In this blog, we will be using Playwright with Nodejs to use for scraping and other automation tasks.
selenium in nodejs

How to Use Selenium in NodeJS

Learn how to use Selenium with NodeJS in this tutorial. You'll understand how browser automation for different purposes is done.

Building A Rank Tracker using Python & Google Search API

In this post, I have build a google keyword rank tracker using Python. I have used Scrapingdog's Google search API to pull keyword ranking data.
Scrape Twitter (X)

Web Scraping X (formerly Twitter) Data using Python

In this read, we are going to scrape Twitter (X) using Python. Further, to avoid blockage and to scale X scraping we have used Scrapingdog's Twitter Scraper API.