# Scrapingdog

> Scrapingdog is a web scraping API platform that handles proxies, CAPTCHAs, headless browsers, and JavaScript rendering so developers can extract structured data from any website at scale without getting blocked.

Scrapingdog provides 60+ scraping and data-extraction APIs covering Google Search, Amazon, social media, e-commerce, AI/LLM pipelines, and more. All APIs return clean, structured JSON. Plans start with a free trial and scale to millions of requests per month.

## Core Product

- [Home](https://www.scrapingdog.com/): Platform overview, key features, and pricing tiers.
- [All APIs](https://www.scrapingdog.com/apis/): Full catalogue of every scraping API offered.
- [Pricing](https://www.scrapingdog.com/pricing/): Plan comparison — Lite, Standard, Pro, and Premium with monthly and annual billing.
- [Documentation](https://docs.scrapingdog.com): Developer docs, quickstart guides, and full API reference.
- [Integration](https://www.scrapingdog.com/integration/): Guides for integrating Scrapingdog with popular languages and frameworks.

## Google APIs

- [Google SERP API](https://www.scrapingdog.com/google-serp-api/): Scrape Google search results — organic listings, ads, People Also Ask, knowledge graph, and more.
- [Google AI Mode API](https://www.scrapingdog.com/google-ai-mode-api/): Extract AI-generated summaries from Google's AI Mode search results.
- [Google AI Overview API](https://docs.scrapingdog.com/google-ai-overview-api): Scrape Google AI Overview snippets that appear at the top of search results.
- [Google Immersive Product API](https://www.scrapingdog.com/google-immersive-product-api/): Extract product data from Google's immersive product panels.
- [Google Maps API](https://www.scrapingdog.com/google-maps-api/): Scrape Google Maps business listings, ratings, hours, and contact details.
- [Google Maps Posts API](https://docs.scrapingdog.com/google-maps-api/google-maps-posts-api): Extract Google Business Profile posts for any Maps listing.
- [Google Maps Reviews API](https://docs.scrapingdog.com/google-maps-api/google-maps-reviews-api): Scrape customer reviews and ratings from Google Maps listings.
- [Google Maps Photos API](https://docs.scrapingdog.com/google-maps-api/google-maps-photos-api): Retrieve photos associated with Google Maps business listings.
- [Google Maps Places API](https://docs.scrapingdog.com/google-maps-api/google-maps-places-api): Search and scrape Google Maps places by keyword or location.
- [Google Local API](https://docs.scrapingdog.com/google-local-api): Scrape Google local pack results including business name, address, and ratings.
- [Google News API](https://www.scrapingdog.com/google-news-scraper-api/): Scrape Google News headlines, sources, and publication dates.
- [Google Hotels API](https://www.scrapingdog.com/google-hotels-api/): Extract hotel listings, availability, and pricing from Google Hotels.
- [Google Trends API](https://www.scrapingdog.com/google-trends-api/): Retrieve trend data and interest-over-time scores from Google Trends.
- [Google Trends Trending Now API](https://docs.scrapingdog.com/google-trends-api/google-trends-trending-now-api): Get currently trending search topics from Google Trends.
- [Google Trends Autocomplete API](https://docs.scrapingdog.com/google-trends-api/google-trends-autocomplete-api): Retrieve autocomplete and related query suggestions from Google Trends.
- [Google Jobs API](https://www.scrapingdog.com/google-jobs-api/): Scrape Google Jobs listings with title, company, location, and description.
- [Google Patents API](https://www.scrapingdog.com/google-patents-api/): Scrape patent listings, abstracts, and inventor data from Google Patents.
- [Google Patent Details API](https://docs.scrapingdog.com/google-patents-api/google-patent-details-api): Extract full details for a specific patent by patent number.
- [Google Finance API](https://www.scrapingdog.com/google-finance-api/): Extract stock prices, financial summaries, and market data from Google Finance.
- [Google Videos API](https://docs.scrapingdog.com/google-videos-api): Scrape Google Video search results including thumbnails, duration, and source.
- [Google Shorts API](https://www.scrapingdog.com/google-shorts-api/): Extract Google Shorts video results from search.
- [Google Images API](https://www.scrapingdog.com/google-images-api/): Scrape Google Image search results including thumbnails and source URLs.
- [Google Light Search API](https://www.scrapingdog.com/google-light-search-api/): Lightweight Google SERP scraper optimised for speed and low credit cost.
- [Google Autocomplete API](https://docs.scrapingdog.com/google-autocomplete-api): Retrieve Google search autocomplete suggestions for any query.
- [Google Shopping API](https://www.scrapingdog.com/google-shopping-api/): Extract Google Shopping product listings, prices, and merchant data.
- [Google Lens API](https://www.scrapingdog.com/google-lens-api/): Scrape reverse image search results from Google Lens.
- [Google Product API](https://docs.scrapingdog.com/google-product-api): Extract detailed product data from Google's product pages.
- [Google Scholar API](https://www.scrapingdog.com/google-scholar-api/): Scrape academic papers, citations, and author profiles from Google Scholar.
- [Google Scholar Author Profile API](https://docs.scrapingdog.com/google-scholar-api/google-scholar-author-profile-api): Extract a researcher's full publication list and citation counts.
- [Google Scholar Profiles API](https://docs.scrapingdog.com/google-scholar-api/google-scholar-profiles-api): Search and scrape Google Scholar researcher profiles.
- [Google Scholar Author API](https://docs.scrapingdog.com/google-scholar-api/google-scholar-author-api): Retrieve detailed author metadata from Google Scholar.
- [Google Scholar Author Citation API](https://docs.scrapingdog.com/google-scholar-api/google-scholar-author-api/google-scholar-author-citation-api): Get citation details for a specific Google Scholar author.
- [Google Scholar Cite API](https://docs.scrapingdog.com/google-scholar-api/google-scholar-cite-api): Extract citation data for individual papers from Google Scholar.

## Social Media APIs

- [Profile Scraper API](https://www.scrapingdog.com/profile-scraper-api/): Extract public profile data from social platforms.
- [Jobs Search API](https://www.scrapingdog.com/jobs-search-api/): Aggregate job listings across multiple job boards.
- [LinkedIn Person Post Scraper](https://docs.scrapingdog.com/linkedin-scraper-api/linkedin-post-scraper): Scrape posts published by a LinkedIn person profile.
- [LinkedIn Company Profile Scraper](https://docs.scrapingdog.com/linkedin-scraper-api/company-profile-scraper): Extract LinkedIn company profile data — about, headcount, and recent posts.
- [LinkedIn Person Profile Scraper](https://docs.scrapingdog.com/linkedin-scraper-api/person-profile-scraper): Scrape LinkedIn individual profiles including experience, education, and skills.
- [LinkedIn Jobs Scraper](https://docs.scrapingdog.com/linkedin-jobs-scraper/scrape-linkedin-jobs): Search and scrape LinkedIn job listings by keyword, location, and filters.
- [LinkedIn Job Overview Scraper](https://docs.scrapingdog.com/linkedin-jobs-scraper/scrape-linkedin-job-overview): Extract full details for a specific LinkedIn job posting.
- [X (Twitter) Scraper API](https://www.scrapingdog.com/twitter-scraper-api/): Scrape tweets, profiles, and engagement data from X / Twitter.
- [X Profile Scraper API](https://docs.scrapingdog.com/x-scraper-api/x-profile-scraper-api): Extract public profile data for any X / Twitter user.
- [X Post Scraper API](https://docs.scrapingdog.com/x-scraper-api/x-post-scraper-api): Scrape individual post content, likes, retweets, and replies from X.
- [YouTube Search Scraper API](https://www.scrapingdog.com/youtube-scraper-api/): Scrape YouTube search results, video metadata, and channel data.
- [YouTube Channel API](https://docs.scrapingdog.com/youtube-scraper-api/youtube-channel-api): Extract YouTube channel details — subscribers, videos, and about section.
- [YouTube Comment API](https://docs.scrapingdog.com/youtube-scraper-api/youtube-comment-api): Scrape comments and replies from any public YouTube video.
- [YouTube Video API](https://docs.scrapingdog.com/youtube-scraper-api/youtube-video-api): Extract full metadata for a YouTube video — title, description, views, and tags.
- [YouTube Transcripts API](https://www.scrapingdog.com/youtube-transcripts-api/): Retrieve full transcripts (captions) from any public YouTube video.

## E-Commerce APIs

- [Amazon Scraper API](https://www.scrapingdog.com/amazon-scraper-api/): Scrape Amazon product pages — titles, prices, ratings, images, and descriptions.
- [Amazon Search Scraper](https://docs.scrapingdog.com/amazon-scraper-api/amazon-search-scraper): Search Amazon and extract product listings for any keyword.
- [Amazon Autocomplete Scraper](https://docs.scrapingdog.com/amazon-scraper-api/amazon-autocomplete-scraper): Retrieve Amazon search autocomplete suggestions.
- [Amazon Offers API](https://www.scrapingdog.com/amazon-offers-api/): Retrieve all active seller offers for any ASIN — price, condition, seller, and delivery.
- [Amazon Reviews API](https://www.scrapingdog.com/amazon-reviews-api/): Extract customer reviews, star ratings, and reviewer profiles from Amazon.
- [eBay Search Scraper API](https://www.scrapingdog.com/ebay-search-scraper-api/): Scrape eBay search results and product listings.
- [Walmart Scraper API](https://www.scrapingdog.com/walmart-scraper-api/): Extract Walmart product data, prices, and availability.
- [Walmart Product Scraper](https://docs.scrapingdog.com/walmart-scraper-api/walmart-product-scraper): Scrape detailed product data for any Walmart item URL.
- [Walmart Search Scraper](https://docs.scrapingdog.com/walmart-scraper-api/walmart-search-scraper): Search Walmart and extract product listings for any keyword.
- [Walmart Reviews Scraper](https://docs.scrapingdog.com/walmart-scraper-api/walmart-reviews-scraper): Extract customer reviews and ratings from Walmart product pages.
- [Flipkart Search API](https://docs.scrapingdog.com/flipkart-scraper-api/flipkart-search-api): Search Flipkart and extract product listings for any keyword.
- [Flipkart Product API](https://docs.scrapingdog.com/flipkart-scraper-api/flipkart-product-api): Scrape detailed product data from Flipkart product pages.

## AI & LLM APIs

- [ChatGPT Scraper API](https://www.scrapingdog.com/chatgpt-scraper-api/): Combine scraping with LLM-based extraction for AI-ready data pipelines.
- [LLM-Ready Data](https://www.scrapingdog.com/llm-ready-data/): Convert any webpage into clean Markdown or plain text for use in LLM prompts and RAG pipelines.

## Search Engine APIs

- [Bing Search API](https://www.scrapingdog.com/bing-search-api/): Scrape Bing organic search results and related queries.
- [Baidu Search API](https://www.scrapingdog.com/baidu-search-api/): Extract search results from Baidu, China's largest search engine.
- [Universal Search API](https://www.scrapingdog.com/universal-search-api/): General-purpose scraper for any URL — returns clean HTML or Markdown.

## Web Tools APIs

- [Data Extraction API](https://www.scrapingdog.com/data-extraction-api/): Extract structured data fields (title, price, text, tables) from any page.
- [Datacenter Proxies](https://www.scrapingdog.com/datacenter-proxies/): High-speed datacenter proxy network for custom scraping setups.
- [Screenshot API](https://www.scrapingdog.com/screenshot-api/): Capture full-page or viewport screenshots of any URL.

## Free Tools

- [LLMs.txt Generator](https://www.scrapingdog.com/llms-txt-generator/): Generate an llms.txt file for any website automatically.
- [URL to Markdown Converter](https://www.scrapingdog.com/url-to-markdown-converter/): Convert any URL to clean Markdown for LLM ingestion.
- [YouTube Transcript Extractor](https://www.scrapingdog.com/youtube-transcript-extractor/): Free tool to extract transcripts from YouTube videos.
- [User Agent Generator](https://www.scrapingdog.com/user-agent-generator/): Generate valid browser User-Agent strings for scraping.
- [Free Local Leads Extraction Tool](https://www.scrapingdog.com/free-local-leads-extraction-tool/): Extract local business leads from Google Maps for free.

## Use Cases

- [Use Cases Overview](https://www.scrapingdog.com/scraping-use-case/): How businesses use Scrapingdog — SEO monitoring, price intelligence, lead generation, and more.
- [SEO Use Case](https://www.scrapingdog.com/scraping-use-case/seo/): Track keyword rankings, SERP features, and competitor visibility at scale.
- [Local SEO Tools](https://www.scrapingdog.com/scraping-use-case/local-seo-tools/): Build local SEO tooling on top of Google Maps and local pack data.
- [Google APIs Overview](https://www.scrapingdog.com/google-apis/): All Google-specific scraping APIs in one place.
- [E-commerce APIs Overview](https://www.scrapingdog.com/ecommerce-apis/): Amazon, eBay, Walmart, and Flipkart scraping APIs for price intelligence.
- [Social Media APIs Overview](https://www.scrapingdog.com/social-media-apis/): APIs for scraping LinkedIn, X, YouTube, and social profiles.
- [Web Scraping Service](https://www.scrapingdog.com/web-scraping-service/): Fully managed scraping service for teams that need custom data pipelines.

## Alternatives & Comparisons

- [Scrapingdog vs SerpApi](https://www.scrapingdog.com/serpapi-alternative/): Side-by-side comparison of Scrapingdog and SerpApi.
- [Scrapingdog vs ScrapingBee](https://www.scrapingdog.com/scrapingbee-alternative/): How Scrapingdog compares to ScrapingBee on features and pricing.
- [Scrapingdog vs ScraperAPI](https://www.scrapingdog.com/scraperapi-alternative/): Comparison with ScraperAPI across API coverage and cost.
- [Scrapingdog vs Scrapingdog](https://www.scrapingdog.com/scrapingdog-alternative/): Overview of Scrapingdog's unique advantages over alternatives.

## Company & Legal

- [About](https://www.scrapingdog.com/about/): Company background, mission, and team.
- [Blog](https://www.scrapingdog.com/blog/): Tutorials, guides, and web scraping tips.
- [Affiliates](https://www.scrapingdog.com/affiliates/): Affiliate programme details and commission structure.
- [Privacy Policy](https://www.scrapingdog.com/privacy/): How Scrapingdog collects and handles user data.
- [Terms of Service](https://www.scrapingdog.com/terms/): Usage terms and conditions.
- [GDPR](https://www.scrapingdog.com/gdpr/): GDPR compliance statement.
- [Data Processing Agreement](https://www.scrapingdog.com/data-processing-agreement/): DPA for enterprise customers requiring data processing agreements.
- [SLA](https://www.scrapingdog.com/sla/): Service Level Agreement — uptime guarantees and support commitments.