Webhook Integration

The Webhook Integration lets you receive scraped data automatically at your own endpoint. Instead of polling for results, configure a webhook URL in your dashboard and Scrapingdog will POST the scraped content directly to you. Ideal for async workflows and database pipelines.

Endpoint: https://api.scrapingdog.com/webhook

API Parameters

🔑

Scrapingdog Parameters

api_key Required
Your personal API key. Available on your dashboard.

Type: String

🌐

Target

url Required
URL of the page you want to scrape and send to your webhook.

Type: String

⚙

️ Options

webhook_id Optional
Identifies the target webhook by name, as configured in your Scrapingdog dashboard. If omitted, the default webhook is used.

Type: String
dynamic Optional
Set to true to enable JavaScript rendering (headless browser). Set to false for faster plain HTTP requests. Default: true.

Type: Boolean

API Examples

Code to Integrate

curl "https://api.scrapingdog.com/webhook?api_key=APIKEY&webhook_id=my_webhook&url=https://httpbin.org/ip&dynamic=false"

import requests

params = {
    "api_key": "APIKEY",
    "webhook_id": "my_webhook",
    "url": "https://httpbin.org/ip",
    "dynamic": "false"
}

response = requests.get("https://api.scrapingdog.com/webhook", params=params)
print(response.json())
# Returns: {__slot_9_ph__: __slot_10_ph__}

const params = new URLSearchParams({
  api_key: "APIKEY",
  webhook_id: "my_webhook",
  url: "https://httpbin.org/ip",
  dynamic: "false"
});

const response = await fetch(`https://api.scrapingdog.com/webhook?${params}`);
const data = await response.json();
console.log(data);
// Returns: { sid: __slot_5_ph__ }

<?php
$url = 'https://api.scrapingdog.com/webhook?' . http_build_query([
    'api_key'    => 'APIKEY',
    'webhook_id' => 'my_webhook',
    'url'        => 'https://httpbin.org/ip',
    'dynamic'    => 'false',
]);
echo file_get_contents($url);

API Response

{
  "sid": "4286cfd7-4752-4f6b-8cc6-df01a8ac3ce3"
}