How to Scrape Yahoo Search Results (2026 Guide)

TL;DR

Learn how to scrape Yahoo Search using Python, with two methods: Scrapingdog's Yahoo Search API rotating proxy.
Use the Yahoo Search API to extract organic results, sitelinks, top stories, and related searches as structured JSON, without dealing with proxies or CAPTCHAs.
Use the rotating proxy to fetch the full Yahoo results page through a single endpoint that also works for Google, Amazon, Walmart, and Bing.
Use the page parameter for pagination and country targeting for region-specific results.

In this article, you will learn to scrape Yahoo Search using Python and the Yahoo Search API.

By the end of this tutorial, you’ll be able to scrape organic search results, sponsored listings, top stories, knowledge graph data, and more from Yahoo Search. Scrapingdog handles all the complexities, including proxies, browsers, and CAPTCHAs, so you can focus entirely on extracting the data you need.

Why Scrape Yahoo Search with Scrapingdog?

No blocks or CAPTCHAs: Scrapingdog rotates IPs and handles anti-bot checks for you.
Clean, ready-to-use output: You get the structured JSON response without managing proxies or headers.
Scales easily: Run thousands of queries without worrying about rate limits or bans.
Saves maintenance time: You skip the constant parser fixes when Yahoo changes its markup.
Global results: Target specific countries to see how results differ by region.
Useful for many cases: SEO rank tracking, competitor research, ad monitoring, and training data.

Prerequisite

You will need Python 3.x on your machine.
A free trial of Scrapingdog. You will get 100 credits for testing the API.
Install the requests library using pip. You can install it with pip install requests.

Scraping Yahoo with Python

You can get the Python code from the dashboard.

1import requests
2 
3url = "https://api.scrapingdog.com/yahoo/search"
4 
5params = {
6    "api_key": "YOUR_API_KEY",
7    "query": "best electric car"
8}
9 
10response = requests.get(url, params=params)
11 
12if response.status_code == 200:
13    data = response.json()
14    print(data)
15else:
16    print(f"Request failed with status code: {response.status_code}")

Import Requests: The requests library is used to send HTTP requests in Python.
API Endpoint: The url specifies Scrapingdog's Yahoo Search API endpoint.
Set Parameters: The params dictionary contains your API key and the search query (best electric car).
Send GET Request: requests.get() sends a GET request to the API with the provided parameters.
Check Response: If the status code is 200, the request was successful, and the API returns structured JSON data.
Handle Errors: If the request fails, the code prints the HTTP status code to help identify the issue.

That’s it! With just a few lines of Python, you can extract Yahoo Search results in structured JSON format.

1{
2  "organic_results": [
3    {
4      "position": 1,
5      "title": "Best Electric Vehicles for 2026, Tested - Car and Driver",
6      "link": "https://www.caranddriver.com/rankings/best-electric-cars",
7      "displayed_link": "https://www.caranddriver.com › rankings › best-electric-cars",
8      "source": "Car and Driver",
9      "snippet": "Wondering what electric car to buy? Our testing team looks at over 200 data points when rating vehicles. Check out what made our list of the best electric vehicles to buy in 2026.",
10      "favicon": "https://s.yimg.com/pv/static/search_favicon/images/40x40_f1ea4197d510f66a.png",
11      "sitelinks": [
12        {
13          "title": "Best Electric Sedans Under $60,000",
14          "link": "https://www.caranddriver.com/rankings/best-sedans/electric/under-60k"
15        },
16        {
17          "title": "Cheapest Electric Vehicles",
18          "link": "https://www.caranddriver.com/rankings/best-electric-cars/cheapest"
19        },
20        {
21          "title": "Best SUVs",
22          "link": "https://www.caranddriver.com/rankings/best-suvs"
23        },
24        {
25          "title": "Electric Sedans and Hatchbacks With The Most Cargo Space",
26          "link": "https://www.caranddriver.com/rankings/best-sedans/electric/cargo-space"
27        },
28        {
29          "title": "Cheapest Electric SUVs",
30          "link": "https://www.caranddriver.com/rankings/best-suvs/electric/cheapest"
31        },
32        {
33          "title": "Cheapest Electric Sedans",
34          "link": "https://www.caranddriver.com/rankings/best-sedans/electric/cheapest"
35        },
36        {
37          "title": "Best Electric Sedans and Hatchbacks",
38          "link": "https://www.caranddriver.com/rankings/best-sedans/electric/affordable"
39        },
40        {
41          "title": "2025 Hyundai Kona Electric",
42          "link": "https://www.caranddriver.com/hyundai/kona-electric"
43        },
44        {
45          "title": "Hybrids",
46          "link": "https://www.caranddriver.com/rankings/best-hybrid-cars"
47        },
48        {
49          "title": "2025 Rivian R1t",
50          "link": "https://www.caranddriver.com/rivian/r1t"
51        }
52      ]
53    },
54    {
55      "position": 2,
56      "title": "Best 2026 Electric Cars – Ranked by Experts - Kelley Blue Book",
57      "link": "https://www.kbb.com/electric-car/best-electric-cars/",
58      "displayed_link": "https://www.kbb.com › electric-car › best-electric-cars",
59      "source": "Kelley Blue Book",
60      "snippet": "The best new electric cars of 2026, ranked by experts based on safety features, price, vehicle range, tech, value, and more.",
61      "favicon": "https://s.yimg.com/pv/static/search_favicon/images/40_402d643d18c72ebf96.png"
62    },
63    {
64      "position": 3,
65      "title": "Best Electric Cars of 2026 and 2027 - Edmunds",
66      "link": "https://www.edmunds.com/electric-car/",
67      "displayed_link": "https://www.edmunds.com › electric-car",
68      "source": "Edmunds",
69      "snippet": "Compare electric cars, SUVs, trucks and vans based on Edmunds ratings, range, price and features. See expert reviews, tips and advice for buying and owning an EV.",
70      "favicon": "https://s.yimg.com/pv/static/search_favicon/images/32x32_8e03652647a8c04c.png"
71    },
72    {
73      "position": 4,
74      "title": "Best Electric Cars 2026 | Top Gear",
75      "link": "https://www.topgear.com/car-news/electric/top-gears-top-20-electric-cars",
76      "displayed_link": "https://www.topgear.com › car-news › electric",
77      "source": "Top Gear",
78      "date": "Aug 17, 2026",
79      "snippet": "Home Car news Electric Want a good EV? Here are the 25 best electric cars on sale right now",
80      "favicon": "https://s.yimg.com/pv/static/search_favicon/images/40x40_b45eaa029851eef4.png"
81    },
82    {
83      "position": 5,
84      "title": "10 Best Electric Cars of 2026 - Autotrader",
85      "link": "https://www.autotrader.com/car-shopping/best-electric-cars",
86      "displayed_link": "https://www.autotrader.com › car-shopping › best-electric-cars",
87      "source": "Autotrader",
88      "date": "May 8, 2026",
89      "snippet": "Here are Autotrader’s picks for the 10 best electric vehicles of 2026, new models first, then used, listed alphabetically by brand.",
90      "favicon": "https://s.yimg.com/pv/static/search_favicon/images/16_16ccdf1e02ed118242.png"
91    },
92    {
93      "position": 6,
94      "title": "The Best Electric Cars of 2026 - CarGurus",
95      "link": "https://www.cargurus.com/research/articles/best-electric-cars",
96      "displayed_link": "https://www.cargurus.com › research › articles",
97      "source": "CarGurus",
98      "date": "3 days ago",
99      "snippet": "This guide highlights the best electric cars available, from family-friendly SUVs like the Kia EV9 to long-range sedans like the Lucid Air, helping you find the right fit for your daily driving needs.",
100      "favicon": "https://s.yimg.com/pv/static/search_favicon/images/40x40_1a4be66217cbf1a6.png"
101    },
102    {
103      "position": 7,
104      "title": "Best Electric Cars for 2026 - MotorTrend's Tested Top Picks",
105      "link": "https://www.motortrend.com/rankings/electric-cars",
106      "displayed_link": "https://www.motortrend.com › rankings › electric-cars",
107      "source": "MotorTrend",
108      "snippet": "From track tests to real-world drives, we ranked the best electric cars of 2026. See which models deliver the most for your money.",
109      "favicon": "https://s.yimg.com/pv/static/search_favicon/images/32x32_b2712875762da56a_1737645174.png"
110    }
111  ],
112  "top_stories": [
113    {
114      "position": 1,
115      "title": "With Tesla Roadster debut, Elon Musk shows \"flying cars are real\"",
116      "link": "https://www.yahoo.com/news/science/articles/tesla-roadster-debut-elon-musk-094430406.html?fr=sycsrp_catchall",
117      "source": "CBS News via Yahoo",
118      "date": "Elon Musk unveils Tesla's new Roadster, which uses high-pressure air thrusters to leave the road entirely during a livestreamed event at his SpaceX facility in Texas.4 mins ago",
119      "thumbnail": "https://s.yimg.com/fz/api/res/1.2/rvRKT9QClhGh2bxnHsr_OA--~C/YXBwaWQ9c3JjaGRkO2ZpPXN0cmltO2g9NDQwO3E9ODA7c209MTt3PTYwMA--/https://media.zenfs.com/en/cbs_news_897/d63dadb708e9e43008e7010dbf3c3996.jpg"
120    }
121  ],
122  "related_searches": [
123    {
124      "query": "best electric car lease deals",
125      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBEztXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzEEdnRpZAMEc2VjA3JlbC1ib3Q-?ei=UTF-8&p=best+electric+car+lease+deals&fr2=p%3As%2Cv%3Aw%2Cm%3Ars-bottom%2Cct%3Agossip&fr=fp-tts"
126    },
127    {
128      "query": "best electric car to buy",
129      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBFztXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzUEdnRpZAMEc2VjA3JlbC1ib3Q-?ei=UTF-8&p=best+electric+car+to+buy&fr2=p%3As%2Cv%3Aw%2Cm%3Ars-bottom%2Cct%3Agossip&fr=fp-tts"
130    },
131    {
132      "query": "best electric car for the money",
133      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBFDtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzIEdnRpZAMEc2VjA3JlbC1ib3Q-?ei=UTF-8&p=best+electric+car+for+the+money&fr2=p%3As%2Cv%3Aw%2Cm%3Ars-bottom%2Cct%3Agossip&fr=fp-tts"
134    },
135    {
136      "query": "best electric suv",
137      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBGDtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzYEdnRpZAMEc2VjA3JlbC1ib3Q-?ei=UTF-8&p=best+electric+suv&fr2=p%3As%2Cv%3Aw%2Cm%3Ars-bottom%2Cct%3Aseaview&fr=fp-tts"
138    },
139    {
140      "query": "best electric car leases",
141      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBFTtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzMEdnRpZAMEc2VjA3JlbC1ib3Q-?ei=UTF-8&p=best+electric+car+leases&fr2=p%3As%2Cv%3Aw%2Cm%3Ars-bottom%2Cct%3Agossip&fr=fp-tts"
142    },
143    {
144      "query": "electric vs hybrid",
145      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBGTtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzcEdnRpZAMEc2VjA3JlbC1ib3Q-?ei=UTF-8&p=electric+vs+hybrid&fr2=p%3As%2Cv%3Aw%2Cm%3Ars-bottom%2Cct%3Aseaview&fr=fp-tts"
146    },
147    {
148      "query": "best-electric-car-offers",
149      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBFjtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzQEdnRpZAMEc2VjA3JlbC1ib3Q-?ei=UTF-8&p=best-electric-car-offers&fr2=p%3As%2Cv%3Aw%2Cm%3Ars-bottom%2Cct%3Aseaview&fr=fp-tts"
150    },
151    {
152      "query": "best reasonably priced electric cars",
153      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBGjtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzgEdnRpZAMEc2VjA3JlbC1ib3Q-?ei=UTF-8&p=best+reasonably+priced+electric+cars&fr2=p%3As%2Cv%3Aw%2Cm%3Ars-bottom%2Cct%3Aseaview&fr=fp-tts"
154    },
155    {
156      "query": "best electric car reliability list",
157      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBJztXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzUEdnRpZAMEc2VjA3JlbC1lYXN0?ei=UTF-8&p=best+electric+car+reliability+list&fr2=p%3As%2Cv%3Aw%2Cm%3Aat-e%2Cct%3Agossip&fr=fp-tts"
158    },
159    {
160      "query": "best electric car deals",
161      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBKDtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzYEdnRpZAMEc2VjA3JlbC1lYXN0?ei=UTF-8&p=best+electric+car+deals&fr2=p%3As%2Cv%3Aw%2Cm%3Aat-e%2Cct%3Agossip&fr=fp-tts"
162    },
163    {
164      "query": "best electric car range",
165      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBKTtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzcEdnRpZAMEc2VjA3JlbC1lYXN0?ei=UTF-8&p=best+electric+car+range&fr2=p%3As%2Cv%3Aw%2Cm%3Aat-e%2Cct%3Agossip&fr=fp-tts"
166    },
167    {
168      "query": "best electric car right now",
169      "link": "https://search.yahoo.com/search;_ylt=A2RRuBi2INJqz5UBKjtXNyoA;_ylu=Y29sbwN1cy1lYXN0LTEEcG9zAzgEdnRpZAMEc2VjA3JlbC1lYXN0?ei=UTF-8&p=best+electric+car+right+now&fr2=p%3As%2Cv%3Aw%2Cm%3Aat-e%2Cct%3Agossip&fr=fp-tts"
170    }
171  ]
172}

Here’s a quick breakdown of the response:

organic_results – Contains organic search listings from Yahoo, including their ranking position, title, URL, source, and description.
position – Indicates where a particular result ranks on the Yahoo Search results page.
title – The clickable headline of the search result.
link – The direct URL of the webpage.
snippet – A short description of the webpage displayed in search results.
sitelinks – Additional links to relevant pages within the same website, when available.
top_stories – Provides news articles related to the search query, including headlines, URLs, sources, publication information, and thumbnails.
related_searches – Contains additional search queries suggested by Yahoo, along with their search URLs.

💡 Now, if you want to scrape the next page, you can use the page parameter. You can read more about the API and its parameters here.

Scraping Yahoo Search with a Rotating Proxy

We will use a rotating proxy from Scrapingdog for this section.

1import requests
2 
3target_url="https://search.yahoo.com/search?p=best+electric+car"
4 
5proxies = {
6    "http": "http://scrapingdog:your-api-key@proxy.scrapingdog.com:8081",
7    "https": "http://scrapingdog:your-api-key@proxy.scrapingdog.com:8081",
8}
9 
10response = requests.get(target_url, proxies=proxies, verify=False)
11print(response.text)

Once you run this code, you will get complete structured JSON from the Yahoo search page. With a single proxy, you can scrape any website, including Google, Amazon, Walmart, Bing, etc. You don't have to switch between APIs and multiple endpoints to scrape websites.

Frequently Asked Questions

1. Is it legal to scrape Yahoo Search?

Public data is generally fine to scrape.

2. Does Yahoo Search have an official API?

No public search results API exists, so scraping is the common route.

3. Why does my Yahoo scraper stop working?

Usually an IP block, a CAPTCHA, or a change in Yahoo’s HTML.

4. How do I scrape more than the first page?

Increase the pagination offset in the URL and loop through pages.

5. Can I get results for a specific country?

Yes, pass a country setting with your request to get region-specific results.