Google Search Results Scraper avatar

Google Search Results Scraper

Try for free

Pay $3.50 for 1,000 results

View all Actors
Google Search Results Scraper

Google Search Results Scraper

apify/google-search-scraper
Try for free

Pay $3.50 for 1,000 results

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Do you want to learn more about this Actor?

Get a demo
WM

News support

Closed

watch_my_competitor opened this issue
a month ago

Hey, i tried to run Scrapper with the news option, but I'm not sure if I'm doing that properly. Is that option supported right now?

ondrejklinovsky avatar

Hey,

thanks for your question.

You put the google search URL inside brackets <...>, which is an invalid format and the actor cannot work with it - try to remove them. The other issue is that we don't support as_epq= parameter, only q= is supported. I tested your URL with q instead of as_epq and the results seem to be identical. So try using q= and in case it gives you different results, let us know and we'll add support for it.

This should work:

"queries": "https://www.google.com/search?hl=en&tbm=nws&gl=au&q=BDO&as_nloc=au",
WM

watch_my_competitor

a month ago

HJWGOCeUFWhXOzis5 that an additional run, with a prepared query by you, but i don't see any results when i executed it, i miss anything to receive news tab? i tried also scrapping with https://www.news.google.com/search?hl=en&gl=au&as_nloc=au&q=BDO but it don't return any content too

ondrejklinovsky avatar

Apologies, I was focusing on the correct input URL that the actor can recognize and I completely missed the empty results. Unfortunately the actor currently cannot extract the news because the page structure is different from the normal Google search results. I will discuss it with the team whether we want to add support for the news. In meantime, you can try Google News Scraper https://console.apify.com/actors/eWUEW5YpCaCBAa0Zs.

WM

watch_my_competitor

a month ago

okay thanks. I looked in your solution, and your looked as a best in price/quality. as i receive just one record for which i would pay instead of 30-40 :)

Developer
Maintained by Apify
Actor metrics
  • 1.7k monthly users
  • 170 stars
  • 100.0% runs succeeded
  • 2.3 days response time
  • Created in Feb 2019
  • Modified 7 days ago