Google Maps Scraper
No credit card required
Google Maps Scraper
No credit card required
Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.
Do you want to learn more about this Actor?
Get a demotime to first result, any way to speed up?
Open
hi there, I'm developing an app that feeds restaurants to people based on their location. it works great with google API, which is of course quite expensive. it is also fast, with results returning within 300 milliseconds. I'd like to switch to your actor but the time to first result seems to be at least 20-30 seconds. any way to improve? I've only run with the free version but even with the 8192 MB / 2 vCPU, the time is 25s to first result. I'd be looking for something < 10 seconds (with the google API next page token wait period, it ends up being ~6s total for 3 pages = 60 places).
Ondrej Klinovský (ondrejklinovsky)
Hey,
thank you for considering this actor.
There are several steps between launching the actor and seeing first results:
- downloading and starting Docker container
- initializing the actor (parsing input, geolocation, initializing crawler, etc)
- launching browser (this is probably the slowest part)
You can try our other actor - Google Maps Extractor - it doesn't use browser so you should see the first results sooner, after about 12-15 seconds.
We will discuss it with team whether we can optimize it some more.
nasty_wombat
Yes I understand spinning up the container in a Kubernetes cluster isn't instant and can be in fact quite slow. My day job is backend dev (python/django/C#)/DevOps for a couple EKS clusters I created. If launching the browser is the slowest part, not a lot can be done there except optimize the actual hardware it's running on (guessing that prioritizing singled threaded CPU performance could 2x the launch speed compared to a traditional server CPU like modern EPYC/Xeon). Does each request to google for one of the map segments ("INFO Splitted the map into 148 map segments") use a different proxy and would therefore require a new browser instance to be launched?
I suppose I should start thinking about potentially doing the place collection asynchronously (e.g. 1x per week) and have places where I launch my app "pre-scraped".
Compass- 3.2k monthly users
- 391 stars
- 98.1% runs succeeded
- 3.7 days response time
- Created in Nov 2018
- Modified about 9 hours ago
