Clutch.co Scraper
3 days trial then $25.00/month - No credit card required now
Clutch.co Scraper
3 days trial then $25.00/month - No credit card required now
Scrape clutch.co and get companies information including website, name, hourly rate, reviews, logo and many more details
does't scrape much
Closed
Trying to crawl 5000 records in the web design category in the US. The scraper only give me about 60 records then it stops. Lots of fails in the process of scraping.
What's the trick here? Used datacenter, didn't work. Used residential proxy, didn't work. Used my own paid residential proxies and inputed 50 rotating, didn't work.
What's the formula to get the most records?
Thanks You
Thanks for opening the issue, Let me check and get back to you
Enable Use browser option and don't use any proxies, it will work perfectly. Example run: https://console.apify.com/actors/ue0DjiPkbPaZSlku6/runs/jTgGdqFxDTJeKAghB#log
I tried that but only got 208 records. Then I tried residential proxy, same thing. 167 records. I need over 1000 records.
Curious Coder- 47 monthly users
- 5 stars
- 100.0% runs succeeded
- 8.4 days response time
- Created in Jun 2023
- Modified 3 months ago
