
Similarweb scraper
Pricing
$19.00/month + usage
Go to Store





Similarweb scraper
Scrape similarweb to get insights for websites in bulk including website traffic, pages per visit, time spent on website, bounce rate, rank, etc
0.0 (0)
Pricing
$19.00/month + usage
36
Total users
1.1K
Monthly users
103
Runs succeeded
>99%
Last modified
6 months ago
Crawler keeps failing, even when re-running with different proxies
Closed
I noticed it hit a point where all the requests started failing despite re-runs.

9 months ago
The issue was due to using urls instead of domain names, I've sent an update to convert the urls into domains automatically
9 months ago
Ahhh okay, gotcha. So you're saying the ideal format would have been "whatever.com" vs "https://whatever.com" ?
Thanks so much for the quick update!

9 months ago
Yes!