Similarweb Scraper avatar
Similarweb Scraper

Pricing

$8.00 / 1,000 results

Go to Store
Similarweb Scraper

Similarweb Scraper

Developed by

Tri⟁angle

Maintained by Apify

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

4.6 (7)

Pricing

$8.00 / 1,000 results

62

Monthly users

168

Runs succeeded

>99%

Response time

13 hours

Last modified

2 months ago

GG

Crawling erros

Closed

gainful_governor opened this issue
7 months ago

Hi there, I've raised this previously and was told that this its not a bug, but I can't see how this can't be deemed a bug when it fails this many times in a row and runs for 15+ minutes (when it usually takes ~ 1 minute

tri_angle avatar

Hi there, if you check the log of this run, you can see the actor is facing captchas. What you can do is to decrease the number of retries in the input, the default is 10 retries.

GG

gainful_governor

7 months ago

thanks for your reply .... what is the best strategy to get around the captcha? would repeated runs ever solve this? is the captcha based on the fingerprint of the current IP + container?

tri_angle avatar

You can start another run with residential proxy, this works well (at least now). Here is more info about dealing with anti-scraping protection, if you would consider building your own actors in the future https://docs.apify.com/academy/anti-scraping and our discord community: https://discord.com/invite/jyEM2PRvMU

GG

gainful_governor

7 months ago

thanks for your help :-) will try residential proxy

Pricing

Pricing model

Pay per result 

This Actor is paid per result. You are not charged for the Apify platform usage, but only a fixed price for each dataset of 1,000 items in the Actor outputs.

Price per 1,000 items

$8.00