Web Scraper avatar
Web Scraper

Pricing

Pay per usage

Go to Store
Web Scraper

Web Scraper

Developed by

Apify

Maintained by Apify

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

4.5 (22)

Pricing

Pay per usage

612

Monthly users

3.6k

Runs succeeded

>99%

Response time

17 days

Last modified

3 days ago

RE

The parametre "Max result records (optional)" is set to N-1

Open

RedabenhAKO opened this issue
3 months ago

I try many times, i think there is a bug. When i set this parameter to 10 (that means: i want to stop the execution of the job when the number of saved result is 10) , but the job stops at 9 and i get only 9 items in the dataset !

jindrich.bar avatar

Hello RedabenhAKO and thank you for your input!

You're right — this is a bug. The "Max result records" option also counts cases where the Page Function does not return any dataset items. In your case, this happens in the handleStart() branch of the function, which is why the Actor stops at 9 instead of 10.

We've already created a tracking issue for this: GitHub Issue #353, and I’m currently collecting feedback from my team. I’ll let you know if there are any developments on this.

I appreciate your patience, and thanks again for reporting this!

RE

RedabenhAKO

2 months ago

Thanks for your answer

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.