Also I have done a test run with start url: https://www.realestate.com.au/buy/in-kellyville/list-1?includeSurrounding=false&source=refinement It returned with 0 output

When I changed parameter from buy to sold, it is functioning fine. But I notice in the input log it says : 2025-04-09T23:40:44.689Z maxPageNumberAvailable 50 The maximum page number is actually 80, does this mean it will only go to 50?

Hi, thanks for reaching out.

The current scraper version scrapes up to 50 pages per search URL. This was a compromise between speed and volume—we prioritized speed, and for now, we've decided to keep it this way to minimize usage cost as low as possible, especially since it's a new scraper without a large user base + I believe 50 pages is already is an acceptable volume for a single search URL. So if you want to scrape all ads, you have to segment the search. (This is mentioned here https://apify.com/azzouzana/realestate-com-au-search-pages-scraper#notes)

You don’t need to do anything to handle pagination—the Actor takes care of that automatically.

As for the test run you performed, it may have been a temporary issue. Could you please share the Actor run details? (I ran a test myself and it worked fine: https://console.apify.com/view/runs/j6ldgVRseo9XhZKDc).

Please note that 100% success isn’t guaranteed, as this is a scraping task by nature and we’re dealing with one of the most challenging anti-bot systems out there (Kasada). That said, we’re doing our best to maintain a success rate above 90%.

Let me know if this helps—thanks again!

Thank you for the quick response! I see, I appreciate the clarification on the 50 page limit. But for my scraping purposes I do need all 80 pages, so I was wondering if I am to have a start url that starts at page 50 (eg. https://www.realestate.com.au/sold/in-kellyville/list-50?includeSurrounding=false&source=refinement) will it scrape the remaining 30 pages?

Also here is the actor run details: https://console.apify.com/view/runs/FYDsY03ayiXb0deLB When you mentioned the success rate being 90% do you mean the scraping run being completed successfully entirely or potential of missing rows/columns/details from a page?

Thank you for the quick response! I see, I appreciate the clarification on the 50 page limit. But for my scraping purposes I do need all 80 pages, so I was wondering if I am to have a start url that starts at page 50 (eg. https://www.realestate.com.au/sold/in-kellyville/list-50?includeSurrounding=false&source=refinement) will it scrape the remaining 30 pages? ==> No, the Actor always scrapes listings starting from page 1 up to page 50 (which is the current maximum). To scrape all pages, you'll need to split your search into multiple URLs.

If you look closely, for the example URL you shared (https://www.realestate.com.au/sold/in-kellyville/list-50?includeSurrounding=false&source=refinement) the website only allows access to the first 80 pages (25 ads per page, so 25 × 80 = 2,000 ads), while the total number of listings is 7,734. This means that even scraping all 80 pages would only give you a partial result.

Since the Actor is limited to 50 pages per search URL (25 × 50 = 1,250 ads), you’ll need to segment your search into multiple URLs, with each one returning a maximum of 1,250 ads. That way, you can scrape all of them and capture the full dataset.

When you mentioned the success rate being 90% do you mean the scraping run being completed successfully entirely or potential of missing rows/columns/details from a page? ==> As of now, the hardest part is bypassing Kasada, which is the first step of the process. So when I mention a 90% success rate, I'm referring to the overall scraping process—not to missing rows, columns, or details. (Since this is a scraping task, future website changes might eventually affect the scraper, but I’ll handle those as they come if that's possible. For now, everything should be working fine)

Thanks for sharing the run, that's definitely a temporary error. Have you tried it again?

Please let me know if this makes sense or if you have any follow-up questions! :)

& Feel free to reach out to me here https://discordapp.com/users/azzouzana if you want to chat more :)