Immoweb.be mass scraper (by search URL) 🏠
Pricing
$35.00/month + usage
Immoweb.be mass scraper (by search URL) 🏠
🔥 Scrape Immoweb.be search result pages and monitor them for new or delisted ads, easily exportable to JSON, CSV, Excel, or as an API... Simply enter the search page URL and get your data! Blazing fast & affordable ⚡
5.0 (2)
Pricing
$35.00/month + usage
5
Total users
41
Monthly users
9
Runs succeeded
>99%
Issues response
1.9 hours
Last modified
7 days ago
Runs often fail
Closed
Hi! Nice tool you have, works well when it works. But it fails quite often, and returns nothing in that case. There's no way to retry, or save the data which was collected before the error. Isn't there a better way to handle errors and/or do retries? Is there something you can improve there? I would really like to use it more, but the error rate is high. Ideally it should handle retries internally. Please give some kind of response or update. Thank you
Turns out the error was a temporary proxy error and the auto-retry we have in place had a minor bug. Fixing this..
For information, the actor works by gathering listings URLs from all pages first (when monitoring mode is enabled, after gathering all URLs from all pages, it compares this with the previously scraped URLs list and gets the delta). Once individual listings URLs are determined, it will scrape each individual ad details (The actor doesn't scrape the ads information as available in search results pages but open each individual ad URL to scrape it)
Please also reach out to me on Discord @azzouzana
And I have just published an update that should improve the actor's reliability. Thanks for the report!
(If the current setup turns out to still be inefficient, I'd be more than happy to gather subscribed users interest and plan a revamp so the actor would scrape individual ads details while looping over pages -data would be saved in parallel to crawling, instead of them being ran in series.
