Sreality scraper
$15.00/month
Sreality scraper
$15.00/month
Fast and efficient sreality.cz actor. The script get all offers (according to the selected input). Needed only 256-512 MB RAM.
crawling timouted after aprox. 10,000 ads
Closed
Hello,
I am having issues successfully scraping all advertisements. Here are my settings. Is there something set up incorrectly, or is it possible to crawl everything at once? I tried Lands, Houses, Sell/Lease separately.
{ "APARTMENTS": false, "AREA": [ "Jihočeský", "Plzeňský", "Karlovarský", "Ústecký", "Liberecký", "Královéhradecký", "Pardubický", "Olomoucký", "Zlínský", "Praha", "Středočeský", "Moravskoslezský", "Vysočina", "Jihomoravský" ], "DATASET_NAME": "Lands-Sell", "DROP_DATASET": false, "HOUSES": false, "LANDS": true, "LANGUAGE_CZ": true, "SAVE_ALL_TEXTS": true, "SELLING": true }
Hi, right now I'm investigating why it's timeout. Not sure what changed on apify side. Script scraping fast but has issues with saving data to apify backend.
VincarioCrawler
Can you do something about that?
Let's try it now. I've removed apify output json and it now it's fast again. Not sure what changed on apify side but there was something
VincarioCrawler
Actors has timeouted again. Could you please double check on your end again?
So I tried run it and it depends on "SAVE_ALL_TEXTS".
If it's FALSE it takes < 15 min,
{ "Hash_id": 2052694604, "Datum": "2024-08-07", "Kraj": "Jihomoravský", "Kategorie": "Pozemky", "Typ": "Prodej", "Dispozice": "Ostatní", "Titulek": "Prodej pozemku 546 m²", "Cena": 80000, "m2": 546, "Cena_m2": 147, "Lokalita": "Silůvky, okres Brno-venkov", "GPS_lat": 49.108608, "GPS_lon": 16.46833, "Exklusivni_rk": false, "URL_AD": "https://www.sreality.cz/detail/prodej/byt/Ostatní/siluvky--/2052694604", "Company_id": null, "Company_name": null, "Company_url": null, "Rus": false },
If TRUE than it's ~5 hours.
{ "Hash_id": 2052694604, "Datum": "2024-08-07", "Kraj": "Jihomoravský", "Kategorie": "Pozemky", "Typ": "Prodej", "Dispozice": "Ostatní", "Titulek": "Prodej pozemku 546 m²", "Cena": 60000, "m2": 546, "Cena_m2": 110, "Lokalita": "Silůvky, okres Brno-venkov", "GPS_lat": 49.10107442822632, "GPS_lon": 16.475863571773676, "Exklusivni_rk": false, "URL_AD": "https://www.sreality.cz/detail/prodej/byt/Ostatní/siluvky--/2052694604", "Company_id": null, "Company_name": null, "Company_url": null, "Rus": false, "Text": " V okolí obce Silůvky nabízíme k prodeji čtyři pozemky o celkové rozloze 546 m2. Silůvky jsou obec v okrese Brno-venkov v Jihomoravském kraji. Rozkládají se v Bobravské vrchovině, na okraji přírodního parku Bobrava. Pozemky jsou v katastru nemovitostí evidovány jako lesní pozemky a ostatní plocha. Silůvky jsou také názvem katastrálního území. V případě zájmu nás neváhejte kontaktovat." },
Depends if you need ad Text.
ALi- 2 monthly users
- 2 stars
- 86.5% runs succeeded
- 9.2 days response time
- Created in May 2023
- Modified about 2 months ago
