eBay Scraper
3 days trial then $50.00/month - No credit card required now
eBay Scraper
3 days trial then $50.00/month - No credit card required now
Unofficial eBay API to extract data from eBay based on keywords or categories. Scrape prices, product descriptions, images, location, availability, brand, and more. Download extracted data in structured format and use it in reports, spreadsheets, databases, and applications.
error in scrape
Open
2024-10-31T11:56:08.712Z INFO Page opened. {"url":"https://www.ebay.com/b/Vintage-Canes-Walking-Sticks/182060/bn_8183644?Country%252FRegion%2520of%2520Manufacture=India&LH_BIN=1&LH_ItemCondition=3&mag=1&rt=nc"} 2024-10-31T11:56:08.745Z ERROR CheerioCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.ebay.com/b/Vintage-Canes-Walking-Sticks/182060/bn_8183644?Country%252FRegion%2520of%2520Manufacture=India&LH_BIN=1&LH_ItemCondition=3&mag=1&rt=nc","retryCount":2,"id":"XqWoGemSmecCOVU"} 2024-10-31T11:56:08.748Z Error: Something wrong! Retry...
waltveron
hey, love your scraper, but on the 4th scrape, the actor didnt scrape any products, its about 612 Results on the page https://www.ebay.com/b/Vintage-Canes-Walking-Sticks/182060/bn_8183644?Country%252FRegion%2520of%2520Manufacture=India&LH_BIN=1&LH_ItemCondition=3&mag=1&rt=nc%22%7D
I just fixed it. Please try to use.
waltveron
Hey
Thanks of the fast reply
Its definitely working, but it only pulled 400 from 600 products on the category page.
Latest run
And it didnt pull the item location tab
[Screenshot 2024-11-01 at 12.55.57 PM.png]
Screenshot below
Please share the run. Maybe your input is not correct. BTW, please check which items were not in the results manually because ebay may return duplicated items. So the text "600 products" you see in the UI may not real.
I have fixed the item location.
waltveron
Hey
Sure, ill send it later
Im curious, how about larger scapes, lets saw pages with lots of products, pic below, just a normal scrape? Youll take care of the proxies?
[Screenshot 2024-11-01 at 6.19.05 PM.png][Screenshot 2024-11-01 at 6.19.14 PM.png]
Yes. It will rotate proxies so you need a big proxies with many IPs for larger scrapes.
waltveron
Hey
Do I have to purchase extra proxies from Apify, or do your actor automatically assign proxies?
Please let me know know which proxies and qty I need for large scrapes, and how to set I tup manually before large scrapes
Walt
At the input, you can choose the proxy groups at Proxy Configuration.
If you you want to know available IPs in proxy groups, please go to Proxy on right panel.
waltveron
Hey
Which ones do you recommend for large scrapes
choose the proxy groups
You can chat with support guys at bottom right because each account has different proxy groups. I think Datacenter groups are fine for large scrapes.
waltveron
Hey Tin
They told me they do not support any actors, so im asking, please give me some advise, so I can start big scrapes
Walt
Not sure because I cannot access your Apify account. I think you can choose the Datacenter proxy (automatically) for large scrapes.
waltveron
Hey
Ok, ill give it a try
Is there a way to scrape only products with a selling price above a certain mount, like say only $20 or above?
Walt
You may try https://www.ebay.com/sch/ebayadvsearch.
waltveron
Ill try
Walt
Tin Duong- 41 monthly users
- 16 stars
- 97.4% runs succeeded
- 10 hours response time
- Created in Oct 2021
- Modified 6 minutes ago
