Shopee Api Scraper
Under maintenance
Pricing
$50.00/month + usage
Shopee Api Scraper
Under maintenance
Query Shopee's unofficial API for product searches by keyword, category, or shop. Access detailed information including prices, orders, stock levels, and ratings. Also retrieve related entities like the category tree, shop listings, and keyword suggestions.
0.0 (0)
Pricing
$50.00/month + usage
12
Monthly users
34
Runs succeeded
73%
Last modified
10 months ago
Requests are unsuccessful.
Closed
Until yesterday, I was able to crawl the Search and Category pages. However, it stopped functioning today. Here’s a sample log for you to examine.
2024-03-26T07:36:01.758Z ACTOR: Pulling Docker image of build Hxt9I5HGeNpZglgpG from repository. 2024-03-26T07:36:33.719Z ACTOR: Creating Docker container. 2024-03-26T07:36:33.959Z ACTOR: Starting Docker container. 2024-03-26T07:36:35.940Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2024-03-26T07:36:35.942Z Executing main command 2024-03-26T07:36:37.335Z INFO System info {"apifyVersion":"3.1.16","apifyClientVersion":"2.9.3","crawleeVersion":"3.8.2","osType":"Linux","nodeVersion":"v20.11.1"} 2024-03-26T07:36:38.345Z 2024-03-26 07:36:38.344 INFO SinglePagePuppeteerCrawler: Starting the crawler. 2024-03-26T07:37:02.871Z 2024-03-26 07:37:02.871 WARN SinglePagePuppeteerCrawler: Reclaiming failed request back to the list or queue. Detected a session error, rotating session... 2024-03-26T07:37:02.873Z Website not loaded properly 2024-03-26T07:37:02.875Z at SinglePagePuppeteerCrawler.postNavigationHooks (file:///home/myuser/dist/actor.js:117:27) {"id":"knmwoQzcSXFXDcj","url":"https://shopee.co.id/api/v4/search/search_items?by=relevancy&keyword=laptop","retryCount":1} 2024-03-26T07:37:23.301Z 2024-03-26 07:37:23.300 WARN SinglePagePuppeteerCrawler: Reclaiming failed request back to the list or queue. Detected a session error, rotating session... 2024-03-26T07:37:23.302Z We... [trimmed]
Marc Plouhinec (marc_plouhinec)
Hi,
Yes Shopee modified their website, I'm working on it since this morning. I deployed a new version 2h ago: https://apify.com/marc_plouhinec/shopee-api-scraper/changelog But it seems that the performance is not as good as before, I continue my investigation.
Best Regards,
Marc
IC_apify
Hello,
We appreciate the update. Unfortunately, the revised version is still not functioning. Kindly notify us when this issue has been resolved.
Regards, Amarnath.
Marc Plouhinec (marc_plouhinec)
Hi Amarnath,
I have been working on it since yesterday morning. Puppeteer is detected, so I have to replace it with the low level CDP protocol.
I have a proof of concept where I can successfully search products by keyword, and I'm currently implementing it in my scraper application.
I hope to solve this issue tomorrow.
Best Regards,
Marc
Marc Plouhinec (marc_plouhinec)
Hi Amarnath,
I have just deployed a new version of my scraper that works with Shopee again.
It was not easy, I put some details in the changelog: https://apify.com/marc_plouhinec/shopee-api-scraper/changelog
There are still some optimizations I need to re-enable (caching, fingerprint injection), so the performance should improve in the next release.
Best Regards,
Marc
Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
14 days
Price
$50.00
