Indeed job scraper avatar
Indeed job scraper

Pricing

$20.00/month + usage

Go to Store
Indeed job scraper

Indeed job scraper

Developed by

Curious Coder

Maintained by Community

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

1.5 (2)

Pricing

$20.00/month + usage

58

Monthly users

166

Runs succeeded

>99%

Response time

26 days

Last modified

2 months ago

WC

Fails with Captcha

Closed

wcflowsync opened this issue
a month ago

Error logs below but it couldn't pass a simple captcha

2025-03-19T03:39:17.409Z ACTOR: Pulling Docker image of build 2BIbJWUn4plV9TjYh from repository. 2025-03-19T03:39:50.266Z ACTOR: Creating Docker container. 2025-03-19T03:39:50.635Z ACTOR: Starting Docker container. 2025-03-19T03:39:51.070Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 800x600x16 -nolisten tcp 2025-03-19T03:39:51.071Z Executing main command 2025-03-19T03:39:52.862Z INFO System info {"apifyVersion":"3.1.7","apifyClientVersion":"2.7.1","crawleeVersion":"3.10.5","osType":"Linux","nodeVersion":"v18.20.7"} 2025-03-19T03:39:53.220Z INFO BasicCrawler: Starting the crawler. 2025-03-19T03:39:53.584Z WARN BasicCrawler: Reclaiming failed request back to the list or queue. Captcha 2025-03-19T03:39:53.585Z at Client.getSearchResults (file:///home/myuser/src/client.js:50:43) {"id":"sJ0ssslvXnnRZUq","url":"https://www.indeed.com/jobs?q=%22executive+chef%22&l=Austin%2C+TX&radius=25&vjk=9e92ebf3aa4c095c","retryCount":1} 2025-03-19T03:39:53.699Z WARN BasicCrawler: Reclaiming failed request back to the list or queue. Captcha 2025-03-19T03:39:53.701Z at Client.getSearchResults (file:///home/myuser/src/client.js:50:43) {"id":"sJ0ssslvXnnRZUq","url":"https://www.indeed.com/jobs?q=%22executive+chef%22&l=Austin%2C+TX&radius=25&vjk=9e92ebf3aa4c095c","retryCount":2} 2025-03-19T03:39:53.958Z WARN BasicCrawler: Reclaiming failed request back to the list or queue. Captcha 2025-03-19T03:39:53.959Z at Client.getSearchResults (file:///home/myuser/src/client.js:50:43) {"id":"sJ0ssslvXnnRZUq","url":"https://www.indeed.com/jobs?q=%22executive+chef%22&l=Austin%2C+TX&radius=25&vjk=9e92ebf3aa4c095c","retryCount":3} 2025-03-19T03:39:54.383Z ERROR BasicCrawler: Request failed and reached maximum retries. Error: Captcha 2025-03-19T03:39:54.384Z at Client.getSearchResults (file:///home/myuser/src/client.js:50:43) 2025-03-19T03:39:54.385Z at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 2025-03-19T03:39:54.386Z at async BasicCrawler.requestHandler (file:///home/myuser/src/main.js:141:44) 2025-03-19T03:39:54.387Z at async BasicCrawler._runRequestHandler (/home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:693:9) 2025-03-19T03:39:54.388Z at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21) {"id":"sJ0ssslvXnnRZUq","url":"https://www.indeed.com/jobs?q=%22executive+chef%22&l=Austin%2C+TX&radius=25&vjk=9e92ebf3aa4c095c","method":"GET","uniqueKey":"https://www.indeed.com/jobs?l=Austin%2C+TX&q=%22executive+chef%22&radius=25&vjk=9e92ebf3aa4c095c"} 2025-03-19T03:39:54.389Z INFO BasicCrawler: All requests from the queue have been processed, the crawler will shut down. 2025-03-19T03:39:54.391Z INFO BasicCrawler: Final request statistics: {"requestsFinished":0,"requestsFailed":1,"retryHistogram":[null,null,null,1],"requestAvgFailedDurationMillis":420,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":50,"requestTotalDurationMillis":420,"requestsTotal":1,"crawlerRuntimeMillis":1198} 2025-03-19T03:39:54.392Z INFO BasicCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: Captcha (file:///home/myuser/src/client.js:50:43)"]} 2025-03-19T03:39:54.393Z INFO BasicCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true}

curious_coder avatar

Please enable "Use browser" option

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

1 day

Price

$20.00