Indeed job scraper avatar

Indeed job scraper

Try for free

1 day trial then $20.00/month - No credit card required now

View all Actors
Indeed job scraper

Indeed job scraper

curious_coder/indeed-scraper
Try for free

1 day trial then $20.00/month - No credit card required now

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

WH

Expensive to crawl

Closed

wh938103 opened this issue
10 days ago

For some some of our runs, it costs 2 or 3 cents per results, meaning it would cost $30 for 1,000 results. Any suggestions on how to bring this cost down?

I'm using useBrowser: true and a US Residential proxy. Scraping doesn't seem to work without these two configurations

curious_coder avatar

I just did a run and scraped 100 jobs at $0.1

Also based on historical data, it costs $2.5 per 1000 jobs scraped on average when browser is enabled, which is fair considering the fact that this website is aggressively protected by cloudflare

WH

wh938103

6 days ago

Totally get what you're saying, not trying to complain just trying to see if there's anything I can do to lower the cost.

What settings are you using to scrape 100 jobs at $.1? My most recent scrape retrieved 26 results for $.41

curious_coder avatar

Sent an update fixing some bugs, check and let me know

Developer
Maintained by Community
Actor metrics
  • 75 monthly users
  • 16 stars
  • 100.0% runs succeeded
  • 4.3 days response time
  • Created in Jun 2023
  • Modified 2 days ago