Hacker News Data Scraper
Pricing
$10.00/month + usage
Hacker News Data Scraper
Extract Y Combinator's Hacker News based on any search criteria. Crawl the front page, Show HN, Ask HN, news, job listings, and historical data. Get links, titles, comments, ratings, and more!
0.0 (0)
Pricing
$10.00/month + usage
6
Monthly users
6
Runs succeeded
>99%
Last modified
11 hours ago
We got blocked
Closed
What is the best way to avoid this error:
2023-06-20T08:12:38.109Z ERROR BasicCrawler: Request failed and reached maximum retries. Error: We got blocked 2023-06-20T08:12:38.111Z at BasicCrawler.requestHandler (file:///home/myuser/src/main.js:49:19) 2023-06-20T08:12:38.113Z at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 2023-06-20T08:12:38.116Z at async BasicCrawler._runRequestHandler (/home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:572:9) 2023-06-20T08:12:38.118Z at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:52:21) {"id":"7VnKzRXCQ8psNG9","url":"https://news.ycombinator.com/item?id=33178562","method":"GET","uniqueKey":"https://news.ycombinator.com/item?id=33178562"} 2
beremekdar
Hello,
Thank you very much for reaching out. Can you please share your Run ID so that we can investigate what went wrong there? Then we can immediately reach out to you about the solutions.
Best
bravura
Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
3 days
Price
$10.00
