Hacker News Data Scraper
Pricing
$10.00/month + usage
Hacker News Data Scraper
Extract Y Combinator's Hacker News based on any search criteria. Crawl the front page, Show HN, Ask HN, news, job listings, and historical data. Get links, titles, comments, ratings, and more!
0.0 (0)
Pricing
$10.00/month + usage
6
Monthly users
6
Runs succeeded
>99%
Last modified
12 hours ago
We got blocked
Closed
What is the best way to avoid this error:
2023-06-20T08:12:38.109Z ERROR BasicCrawler: Request failed and reached maximum retries. Error: We got blocked 2023-06-20T08:12:38.111Z at BasicCrawler.requestHandler (file:///home/myuser/src/main.js:49:19) 2023-06-20T08:12:38.113Z at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 2023-06-20T08:12:38.116Z at async BasicCrawler._runRequestHandler (/home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:572:9) 2023-06-20T08:12:38.118Z at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:52:21) {"id":"7VnKzRXCQ8psNG9","url":"https://news.ycombinator.com/item?id=33178562","method":"GET","uniqueKey":"https://news.ycombinator.com/item?id=33178562"} 2
attaching run ID
tugkan_epctex
Hey Mackie,
Thank you very much for reaching out. It seems like this is a bug that we have to take care of. I'll inform the Engineering Team and will keep you posted.
Best
tugkan_epctex
Hey Mackie,
I just wanted to let you know that we've fixed the problem and it should work as expected. You can use the latest build on the Hacker News actor.
Thank you very much and sorry for the inconvenience. Best
Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
3 days
Price
$10.00
