Advanced Product Hunt Scraper avatar
Advanced Product Hunt Scraper

Pricing

$15.00/month + usage

Go to Store
Advanced Product Hunt Scraper

Advanced Product Hunt Scraper

Developed by

Danil Poletaev

Maintained by Community

Scrape product hunt "Top Products Launching Today" section. Actor crawls products and extracts information about the product: title, description, categories, images, maker info with contact links and website info with raw text and email. Export scraped datasets in JSON, csv, etc. Run via API.

5.0 (2)

Pricing

$15.00/month + usage

18

Monthly users

60

Runs succeeded

>99%

Response time

16 hours

Last modified

6 days ago

A0

Issue with Scraping Dates Leading to Category Pages

Closed

ABC-01 opened this issue
14 days ago

Hi,

I'm currently scraping some dates, but a few of them aren't returning any data.

Here are some example dates that seem to cause the issue:

2025-03-11 2025-03-14 2025-03-15 2025-03-18 2025-03-19 2025-03-22 2025-03-27 2025-04-02

It looks like, for these dates, the scraper is hitting category pages instead of individual product pages. As a result, a single request ends up trying to scrape over 500 pages, which obviously isn’t ideal.

Is there a way to avoid this and ensure it only scrapes relevant product pages?

Thanks in advance for your help!

danpoletaev avatar

Hi there 👋

Thanks a lot for your feedback!

I've tried to run it and 500 requests are fine, because we also scrape makers page and product's website page by default.

If you don’t need that, you can turn it off by setting scrapeMakers: false and scrapeWebsite: false in the input. That’ll cut down the number of requests a lot.

You can also use filters — like setting a minimum number of votes or choosing only the top N products — to further reduce the load.

I’m closing the issue for now, but feel free to share your use case and what information you need to scrape. I’d love to understand it better!

Thank you, Dan

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

3 days

Price

$15.00