Reddit Scraper Lite avatar

Reddit Scraper Lite

Try for free

Pay $4.00 for 1,000 results

View all Actors
Reddit Scraper Lite

Reddit Scraper Lite

trudax/reddit-scraper-lite
Try for free

Pay $4.00 for 1,000 results

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

JF

Duplicate comments

Closed

juxtaposed_fish opened this issue
a month ago

When scraping comments from some Reddit posts, some comments are scraped twice. Looking at the logs, the json endpoints for these posts are called twice -> one with the original link and another with an underscore attached. I don't want duplicates which would make the scrapes more expensive. Thank you :)

trudax avatar

Thank you for letting me know. I have fixed the actor. Can you try again?

Developer
Maintained by Community
Actor metrics
  • 175 monthly users
  • 31 stars
  • 99.9% runs succeeded
  • 1.9 days response time
  • Created in Jun 2020
  • Modified 2 days ago