No credit card required

G2 Explorer

jupri/g2-explorer

Try for free

No credit card required

💫 Scrape G2.com

Back to issues Create new issue

Unable to extract more than 10000 reviews

Open

Webaffiniti opened this issue

The crawler is unable to extract more than 10000 reviews. Works fine till 10000 reviews.

12024-03-08T12:15:54.214Z ACTOR: Pulling Docker image of build BNzoWrVuBgVVtvURl from repository.
22024-03-08T12:15:56.435Z ACTOR: Creating Docker container.
32024-03-08T12:15:56.671Z ACTOR: Starting Docker container.
42024-03-08T12:15:58.488Z ☢️ Proxy enabled: <http://groups-RESIDENTIAL@10.0.35.96> (REQUIRED)
52024-03-08T12:15:58.503Z 📝 Arguments :
62024-03-08T12:15:58.505Z     🟩 query         : slack
72024-03-08T12:15:58.506Z     🟩 mode          : review
82024-03-08T12:15:58.507Z     🟩 limit         : 10005
92024-03-08T12:15:58.509Z     🟩 sort_review   : newest
102024-03-08T12:15:58.510Z     🟩 response_type : text
112024-03-08T12:15:58.511Z     🟩 strict_search : True
122024-03-08T12:15:58.513Z 😼 searching products : slack ...
132024-03-08T12:15:59.966Z 🐭 deploying 1 workers ... 🐸
142024-03-08T12:16:01.107Z 🐸 [1] ❌ HTTPStatusError
152024-03-08T12:16:01.108Z 🐭 something went wrong!
162024-03-08T12:16:01.109Z ❌ HTTP Error 400: Bad Request
172024-03-08T12:16:01.414Z 💔 Failed, Bad Request ... sad.

URL https://console.apify.com/view/runs/8aNgKSlFfgveNPtYa

Add comment

Developer

cat

Actor Metrics

68 monthly users
22 stars
>99% runs succeeded
11 days response time
Created in Aug 2022
Modified a month ago

Categories

Other

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

67.1k

765

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

16.8k

244

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor and lead scraper to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

26.5k

274

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

25k

590

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.9k

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape data from Instagram reels. Just add one or more Instagram usernames and get your data in seconds including hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

5.2k

157

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add one or more Instagram usernames and extract number of followers&follows, URLs, bio, posts, likes, counts, related profiles, captions, highlight reels. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

41k

283

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

7.6k

Instagram Hashtag Scraper

apify/instagram-hashtag-scraper

Scrape Instagram hashtags data. Just add one or more hashtags and extract posts, images, URLs, comments, likes, users, locations, timestamps, and more. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

19.4k

119

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!