🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Pay $0.40 for 1,000 tweets
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Pay $0.40 for 1,000 tweets
⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!
Not Capturing All Results
Closed
not retrieving all the tweets that are visible in the Twitter UI.While the UI shows more results for the same search,the scraper only captures a limited number of them. Run ID: iBfa5y1D4VOMs0PcA
lalatendusahu123
I am also facing the same issue, for any search it is only providing 10 results. Run ID: AqG0Vt8dWDVK2yHHG
navya.n
For the free plan, it only retrieves 10 results, as shown in the logs. On the starter plan, I was able to get more results, around 60, but still not all the results visible in the Twitter UI.
Hello,
@navya.n, unfortunately this is purely related to Twitter. It doesn't act like expected all the time. However I saw that you are using Top as your sort which will bring less results eventually. Can you please change your sort from Top to Latest and try again?
@lalatendusahu123, as navya.n mentioned, you need to subscribe to a paid Apify plan in order to use the actor fully.
Cheers
ArcticPenguin
when I enter multiple start URLs, only results for one of them are returned: sample input
{ // "author": "MorphoLabs", "customMapFunction": "(object) => {\r\n if (!object.isRetweet) {\r\n return { ...object };\r\n }\r\n return undefined; // or undefined if you want to exclude non-retweet objects\r\n}\r\n", "includeSearchTerms": false, "maxItems": 10, "minimumRetweets": 0, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "sort": "Latest", "start": currentDate, "startUrls": [ "https://x.com/MorphoLabs", "https://x.com/ironfishcrypto" ], "tweetLanguage": "en" }
navya.n
@apidojo, I've noticed that switching to the Latest filter yields significantly more results compared to the Top filter. Is there an issue with the Top filter?
Hello,
@navya.n No there is no issue, it is working the same as Twitter. On Twitter, when you select Top on the search page, you see less results but in Latest tab you see more.
@ArcticPenguin, you need to remove maxItems:10. maxItems works for the whole run so it stops after it fetches 10 from the first URL. If this doesn't answer your quqestion, please open a separate issue.
Cheers
API Dojo- 1.6k monthly users
- 276 stars
- 99.0% runs succeeded
- 6.1 hours response time
- Created in Nov 2023
- Modified about 23 hours ago
