🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Pay $0.30 for 1,000 tweets
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Pay $0.30 for 1,000 tweets
⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!
Actor returning results, but they are all empty
Open
Hi, If you check the URL below, you'll see that we are receiving empty results, AND BEING CHARGED FOR THEM. I've checked the twitter profile in question, and there are definitely posts. Can you look at this as a matter of urgency? Right now we are spending a lot of credits for no results.
Hello,
If you check your logs, you will see that you got rate-limitted automatically because of very high usage or monitoring activities which is not permitted in our actor. What is your use-case? Can you give me an idea of the logic you've on your end? Then if that is something we can handle, I can lift your rate-limit.
You can also contact me via Discord if you want to talk it in private.
Best
aqua_plants
Hi, I see the log message now, it didn't occur to me to look there.
We use your Tweet Scraper as part of an application that allows our clients to search for search terms on social media.
I suspect there has been an uptick in the amount of searches we are initiating since we made some efficiency updates to our software over the last couple of days.
I have some questions:
- What do you mean by monitoring activities?
- I don't see any mention of misuse or rate limiting on your information page.
- If we are rate-limited why are still charging us?
- What are your rate limit thresholds so that we can manage them from our side as well?
I look forward to hearing from you.
Thanks.
Hello,
To give you a general idea, in pay-per-result actors, we are covering the costs of the runs and you are only paying for the results so when you get less than 10 results in every run, we get a negative margin. Apify is currently working on a "min run cost" feature so when it is done, this won't be an issue however right now, our backend has some precautions for us not to go bankrupt :)
Let me try to answer your questions real quick
1- It means when someone tries to monitor a Twitter profile and tries to get real-time notifications for new tweets by sending lots of req/sec with minimum time intervals and 0-1 results
2- It happens automatic and there is no documentation about this. Most of our users fetches historical data so they won't get affected. If someone tries to use our actor like using an API, this happens. Our actor is not an API and it shouldn't be used as one, it is a scraper.
3- Because we are having a negative margin for each of your run and Apify doesn't have a feature for this right now. That is how we can cover our costs. You should watch the logs and when you see this happens, stop and contact us.
4- What are your queries exactly? I saw lots of different query usages from ORs, to max_ids and some timeframes. If you can give us some information about them, we can help you optimize your usage.
Cheers!
API Dojo- 1.4k monthly users
- 194 stars
- 97.7% runs succeeded
- 6.4 hours response time
- Created in Nov 2023
- Modified about 23 hours ago
