Substack Scraper
1 day trial then $20.00/month - No credit card required now
Substack Scraper
1 day trial then $20.00/month - No credit card required now
The Substack Author Scraper is a powerful Apify actor that makes it easy for content creators to scrape and retrieve all posts from their favorite Substack authors. With structured data presented in a user-friendly format, analyzing and processing valuable information has never been easier.
The subscription baed substack accounts are impossible to scrape
Closed
this is one of the subsctiption based accounts I tried to scrape:
2024-04-03T09:07:38.678Z ACTOR: Pulling Docker image of build 79Jhj6dXdLhgwsEkQ from repository. 2024-04-03T09:07:41.656Z ACTOR: Creating Docker container. 2024-04-03T09:07:41.741Z ACTOR: Starting Docker container. 2024-04-03T09:07:44.037Z INFO Initializing actor... 2024-04-03T09:07:44.038Z INFO System info ({"apify_sdk_version": "1.0.0", "apify_client_version": "1.0.0", "python_version": "3.11.6", "os": "linux"}) 2024-04-03T09:07:44.126Z 2024-04-03 09:07:44 [INFO] substack_scraper.main - Scraping 10 most recent posts from asiancenturystocks, (scrape article content: True) - (main.py:20) 2024-04-03T09:07:44.128Z 2024-04-03 09:07:44 [INFO] substack_scraper.posts_scraper - Scraping posts from author asiancenturystocks using url https://asiancenturystocks.substack.com (profile: https://asiancenturystocks.substack.com) - (posts_scraper.py:32) 2024-04-03T09:07:44.235Z ERROR Actor failed with an exception 2024-04-03T09:07:44.236Z Traceback (most recent call last): 2024-04-03T09:07:44.237Z File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 971, in json 2024-04-03T09:07:44.238Z return complexjson.loads(self.text, **kwargs) 2024-04-03T09:07:44.239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-04-03T09:07:44.239Z File "/usr/local/lib/python3.11/json/init.py", line 346, in loads 2024-04-03T09:07:44.240Z return _default_decod... [trimmed]
Hello,
It's because the input require the author of the article. In your case the author name is "fritz"
Please give it a try and let us know if that resolve your issue
Regards, Yoann
Hello, the issue has been fixed
QPSActor Metrics
12 monthly users
-
6 stars
65% runs succeeded
1.5 days response time
Created in Apr 2023
Modified 9 months ago
