Medium Scraper
1 day trial then $20.00/month - No credit card required now
Medium Scraper
1 day trial then $20.00/month - No credit card required now
Revolutionize your content sourcing with Medium Author Scraper - the powerful Apify actor that effortlessly scrapes all posts / contents from your desired Medium author and returns the data in a structured format, giving you valuable insights in just seconds.
still not working
Closed
2023-06-16T09:04:26.364Z ACTOR: Pulling Docker image from repository. 2023-06-16T09:04:26.458Z ACTOR: Creating Docker container. 2023-06-16T09:04:26.698Z ACTOR: Starting Docker container. 2023-06-16T09:04:28.612Z INFO Initializing actor... 2023-06-16T09:04:28.616Z INFO System info ({"apify_sdk_version": "1.1.1", "apify_client_version": "1.2.2", "python_version": "3.11.3", "os": "linux"}) 2023-06-16T09:04:28.681Z 2023-06-16 09:04:28 [INFO] medium_scraper.main - Scraping 200 most recent posts from cardanorss, (scrape article content: True) - (main.py:20) 2023-06-16T09:04:28.684Z 2023-06-16 09:04:28 [INFO] medium_scraper.posts_scraper - Scraping posts from author cardanorss using url https://cardanorss.medium.com (profile: https://medium.com/@cardanorss) - (posts_scraper.py:35) 2023-06-16T09:04:28.802Z ERROR Actor failed with an exception 2023-06-16T09:04:28.804Z Traceback (most recent call last): 2023-06-16T09:04:28.806Z File "/usr/src/app/src/main.py", line 43, in main 2023-06-16T09:04:28.808Z data = await scrap(actor_input) 2023-06-16T09:04:28.810Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2023-06-16T09:04:28.813Z File "/usr/src/app/src/main.py", line 23, in scrap 2023-06-16T09:04:28.815Z posts: list[Post] = PostsScraper.scrap(author, limit) 2023-06-16T09:04:28.817Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2023-06-16T09:04:28.819Z File "/usr/src/app/src/medium_scraper/posts_scraper.py", line 57, in scrap 2023-06-16T09:04:28.822Z _posts = data[0]['data']['userResult']['homepagePostsConnection'][ 2023-06-16T09:04:28.825Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2023-06-16T09:04:28.827Z KeyError: 'homepagePostsConnection' 2023-06-16T09:04:28.829Z INFO Exiting actor ({"exit_code": 91})
qpayre-owner
That's weird, We are looking
jackso6
Hello,
It appear that cardanorss has the same articles as cardano.foundation plus exclusive articles from cardano.foundation I believe. Also note that a RSS feed (and thus cardanorss?) only has the last 5 to 10 items. Also note that you can know (using cardano.foundation) if the article is from the main sub stack or from the cardanorss using the url of the article. You should use cardano.foundation as author, and filter if needed using the url of the article. btw its not a normal medium page so we are not able to get data from it the same way.
QPS- 8 monthly users
- 1 star
- 91.9% runs succeeded
- 0.66 hours response time
- Created in Apr 2023
- Modified over 1 year ago
