Medium User Posts Scraper 📝

🤖 What does Medium User Posts Scraper do?

This actor scrapes detailed information about posts from Medium users' profiles. For each provided Medium username, it extracts comprehensive data about their published articles, including titles, engagement metrics, and publication details.

✨ Features

• 🔍 Scrapes posts from any public Medium profile
• 📊 Extracts detailed metrics (claps, responses, reading time)
• 🔒 Identifies premium (member-only) content
• 📅 Captures publication dates and update history
• 🖼️ Includes preview image URLs
• 📚 Supports collection/publication information
• ⚡ Fast and efficient with built-in request optimization

📋 Output Dataset

The actor extracts the following data for each post:

• Post ID and title
• Subtitle/description
• Direct URL to the post
• Estimated reading time
• Premium content status
• Engagement metrics (claps, responses)
• Publication dates (first and latest)
• Preview image URL
• Author information
• Collection/Publication details
• Visibility and publication status

💡 Use Cases

• 📈 Track content performance metrics
• 🎯 Analyze posting patterns and engagement
• 📊 Monitor publication strategy
• 🔍 Research content topics and trends
• 📱 Build content aggregation services

💪 Input Parameters

• usernames: Array of Medium usernames to scrape (e.g., ["username1", "username2"])
• maxItems: Maximum number of posts to scrape per user

Input Example

A full explanation of an input example in JSON.

1{
2    "usernames": [
3        "mariaspantidi"
4    ],
5    "maxItems": 30
6}

Output sample

The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above:

And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML.

1[
2	{
3		"username": "yaelwolfe",
4		"id": "5c510f575964",
5		"title": "What Does It Mean to Write Women’s Fiction?",
6		"subtitle": "A female writer’s musings on the challenges of an imposed niche",
7		"url": "https://medium.com/wilder-with-yael-wolfe/what-does-it-mean-to-write-womens-fiction-5c510f575964",
8		"readingTime": 9,
9		"isLocked": true,
10		"responseCount": 49,
11		"clapCount": 2515,
12		"visibility": "LOCKED",
13		"isSeries": false,
14		"firstPublishedAt": "2024-11-03T16:44:42.880Z",
15		"latestPublishedAt": "2024-11-03T16:44:42.880Z",
16		"previewImage": "https://miro.medium.com/v2/resize:fill:320:214/1*X1YZ5fw1y51ytJvBArdhMA.jpeg",
17		"isPublished": true,
18		"isLimitedState": false,
19		"creator": {
20			"id": "d02ca71a13d6",
21			"name": "Y.L. Wolfe",
22			"username": "yaelwolfe",
23			"bio": "Adventuring & nesting in middle age. Welcome to my second act. | Newsletter: http://eepurl.com/gleDcD | Email: hello@ylwolfe.com"
24		},
25		"collection": {
26			"name": "Wilder",
27			"subscriberCount": 675,
28			"description": "We will not be tamed."
29		},
30		"scrapedAt": "2024-11-06T16:44:42.880Z"
31	},
32    ...
33]