1 day trial then $20.00/month - No credit card required now

XiaoHongShu Profile Scraper

kuaima/xiaohongshu-profile

1 day trial then $20.00/month - No credit card required now

本工具可以处理小红书用户页数据及其发表的文章详情页数据。[小红书](https://www.xiaohongshu.com/) is a famous social e-commerce platform that combines user-generated content with online shopping, catering to the needs of young Chinese consumers. This scraper can get data from xiaohongshu user profile and detail pages.

Back to issues Create new issue

Unable to crawl Xiaohongshu ，no result

Open

yuanxiang250 opened this issue

2024-09-10T10:08:11.596Z INFO - 保存起始链接(https://www.xiaohongshu.com/explore/)的截图. 2024-09-10T10:08:41.742Z ERROR PlaywrightCrawler: Request failed and reached maximum retries. locator.innerHTML: Timeout 30000ms exceeded. 2024-09-10T10:08:41.744Z =========================== logs =========================== 2024-09-10T10:08:41.749Z waiting for locator('div#noteContainer').first() 2024-09-10T10:08:41.750Z ============================================================ 2024-09-10T10:08:41.752Z at page_debug_info (/home/myuser/dist/common.js:17:59) 2024-09-10T10:08:41.754Z at async ProfileScraper.detail_handler (/home/myuser/dist/common.js:227:9) 2024-09-10T10:08:41.755Z at /home/myuser/async file:/home/myuser/dist/routes.js:15:5 2024-09-10T10:08:41.757Z at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:52:21) {"id":"j4kmEkC6CKIIqI1","url":"https://www.xiaohongshu.com/explore/","method":"GET","uniqueKey":"https://www.xiaohongshu.com/explore"} 2024-09-10T10:08:41.797Z INFO RequestQueue: Waiting for 9936ms before considering the queue as finished to ensure that the data is consistent. 2024-09-10T10:08:46.600Z INFO Statistics: PlaywrightCrawler request statistics: {"requestAvgFailedDurationMillis":62093,"requestAvgFinishedDurationMillis":75708,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":137801,"requestsTotal":2,"crawlerRuntimeMillis":310442,"retryHistogram":[1,null,null,1]} 2024-09-10T10:08:46.821Z ... [trimmed]

Add comment

Developer

kuai ma

Actor metrics

10 monthly users
4 stars
100.0% runs succeeded
64 days response time
Created in Jun 2023
Modified 3 days ago

Categories

E-commerce

Social media

Xiaohongshu User Profile Extractor

dainty_screw/xiaohongshu-data-scraper

Effortlessly capture comprehensive profile insights from XiaoHongShu. From basic user details to interaction metrics, streamline your market research with precision. Ideal for fashion and trend analysis.

codemaster devops

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

14.6k

184

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

16.7k

187

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

58k

476

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add one or more Instagram usernames and extract number of followers&follows, URLs, bio, posts, likes, counts, related profiles, captions, highlight reels. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

37.5k

199

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

6.6k

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.1k

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

20.2k

144

Instagram Hashtag Scraper

apify/instagram-hashtag-scraper

Scrape Instagram hashtags data. Just add one or more hashtags and extract posts, images, URLs, comments, likes, users, locations, timestamps, and more. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

18.3k

TikTok Comments Scraper

clockworks/tiktok-comments-scraper

Extract TikTok comments. Just add a TikTok URL and get TikTok video and profile data: comments, URLs, numbers of shares, followers, hashtags, hearts, video, and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

4.1k