Xiaohongshu Search Scraper 🔍

Features ✨

• 🎯 Search posts by keywords
• 📱 Simulates real user behavior with stealth mode
• 🔄 Auto-scrolling with random delays
• 📊 Comprehensive data extraction
• 🚀 High performance with request filtering
• 🛡️ Built-in anti-detection mechanisms

Use Cases 💡

• Market Research & Analysis
• Social Media Monitoring
• Competitor Intelligence
• Trend Spotting
• Consumer Insights
• Influencer Research

Output Data Structure 📋

For each post, you'll get:

• Search keyword used
• Post ID and type
• User information (nickname, ID, avatar)
• Engagement metrics (likes)
• Image information (URLs, dimensions)
• Post title
• Timestamp of scraping

Input Parameters ⚙️

Parameter	Type	Description
keywords	Array	List of keywords to search for
maxItems	Number	Maximum number of items to scrape per keyword

Limitations ⚠️

• Respects Xiaohongshu's terms of service
• Includes random delays to prevent rate limiting

Tips for Best Results 💪

1. Use specific keywords for better targeting
2. Set reasonable maxItems limits
3. Run during off-peak hours for better performance
4. Consider using proxy rotation for large-scale scraping

Need help or custom solutions? Feel free to reach out! 🤝

Input Example

A full explanation of an input example in JSON.

1{
2    "keywords": [
3        "ai"
4    ],
5    "maxItems": 20
6}

Output sample

The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above:

And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML.

1[
2    {
3        "keyword": "ai",
4        "item": {
5            "id": "670a46a50000000024017580",
6            "model_type": "note",
7            "note_card": {
8                "image_list": [
9                    {
10                        "height": 1660,
11                        "width": 1242,
12                        "info_list": [
13                            {
14                                "image_scene": "WB_DFT",
15                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/9a5a4077262b93a5364fb23edcdd9fb7/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_mw_1"
16                            },
17                            {
18                                "image_scene": "WB_PRV",
19                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0bb022e2b3fd7ce5d31d4ffc55b8d871/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_prv_1"
20                            }
21                        ]
22                    },
23                    {
24                        "width": 1242,
25                        "info_list": [
26                            {
27                                "image_scene": "WB_DFT",
28                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/cb13ef72141a0909ab3b57587bb769b6/1040g008318rnbkmlgs0g5og26aok1l061rcpmk0!nc_n_webp_mw_1"
29                            },
30                            {
31                                "image_scene": "WB_PRV",
32                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/b8d4bba0de0cb741ac7e8d376a23d288/1040g008318rnbkmlgs0g5og26aok1l061rcpmk0!nc_n_webp_prv_1"
33                            }
34                        ],
35                        "height": 1660
36                    },
37                    {
38                        "width": 1242,
39                        "info_list": [
40                            {
41                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/6d4ef8a530523eebdcbb8e918b63e1b0/1040g008318rnbkmlgs105og26aok1l06fnlsop0!nc_n_webp_mw_1",
42                                "image_scene": "WB_DFT"
43                            },
44                            {
45                                "image_scene": "WB_PRV",
46                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/7122c7c99f28c5c2ed66ae4995b12680/1040g008318rnbkmlgs105og26aok1l06fnlsop0!nc_n_webp_prv_1"
47                            }
48                        ],
49                        "height": 1660
50                    },
51                    {
52                        "height": 1660,
53                        "width": 1242,
54                        "info_list": [
55                            {
56                                "image_scene": "WB_DFT",
57                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/458a8ee764c354d9dcffecc1b93c970c/1040g008318rnbkmlgs1g5og26aok1l06sqjtobo!nc_n_webp_mw_1"
58                            },
59                            {
60                                "image_scene": "WB_PRV",
61                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/eac2bd35f2e92f3a2931a472eec4ee7c/1040g008318rnbkmlgs1g5og26aok1l06sqjtobo!nc_n_webp_prv_1"
62                            }
63                        ]
64                    },
65                    {
66                        "info_list": [
67                            {
68                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/5e4c46ae972bdf4ebe01fea6627c1afa/1040g00831924m06ikg005og26aok1l067gka0b8!nc_n_webp_mw_1",
69                                "image_scene": "WB_DFT"
70                            },
71                            {
72                                "image_scene": "WB_PRV",
73                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/6a9fb402316da5ca0aa56ec49b5f537b/1040g00831924m06ikg005og26aok1l067gka0b8!nc_n_webp_prv_1"
74                            }
75                        ],
76                        "height": 1660,
77                        "width": 1242
78                    },
79                    {
80                        "info_list": [
81                            {
82                                "image_scene": "WB_DFT",
83                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0cf93838983808e3f5fc0b88b12a2427/1040g008318rnbkmlgs2g5og26aok1l069b8n64o!nc_n_webp_mw_1"
84                            },
85                            {
86                                "image_scene": "WB_PRV",
87                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/33c6bee6e587e28dea26e00bd5a08a41/1040g008318rnbkmlgs2g5og26aok1l069b8n64o!nc_n_webp_prv_1"
88                            }
89                        ],
90                        "height": 1660,
91                        "width": 1242
92                    },
93                    {
94                        "height": 1660,
95                        "width": 1242,
96                        "info_list": [
97                            {
98                                "image_scene": "WB_DFT",
99                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/0a4ae6466a84fa1e9e947cb3b4fd6894/1040g008318rnbkmlgs305og26aok1l06kqqfqa8!nc_n_webp_mw_1"
100                            },
101                            {
102                                "image_scene": "WB_PRV",
103                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/a48ab77a62e1f4ac0b00be5c544212c2/1040g008318rnbkmlgs305og26aok1l06kqqfqa8!nc_n_webp_prv_1"
104                            }
105                        ]
106                    },
107                    {
108                        "height": 1660,
109                        "width": 1242,
110                        "info_list": [
111                            {
112                                "image_scene": "WB_DFT",
113                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/d8d9c0de7f30c85f4af984b6c62ac311/1040g008318rnbkmlgs3g5og26aok1l06avtuleo!nc_n_webp_mw_1"
114                            },
115                            {
116                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/3c5083da80364fcb80dd8a26e4dddfbb/1040g008318rnbkmlgs3g5og26aok1l06avtuleo!nc_n_webp_prv_1",
117                                "image_scene": "WB_PRV"
118                            }
119                        ]
120                    },
121                    {
122                        "height": 1660,
123                        "width": 1242,
124                        "info_list": [
125                            {
126                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/d9823a69036cb4800208e8f9b588d7b8/1040g008318rnbkmlgs405og26aok1l06ntd5gu8!nc_n_webp_mw_1",
127                                "image_scene": "WB_DFT"
128                            },
129                            {
130                                "url": "http://sns-webpic-qc.xhscdn.com/202501171106/4586583b89ac468f08155e2d5c3eee45/1040g008318rnbkmlgs405og26aok1l06ntd5gu8!nc_n_webp_prv_1",
131                                "image_scene": "WB_PRV"
132                            }
133                        ]
134                    }
135                ],
136                "type": "normal",
137                "display_title": "国内AI工具推荐，亲测好用！",
138                "user": {
139                    "nick_name": "千寻AI部落",
140                    "avatar": "https://sns-avatar-qc.xhscdn.com/avatar/1040g2jo3138f13q208005og26aok1l06olihpp8?imageView2/2/w/80/format/jpg",
141                    "user_id": "620232b1000000001000d406",
142                    "nickname": "千寻AI部落",
143                    "xsec_token": "ABaVqWXGkAIRf-8QqiYwjllFDByVIFaMhzHeALEsf6PWA="
144                },
145                "interact_info": {
146                    "liked": false,
147                    "liked_count": "13759"
148                },
149                "cover": {
150                    "width": 1242,
151                    "url_default": "http://sns-webpic-qc.xhscdn.com/202501171106/9a5a4077262b93a5364fb23edcdd9fb7/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_mw_1",
152                    "url_pre": "http://sns-webpic-qc.xhscdn.com/202501171106/0bb022e2b3fd7ce5d31d4ffc55b8d871/1040g008318rnbkmlgs005og26aok1l06286dlgg!nc_n_webp_prv_1",
153                    "height": 1660
154                }
155            },
156            "xsec_token": "AByUeGt1ahKuwpBC-iDpv3S0kRcHqxyRWLKaJkVAYm0d4="
157        },
158        "link": "https://www.xiaohongshu.com/explore/670a46a50000000024017580?xsec_token=AByUeGt1ahKuwpBC-iDpv3S0kRcHqxyRWLKaJkVAYm0d4=&xsec_source=pc_search&source=web_explore_feed",
159        "scrapedAt": "2025-01-17T03:06:58.355Z"
160    },
161    ...
162]