What does Idealo.de Product Scraper do?

The Idealo.de Product Scraper is an efficient tool designed to extract detailed product data from the idealo.de platform. This scraper provides comprehensive product information in structured formats like JSON, enabling you to seamlessly integrate it into your reports, spreadsheets, and applications.

With the Idealo.de Product Scraper, you can:

• Collect in-depth product data from idealo.de.
• Access the information in a user-friendly structured format such as JSON.
• Gather detailed product information from all regions where Idealo.de operates.

Idealo.de Product Scraper allows you to collect detailed product information, including:

• ID
• URL
• Name
• Full Title
• Variant Title
• Brand
• Product Overview
• Description
• Image URL
• SKU
• GTIN
• Low Price
• High Price
• Currency
• Total Offers
• Top Offers
• Total Ratings
• Rating Score
• Detail
• Pros
• Cons

Input & Output

To start collecting Idealo.de product data, simply fill out the input form. Idealo.de Product Scraper recognizes the following input parameters:

• URLs - Links to product information pages, seller product listing pages, or product query pages via search, categories, etc. You can paste URLs one at a time or use the Bulk Edit section to add a prepared list.
• Scrape type - The type of link you just pasted includes: Get products by Queries and Get products by Specific product urls. Note: When using the Get products by Specific product urls option, the Total pages to scrape input parameters will have no effect.
• Total pages to scrape - If you use a product listing page path type, don't forget to fill in this field, which allows you to choose the total page when crawling from the product listing page.
• Limit the number of retries - Maximum number of retries for each URL when collecting data when an unexpected error occurs.
• Proxy configuration - Add a proxy to ensure that during the data collection process, you are not detected as a bot.

Idealo.de Product Scraper offers 3 different types of data collection, including:

1. Collect product data from product information pages

Example url: https://www.idealo.de/preisvergleich/OffersOfProduct/203473202_-af400eudbcp-ninja.html

Example Screenshot of product information page:

Input:

1{
2  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
3  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
4    "useApifyProxy": true,
5    "apifyProxyGroups": [
6      "RESIDENTIAL" 
7    ],
8    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
9  },
10  "scrape_type": "specific_product_urls", // Get products by Specific product urls
11  "urls": [ // Links to product information pages.
12    "https://www.idealo.de/preisvergleich/OffersOfProduct/203473202_-af400eudbcp-ninja.html"
13  ]
14}

Output:

You get the output from the Idealo.de Product Scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

1[ // List of product information
2  {
3    "id": "203473202",
4    "url": "https://www.idealo.de/preisvergleich/OffersOfProduct/203473202_-af400eudbcp-ninja.html",
5    "name": "Ninja AF400",
6    "full_title": "Ninja AF400 AF400EUDBCP",
7    "variant_title": "AF400EUDBCP",
8    "brand": "Ninja",
9    "product_overview": "Produktübersicht: 9,5 Liter  Fassungsvermögen Frittiergut 2,8 kg  2.470 Watt  Temperaturbereich bis 180 °C  mit Timer",
10    "description": "Bereits ab 269,90 € ✓ Große Shopvielfalt ✓ Testberichte & Meinungen ✓ | Jetzt Ninja  AF400EUDBCP  günstig kaufen bei idealo.de",
11    "image_url": [
12      "https://cdn.idealo.com/folder/Product/203473/2/203473202/s1_produktbild_gross/ninja-af400eudbcp.jpg"
13    ],
14    "sku": "0622356264518",
15    "gtin": "0622356264518",
16    "low_price": 269.9,
17    "high_price": 299.0,
18    "currency": "EUR",
19    "total_offers": 4,
20    "top_offers": [
21      {
22        "shop_name": "warenstube-bender.de",
23        "products": [
24          {
25            "id": 203473202,
26            "category": 3513,
27            "name": "Ninja AF400EUDBCP",
28            "price": 269.9
29          }
30        ],
31        "event": "leadout"
32      },
33      {
34        "shop_name": "ninjakitchen.de",
35        "products": [
36          {
37            "id": 203473202,
38            "category": 3513,
39            "name": "Ninja AF400EUDBCP",
40            "price": 269.99
41          }
42        ],
43        "event": "leadout"
44      },
45      {
46        "shop_name": "eBay",
47        "products": [
48          {
49            "id": 203473202,
50            "category": 3513,
51            "name": "Ninja AF400EUDBCP",
52            "price": 279.0
53          }
54        ],
55        "event": "leadout"
56      },
57      {
58        "shop_name": "otto.de (Marktplatzhändler)",
59        "products": [
60          {
61            "id": 203473202,
62            "category": 3513,
63            "name": "Ninja AF400EUDBCP",
64            "price": 299.0
65          }
66        ],
67        "event": "leadout"
68      }
69    ],
70    "total_ratings": null,
71    "rating_score": null,
72    "detail": [
73      {
74        "key": "Produkttypen",
75        "value": "Heißluftfritteuse, Doppelfritteuse"
76      },
77      {
78        "key": "Serien",
79        "value": "Ninja Foodi, Ninja Foodi MAX"
80      },
81      {
82        "key": "Fassungsvermögen",
83        "value": "9,5 Liter"
84      },
85      {
86        "key": "Fassungsvermögen Frittiergut",
87        "value": "2,8 kg"
88      },
89      {
90        "key": "Zubereitungsarten",
91        "value": "Backen, Braten, Kochen, ohne Fett, Dörren, Erwärmen"
92      },
93      {
94        "key": "Bedienelemente",
95        "value": "Tasten"
96      },
97      {
98        "key": "Sicherheitseinrichtungen",
99        "value": "Kontrollleuchte, Anti-Rutsch-Füße, wärmeisolierter Griff"
100      },
101      {
102        "key": "Ausstattungen",
103        "value": "Ein-/Ausschalter, abnehmbarer Frittierkorb, abnehmbares Zubehör"
104      },
105      {
106        "key": "Funktionen",
107        "value": "Timer"
108      },
109      {
110        "key": "Anzeigen",
111        "value": "LED, mit Display"
112      },
113      {
114        "key": "Form",
115        "value": "rechteckig"
116      },
117      {
118        "key": "Farbe",
119        "value": "schwarz"
120      },
121      {
122        "key": "Material",
123        "value": "Metall"
124      },
125      {
126        "key": "Breite",
127        "value": "41,5 cm"
128      },
129      {
130        "key": "Höhe",
131        "value": "32,5 cm"
132      },
133      {
134        "key": "Tiefe",
135        "value": "27 cm"
136      },
137      {
138        "key": "Gewicht",
139        "value": "8,8 kg"
140      },
141      {
142        "key": "Leistung (W)",
143        "value": "2.470 Watt"
144      },
145      {
146        "key": "Anzahl der Automatikprogramme",
147        "value": "6"
148      },
149      {
150        "key": "Temperaturbereich",
151        "value": "bis 180 °C"
152      },
153      {
154        "key": "Betriebsspannung",
155        "value": "220 - 240 V"
156      },
157      {
158        "key": "Netzabsicherung",
159        "value": "16 A"
160      },
161      {
162        "key": "Frequenz",
163        "value": "50 Hz"
164      }
165    ],
166    "pros": [
167      "großes Fassungsvermögen",
168      "2 synchronisierbare Garschubladen",
169      "breiter Temperaturbereich"
170    ],
171    "cons": [
172      "keine App-Konnektivität",
173      "keine komplett vorkonfigurierten Garprogramme"
174    ],
175    "from_url": null,
176    "page": null
177  }, // ... Many other product details
178]

2. Collect product data from products by Queries

Example url: "https://www.idealo.de/preisvergleich/ProductCategory/3513I16-705.html",

Example Screenshot of Author product list page:

Input:

1{
2  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
3  "total_pages_to_scrape": 10, // Total page you want scrape
4  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
5    "useApifyProxy": true,
6    "apifyProxyGroups": [
7      "RESIDENTIAL" 
8    ],
9    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
10  },
11  "scrape_type": "product_list_by_query", // Get products by Specific product urls
12  "urls": [ // List of product list page from query urls
13    "https://www.idealo.de/preisvergleich/ProductCategory/3513I16-705.html"
14  ],
15}

Output:

You get the output from the Idealo.de Product Scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

1[
2  {
3    "id": "204292302",
4    "url": "https://www.idealo.de/preisvergleich/OffersOfProduct//204292302",
5    "name": null,
6    "full_title": "Ninja AF400",
7    "variant_title": null,
8    "brand": null,
9    "product_overview": "Heißluftfritteuse, 9,5 Liter, Fassungsvermögen Frittiergut 2,8 kg, 2.470 Watt, Temperaturbereich bis 180 °C, mit Timer",
10    "description": null,
11    "image_url": "https://cdn.idealo.com/folder/Product/204292/3/204292302/s1_produktbild_mittelgross/ninja-af400.jpg",
12    "sku": null,
13    "gtin": null,
14    "low_price": 159.99,
15    "high_price": 159.99,
16    "currency": "€",
17    "total_offers": 80,
18    "top_offers": null,
19    "total_ratings": 20,
20    "rating_score": 2.4,
21    "detail": null,
22    "pros": null,
23    "cons": null,
24    "from_url": "https://www.idealo.de/preisvergleich/ProductCategory/3513I16-705.html", // Which url are the products crawled from
25    "page": 1 // Which page are the products crawled from
26  }, // ... Many other product details
27]

How can I use the data extracted from Idealo.de with Idealo.de Product Scraper?

💙 Boost Brand Awareness: Leverage the data to build and increase your brand visibility on Idealo.de and beyond.

📈 Analyze Market Trends and Influences: Track upcoming trends in product categories, brands, and sellers to stay ahead of the competition.

🔬 Support Research and Testing: Use the data for thorough product research and testing to refine strategies or develop new ideas.

⭐ Enhance Sentiment Analysis: Count and score authentic product reviews to reinforce sentiment analysis with real, reliable data.

🪧 Plan Strategic Campaigns: Design and execute commercial campaigns on Idealo.de or other e-commerce platforms, backed by actionable data.

📚 Streamline Market Research: Simplify the process of gathering market insights and executing marketing campaigns efficiently.

📋 Generate Targeted Marketing Leads: Build a list of precisely matched marketing leads to optimize your outreach and conversion efforts.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Idealo.de Product Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.