Ebay Kleinanzeigen.de Scraper

Overview

The Kleinanzeigen.de Scraper is designed to help you scrape classified listings from the German website Kleinanzeigen.de. This tool extracts detailed data about various listings, including real estate, items for sale, services, and more. You can use it to gather large datasets for market research, competitor analysis, or other needs.

How it Works

This scraper extracts listings from Kleinanzeigen.de, including:

• Title of the listing
• Price
• Description
• Listing URL
• Location
• Seller information (where available)

The scraper is highly customizable to meet different use cases, such as limiting the number of items to scrape or specifying how to handle retries and delays.

Key Features

• Flexible Configuration: Configure the maximum number of listings to scrape, concurrency settings, and retry strategies.
• Customizable Scraping: Start scraping from a variety of URLs, such as category pages, search results, or specific listings.
• Proxy Support: Use Apify's proxy configuration to avoid detection and IP blocking when scraping large datasets.
• Automatic Pagination: The scraper automatically navigates to the next pages of listings for continuous scraping.
• Error Handling: Includes automatic retries for failed requests to maximize the success rate of the scraping process.

How to Use

1. Set Up: Create an account on Apify if you don't have one and access the Kleinanzeigen.de Scraper actor.
2. Configure Start URLs: Provide the URLs to start the scraping process. These could be category pages, search results, or specific listings.
3. Set Scraping Limits:
   • Max Items: Set the maximum number of items to scrape. Leave it empty to scrape all available listings.
   • Concurrency: Adjust the number of pages to be scraped simultaneously.
   • Scroll Delay: Set the delay between scroll actions to avoid detection.
4. Run the Scraper: Execute the scraper to start scraping listings.
5. Download Data: Once the scraping process is complete, the data will be available in your preferred format: JSON, CSV, Excel, or others.

Input Data Example

Here’s an example configuration for scraping listings of beachfront properties in Florida:

1{
2    "startUrls": [
3        {
4            "url": "https://www.kleinanzeigen.de/s-aachen/iphone/k0l1921"
5        }
6    ],
7    "maxItems": 100,
8    "maxConcurrency": 10,
9    "minConcurrency": 1,
10    "maxRequestRetries": 100,
11    "proxy": {
12        "useApifyProxy": true,
13        "apifyProxyGroups": [
14            "RESIDENTIAL"
15        ]
16    }
17}

Parameters:

• startUrls: The URLs to start scraping from.
• maxItems: Maximum number of listings/items to scrape.
• maxConcurrency: Maximum number of pages to scrape concurrently.
• minConcurrency: Minimum number of pages to scrape concurrently.
• maxRequestRetries: Number of retries for failed requests.
• proxy: Proxy configuration to help avoid being blocked by the site.

Output Structure

The scraper provides detailed information about each listing in the following structure:

1{
2        "title": "iPhone 13 mini 128GB",
3        "price": "360 €",
4        "description": "Ich verkaufe mein iPhone 13 Mini in der Farbe Grün mit 128 GB Speicher. Das Handy ist in einem sehr guten Zustand und wurde immer sorgfältig behandelt. Es gibt nur minimale Gebrauchsspuren, die kaum auffallen.Das iPhone funktioniert einwandfrei, hat kaum Kratzer auf dem Display und die Akkuleistung ist ebenfalls noch gut. Es wurde immer mit Hülle und Schutzfolie benutzt.Lieferumfang:\t•\tiPhone 13 Mini 128 GB in Grün\t•\tOriginalverpackung\tDas Gerät ist ohne SIM-Lock und bereit für die Nutzung mit jeder SIM-Karte.Bei Interesse oder Fragen gerne melden!Nur Abholung oder Versand nach Absprache.",
5        "location": "52066 Aachen - Aachen-Mitte",
6        "datePosted": "17.01.2025",
7        "itemId": 2978301221,
8        "itemUrl": "https://www.kleinanzeigen.de/s-anzeige/iphone-13-mini-128gb/2978301221-173-1923",
9        "imageUrl": "https://img.kleinanzeigen.de/api/v1/prod-ads/images/e0/e02ab853-e7a6-47cc-af42-5ce91667de15?rule=$_2.AUTO",
10        "imageCount": 3,
11        "hasShipping": false,
12        "metaDescription": "Ich verkaufe mein iPhone 13 Mini in der Farbe Grün mit 128 GB Speicher. Das Handy ist in einem sehr...",
13        "metaImageUrl": "https://img.kleinanzeigen.de/api/v1/prod-ads/images/e0/e02ab853-e7a6-47cc-af42-5ce91667de15?rule=$_57.AUTO",
14        "shipping": "Nur Abholung",
15        "viewCount": "",
16        "specifications": {
17            "Art": "Apple",
18            "Farbe": "Grün",
19            "Gerät & Zubehör": "Gerät & Zubehör",
20            "Zustand": "Sehr Gut"
21        },
22        "images": [
23            "https://img.kleinanzeigen.de/api/v1/prod-ads/images/e0/e02ab853-e7a6-47cc-af42-5ce91667de15?rule=$_59.AUTO",
24            "https://img.kleinanzeigen.de/api/v1/prod-ads/images/77/77185e5d-0e64-4879-9206-1c7e50b78d7a?rule=$_59.AUTO",
25            "https://img.kleinanzeigen.de/api/v1/prod-ads/images/27/27854cc7-5745-4f85-8660-222dfb714743?rule=$_59.AUTO"
26        ]
27    }

Explanation of Fields

• title: The title of the listing. In this case, it's the product name "Apple iPhone 16 5G 128 GB Schwarz."
• price: The price of the item, here displayed as "819 €."
• description: A brief description of the item, which may contain details about the condition, how the transaction will take place, and other notes.
• location: The location where the item is being sold from. In this case, it is "52070 Aachen-​Mitte."
• datePosted: The date and time the listing was posted. For this listing, it was posted today at "08:12."
• itemId: A unique identifier for the listing.
• itemUrl: The URL where the listing can be viewed on Kleinanzeigen.de.
• imageUrl: The URL of the main image associated with the listing.
• imageCount: The number of images associated with the listing (null if not available).
• hasShipping: A boolean (true/false) indicating if the item has shipping available.
• metaDescription: A brief description of the item used for SEO purposes or as a preview on the website.
• metaImageUrl: A URL for the image to be used in the preview or meta tags for the item.
• viewCount: The number of views the item has received (empty or null if not tracked).
• specifications: The technical or detailed specifications of the item (for example, "Art" for the brand, "Farbe" for color, etc.).
• description: A detailed description of the item, including additional selling terms and conditions.
• images: An array of image URLs associated with the listing, providing a way to gather all images related to the item.

Best Practices

• Location-Specific Scraping: Use specific location-based URLs to scrape more relevant listings.
• Use Proxies: To avoid detection or rate-limiting, use residential proxies when scraping large numbers of listings.
• Respect Website Terms: Make sure you're abiding by Kleinanzeigen.de's terms of service when using this scraper.

Explore More Scrapers

If you found this Facebook Groups and Details Scraper useful, be sure to check out our other powerful scrapers and actors at memo23's Apify profile. We offer a wide range of tools to enhance your web scraping and automation needs across various platforms and use cases.

Support

• For issues or feature requests, please use the Issues section of this actor.
• If you need customization or have questions, feel free to contact the author:
  • Author's website: https://muhamed-didovic.github.io/
  • Email: muhamed.didovic@gmail.com

Additional Services

• Request customization or whole dataset: muhamed.didovic@gmail.com
• If you need anything else scraped, or this actor customized, email: muhamed.didovic@gmail.com
• For API services of this scraper (no Apify fee, just usage fee for the API), contact: muhamed.didovic@gmail.com
• Email: muhamed.didovic@gmail.com