What does willhaben.at Scraper do?

Willhaben.at Scraper for cars allows you to scrape any cars from chosen urls from willhaben.at. Here are main functionalities:

1. Extract all willhaben.at data from chosen urls
2. Extract all willhaben.at data with limited page from chosen urls
3. Export any willhaben.at data in many formats, also easy to integrate with your own external systems within minutes

Note: willhaben.at of each country domain hasn't been tested. If you have special request for a specific country, please let us know, we may help to test willhaben.at limitation: willhaben.at only allows to get maximum 20 search result pages, in case you need to scrape bigger amount, you may need to split the result into smaller chunk, use excel to generate URL if needed. We are working on the solution to scrape with bigger result, status will be updated here

Input

Full input sample:

{
  "start_urls": [
    {
      "url": "https://www.willhaben.at/iad/gebrauchtwagen/auto/gebrauchtwagenboerse?rows=30"
    }
  ],
  "scrape_page_limit": 1,
  "ad_detail_page_urls": "https://www.willhaben.at/iad/gebrauchtwagen/d/auto/audi-e-tron-55-quattro-95kwh-advanced-s-line-suv-gelaendewagen-867346418/"
}

• run_mode By default, test mode is enabled, for the real scraped, please select Production option (prod)

• start_urlsshould be cars search page. i.e. https://www.willhaben.at/iad/gebrauchtwagen/auto/gebrauchtwagenboerse?rows=30.

• scrape_page_limitif this data is set, only the first scrape_page_limit of start_urls will be scraped. To remove this limit, remove this scrape_page_limitfrom input

Output

Output sample for simple data

{
  "id": "1654277607",
  "url": "https://www.willhaben.at/iad/gebrauchtwagen/d/auto/bmw-5er-reihe-525d-xdrive-1654277607/",
  "description": "BMW 5er-Reihe 525d xdrive",
  "photos": [
    "https://cache.willhaben.at/mmo/7/165/427/7607_1988883143.jpg",
    "https://cache.willhaben.at/mmo/7/165/427/7607_-2021590471.jpg",
    "https://cache.willhaben.at/mmo/7/165/427/7607_-804916147.jpg"
  ],
  "highlight": [
    {
      "prefix": null,
      "value": "2009",
      "postfix": "EZ"
    },
    {
      "prefix": null,
      "value": "352.000",
      "postfix": "km"
    },
    {
      "prefix": null,
      "value": "197",
      "postfix": "PS (145 kW)"
    }
  ],
  "attributes": {
    "attribute": [
      {
        "name": "BODY_DYN",
        "values": [
          "Seit 2013 in meinem Besitz. Es wurde immer alles fachgerecht repariert, das Auto ist also in gutem Zustand und nach wie vor angemeldet. Er steht entweder in Schrems (3943) oder in Wien. Reifen neu, Batterie neu, Stoßdämpfer und Federn vorne neu etc."
        ]
      },
      {
        "name": "CONDITION_REPORT",
        "values": ["1"]
      },
      {
        "name": "MOTOR_PRICE_BONUS/TRADE_IN",
        "values": ["false"]
      },
      {
        "name": "MILEAGE",
        "values": ["352000"]
      },
      {
        "name": "CAR_MODEL/MAKE",
        "values": ["BMW"]
      },
      {
        "name": "ORG_UUID",
        "values": ["adef4342-a857-4d3e-a4c4-c82a3667e9e5"]
      },
      {
        "name": "PUBLISHED",
        "values": ["1724709600000"]
      },
      {
        "name": "COUNTRY",
        "values": ["Österreich"]
      },
      {
        "name": "CAR_MODEL/MODEL",
        "values": ["5er-Reihe"]
      },
      {
        "name": "CAR_MODEL/MODEL_SPECIFICATION",
        "values": ["525d xdrive"]
      },
      {
        "name": "PRICE/AMOUNT",
        "values": ["4900.0"]
      },
      {
        "name": "AUTDEALER",
        "values": ["0"]
      },
      {
        "name": "NOOFSEATS",
        "values": ["5"]
      },
      {
        "name": "ADTYPE_ID",
        "values": ["20"]
      },
      {
        "name": "ORGID",
        "values": ["22116374"]
      },
      {
        "name": "SEO_URL",
        "values": [
          "gebrauchtwagen/d/auto/bmw-5er-reihe-525d-xdrive-1654277607/"
        ]
      },
      {
        "name": "PUBLISHED_String",
        "values": ["2024-08-27T00:00:00Z"]
      },
      {
        "name": "ENGINE/EFFECT",
        "values": ["145"]
      },
      {
        "name": "MMO",
        "values": ["7/165/427/7607_1988883143.jpg"]
      },
      {
        "name": "ENGINE/FUEL",
        "values": ["100003"]
      },
      {
        "name": "AD_UUID",
        "values": ["b44b60fe-d2c7-4e38-8b2e-a6ca8aa3da02"]
      },
      {
        "name": "SOURCE",
        "values": ["11"]
      },
      {
        "name": "CONDITION",
        "values": ["20"]
      },
      {
        "name": "COORDINATES",
        "values": ["48.191558837890625,16.370309829711914"]
      },
      {
        "name": "LOCATION",
        "values": ["Wien, 04. Bezirk, Wieden"]
      },
      {
        "name": "POSTCODE",
        "values": ["1040"]
      },
      {
        "name": "STATE",
        "values": ["Wien"]
      },
      {
        "name": "fnmmocount",
        "values": ["13"]
      },
      {
        "name": "EQUIPMENT",
        "values": [
          "45;24;68;69;26;28;110;111;114;116;117;71;94;72;95;74;97;75;98;11;99;77;12;34;38;19;101;2;102;5;104;6;8;9;81;40;42;43"
        ]
      },
      {
        "name": "DISTRICT",
        "values": ["Wien"]
      },
      {
        "name": "HEADING",
        "values": ["BMW 5er-Reihe 525d xdrive"]
      },
      {
        "name": "CAR_TYPE",
        "values": ["Kombi / Family Van"]
      },
      {
        "name": "NO_OF_OWNERS",
        "values": ["2"]
      },
      {
        "name": "ADID",
        "values": ["1654277607"]
      },
      {
        "name": "EXTERIORCOLOURMAIN",
        "values": ["5"]
      },
      {
        "name": "YEAR_MODEL",
        "values": ["2009"]
      },
      {
        "name": "ALL_IMAGE_URLS",
        "values": [
          "7/165/427/7607_1988883143.jpg;7/165/427/7607_-2021590471.jpg;7/165/427/7607_-804916147.jpg;7/165/427/7607_-1670187090.jpg;7/165/427/7607_-742718496.jpg;7/165/427/7607_1895627441.jpg;7/165/427/7607_230487104.jpg;7/165/427/7607_1084489604.jpg;7/165/427/7607_-1730086046.jpg;7/165/427/7607_-874710057.jpg;7/165/427/7607_714075728.jpg;7/165/427/7607_-344525796.jpg;7/165/427/7607_-580782597.jpg"
        ]
      },
      {
        "name": "ISPRIVATE",
        "values": ["1"]
      },
      {
        "name": "MOTOR_PRICE_BONUS/FINANCE",
        "values": ["false"]
      },
      {
        "name": "PRODUCT_ID",
        "values": ["5231"]
      },
      {
        "name": "TRANSMISSION",
        "values": ["180004"]
      },
      {
        "name": "WARRANTY",
        "values": ["-1"]
      },
      {
        "name": "PRICE",
        "values": ["4900"]
      },
      {
        "name": "PRICE_FOR_DISPLAY",
        "values": ["€ 4.900"]
      },
      {
        "name": "LAST_UPDATED",
        "values": ["1724709593000"]
      },
      {
        "name": "ENGINE/FUEL_RESOLVED",
        "values": ["Diesel"]
      },
      {
        "name": "TRANSMISSION_RESOLVED",
        "values": ["Automatik"]
      },
      {
        "name": "CONDITION_RESOLVED",
        "values": ["Gebrauchtwagen"]
      },
      {
        "name": "EQUIPMENT_RESOLVED",
        "values": [
          "Regensensor",
          "Fahrerairbag",
          "Nebelscheinwerfer",
          "Leichtmetall-/Alufelgen",
          "Antriebsschlupfregelung (ASR)",
          "CD Player",
          "Nichtraucherfahrzeug",
          "Mittelarmlehne",
          "Lederlenkrad",
          "Kurvenfahrlicht",
          "Kopfairbags",
          "Schisack",
          "Multifunktionslenkrad",
          "elektr. Sitze",
          "Lichtsensor",
          "Parksensor hinten",
          "ISOFIX",
          "Beifahrerairbags",
          "Head-Up-Display",
          "Tempomat",
          "Bluetooth / USB",
          "Stabilitätsprogramme (ESP)",
          "Lederausstattung",
          "Radio",
          "Klimaautomatik",
          "elektr. Spiegel",
          "Dachreling",
          "Servolenkung",
          "Parksensor vorne & hinten",
          "ABS",
          "Tagfahrlicht",
          "elektr. Fensterheber",
          "Zentralverriegelung",
          "Klimaanlage",
          "Reifendrucksensor",
          "Navigationssystem",
          "Bordcomputer",
          "Xenon"
        ]
      },
      {
        "name": "WARRANTY_RESOLVED",
        "values": ["Nein"]
      }
    ]
  },
  "seller": {
    "type": "Privat",
    "iconType": "NONE",
    "upsellingOrgLogo": null
  }
}

Support

If this ready made scraper does not match your need (input, output, pricing) or you get any issue or you need to scrape other websites, please contact us at: realspidery@gmail.com or on X: realspidery