Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

Professional Onthemarket.com Real Estate Data Extraction Solution

The UK property market generates millions of listings annually, making manual data collection from property portals an overwhelming task for real estate professionals, investors, and researchers. OnTheMarket.com stands as one of the UK's most user-friendly property portals, featuring hundreds of thousands of properties for sale and rent from leading estate agents. As the UK's fastest-growing property portal since its acquisition by CoStar Group, OnTheMarket provides a rich source of property data that can drive informed decision-making in real estate investments, market analysis, and competitive research.

The challenge lies in efficiently extracting and organizing this valuable property information at scale. Traditional manual browsing and copy-pasting methods are time-consuming and prone to errors, especially when dealing with thousands of property listings across different regions. This is where a specialized OnTheMarket.com property scraper becomes an invaluable tool for automating data collection and transforming unstructured web content into actionable business intelligence.

Comprehensive Property Data Extraction Solution

The OnTheMarket.com Property Search Scraper is a sophisticated automated tool designed to extract comprehensive property information from the UK's rapidly growing property portal. This scraper addresses the critical need for scalable data collection in the real estate sector, enabling users to gather detailed property intelligence without the manual overhead of browsing individual listings.

The scraper's primary strength lies in its ability to process multiple property search result pages simultaneously while maintaining data integrity and completeness. Unlike basic web scraping tools that may miss crucial information or fail under anti-bot measures, this specialized scraper is engineered specifically for OnTheMarket.com's structure and requirements. It handles dynamic content loading, manages request throttling, and ensures consistent data extraction across different property types and locations.

Target users include real estate investors analyzing market trends, property developers researching potential locations, estate agents conducting competitive analysis, and academic researchers studying housing market patterns. The tool's flexibility accommodates both small-scale research projects requiring data from specific areas and large-scale market analysis covering entire regions or property types.

Input Configuration and Requirements

Example url 1: https://www.onthemarket.com/for-sale/property/shropshire/

Example url 2: https://www.onthemarket.com/for-sale/property/burley-leeds/

Example url 3: https://www.onthemarket.com/for-sale/property/roughley/

Example Screenshot of property list by query page:

Input Format Specification

The scraper accepts JSON configuration with precise parameters to customize data extraction according to specific requirements. The input structure includes essential settings for proxy configuration, retry mechanisms, and URL specifications.

Example Input Configuration:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "max_items_per_url": 20,
  "urls": [ // Links to property list by query pages.
    "https://www.onthemarket.com/for-sale/property/shropshire/",
    "https://www.onthemarket.com/for-sale/property/burley-leeds/",
    "https://www.onthemarket.com/for-sale/property/roughley/"
  ]
}

Input Parameter Details:

• max_retries_per_url: Controls the maximum number of retry attempts for each URL when encountering network issues or temporary blocks. Setting this to 2 provides a balance between thoroughness and efficiency.

• proxy configuration: Essential for avoiding detection as an automated bot. The residential proxy group from Singapore (SG) provides reliable access while maintaining anonymity. Users should select a proxy country that aligns with their target market for optimal performance.

• max_items_per_url: Limits the number of properties extracted per search result page, allowing for controlled data collection and preventing overwhelming server requests.

• urls: Accepts OnTheMarket.com property search result URLs, including filtered searches by location, property type, price range, or other criteria available on the platform.

Input Requirements and Limitations

The scraper requires properly formatted OnTheMarket.com URLs from property search result pages. Direct property detail page URLs are not supported - only search result pages containing multiple property listings. Users must ensure URLs are accessible and contain active property listings. The tool respects rate limiting to maintain server stability and avoid triggering anti-bot measures.

Comprehensive Output Data Structure

You get the output from the Onthemarket.com Property Search Scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[ // List of property information
  {
    "features": [
      "£15,000 Key Worker savings",
      "Upgraded kitchen with selected appliances",
      "Open plan kitchen-diner",
      "Main bedroom with en suite"
    ],
    "bedrooms_text": "4",
    "images_count": 10,
    "price_qualifier": null,
    "images": [
      {
        "default": "https://media.onthemarket.com/properties/17200228/1548749805/image-0-480x320.jpg",
        "portrait?": false,
        "webp": "https://media.onthemarket.com/properties/17200228/1548749805/image-0-480x320.webp"
      },
      {
        "default": "https://media.onthemarket.com/properties/17200228/1548749805/image-1-480x320.jpg",
        "portrait?": false,
        "webp": "https://media.onthemarket.com/properties/17200228/1548749805/image-1-480x320.webp"
      },
      {
        "default": "https://media.onthemarket.com/properties/17200228/1548749805/image-2-480x320.jpg",
        "portrait?": false,
        "webp": "https://media.onthemarket.com/properties/17200228/1548749805/image-2-480x320.webp"
      },
      {
        "default": "https://media.onthemarket.com/properties/17200228/1548749805/image-3-480x320.jpg",
        "portrait?": false,
        "webp": "https://media.onthemarket.com/properties/17200228/1548749805/image-3-480x320.webp"
      },
      {
        "default": "https://media.onthemarket.com/properties/17200228/1548749805/image-4-480x320.jpg",
        "portrait?": false,
        "webp": "https://media.onthemarket.com/properties/17200228/1548749805/image-4-480x320.webp"
      }
    ],
    "new_home_flag": true,
    "online_viewing": true,
    "display_address": "INGLEBY at Hughes Meadow Milners Lane, off Concorde, Lawley, Telford TF4",
    "property_sticker": "Spotlight Property",
    "property_serp_title": "Detached house in off Concorde for sale",
    "cover_images": {
      "default": "https://media.onthemarket.com/properties/17200228/1548749805/image-0-480x320.jpg",
      "webp": "https://media.onthemarket.com/properties/17200228/1548749805/image-0-480x320.webp"
    },
    "floorplans_count": 2,
    "agent": {
      "telephone": "01952 476391",
      "name": "David Wilson Homes - Hughes Meadow",
      "details-url": "/new-homes/developers/development/hughes-meadow-70234/",
      "base-contact-url": "/agents/contact/17200228/",
      "rank": 2,
      "development?": true,
      "display-logo": {
        "url": "https://media.onthemarket.com/agents/companies/9586/190805100257723/logo-100x65.jpg",
        "height": 40,
        "width": 100,
        "resized?": true
      },
      "contact-url": "/agents/contact/17200228/?form-name=details-contact",
      "id": 70234,
      "enhanced?": false
    },
    "property_labels": [
      "New build"
    ],
    "property_title": "4 bedroom detached house for sale",
    "bedrooms": 4,
    "id": "17200228",
    "days_since_added_reduced": "Added > 14 days",
    "eb_cover_images": [
      {
        "default": "https://media.onthemarket.com/properties/17200228/1548749805/image-1-480x320.jpg",
        "url": "https://media.onthemarket.com/properties/17200228/1548749805/image-1-480x320.jpg",
        "portrait?": false,
        "webp": "https://media.onthemarket.com/properties/17200228/1548749805/image-1-480x320.webp"
      },
      {
        "default": "https://media.onthemarket.com/properties/17200228/1548749805/image-2-480x320.jpg",
        "url": "https://media.onthemarket.com/properties/17200228/1548749805/image-2-480x320.jpg",
        "portrait?": false,
        "webp": "https://media.onthemarket.com/properties/17200228/1548749805/image-2-480x320.webp"
      }
    ],
    "spotlight": true,
    "virtual_tours": true,
    "show_features": true,
    "property_link": "/details/17200228/",
    "postcode1": "TF4",
    "cover_image": "https://media.onthemarket.com/properties/17200228/1548749805/image-0-480x320.jpg",
    "location": {
      "lon": -2.470922,
      "lat": 52.672612
    },
    "address_locality": "Lawley, Telford",
    "price": "£350,000",
    "videos": true,
    "floorplans": true,
    "for_sale": true,
    "from_url": "https://www.onthemarket.com/for-sale/property/shropshire/"
  }, // ... Many other property details
]

The scraper generates structured JSON output containing extensive property information extracted from each listing. The output provides a comprehensive dataset suitable for various analytical applications and business intelligence purposes.

Output Field Explanations:

Property Identification Fields:

• ID: Unique property identifier used by OnTheMarket.com for internal tracking and URL generation
• Property Link: Direct URL to the full property details page, enabling easy access to complete listing information
• Property Title: Full property headline as displayed in search results, typically including property type and key features
• Property SERP Title: Search engine optimized title used for SEO purposes and search result displays

Location and Address Information:

• Display Address: Public-facing address information shown to potential buyers, may be partially obscured for privacy
• Address Locality: Specific area or neighborhood designation within the broader location
• Location: General geographic area or district where the property is situated
• Postcode 1: First part of the UK postcode, providing regional location context for analysis and mapping

Property Specifications:

• Bedrooms: Numerical count of bedrooms, crucial for property categorization and target market analysis
• Bedrooms Text: Descriptive bedroom information including additional details like "3 bedroom house" or "2 bed apartment"
• Features: Comprehensive list of property amenities, facilities, and special characteristics such as garden, parking, or period features
• Show Features: Boolean indicator of whether additional features are available for display

Financial Information:

• Price: Current asking price in GBP, the primary metric for market analysis and investment evaluation
• Price Qualifier: Additional price context such as "Offers Over," "Guide Price," or "Auction" providing pricing strategy insights
• For Sale: Boolean indicator confirming the property's sales status and availability

Visual Content Metrics:

• Images: Complete collection of property photographs available on the listing
• Images Count: Total number of images associated with the property, indicating listing quality and completeness
• Cover Image: Primary display image used in search results and thumbnails
• Cover Images: Collection of cover images used across different display contexts
• EB Cover Images: Enhanced or branded cover images for premium listings
• Videos: Video content associated with the property, including virtual tours or promotional videos
• Floorplans: Architectural drawings and layout diagrams when available
• Floorplans Count: Number of floorplan images or documents associated with the property

Agent and Marketing Information:

• Agent: Details of the estate agent or agency responsible for the property sale, including contact information and branding
• Property Sticker: Marketing badges or labels applied to the property such as "New," "Reduced," or "Under Offer"
• Property Labels: Additional classification tags applied to enhance property visibility and categorization
• New Home Flag: Indicator for newly built properties or new developments, important for market segmentation
• Days Since Added Reduced: Time metric showing how long since the property was added or price was reduced, valuable for market timing analysis

Enhanced Features:

• Online Viewing: Availability of virtual viewing options, increasingly important in modern property marketing
• Virtual Tours: Interactive 3D tours or 360-degree viewing experiences available for the property
• Spotlight: Premium listing enhancement indicating paid promotional placement

Implementation Guide and Best Practices

Step-by-Step Usage Instructions

Step 1: Configuration Setup Begin by configuring the input JSON with appropriate parameters for your specific data collection requirements. Set reasonable retry limits and item counts to balance thoroughness with system performance. Configure proxy settings based on your target market geography for optimal access.

Step 2: URL Preparation Gather OnTheMarket.com search result URLs that match your research criteria. Use the platform's built-in filters to narrow down property types, locations, price ranges, and other relevant parameters before inputting URLs into the scraper.

Step 3: Execution and Monitoring Launch the scraper with your configured parameters and monitor the extraction process. The tool provides real-time feedback on processing status and any encountered issues. Typical extraction times vary based on the number of properties and server response rates.

Best Practices for Optimal Results

Implement staggered execution schedules to avoid overwhelming the target server with simultaneous requests. Use residential proxies from appropriate geographic locations to maintain access reliability. Regular monitoring of extraction logs helps identify potential issues before they impact data quality.

When processing large datasets, consider breaking requests into smaller batches to improve managability and reduce the risk of incomplete extractions. Implement data validation checks to ensure extracted information meets quality standards and business requirements.

Common Issues and Solutions

Network connectivity issues may cause temporary extraction failures. The built-in retry mechanism handles most transient problems automatically. For persistent access issues, verify proxy configuration and consider adjusting request timing parameters.

Data inconsistencies occasionally occur when property listings are updated during extraction. Implement timestamp tracking and periodic re-extraction for critical datasets to maintain data currency and accuracy.

Business Value and Practical Applications

The OnTheMarket.com Property Search Scraper delivers significant time savings compared to manual data collection methods. Tasks that previously required hours or days of manual browsing can be completed in minutes, freeing up valuable resources for analysis and decision-making activities.

Real estate investors leverage the extracted data for market trend analysis, identifying undervalued properties, and tracking price movements across different areas. Property developers use comprehensive location and feature data to assess market demand and plan new developments. Estate agents utilize competitive analysis capabilities to benchmark their listings against market standards and optimize pricing strategies.

The structured data output integrates seamlessly with business intelligence tools, spreadsheet applications, and custom analysis frameworks. This compatibility enables sophisticated market analysis, automated reporting, and data-driven decision making across various real estate business functions.

Conclusion

OnTheMarket.com's position as one of the UK's most user-friendly property portals makes it an invaluable data source for real estate professionals and researchers. The OnTheMarket.com Property Search Scraper transforms this wealth of information into actionable business intelligence through automated, reliable data extraction.

Whether you're conducting market research, analyzing investment opportunities, or monitoring competitive landscapes, this specialized scraper provides the comprehensive property data needed to make informed decisions in the dynamic UK real estate market. Transform your property research capabilities today with efficient, scalable data extraction from one of the UK's leading property portals.

Related Actors

• Onthemarket.com Property Details Scraper: A specialized data extraction tool engineered to harvest detailed property information from Onthemarket's dominant Dutch real estate marketplace.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Onthemarket.com Property Search Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.