Asos Search Scraper

This Apify Actor scrapes product search results from ASOS using their mobile search API. It supports pagination, retry logic, rate limiting, and structured output suitable for Apify datasets.

Features

• Search by query: Provide a search term (e.g., "boots", "summer dress").
• Robust networking: Retry logic with backoff and request timeouts.
• Rate-limited: Adds small delays to be respectful to ASOS.
• Structured output: Clean product records with stable fields.

Input Parameters

The actor accepts the following input parameters:

• q (string, required): Search query to run on ASOS.

Example input:

{
  "q": "women boots"
}

Output

Each dataset item corresponds to a product and contains:

• id: Product identifier (string)
• name: Product name (string)
• product_url: Canonical product URL on www.asos.com (string)
• img_url: Image URL (string; may be empty if unavailable)
• price: Current price (number; may be null if missing)

Example dataset item:

{
  "id": "204123456",
  "name": "ASOS DESIGN Chelsea boots in black",
  "product_url": "https://www.asos.com/asos-design/asos-design-chelsea-boots-in-black/prd/204123456",
  "img_url": "https://images.asos-media.com/products/asos-design-chelsea-boots-in-black/204123456-1-black",
  "price": 69.99
}

How it works

1. Validates the input and builds requests to ASOS search API.
2. Fetches search results with retry and timeout handling.
3. Extracts product fields and writes them to the default Apify dataset.
4. Paginates until no more products or the end is reached.

Running locally

1. Ensure you have Python 3.9+.
2. From the project root, run the actor with your input:
   • Update actors/asos-search-scraper/input.json with your query.
   • Run:

$apify run -p actors/asos-search-scraper

Notes

• The actor uses async I/O (httpx) with retry logic and short delays between page fetches.
• Field availability (e.g., price, img_url) depends on API response contents.
• The limit controls page size; total items is governed by ASOS search and may be capped.

Troubleshooting

• If you see module import warnings locally, ensure dependencies for apify-sdk (Python) and httpx are installed in your environment.
• Network-related issues may be transient; the actor already retries, but repeated failures could indicate regional or temporary API restrictions.