Shopify API Scraper

Shopify API Scraper

Most eCommerce stores based on Shopify platform expose RESTful API to get product data, e.g.:

• https://www.allbirds.com/products.json
• https://www.allbirds.com/collections/mens/products.json
• https://pelacase.ca/products.json
• https://pelacase.myshopify.com/products.json

Note, however, that in some cases this trick won't work with primary store domain. In that case one should inspect web site source with View Source feature of Chrome browser and look for *.myshopify.com subdomain being referenced in JavaScript code, e.g.:

Shopify.shop = "pelacase.myshopify.com";

Input example

{
  "start_urls": [
    {
      "url": "https://allbirds.com/products.json"
    }
  ]
}

Output example

This scraper outputs one row per product variant, e.g.:

{
  "product_id": 4826199687248,
  "title": "Women's Wool Runner - True Black (Cream Sole)",
  "description": "The Allbirds Wool Runner is the orginal wool sneaker that started it all. Called the world's most comfortable shoe, it's flexible, supportive, astonishingly soft, and machine washable. The Wool Runner is breathable, lightweight, and can be worn sockless. Best used for walking, cooler weather, and everyday casual wear.",
  "handle": "womens-wool-runners-true-black",
  "web_url": "https://allbirds.com/products/womens-wool-runners-true-black",
  "vendor": "Allbirds",
  "product_type": "Shoes",
  "tags": [
    "allbirds::carbon-score => 7.07",
    "allbirds::cfId => color-womens-wool-runners-true-black-cream",
    "allbirds::complete => true",
    "allbirds::edition => classic",
    "allbirds::gender => womens",
    "allbirds::hue => black",
    "allbirds::master => womens-wool-runners",
    "allbirds::material => wool",
    "allbirds::price-tier => msrp",
    "allbirds::silhouette => runner",
    "allbirdskit::kit-discount-2c1bmbSUmqIAxb6DrSxejL => 9",
    "allbirdskit::kit-id => 2c1bmbSUmqIAxb6DrSxejL",
    "allbirdskit::kit-size-2c1bmbSUmqIAxb6DrSxejL => 2",
    "loop::returnable => true",
    "shoprunner",
    "YCRF_womens-move-shoes",
    "YGroup_ygroup_womens-wool-runners"
  ],
  "images": [
    "https://cdn.shopify.com/s/files/1/1104/4168/files/WR3MTBK_SHOE_LEFT_GLOBAL_MENS_WOOL_RUNNER_TRUE_BLACK_CREAM.png?v=1751144315",
    "https://cdn.shopify.com/s/files/1/1104/4168/files/WR3MTBK_SHOE_BACK_GLOBAL_MENS_WOOL_RUNNER_TRUE_BLACK_CREAM.png?v=1751144315",
    "https://cdn.shopify.com/s/files/1/1104/4168/files/WR3MTBK_SHOE_TOP_GLOBAL_MENS_WOOL_RUNNER_TRUE_BLACK_CREAM.png?v=1751144315",
    "https://cdn.shopify.com/s/files/1/1104/4168/files/WR3MTBK_SHOE_BOTTOM_GLOBAL_MENS_WOOL_RUNNER_TRUE_BLACK_CREAM.png?v=1751144315"
  ],
  "featured_image": null,
  "variant_id": 32956153069648,
  "variant_title": "9",
  "option1": "9",
  "option2": null,
  "option3": null,
  "variant_sku": "WR3WTBK090",
  "variant_available": true,
  "price": "100.00",
  "compare_at_price": null
}

Notes

• Some of the heavily customised Shopify stores (e.g. Supreme) do not expose the API this scraper relies on.
• It is recommended to disable timeout for larger scraping jobs that span across multiple stores or cover large amount of products.