No credit card required

Web Scraper Experimental Debug

mtrunkat/web-scraper-experimental-dbgr

No credit card required

Experimental version of Apify Web Scraper with Chrome debugger integrated

You can access the Web Scraper Experimental Debug programmatically from your own applications by using the Apify API. You can choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1echo '{
2  "startUrls": [
3    {
4      "url": "https://apify.com"
5    }
6  ],
7  "pseudoUrls": [
8    {
9      "purl": "https://apify.com[(/[\\\\w-]+)?]"
10    }
11  ],
12  "linkSelector": "a",
13  "pageFunction": "async function pageFunction(context) {\\n    // See README for context properties. If the syntax is unfamiliar see the link\\n    // https://javascript.info/destructuring-assignment#object-destructuring\\n    const { request, log, jQuery } = context;\\n\\n    // To be able to use jQuery as $, one needs save it into a variable\\n    // and select the inject jQuery option. We'\''ve selected it for you.\\n    const $ = jQuery;\\n    const title = $('\''title'\'').text();\\n\\n    // This is yet another new feature of Javascript called template strings.\\n    // https://javascript.info/string#quotes\\n    log.info(`URL: ${request.url} TITLE: ${title}`);\\n\\n    // To save data just return an object with the requested properties.\\n    return {\\n        url: request.url,\\n        title\\n    };\\n}",
14  "proxyConfiguration": {
15    "useApifyProxy": false
16  },
17  "initialCookies": [],
18  "waitUntil": [
19    "networkidle2"
20  ],
21  "customData": {}
22}' |
23apify call mtrunkat/web-scraper-experimental-dbgr --silent --output-dataset

Web Scraper Experimental Debug API through CLI

The Apify CLI is the official tool that allows you to use Web Scraper Experimental Debug locally, providing convenience functions and automatic retries on errors.

Install the Apify CLI

1npm i -g apify-cli
2apify login

Other API clients include:

Web Scraper Experimental Debug API in Python

Web Scraper Experimental Debug API in JavaScript

Web Scraper Experimental Debug API

Developer

Marek Trunkát

Actor metrics

2 monthly users
3 stars
100.0% runs succeeded
Created in Oct 2019
Modified over 3 years ago

Categories

Developer examples

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

21.2k

472

Youtube Transcript Scraper

topaz_sharingan/Youtube-Transcript-Scraper

Are you in search of a robust solution for extracting transcripts from YouTube videos? Look no further 😉, YouTube-Transcript-Scraper will meet your needs. Our software not only efficiently retrieves transcripts but also provides additional valuable information .👍 😀 Scrap away 🕵‍♂️.

Moses Bilal

499

Example Image Download

lukaskrivka/download-image

Download a single image from a URL and store it into a key-value store.

Lukáš Křivka

137

Example Live View

apify/example-live-view

This example demonstrates how to use web server in actor as communication channel with outer world. Read more at Apify docs https://docs.apify.com/actors/running#container-web-server

Apify

Example Sitemap Cheerio

jancurn/example-sitemap-cheerio

An example actor that first downloads a sitemap in XML format and the crawls each page from the sitemap using the fast CheerioCrawler from Apify SDK.

Jan Čurn

Example Secret Input

apify/example-secret-input

This Apify actor showcases how to use secret fields in the actor input.

Apify

YouTube Channels Video Scraper

topaz_sharingan/YouTube-Video-Scraper

YouTube Channels Video Scraper is a powerful and user-friendly tool designed to extract valuable data from YouTube channels. This actor allows you to effortlessly collect detailed information about YouTube Videos from a Channel, including video IDs, titles, URLs, views, likes, published times, etc.

Moses Bilal