Under maintenance

Pricing

Pay per event

Try for free

Go to Store

Dynamic Web Scraper

Under maintenance

Try for free

Developed by

Pepa <b>J</b>

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.

0.0 (0)

Pricing

Pay per event

Monthly users

Runs succeeded

>99%

Last modified

a month ago

Automation

Open source

Start Sources

startSourcesarrayRequired

Sources to start with, could be .

Prompt

promptstringRequired

Prompt to evaluate on content.

Max Depth

maxDepthintegerOptional

Maximum depth to scrape.

Default value of this property is 3

Pricing

Pricing model

Pay per event

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Start the actor

$0.010

Start the actor

ChatGPT API call

$0.010

Performing a request to CHAT GPT API

Pushing to Dataset

$0.010

Pushing To Dataset

Web Scraper Task

undrtkr984/web-scraper-task

Matt

108

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

79.9k

DataDome Web Scraper

ecomscrape/datadome-web-scraper

DataDome Web Scraper extracts data from DataDome-protected websites. You can customize parameters such as proxies, timeouts, and JavaScript execution, making it ideal for reports, spreadsheets, and applications.

ecomscrape

Dynamic Markdown Scraper

louisdeconinck/dynamic-markdown-scraper

Effortlessly feed LLM AIs with clean Markdown using our advanced web scraper. Seamlessly scrape dynamic, JavaScript-rendered websites while preserving original formatting. Ideal for AI training, documentation, and content migration.

Louis Deconinck

Instant web data scraper - Scrape any website

curious_coder/instant-web-scraper

Scrape any public and private website data by providing just URL and optionally cookies and proxy information. This scraper is similar to instant data scraper but runs on cloud and can be used as API too!

Curious Coder

1.1k

Browser Use Apify

lexis-solutions/browser-use-apify

Open-source AI-powered browser automation based on browser-use and hosted on Apify. Run any task using Apify's platform and LLMs like ChatGPT, Claude, etc. Easy, scalable, resilient, and hosted solution for web-enabled AI agents.

Lexis Solutions

Ai Web Scraper - Extract Data With Ease

eloquent_mountain/ai-web-scraper-extract-data-with-ease

Ai Web Scraper enables scraping for everyone, including non-techies! It uses Google's Gemini LLM to scrape websites with natural language commands. It dynamically extracts data, no selector input needed, handles dynamic content and cookie consent, avoids bot detection, outputs JSON or other formats.

Paco

228

Cloudflare Web Scraper

dtrungtin/cloudflare-web-scraper

Prevents Puppeteer from being detected as a bot in services like Cloudflare and allows you to pass captchas without any problems

Tin Duong

AI Markdown Web Scraper

jordanchalupka/ai-markdown-web-scraper

Turn any webpage into a clean markdown format. Perfect to use as input to your LLM.

Jordan

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

6.1k