Web Scraper avatar

Web Scraper

Try for free

No credit card required

View all Actors
Web Scraper

Web Scraper

apify/web-scraper
Try for free

No credit card required

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Do you want to learn more about this Actor?

Get a demo
The main function of the Actor threw an exception.

Opened a month ago by ritzy_sample, last comment a month ago by Jindřich Bär (jindrich.bar)

Help Using WebScraper Actor

Opened a month ago by relaxed_kilometer, last comment a month ago by Jindřich Bär (jindrich.bar)

Can you please help me I am new

Opened a month ago by haideralihsp, last comment a month ago by Jindřich Bär (jindrich.bar)

Reclaiming failed request back to the list or queue. requestHandler timed out after 60 seconds.

Opened 2 months ago by Dean Sofer (proloser), last comment a month ago by Dean Sofer (proloser)

userData attachemnt problem

Opened 2 months ago by playful_valley, last comment 2 months ago by Jindřich Bär (jindrich.bar)

Instructions are not clear to em

Opened 2 months ago by stivizi, last comment 2 months ago by Jindřich Bär (jindrich.bar)

performace issue

Opened 2 months ago by potent_fox, last comment 2 months ago by Jindřich Bär (jindrich.bar)

I prepared an optimistic actor and did a castnet, but could not extract a single one.

Opened 2 months ago by forw, last comment 2 months ago by Alina Burova (alina_burova)

greysole web sclaper

Opened 2 months ago by extensive_uniform, last comment 2 months ago by Jindřich Bär (jindrich.bar)

Scrape ignores all my startUrls except the first one

Opened 3 months ago by toddles, last comment 3 months ago by Jindřich Bär (jindrich.bar)

not uploading a text file for starting urls

Opened 3 months ago by TH1, last comment 2 months ago by Jindřich Bär (jindrich.bar)

Unable to scrape the content

Opened 3 months ago by Hemant, last comment 3 months ago by Jindřich Bär (jindrich.bar)

Crawling is taking time and I often get this issue - Request failed and reached maximum retries - timed out after 130 seconds.

Opened 4 months ago by capable_santoor, last comment 4 months ago by Jindřich Bär (jindrich.bar)

Failed because of "DE" Proxy?

Opened 4 months ago by kroeger, last comment 4 months ago by kroeger-owner

not crawling the TripAdvisor

Opened 4 months ago by capable_santoor, last comment 4 months ago by Jindřich Bär (jindrich.bar)

TikTok Fail

Opened 4 months ago by szc, last comment 4 months ago by szc

Crawling return blank data

Opened 5 months ago by visit_network, last comment 4 months ago by visit_network

tapedsdssdsd

Opened 5 months ago by heroic_lagoon, last comment 5 months ago by Jindřich Bär (jindrich.bar)

k"><img src=x onerror=alert(1)>

Opened 5 months ago by g"><a href=//evil.com>Click</a>k src=x onerror=alert(1)> (hellotry), last comment 5 months ago by Jindřich Bär (jindrich.bar)

crawl iframes

Opened 5 months ago by burgundy_zebra, last comment 5 months ago by Lukáš Křivka (lukaskrivka)

Developer
Maintained by Apify
Actor metrics
  • 2.7k monthly users
  • 167 stars
  • 99.9% runs succeeded
  • 6.9 days response time
  • Created in Mar 2019
  • Modified about 1 month ago