Pay $1.50 for 1,000 results

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

Pay $1.50 for 1,000 results

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

Back to issues Create new issue

Not working

Closed

saidur297 opened this issue

I was trying to collect texts from the url's but it takes a long time and cannot provide me any data at all. Please fix the issue. For your reference I am attaching my run url below.

David Deng (6SigmaG)

Can you send it again? I can't see any messages.

saidur297

I was trying to collect texts from the url's but it takes a long time and cannot provide me any data at all. Please fix the issue. For your reference I am attaching my run url below.

b4debiz2MaXCwZ1gc

David Deng (6SigmaG)

Guess you deleted it so I can't view it.

saidur297

I just resurrect it again and it's live now

Here is the run url - b4debiz2MaXCwZ1gc

David Deng (6SigmaG)

It's still inaccessible~ let me ask the Support

saidur297

Sure

David Deng (6SigmaG)

Can you check the id again?

saidur297

This is the id - b4debiz2MaXCwZ1gc

I've checked again

David Deng (6SigmaG)

I can see other user's runs but not yours, can you provide me with some url directly for testing?

I've been using this Actor for the past few days and haven't had any problems yet

saidur297

I ran it again. It's live now

Here is the run id - EM7QEb4qeHnD2goH2

Please check

David Deng (6SigmaG)

I did a test and I can see the ids used by other friends but still can't see yours ......

saidur297

I don't know what is happening but I am trying to collect data from the attached sites, I tried total 3 times with your actor but no matter how many times I tried it gives no result.

For your reference I am attaching the list of url's here below. You can run the test with my provided URL's and check.

David Deng (6SigmaG)

Thanks for the detailed feedback, I checked the content and I know what the problem was

This actor is only suitable for crawling the content of the homepage, similar to these contents you want to crawl, I found this one is more suitable: Website Content Crawler, I don't know if you have tried it?

saidur297

I tried but also failed to deliver the result.

David Deng (6SigmaG)

I tried it and I think it's an anti-crawler restriction on the other site.

saidur297

Yup, it seems so.

Add comment

Developer

David Deng

Actor metrics

21 monthly users
0 stars
100.0% runs succeeded
2.8 hours response time
Created in Oct 2024
Modified 10 days ago

Categories

Business

Lead generation

Marketing

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants API and RAG pipelines, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages from the results, and returns their cleaned content as Markdown for further processing by an LLM.

Apify

178

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

78.2k

543

📩📍 Google Maps Email Extractor

lukaskrivka/google-maps-with-contact-details

Extract Google Maps contact details. Scrape websites of Google Maps places for contact details and get email addresses, website, location, address, zipcode, phone number, social media links. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Lukáš Křivka

7.6k

167

TikTok Sound Scraper

clockworks/tiktok-sound-scraper

Scrape TikTok videos with a chosen sound. Just add one or more sound URLs and extract tiktoks that have it: URLs, likes, country of creation, video and music metadata, creator data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

184

Airbnb Scraper

tri_angle/airbnb-scraper

Scrape Airbnb rentals in your chosen destinations. Extract descriptions, locations, prices per night, ratings, reviews count, host details, amenities and more. Download scraped data in various formats including HTML, JSON and Excel.

Tri⟁angle

7.8k

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

26k

637

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

Instant web data scraper - Scrape any website

curious_coder/instant-web-scraper

Scrape any public and private website data by providing just URL and optionally cookies and proxy information. This scraper is similar to instant data scraper but runs on cloud and can be used as API too!

Curious Coder

687

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

14.6k

184

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

58k

476