No credit card required

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

No credit card required

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

phantom js is not loading page

Closed

kashif_ghafoor opened this issue

I am loading this page in phantomjs https://www.meetup.com/find/?source=EVENTS&location=us--ny--New%20York&eventType=inPerson

But I am not getting expected results. There is difference when I use document.querySelectorAll('a[data-event-label="Event card"]').length This query selects 21 in my browser. But when I log this in phantomjs it logs 0.

kashif_ghafoor

I think this is the problem that's why on crawl of this page there is not URL in queue

Andrey Bykov (Andrey_Bykov)

Hey there! PhantomJS development stopped in 2018, which is almost 5 years ago. Sadly, PhantomJS does not work reliably with modern websites... I could only suggest using the Web Scraper instead (same as my colleague Lukas already recommended on discord).

Add comment

Developer

Apify

Actor metrics

122 monthly users
21 stars
100.0% runs succeeded
20 days response time
Created in Mar 2019
Modified 3 months ago

Categories

Developer tools

For creators

Send Legacy PhantomJS Crawler Results

drobnikj/send-crawler-results

This actor downloads results from Legacy PhantomJS Crawler task and sends them to email as attachments. It is designed to run from finish webhook.

Jakub Drobník

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

21.2k

472

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

68.6k

170

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.2k

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.2k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

1.1k

Monitoring Reporter Dashboard

apify/monitoring-reporter-dashboard

The monitoring reporter dashboard is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

759