30 minutes trial then $10.00/month - No credit card required now

Domain Scraper

ib4ngz/domain-scraper

30 minutes trial then $10.00/month - No credit card required now

This actor scrapes unique domains from a list of provided URLs. It crawls each page, extracts domains, and stores them in a dataset. The actor respects a defined maximum depth and filters domains based on whether they are ICANN-approved and whether private domains are allowed.

You can access the Domain Scraper programmatically from your own JavaScript applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "startUrls": [
12        {
13            "url": "https://apify.com"
14        }
15    ],
16    "crawlerType": "Crawlee + Cheerio"
17};
18
19// Run the Actor and wait for it to finish
20const run = await client.actor("ib4ngz/domain-scraper").call(input);
21
22// Fetch and print Actor results from the run's dataset (if any)
23console.log('Results from dataset');
24console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
25const { items } = await client.dataset(run.defaultDatasetId).listItems();
26items.forEach((item) => {
27    console.dir(item);
28});
29
30// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Domain Scraper API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Domain Scraper API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

npm install apify-client

Other API clients include:

Domain Scraper API in Python

Domain Scraper API through CLI

Domain Scraper OpenAPI definition

Domain Scraper API

Developer

Iqbal R

Actor Metrics

5 monthly users
1 bookmark
>99% runs succeeded
Created in Dec 2024
Modified 2 months ago

Categories

Domain.com.au Scraper

scrapemind/Domaincomau-Scraper

Unlock Comprehensive Real Estate Data from Domain.com.au Discover a wealth of information from Domain.com.au's vast property listings. Effortlessly extract detailed descriptions, high-quality images, unique features, and essential property details.

ScrapeMind

Expired Domains Scraper

ib4ngz/expired-domains-scraper

This actor scrapes expired domain data from expireddomains.net, supporting user authentication with optional multi-factor authentication (MFA). It also allows users to apply filters for targeted domain scraping.

Iqbal R

Expired Domains Scraper

martin1080p/expired-domains-scraper

The Expired Domains Scraper automates finding valuable expired domains from expireddomains.com, offering filters and sorting by SEO metrics and auction details for efficient domain acquisition.

Martin Fanta

Advanced Website Domain Name Validator

saswave/advanced-website-domain-name-validator

Advanced domain scraper. Determine if a domain is still valid or has moved. We test multiple scenario before flagging the domain as invalid. Extract technologies stack, social account, emails

SASWAVE

Similarweb Scraper

tri_angle/similarweb-scraper

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

Tri⟁angle

2.7k

Social Media Contact Scraper

easyapi/social-media-contact-scraper

🕵️‍♂️ Supercharge your lead generation with our Social Media Contact Scraper! Extract emails, phone numbers, and social media profiles from websites effortlessly. Customizable depth, domain control, and stealth mode for efficient and ethical scraping. Build your contact database today! 📧📞🌐

EasyApi

Godaddy Auctions Scraper

scraper-mind/godaddy-auctions-scraper

[𝗖𝗵𝗲𝗮𝗽𝗲𝘀𝘁 𝗣𝗿𝗶𝗰𝗲] Godaddy Auctions Scraper: scrape real-time domain auctions data from GoDaddy.com with our scraper. Export data in JSON or CSV for easy use. Ideal for domain investors, SEOs, and market researchers to uncover valuable opportunities and trends effortlessly.

Scraper Mind

🔥Apollo Scraper - Scrape upto 50k Leads

code_crafter/apollo-io-scraper

Scrape up to 50,000 leads per search URL.

Code Pioneer

14k

537

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

77.9k

528

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

55.2k

398