Pay $8.00 for 1,000 emails

Deep Email, Phone, & Social Media Scraper

peterasorensen/snacci

Pay $8.00 for 1,000 emails

A powerful tool that extracts emails, phone numbers, and social media profiles from any website. It intelligently navigates, prioritizing pages likely to have contact info - even deep in the site. Perfect for lead generation, market research, competitive analysis, and building contact databases.

Back to issues Create new issue

Issue with Dynamic Input Configuration in Deep Email Web Scraper Actor

Closed

dadegen87 opened this issue

Hello!

I’m using your Deep Email Web Scraper Actor to scrape emails from websites, but I’m experiencing an issue with how it handles dynamic input.

I’m sending input via TaskMagic, which extracts URLs from a database and passes them to the Actor in a JSON payload like this:

json { "input": { "websites": ["https://example.net/"] } }

While TaskMagic sends the data correctly, the Actor ignores the dynamic input and instead processes the static placeholder (http://placeholder.com) defined in the Actor’s input configuration:

json { "removeDuplicateEmails": true, "websites": ["http://placeholder.com"] }

Apify doesn’t allow leaving the websites field empty, so I used a placeholder. However, the logs show the Actor is using the placeholder instead of the URLs passed dynamically:

plaintext websites: [ 'http://placeholder.com' ] 'input.websites': [ 'https://example.net/' ]

Could you please help me understand how to make the Actor process the dynamically passed input.websites instead of the placeholder?

Thank you for your support!

dadegen87

https://console.apify.com/view/runs/HqKwCi1me24ykhTf1

peterasorensen (peterasorensen)

Hi there! Sorry for the delay here. I am unable to view your test run, as it seems to be under your private account. That being said, I'd have to guess this is a simple malformed JSON. I don't know the specifics of TaskMagic and if there's any wrappers there, but as for my own runs on this Actor, I don't need a top level "input" key. So instead of:

1{
2  "input": {
3    "removeDuplicateEmails": true,
4    "websites": [
5      "https://www.southampton.ac.uk/people"
6    ]
7  }
8}

just

1{
2  "removeDuplicateEmails": true,
3  "websites": [
4    "https://www.southampton.ac.uk/people"
5  ]
6}

sould be good enough.

peterasorensen (peterasorensen)

Closing this due to inactivity.

Add comment

Developer

peterasorensen

Actor Metrics

94 monthly users
7 bookmarks
98% runs succeeded
7.5 days response time
Created in Oct 2024
Modified a day ago

Categories

📧 Email & Contact Extractor From Any Web

easyapi/email-contact-extractor-from-any-web

A powerful web scraper that automatically extracts emails, phone numbers, and social media profiles from any website. Features deep crawling, smart retry mechanism, and advanced pattern recognition. Perfect for lead generation and contact discovery.

EasyApi

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

39k

1.1k

📩📍 Google Maps Email Extractor

lukaskrivka/google-maps-with-contact-details

Extract Google Maps contact details. Scrape websites of Google Maps places for contact details and get email addresses, website, location, address, zipcode, phone number, social media links. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Lukáš Křivka

18.5k

543

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

77.8k

1.1k

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

19k

299

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor and lead scraper to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

28.7k

344

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.6k

124

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

31.8k

787

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

27.1k

284

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

77.3k

506