2 hours trial then $25.00/month - No credit card required now

Craigslist Scraper

ivanvs/craigslist-scraper

2 hours trial then $25.00/month - No credit card required now

Extract data from classified advertisements on Craigslist. Scrape contact details from jobs, housing, items wanted, items for sale, services, community service, gigs, events and resumes listed on Craigslist. Download listings data in JSON, XML, Excel, and other versatile

Back to issues Create new issue

Time out error

Closed

paomontero opened this issue

The crawler keeps on timing ou.

Ivan Vasiljević (ivanvs)

Hi CrewBloom,

Thank you for contact me, it seems that they have changed something in structure of HTML on some pages. I will take a look.

Thank you for informing me about this issue.

Ivan Vasiljević (ivanvs)

Hi CrewBloom,

I checked log and do some debugging. It seems that in general parser is working. I fixed one minor bug. The problem here is that after some time Craigslist is detecting that it is being parsed. Have you enabled Automatic proxy like I did on picture below?

That should help you with this issue. Also I have add some additional configuration so that it would be harder for the Craigslist to detect that we are scraping it.

paomontero-owner

Thanks! Will test it out now.

-- [image: Crewbloom] Jesus Paulo Montero (He/Him) Chief Technology Officer, CrewBloom

O. +1 (718) 747-8756 https://www.linkedin.com/company/crewbloom https://www.facebook.com/crewbloom/ https://www.instagram.com/crewbloom/ https://www.tiktok.com/@crewbloom https://crewbloom.com/30-minute-strategy-session/ https://crewbloom.zohodesk.com/portal/en/newticket

This email contains confidential information and is intended only for the individual to whom it is addressed.

paomontero-owner

Hi Ivan,

I am getting this error message when running your actor:

[image: image.png]

And I am not getting any results.

Kindly advise.

Thanks,

-- [image: Crewbloom] Jesus Paulo Montero (He/Him) Chief Technology Officer, CrewBloom

This email contains confidential information and is intended only for the individual to whom it is addressed.

Ivan Vasiljević (ivanvs)

Let me check what is happening with this.

Ivan Vasiljević (ivanvs)

Hi Paulo,

I checked the issue. Craigslist has changed structure of html. I have fixed the issue, I've tested quiet a few urls, and it seems that everything should work now.

Also, I've added additional field that could be interesting for you. On job posts I've managed to parse company name on pages where company name exists.

Thank you for informing me about this issue. Sorry for this inconvenience.

mr415

In the description of this actor is says contact details are available. Does that direct email address, or something different?

Ivan Vasiljević (ivanvs)

It is email address that you get when you press "Replay" button. It takes a lot of time to load this information and it is protected with captcha. So it will increase time needed to scrape page.

Add comment

Developer

Ivan Vasiljević

Actor metrics

29 monthly users
4 stars
99.8% runs succeeded
Created in Sep 2022
Modified 24 days ago

Categories

Business

Jobs

Lead generation

Craigslist Scraper (Pay Per Result)

ivanvs/craigslist-scraper-pay-per-result

Ivan Vasiljević

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

21.2k

472

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

9.8k

162

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

12.4k

129

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

51.3k

311

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

21.9k

124

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

74.7k

409

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add one or more Instagram usernames and extract number of followers&follows, URLs, bio, posts, likes, counts, related profiles, captions, highlight reels. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

34.6k

149

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

6.1k

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

18.1k