3 days trial then $15.00/month - No credit card required now

Articles Extractor

web.harvester/articles-extractor

3 days trial then $15.00/month - No credit card required now

A fast and powerful tool for extracting article data from URLs. It uses advanced scraping techniques to parse HTML and extract relevant information such as the article title, author, publication date, and content. Download your data in any format (JSON, CSV, XML, RSS, HTML Table).

Start URLs

startUrlsarrayOptional

List of Article URLs to extract

Default value of this property is []

Save article HTML

saveArticleHtmlbooleanOptional

If checked, it saves only the article section of the HTML for each article.

Default value of this property is false

Save full page HTML

savePageHtmlbooleanOptional

If checked, it saves the whole HTML for each article.

Default value of this property is false

(New!) Use new content parser

newContentParserbooleanOptional

If checked, it uses the new content parser. If unchecked, it uses the old one.

Default value of this property is false

Custom headers

customHeadersobjectOptional

Custom headers to be added to each request.

Proxy configuration

proxyConfigurationobjectOptional

This is required if you want to use Apify Proxy.

Default value of this property is {"useApifyProxy":true}

Developer

Web Harvester

Actor metrics

28 monthly users
9 stars
100.0% runs succeeded
Created in Jun 2023
Modified 8 days ago

Categories

News

SEO tools

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

Article Text Extractor

mtrunkat/article-text-extractor

Simply extracts article texts and other meta info from the given URL. Uses https://github.com/ageitgey/node-unfluff which is a NodeJS implementation of https://github.com/grangier/python-goose.

Marek Trunkát

912

YouTube Full Channel Transcripts Extractor

karamelo/youtube-full-channel-transcripts-extractor

With only the channel link You can extract 1 to 1000s of all the transcripts of a channel, be it videos or shorts or streams/lives or even podcasts and playlists, you name it. Get all the transcripts/captions organized with video ID and title in a nice table or JSON or CSV to download.

karamelo

Allrecipes Advanced Scraper

epctex/allrecipes-advanced-scraper

Advanced scraping on Allrecipes for data on millions of recipes, articles, galleries, and many more. Crawl Recipes and extract descriptions, images, steps, ingredients, nutrition, and all other properties. You can specify search terms, filters, mappings, and much more.

epctex

Tasty Scraper

epctex/tasty-scraper

Gather data on millions of recipes, articles, and compilations. Extract descriptions, images, ingredients, videos, and more. Customize your searches with filters for targeted results.

epctex

New York Times Scraper

theo/new-york-times-scraper

Scrape news data from nytimes.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

148

BBC Scraper

theo/bbc-scraper

Scrape news data from bbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

CNBC Scraper

maria.f/cnbc-scraper

Scrape news data from cnbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Mariachiara Faraon

Washington Post Scraper

theo/washington-post-scraper

Scrape news data from washingtonpost.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

AP News Scraper

theo/ap-news-scraper

Scrape news data from apnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

How to extract and download news articles online

Python web scraping tutorial (Step-by-step guide for 2024)

The definitive guide to text scraping

Build new tools

Are you a developer? Build your own Actors and run them on Apify.

Learn more

Get a custom solution

Get a custom web scraping or RPA solution.

Book a demo

Articles Extractor

Articles Extractor

Start URLs

Save article HTML

Save full page HTML

(New!) Use new content parser

Custom headers