3 days trial then $15.00/month - No credit card required now

Articles Extractor

web.harvester/articles-extractor

3 days trial then $15.00/month - No credit card required now

A fast and powerful tool for extracting article data from URLs. It uses advanced scraping techniques to parse HTML and extract relevant information such as the article title, author, publication date, and content. Download your data in any format (JSON, CSV, XML, RSS, HTML Table).

Back to issues Create new issue

Some valid article content not being scraped

Open

releasd opened this issue

In this article the last two paragraphs of text are not extracted: https://www.sussexexpress.co.uk/news/people/father-and-daughter-team-up-at-bellway-development-in-crawley-4379088

The extracted text ends with "£455,000 and £605,000 respectively."

The following two paragraphs are missed:

"To find out more about the development, visit https://www.bellway.co.uk/new-homes/south-london/riverbrook-place or call the sales team on 01293 306782.

To find out more about careers with Bellway, visit https://www.bellwaycareers.co.uk/."

Why would this text not be scraped?

Thanks

Add comment

Developer

Web Harvester

Actor metrics

28 monthly users
9 stars
100.0% runs succeeded
Created in Jun 2023
Modified 8 days ago

Categories

News

SEO tools

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

Article Text Extractor

mtrunkat/article-text-extractor

Simply extracts article texts and other meta info from the given URL. Uses https://github.com/ageitgey/node-unfluff which is a NodeJS implementation of https://github.com/grangier/python-goose.

Marek Trunkát

912

YouTube Full Channel Transcripts Extractor

karamelo/youtube-full-channel-transcripts-extractor

With only the channel link You can extract 1 to 1000s of all the transcripts of a channel, be it videos or shorts or streams/lives or even podcasts and playlists, you name it. Get all the transcripts/captions organized with video ID and title in a nice table or JSON or CSV to download.

karamelo

Allrecipes Advanced Scraper

epctex/allrecipes-advanced-scraper

Advanced scraping on Allrecipes for data on millions of recipes, articles, galleries, and many more. Crawl Recipes and extract descriptions, images, steps, ingredients, nutrition, and all other properties. You can specify search terms, filters, mappings, and much more.

epctex

Tasty Scraper

epctex/tasty-scraper

Gather data on millions of recipes, articles, and compilations. Extract descriptions, images, ingredients, videos, and more. Customize your searches with filters for targeted results.

epctex

New York Times Scraper

theo/new-york-times-scraper

Scrape news data from nytimes.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

148

BBC Scraper

theo/bbc-scraper

Scrape news data from bbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

CNBC Scraper

maria.f/cnbc-scraper

Scrape news data from cnbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Mariachiara Faraon

Washington Post Scraper

theo/washington-post-scraper

Scrape news data from washingtonpost.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

AP News Scraper

theo/ap-news-scraper

Scrape news data from apnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis