Website Content Crawler
No credit card required
Website Content Crawler
No credit card required
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.
Do you want to learn more about this Actor?
Get a demoapify_client._errors.ApifyApiError: You must rent a paid Actor in order to run it.
Closed
Prepare the Actor input
run_input = { "keywords": ["fridge"], "pages": 1, "maxRequests": 50, }
Run the Actor and wait for it to finish
run = client.actor("crafter/amazon-keyword-scraper").call(run_input=run_input)
Hi, thank you for using Apify.
Apify offers tools for web scraping and automation. We have an app store with Actors, which can be created either by Apify or by the community.
In this case, the "Website Content Crawler" was created and is maintained by Apify. However, the "crafter/amazon-keyword-scraper" tool was developed by a community member (crafter) and requires a $5 subscription fee to use. Since this Actor is not maintained by Apify but runs on the Apify platform, a subscription is required to use it.
Please note the information on console.apify.com: To use this Actor, you must pay a monthly fee to the developer. This fee is deducted from your prepaid usage each month after the free trial period. Additionally, you will incur costs for using the Apify platform.
For more information about rental Actors, you can visit: Rental Actors. These are Actors that require a recurring fee after the trial period. This fee allows developers to invest more time and effort into maintaining and improving their Actors, ensuring high quality and ongoing support.
I'll close this issue now. Please let us know if you have any further questions or concerns.
Apify- 3k monthly users
- 465 stars
- 99.9% runs succeeded
- 3.1 days response time
- Created in Mar 2023
- Modified 10 days ago
