Upwork Scraper Without Stale Job Posts
Pricing
$9.99/month + usage
Upwork Scraper Without Stale Job Posts
Comes without any stale data like many other scrapers do. Low cost and efficient. Can filter out duplicates and posts older than 24h
5.0 (1)
Pricing
$9.99/month + usage
15
Monthly users
45
Runs succeeded
95%
Response time
3.8 days
Last modified
19 days ago
Number of results and duplicates
Closed
Hi, I like your Upwork scraper the best because it allows for multiple search URLs. Every run only pulls 20 results (I ran two search URLs and it seems to give 10 for each). I want to run the scraper twice per day and add the results to Airtable through a Make scenario. Is it possible to filter duplicates or only pull results that are new since the last run? Also, how does the scraper choose which results to pull? I assumed it was only the most recent (search filter is sorted by 'newest') but some results are from a week ago. Thanks for your help. Again, I think this has the potential to be the best Upwork scraper on Apify,
Hey. Thank you for the kind comments. As for the amount of results - it is specified via the url you provide. E.g: https://www.upwork.com/nx/search/jobs/?per_page=50&q=python%20developer&sort=recency -- provides 50 results (per_page=50) and sorts by recency (&sort=recency). 10,20 and 50 are the options for the per_page= parameter. I'll see what I can do in regards to the duplicates. As for only pulling new results, this logic you would have to implement on your end. Hope this helped.
alligator.crawl
Great, that's clear, thanks for explaining!
version 0.0, build 0.0.25 (latest) now has the option to remove duplicates
Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
2 hours
Price
$9.99
