Upwork Job Scraper avatar
Upwork Job Scraper

Pricing

$10.00/month + usage

Go to Store
Upwork Job Scraper

Upwork Job Scraper

Developed by

Matthew James

Maintained by Community

Scrape recent Upwork.com jobs with or without cookies. Fast and effective.

5.0 (1)

Pricing

$10.00/month + usage

8

Monthly users

55

Runs succeeded

>99%

Response time

8.2 hours

Last modified

17 days ago

WS

Only getting 1 job back from 6 pages

Closed

weighty_sycamore opened this issue
a month ago

Recently, I'm only getting back one job. There were some "errors" in the log from puppeteer saying it timed out waiting for job details.

This my json:

e input to new taskExport { "experienceLevel": [ "Intermediate", "Expert" ], "jobsPerPage": "10", "paymentVerified": "Yes", "scrapePages": 4, "startUrls": "https://www.upwork.com/nx/search/jobs/?q=make.com%20n8n%20automation" }

matthewjames avatar

I would suggest scraping with your Upwork cookies to get the best results, I've attached the results of the same query but with cookies.

If you would like to continue without cookies, I would suggest using the "any of these words" query, It basically makes your search query: (make.com OR n8n OR automation)

So your input would look like this:

1{
2  "experienceLevel": [
3    "Intermediate",
4    "Expert"
5  ],
6  "jobsPerPage": "10",
7  "paymentVerified": "Yes",
8  "scrapePages": 4,
9  "startUrls": "https://www.upwork.com/nx/search/jobs/?q=%28make.com%20OR%20n8n%20OR%20automation%29"
10}

But I would always recommend to add cookies for best results. Let me know how it goes!

WS

weighty_sycamore

a month ago

Thanks Matthew, that helped.

I pasted in my whole cookies from the upwork site, which is probably overkill. Are there specific ones I should be using?

matthewjames avatar

Glad to hear that!

I haven't optimized which cookies should be used or not yet. In terms of performance, there shouldn't be a negative impact.

I use all of my cookies as well (66 total values), but if I ever find out which ones are absolutely necessary I will post an update!

I'll close this issue now, feel free to reach back if you encounter any other problems, cheers!

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

2 hours

Price

$10.00