Work Scraper avatar

Work Scraper

Try for free

7 days trial then $40.00/month - No credit card required now

View all Actors
Work Scraper

Work Scraper

trudax/work-scraper
Try for free

7 days trial then $40.00/month - No credit card required now

Extract data from the top freelancing websites. Search by URL or search terms, filter by categories, English level, and hourly rate. Get info about freelancers and agencies without login. Download your data as an HTML table, JSON, CSV, Excel, or XML.

IP

Search parameters don't work.

Closed

immense_plate opened this issue
a year ago

I wanted to filter jobs by keywords, I tried several options but nothing works. Examples: 1. run_input = { "maxItems": 5, "useBuiltInSearch" : True,
"Search" : "NVIDIA, nvidia, Nvidia", "proxy": { "useApifyProxy": True }, }

run_input = { "startUrls": ["https://www.upwork.com/nx/jobs/search/?q=NVIDIA"], "maxItems": 5, "proxy": { "useApifyProxy": True },

trudax avatar

You should be able to do it by passing "nvidia" just once on the search term. Can you share your failed run with me so I can take a look at the logs?

IP

immense_plate

a year ago
  1. run_id: auyl5eII88x59wviF

code: """ from apify_client import ApifyClient

Initialize the ApifyClient with your API token

client = ApifyClient("apify_api")

Prepare the actor input

Input is not valid: Values in input.startUrls at positions [0] must match

regular expression "^$|https://www.upwork.com/(search|hire|o/profiles/users|nx/jobs/search)/.*" run_input = { "maxItems": 5, "useBuiltInSearch" : True, "Search" : "nvidia", "searchFor": "job", }

Run the actor and wait for it to finish

run = client.actor("trudax/upwork-scraper").call(run_input=run_input) """ The results are not relevan with Search filter.

The only successful trial with one results (out of 41) was: run_id: 0Lfds7I0mmkJvjScd I used "startUrls": ["https://www.upwork.com/nx/jobs/search/?q=NVIDIA"]. You can check that there are 41 results for this search

IP

immense_plate

a year ago

I found a work around: I found that on web-site searches there is U.S. only / non-U.S. only. (I haven't seen it before) . When I use it in my search web query - it works.

"startUrls": [" https://www.upwork.com/nx/jobs/search/?q=NVIDIA&sort=recency&user_location_match=2 "], but it didn't work separate parameters, like that one: "useBuiltInSearch" : True, "Search" : "nvidia", "searchFor": "job"

trudax avatar

Right, Upwork has some restrictions when in the US. You can try to use a different country in the proxy settings or use your login credentials to scrape. Upwork will return more results if you are logged in.

Developer
Maintained by Community
Actor metrics
  • 15 monthly users
  • 5 stars
  • 98.8% runs succeeded
  • 2.4 days response time
  • Created in Jun 2020
  • Modified 4 months ago
Categories