Upwork Job Auto Apply
7 days trial then $50.00/month - No credit card required now
Upwork Job Auto Apply
7 days trial then $50.00/month - No credit card required now
Pass a job application URL, Upwork login information, and messaging and automatically apply to a job. Pair with Upwork's RSS feeds to apply within minutes of a job being posted.
Timeout Error
Closed
Could you please check the below logs in order to understand what is the issur exactly. I couldn't figure it out, can you help me? Also can you provide a tutorial or docmentation about how to setup a RSS feed to apply automatically without any manuel interfrence. Please answer this ticket asap, I'm planning to buy it and use it. Thank you in advance.
2023-03-15T15:53:12.722Z ACTOR: Pulling Docker image from repository.
2023-03-15T15:53:12.835Z ACTOR: Creating Docker container.
2023-03-15T15:53:12.921Z ACTOR: Starting Docker container.
2023-03-15T15:53:13.937Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp
2023-03-15T15:53:13.938Z Executing main command
2023-03-15T15:53:14.640Z INFO System info {"apifyVersion":"1.3.4","apifyClientVersion":"1.4.2","osType":"Linux","nodeVersion":"v16.19.0"}
2023-03-15T15:53:15.290Z INFO Starting the crawl.
2023-03-15T15:53:15.401Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":0,"desiredConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}}
2023-03-15T15:53:24.010Z WARN Stealth: Evaluating hiding tricks in too many iframes (limit: 10).You might experience some performance issues. Try setting 'stealth' false
2023-03-15T15:53:24.047Z INFO Page opened. {"url":"https://www.upwork.com/ab/proposals/job/~01e9be7ebb0ea82eda/apply/"}
2023-03-15T15:53:24.063Z INFO Needs to login
2023-03-15T15:53:24.065Z INFO Logging in
2023-03-15T15:53:38.292Z INFO Handling application url
2023-03-15T15:53:54.048Z INFO Failed to accept Cookies
2023-03-15T15:54:11.296Z ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.upwork.com/ab/proposals/job/~01e9be7ebb0ea82eda/apply/","retryCount":1,"id":"UK4I29oAIjpsCgb"}
2023-03-15T15:54:11.299Z TimeoutError: waiting for selector .nav-messages ~ .nav-dropdown-account .nav-item-label failed: timeout 30000ms exceeded
2023-03-15T15:54:11.301Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-15T15:54:11.303Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-15T15:54:11.305Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-15T15:54:11.307Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-15T15:54:11.309Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-15T15:54:11.311Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-15T15:54:11.313Z at exports.handleApplication (/home/myuser/src/routes.js:145:20)
2023-03-15T15:54:11.314Z at async PuppeteerCrawler.handlePageFunction (/home/myuser/main.js:103:13)
2023-03-15T15:54:11.316Z at async PuppeteerCrawler._handleRequestFunction (/home/myuser/node_modules/apify/build/crawlers/browser_crawler.js:324:13)
2023-03-15T15:54:11.318Z at async PuppeteerCrawler._runTaskFunction (/home/myuser/node_modules/apify/build/crawlers/basic_crawler.js:425:13)
2023-03-15T15:54:15.403Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}
2023-03-15T15:54:15.446Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60157,"retryHistogram":[]}
2023-03-15T15:54:16.452Z WARN Stealth: Evaluating hiding tricks in too many iframes (limit: 10).You might experience some performance issues. Try setting 'stealth' false
2023-03-15T15:54:17.210Z INFO Page opened. {"url":"https://www.upwork.com/ab/proposals/job/~01e9be7ebb0ea82eda/apply/"}
2023-03-15T15:54:17.240Z INFO Needs to login
2023-03-15T15:54:17.242Z INFO Logging in
2023-03-15T15:54:20.015Z ACTOR: The actor run was aborted by the user.
gprosper
I'm also running into this issue
How long is your timeout set to?
gprosper
2023-03-29T05:58:05.882Z ACTOR: Pulling Docker image from repository.
2023-03-29T05:58:14.756Z ACTOR: Creating Docker container.
2023-03-29T05:58:15.385Z ACTOR: Starting Docker container.
2023-03-29T05:58:16.540Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp
2023-03-29T05:58:16.545Z Executing main command
2023-03-29T05:58:17.549Z INFO System info {"apifyVersion":"1.3.4","apifyClientVersion":"1.4.2","osType":"Linux","nodeVersion":"v16.19.0"}
2023-03-29T05:58:17.671Z DEBUG RequestList: Loaded state from key value store using the persistStateKey.
2023-03-29T05:58:18.351Z INFO Starting the crawl.
2023-03-29T05:58:18.409Z DEBUG PuppeteerCrawler:SessionPool: Recreating state from KeyValueStore {"persistStateKeyValueStoreId":"upwork-sessions","persistStateKey":"SDK_SESSION_POOL_STATE"}
2023-03-29T05:58:18.412Z DEBUG PuppeteerCrawler:SessionPool: 0 active sessions loaded from KeyValueStore
2023-03-29T05:58:18.437Z DEBUG PuppeteerCrawler:AutoscaledPool: scaling up {"oldConcurrency":1,"newConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}}
2023-03-29T05:58:18.439Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":0,"desiredConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}}
2023-03-29T05:58:18.441Z DEBUG PuppeteerCrawler:SessionPool: Created new Session - session_arlGg34dz8
2023-03-29T05:58:28.438Z DEBUG PuppeteerCrawler:AutoscaledPool: scaling up {"oldConcurrency":2,"newConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}
2023-03-29T05:58:41.345Z INFO Page opened. {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/"}
2023-03-29T05:58:41.420Z INFO Needs to login
2023-03-29T05:58:41.422Z INFO Logging in
2023-03-29T05:58:41.425Z DEBUG title: Log In to Your Account | Upwork
2023-03-29T05:58:41.427Z DEBUG Typing username
2023-03-29T05:58:42.453Z WARN Stealth: Evaluating hiding tricks in too many iframes (limit: 10).You might experience some performance issues. Try setting 'stealth' false
2023-03-29T05:58:43.744Z DEBUG Typing password
2023-03-29T05:58:53.781Z DEBUG Validating login
2023-03-29T05:59:03.782Z DEBUG No validation required
2023-03-29T05:59:03.784Z DEBUG Logging in
2023-03-29T05:59:03.909Z INFO Handling application url
2023-03-29T05:59:11.346Z INFO Failed to accept Cookies
2023-03-29T05:59:13.917Z DEBUG TimeoutError: waiting for XPath //li[contains(@class, "nav-dropdown-account")][last()]//li[contains(@class, "active")]//div[contains(text(), "Agency")] failed: timeout 10000ms exceeded
2023-03-29T05:59:17.551Z DEBUG PuppeteerCrawler:SessionPool: Persisting state {"persistStateKeyValueStoreId":"upwork-sessions","persistStateKey":"SDK_SESSION_POOL_STATE"}
2023-03-29T05:59:17.554Z DEBUG Statistics: Persisting state {"persistStateKey":"SDK_CRAWLER_STATISTICS_0"}
2023-03-29T05:59:18.439Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}
2023-03-29T05:59:18.485Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":60135,"retryHistogram":[]}
2023-03-29T05:59:18.918Z Error while refilling connects
2023-03-29T05:59:18.920Z TimeoutError: waiting for selector .fe-proposal-more-connects-needed-dialog .desktop-size-controls button failed: timeout 5000ms exceeded
2023-03-29T05:59:18.925Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T05:59:18.927Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T05:59:18.929Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T05:59:18.931Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T05:59:18.938Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T05:59:18.941Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T05:59:18.945Z at exports.handleApplication (/home/myuser/src/routes.js:202:16)
2023-03-29T05:59:18.948Z at async PuppeteerCrawler.handlePageFunction (/home/myuser/main.js:103:13)
2023-03-29T05:59:18.950Z at async PuppeteerCrawler._handleRequestFunction (/home/myuser/node_modules/apify/build/crawlers/browser_crawler.js:324:13)
2023-03-29T05:59:18.952Z at async PuppeteerCrawler._runTaskFunction (/home/myuser/node_modules/apify/build/crawlers/basic_crawler.js:425:13)
2023-03-29T05:59:18.954Z DEBUG Setting project payment method
2023-03-29T05:59:18.956Z DEBUG Setting project duration
2023-03-29T05:59:23.925Z WARN No project duration option found
2023-03-29T05:59:23.927Z DEBUG TimeoutError: waiting for selector .fe-proposal-job-estimated-duration [role="combobox"], .fe-proposal-job-estimated-duration button failed: timeout 5000ms exceeded
2023-03-29T05:59:28.929Z ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/","retryCount":1,"id":"IanfpQwPkwEddUo"}
2023-03-29T05:59:28.931Z TimeoutError: waiting for selector .cover-letter-area textarea failed: timeout 5000ms exceeded
2023-03-29T05:59:28.934Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T05:59:28.936Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T05:59:28.938Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T05:59:28.940Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T05:59:28.942Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T05:59:28.944Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T05:59:28.946Z at exports.focusAndType (/home/myuser/src/tools.js:35:20)
2023-03-29T05:59:28.948Z at runMicrotasks ()
2023-03-29T05:59:28.950Z at processTicksAndRejections (node:internal/process/task_queues:96:5)
2023-03-29T05:59:28.953Z at async exports.handleApplication (/home/myuser/src/routes.js:241:5)
2023-03-29T05:59:36.663Z INFO Page opened. {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/"}
2023-03-29T05:59:36.846Z INFO Needs to login
2023-03-29T05:59:36.848Z INFO Logging in
2023-03-29T05:59:36.930Z DEBUG title: Log In to Your Account | Upwork
2023-03-29T05:59:36.932Z DEBUG Typing username
2023-03-29T05:59:37.828Z WARN Stealth: Evaluating hiding tricks in too many iframes (limit: 10).You might experience some performance issues. Try setting 'stealth' false
2023-03-29T05:59:39.968Z DEBUG Typing password
2023-03-29T05:59:51.444Z DEBUG Validating login
2023-03-29T06:00:01.444Z DEBUG No validation required
2023-03-29T06:00:01.447Z DEBUG Logging in
2023-03-29T06:00:01.620Z INFO Handling application url
2023-03-29T06:00:06.663Z INFO Failed to accept Cookies
2023-03-29T06:00:11.624Z DEBUG TimeoutError: waiting for XPath //li[contains(@class, "nav-dropdown-account")][last()]//li[contains(@class, "active")]//div[contains(text(), "Agency")] failed: timeout 10000ms exceeded
2023-03-29T06:00:16.624Z Error while refilling connects
2023-03-29T06:00:16.627Z TimeoutError: waiting for selector .fe-proposal-more-connects-needed-dialog .desktop-size-controls button failed: timeout 5000ms exceeded
2023-03-29T06:00:16.629Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T06:00:16.631Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T06:00:16.633Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T06:00:16.635Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T06:00:16.637Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T06:00:16.639Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T06:00:16.641Z at exports.handleApplication (/home/myuser/src/routes.js:202:16)
2023-03-29T06:00:16.643Z at async PuppeteerCrawler.handlePageFunction (/home/myuser/main.js:103:13)
2023-03-29T06:00:16.645Z at async PuppeteerCrawler._handleRequestFunction (/home/myuser/node_modules/apify/build/crawlers/browser_crawler.js:324:13)
2023-03-29T06:00:16.647Z at async PuppeteerCrawler._runTaskFunction (/home/myuser/node_modules/apify/build/crawlers/basic_crawler.js:425:13)
2023-03-29T06:00:16.649Z DEBUG Setting project payment method
2023-03-29T06:00:16.651Z DEBUG Setting project duration
2023-03-29T06:00:17.551Z DEBUG PuppeteerCrawler:SessionPool: Persisting state {"persistStateKeyValueStoreId":"upwork-sessions","persistStateKey":"SDK_SESSION_POOL_STATE"}
2023-03-29T06:00:17.553Z DEBUG Statistics: Persisting state {"persistStateKey":"SDK_CRAWLER_STATISTICS_0"}
2023-03-29T06:00:18.443Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.035},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}
2023-03-29T06:00:18.485Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":120135,"retryHistogram":[]}
2023-03-29T06:00:21.632Z WARN No project duration option found
2023-03-29T06:00:21.634Z DEBUG TimeoutError: waiting for selector .fe-proposal-job-estimated-duration [role="combobox"], .fe-proposal-job-estimated-duration button failed: timeout 5000ms exceeded
2023-03-29T06:00:26.636Z ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/","retryCount":2,"id":"IanfpQwPkwEddUo"}
2023-03-29T06:00:26.638Z TimeoutError: waiting for selector .cover-letter-area textarea failed: timeout 5000ms exceeded
2023-03-29T06:00:26.641Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T06:00:26.644Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T06:00:26.646Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T06:00:26.648Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T06:00:26.650Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T06:00:26.652Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T06:00:26.655Z at exports.focusAndType (/home/myuser/src/tools.js:35:20)
2023-03-29T06:00:26.657Z at runMicrotasks ()
2023-03-29T06:00:26.659Z at processTicksAndRejections (node:internal/process/task_queues:96:5)
2023-03-29T06:00:26.661Z at async exports.handleApplication (/home/myuser/src/routes.js:241:5)
2023-03-29T06:00:34.658Z WARN Stealth: Evaluating hiding tricks in too many iframes (limit: 10).You might experience some performance issues. Try setting 'stealth' false
2023-03-29T06:00:34.738Z INFO Page opened. {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/"}
2023-03-29T06:00:34.915Z INFO Needs to login
2023-03-29T06:00:34.917Z INFO Logging in
2023-03-29T06:00:34.927Z DEBUG title: Log In to Your Account | Upwork
2023-03-29T06:00:34.930Z DEBUG Typing username
2023-03-29T06:00:37.098Z DEBUG Typing password
2023-03-29T06:00:51.334Z DEBUG Validating login
2023-03-29T06:01:01.335Z DEBUG No validation required
2023-03-29T06:01:01.338Z DEBUG Logging in
2023-03-29T06:01:01.497Z INFO Handling application url
2023-03-29T06:01:04.738Z INFO Failed to accept Cookies
2023-03-29T06:01:11.501Z DEBUG TimeoutError: waiting for XPath //li[contains(@class, "nav-dropdown-account")][last()]//li[contains(@class, "active")]//div[contains(text(), "Agency")] failed: timeout 10000ms exceeded
2023-03-29T06:01:16.502Z Error while refilling connects
2023-03-29T06:01:16.504Z TimeoutError: waiting for selector .fe-proposal-more-connects-needed-dialog .desktop-size-controls button failed: timeout 5000ms exceeded
2023-03-29T06:01:16.506Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T06:01:16.508Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T06:01:16.510Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T06:01:16.512Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T06:01:16.514Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T06:01:16.515Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T06:01:16.517Z at exports.handleApplication (/home/myuser/src/routes.js:202:16)
2023-03-29T06:01:16.519Z at async PuppeteerCrawler.handlePageFunction (/home/myuser/main.js:103:13)
2023-03-29T06:01:16.521Z at async PuppeteerCrawler._handleRequestFunction (/home/myuser/node_modules/apify/build/crawlers/browser_crawler.js:324:13)
2023-03-29T06:01:16.523Z at async PuppeteerCrawler._runTaskFunction (/home/myuser/node_modules/apify/build/crawlers/basic_crawler.js:425:13)
2023-03-29T06:01:16.525Z DEBUG Setting project payment method
2023-03-29T06:01:16.527Z DEBUG Setting project duration
2023-03-29T06:01:17.551Z DEBUG PuppeteerCrawler:SessionPool: Persisting state {"persistStateKeyValueStoreId":"upwork-sessions","persistStateKey":"SDK_SESSION_POOL_STATE"}
2023-03-29T06:01:17.554Z DEBUG Statistics: Persisting state {"persistStateKey":"SDK_CRAWLER_STATISTICS_0"}
2023-03-29T06:01:18.446Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.035},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}
2023-03-29T06:01:18.485Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":180135,"retryHistogram":[]}
2023-03-29T06:01:21.505Z WARN No project duration option found
2023-03-29T06:01:21.507Z DEBUG TimeoutError: waiting for selector .fe-proposal-job-estimated-duration [role="combobox"], .fe-proposal-job-estimated-duration button failed: timeout 5000ms exceeded
2023-03-29T06:01:26.507Z ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/","retryCount":3,"id":"IanfpQwPkwEddUo"}
2023-03-29T06:01:26.510Z TimeoutError: waiting for selector .cover-letter-area textarea failed: timeout 5000ms exceeded
2023-03-29T06:01:26.511Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T06:01:26.513Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T06:01:26.515Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T06:01:26.517Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T06:01:26.520Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T06:01:26.522Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T06:01:26.524Z at exports.focusAndType (/home/myuser/src/tools.js:35:20)
2023-03-29T06:01:26.526Z at runMicrotasks ()
2023-03-29T06:01:26.528Z at processTicksAndRejections (node:internal/process/task_queues:96:5)
2023-03-29T06:01:26.530Z at async exports.handleApplication (/home/myuser/src/routes.js:241:5)
2023-03-29T06:01:33.027Z INFO Page opened. {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/"}
2023-03-29T06:01:33.256Z INFO Needs to login
2023-03-29T06:01:33.258Z INFO Logging in
2023-03-29T06:01:33.349Z DEBUG title: Log In to Your Account | Upwork
2023-03-29T06:01:33.351Z DEBUG Typing username
2023-03-29T06:01:33.964Z WARN Stealth: Evaluating hiding tricks in too many iframes (limit: 10).You might experience some performance issues. Try setting 'stealth' false
2023-03-29T06:01:35.867Z DEBUG Typing password
2023-03-29T06:01:47.429Z DEBUG Validating login
2023-03-29T06:01:57.429Z DEBUG No validation required
2023-03-29T06:01:57.431Z DEBUG Logging in
2023-03-29T06:01:57.549Z INFO Handling application url
2023-03-29T06:02:03.027Z INFO Failed to accept Cookies
2023-03-29T06:02:07.551Z DEBUG TimeoutError: waiting for XPath //li[contains(@class, "nav-dropdown-account")][last()]//li[contains(@class, "active")]//div[contains(text(), "Agency")] failed: timeout 10000ms exceeded
2023-03-29T06:02:12.552Z Error while refilling connects
2023-03-29T06:02:12.554Z TimeoutError: waiting for selector .fe-proposal-more-connects-needed-dialog .desktop-size-controls button failed: timeout 5000ms exceeded
2023-03-29T06:02:12.556Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T06:02:12.558Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T06:02:12.560Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T06:02:12.561Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T06:02:12.563Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T06:02:12.565Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T06:02:12.567Z at exports.handleApplication (/home/myuser/src/routes.js:202:16)
2023-03-29T06:02:12.569Z at async PuppeteerCrawler.handlePageFunction (/home/myuser/main.js:103:13)
2023-03-29T06:02:12.571Z at async PuppeteerCrawler._handleRequestFunction (/home/myuser/node_modules/apify/build/crawlers/browser_crawler.js:324:13)
2023-03-29T06:02:12.572Z at async PuppeteerCrawler._runTaskFunction (/home/myuser/node_modules/apify/build/crawlers/basic_crawler.js:425:13)
2023-03-29T06:02:12.574Z DEBUG Setting project payment method
2023-03-29T06:02:12.576Z DEBUG Setting project duration
2023-03-29T06:02:17.552Z DEBUG PuppeteerCrawler:SessionPool: Persisting state {"persistStateKeyValueStoreId":"upwork-sessions","persistStateKey":"SDK_SESSION_POOL_STATE"}
2023-03-29T06:02:17.554Z DEBUG Statistics: Persisting state {"persistStateKey":"SDK_CRAWLER_STATISTICS_0"}
2023-03-29T06:02:17.557Z WARN No project duration option found
2023-03-29T06:02:17.559Z DEBUG TimeoutError: waiting for selector .fe-proposal-job-estimated-duration [role="combobox"], .fe-proposal-job-estimated-duration button failed: timeout 5000ms exceeded
2023-03-29T06:02:18.455Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":1,"desiredConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.035},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}}
2023-03-29T06:02:18.485Z INFO Statistics: PuppeteerCrawler request statistics: {"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":0,"requestsTotal":0,"crawlerRuntimeMillis":240135,"retryHistogram":[]}
2023-03-29T06:02:22.603Z ERROR Url https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/ failed
gprosper
The failure is at
2023-03-29T05:59:18.920Z TimeoutError: waiting for selector .fe-proposal-more-connects-needed-dialog .desktop-size-controls button failed: timeout 5000ms exceeded
gprosper
How do I set the timeout?
In Input -> Options
gprosper
Isn't that the run timeout? The issue seems to be a PuppeteerCrawler timeout waiting for html elements to appear.
gprosper
I'm getting the error with timeout = 0
ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.upwork.com/ab/proposals/job/~01792c185ef33e27e2/apply/","retryCount":2,"id":"pmp4ZGscKAxp4u5"}
2023-03-29T21:06:14.198Z TimeoutError: waiting for selector .cover-letter-area textarea failed: timeout 5000ms exceeded
2023-03-29T21:06:14.199Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T21:06:14.200Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T21:06:14.201Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T21:06:14.202Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T21:06:14.202Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T21:06:14.203Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T21:06:14.204Z at exports.focusAndType (/home/myuser/src/tools.js:35:20)
2023-03-29T21:06:14.204Z at runMicrotasks ()
2023-03-29T21:06:14.205Z at processTicksAndRejections (node:internal/process/task_queues:96:5)
2023-03-29T21:06:14.206Z at async exports.handleApplication (/home/myuser/src/routes.js:241:5)
https://www.upwork.com/ab/proposals/job/~01792c185ef33e27e2/apply/
If you open the URL, the job was removed. This is why you're getting an error with this job.
gprosper
You're right about that one. But this 2nd one is active
ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/","retryCount":3,"id":"IanfpQwPkwEddUo"}
2023-03-29T21:12:04.050Z TimeoutError: waiting for selector .cover-letter-area textarea failed: timeout 5000ms exceeded
2023-03-29T21:12:04.051Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34)
2023-03-29T21:12:04.051Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26)
2023-03-29T21:12:04.052Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77)
2023-03-29T21:12:04.053Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29)
2023-03-29T21:12:04.053Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51)
2023-03-29T21:12:04.054Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33)
2023-03-29T21:12:04.054Z at exports.focusAndType (/home/myuser/src/tools.js:35:20)
2023-03-29T21:12:04.055Z at runMicrotasks ()
2023-03-29T21:12:04.056Z at processTicksAndRejections (node:internal/process/task_queues:96:5)
Is this every run, or a few runs?
In a sample size of 20, I had 17 succeed and 3 fail.
gprosper
One sec I think I might know why
gprosper
{ "username": "gregoryprosper@gmail.com", "password": "[Redacted]", "testMode": true, "debugMode": true, "startUrls": [ { "url": "https://www.upwork.com/ab/proposals/job/~01717f434986da189c/apply/" } ], "coverLetter": "Hello,\r\n\r\nI'd love to assist you with your development needs.\r\n\r\nIf you'd like to know more about me. Let me start by saying, I love to build things! I'm the type of developer that needs to know how everything works. There's not a single line of code that I write, and I don't understand why it's there. I've personally built four apps across iOS & Android and manage them daily. You can find more info on them in the links below. I know what it takes to bring an idea from conception to reality. I've put in the late-night hours fixing bugs even though I have to be at my day job in the morning, where I also build apps. 😆\r\n\r\nStyles4Nailz\r\nhttps://styles4nailz.com\r\n\r\nHaitian Creole Bible \r\nhttps://creolebible.com\r\n\r\nFamily Frame\r\nhttps://play.google.com/store/apps/details?id=com.duvemessenger.familyframe\r\n\r\nBranded Pix\r\nhttps://play.google.com/store/apps/details?id=com.palmbeachsoftware.brandedpix\r\n\r\nI would love to use my experiences from my day job as a Senior Software Developer as well as my experience as an Entrepreneur/Developer to help you bring your ideas to life.\r\n\r\nAn important note is that I currently hold a full-time Android Developer position so I'm looking for something part-time. You can find links to more projects that I've contributed to on my LinkedIn.\r\n\r\nhttps://www.linkedin.com/in/gprosper\r\n\r\n– Gregory P.", "defaultAnswer": "Let's get on a call and discuss.", "securityQuestion": "Toyota Corolla", "autoRefill": false, "autoRefillAmount": "10", "ignoreDuplicateProposals": true }
gprosper
Does anything seem off?
You should add a proxy
Here's a sample query of a successful call
{ "username": "patrick@big-brain.co", "password": "redacted", "startUrls": [{ "url": "https://www.upwork.com/ab/proposals/job/~01d44f3f2429b9703e/apply/#/", "method": "GET" }], "coverLetter": "Hi, Great to connect! I am an expert in data and automation and can help with your lead generation. A few things I can do: - Get thousands of email addresses from Linkedin every day. - Email sequences where if someone clicks on a link in a sales email, they automatically get a Linkedin connection request from you. - Personalize Linkedin outreach at scale. For example, someone with a marketing title gets one message and someone with an operations title gets a different message. Comment on where they went to school, a skill they have, or mention a shared connection - without even opening their Linkedin profile yourself. - Build a fully automated newsletter that finds new content, curates it for relevancy, formats it into a templated format and sends it out to your subscribers on a weekly basis. No need for a human. That’s just the beginning! Don’t hire anyone who can just write an email, hire me and I’ll show you what’s possible. Pick a time that works to connect: https://www.big-brain.co/contact Patrick", "defaultAnswer": "Let's get on a call.", "securityQuestion": "redacted", "proxyConfig": { "useApifyProxy": true, "apifyProxyGroups": [ "qfCaFFuCodXxAS59E" ] }, "debugMode": true, "testMode": false, "agency": "", "freelancer": "Patrick Hoban", "autoRefill": true, "autoRefillAmount": "100", "ignoreDuplicateProposals": false }
gprosper
Got it!!!! Verification by device was on
Great!
Big Brain
