LinkedIn Ad Library Scraper

Hi! I am unfortunately unable to reproduce the issues you describe. Could you please share the exact input you are using? Searching for "apple" as follows yields me hundreds of results: { "startUrl": "https://www.linkedin.com/ad-library/search?accountOwner=apple&countries=US&dateOption=last-30-days" }

Ok but try running that and view the results - empty

I do see the results properly, none of them is empty at all. Please confirm that you are running the scraper with 4096MB memory and no timeout and try again.

Here are the logs: 2024-01-29T18:37:13.844Z ACTOR: Pulling Docker image of build mrdrwQn2JIz1e5YQl from repository. 2024-01-29T18:37:40.457Z ACTOR: Creating Docker container. 2024-01-29T18:37:40.776Z ACTOR: Starting Docker container. 2024-01-29T18:37:43.069Z INFO System info {"apifyVersion":"3.1.12","apifyClientVersion":"2.8.1","crawleeVersion":"3.5.8","osType":"Linux","nodeVersion":"v18.18.2"} 2024-01-29T18:37:43.074Z DEBUG Events initialized 2024-01-29T18:37:43.075Z DEBUG Default storages purged 2024-01-29T18:37:43.767Z DEBUG PlaywrightCrawler:SessionPool: No 'persistStateKeyValueStoreId' options specified, this session pool's data has been saved in the KeyValueStore with the id: Mvzb1YXYO2krdNzvM 2024-01-29T18:37:43.883Z INFO PlaywrightCrawler: Starting the crawler. 2024-01-29T18:37:43.901Z DEBUG PlaywrightCrawler:AutoscaledPool: scaling up {"oldConcurrency":1,"newConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2024-01-29T18:37:43.930Z DEBUG PlaywrightCrawler:SessionPool: Created new Session - session_Pccz1hXfPz 2024-01-29T18:37:43.935Z DEBUG PlaywrightCrawler:SessionPool: Created new Session - session_chmhzcQNnI 2024-01-29T18:37:46.458Z DEBUG PlaywrightCrawler: Page opened. {"url":"https://www.linkedin.com/ad-library/search?accountOwner=apple&countries=US&dateOption=last-30-days"} 2024-01-29T18:37:46.459Z DEBUG Enqueueing pagination: https://www.linkedin.com/ad-library/search?accountOwner=apple&countries=US&dateOption=last-30-days 2024-01-29T18:37:47.357Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":24,"linkCountLastScroll":0} 2024-01-29T18:37:49.422Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":48,"linkCountLastScroll":24} 2024-01-29T18:37:49.849Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":48,"linkCountLastScroll":48} 2024-01-29T18:37:50.850Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":72,"linkCountLastScroll":48} 2024-01-29T18:37:51.683Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":72,"linkCountLastScroll":72} 2024-01-29T18:37:52.139Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":72,"linkCountLastScroll":72} 2024-01-29T18:37:52.440Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":72,"linkCountLastScroll":72} 2024-01-29T18:37:53.884Z DEBUG PlaywrightCrawler: Crawled 0/1 pages, 0 failed requests. 2024-01-29T18:37:53.903Z DEBUG PlaywrightCrawler:AutoscaledPool: scaling up {"oldConcurrency":2,"newConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.328},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2024-01-29T18:37:54.239Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":96,"linkCountLastScroll":72} 2024-01-29T18:37:55.807Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":96,"linkCountLastScroll":96} 2024-01-29T18:37:59.009Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":120,"linkCountLastScroll":96} 2024-01-29T18:38:03.885Z DEBUG PlaywrightCrawler: Crawled 0/1 pages, 0 failed requests. 2024-01-29T18:38:03.903Z DEBUG PlaywrightCrawler:AutoscaledPool: scaling down {"oldConcurrency":3,"newConcurrency":2,"systemStatus":{"isSystemIdle":false,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":true,"limitRatio":0.4,"actualRatio":0.689},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2024-01-29T18:38:03.905Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":144,"linkCountLastScroll":120} 2024-01-29T18:38:09.148Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":168,"linkCountLastScroll":144} 2024-01-29T18:38:09.852Z ACTOR: The Actor run was aborted by the user. 2024-01-29T18:37:13.844Z ACTOR: Pulling Docker image of build mrdrwQn2JIz1e5YQl from repository. 2024-01-29T18:37:40.457Z ACTOR: Creating Docker container. 2024-01-29T18:37:40.776Z ACTOR: Starting Docker container. 2024-01-29T18:37:43.069Z INFO System info {"apifyVersion":"3.1.12","apifyClientVersion":"2.8.1","crawleeVersion":"3.5.8","osType":"Linux","nodeVersion":"v18.18.2"} 2024-01-29T18:37:43.074Z DEBUG Events initialized 2024-01-29T18:37:43.075Z DEBUG Default storages purged 2024-01-29T18:37:43.767Z DEBUG PlaywrightCrawler:SessionPool: No 'persistStateKeyValueStoreId' options specified, this session pool's data has been saved in the KeyValueStore with the id: Mvzb1YXYO2krdNzvM 2024-01-29T18:37:43.883Z INFO PlaywrightCrawler: Starting the crawler. 2024-01-29T18:37:43.901Z DEBUG PlaywrightCrawler:AutoscaledPool: scaling up {"oldConcurrency":1,"newConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2024-01-29T18:37:43.930Z DEBUG PlaywrightCrawler:SessionPool: Created new Session - session_Pccz1hXfPz 2024-01-29T18:37:43.935Z DEBUG PlaywrightCrawler:SessionPool: Created new Session - session_chmhzcQNnI 2024-01-29T18:37:46.458Z DEBUG PlaywrightCrawler: Page opened. {"url":"https://www.linkedin.com/ad-library/search?accountOwner=apple&countries=US&dateOption=last-30-days"} 2024-01-29T18:37:46.459Z DEBUG Enqueueing pagination: https://www.linkedin.com/ad-library/search?accountOwner=apple&countries=US&dateOption=last-30-days 2024-01-29T18:37:47.357Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":24,"linkCountLastScroll":0} 2024-01-29T18:37:49.422Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":48,"linkCountLastScroll":24} 2024-01-29T18:37:49.849Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":48,"linkCountLastScroll":48} 2024-01-29T18:37:50.850Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":72,"linkCountLastScroll":48} 2024-01-29T18:37:51.683Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":72,"linkCountLastScroll":72} 2024-01-29T18:37:52.139Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":72,"linkCountLastScroll":72} 2024-01-29T18:37:52.440Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":72,"linkCountLastScroll":72} 2024-01-29T18:37:53.884Z DEBUG PlaywrightCrawler: Crawled 0/1 pages, 0 failed requests. 2024-01-29T18:37:53.903Z DEBUG PlaywrightCrawler:AutoscaledPool: scaling up {"oldConcurrency":2,"newConcurrency":3,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":0.328},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2024-01-29T18:37:54.239Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":96,"linkCountLastScroll":72} 2024-01-29T18:37:55.807Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":96,"linkCountLastScroll":96} 2024-01-29T18:37:59.009Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":120,"linkCountLastScroll":96} 2024-01-29T18:38:03.885Z DEBUG PlaywrightCrawler: Crawled 0/1 pages, 0 failed requests. 2024-01-29T18:38:03.903Z DEBUG PlaywrightCrawler:AutoscaledPool: scaling down {"oldConcurrency":3,"newConcurrency":2,"systemStatus":{"isSystemIdle":false,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":0},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":0},"cpuInfo":{"isOverloaded":true,"limitRatio":0.4,"actualRatio":0.689},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":0}}} 2024-01-29T18:38:03.905Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":144,"linkCountLastScroll":120} 2024-01-29T18:38:09.148Z DEBUG Will keep scrolling to load the next pages. {"currentLinkCount":168,"linkCountLastScroll":144} 2024-01-29T18:38:09.852Z ACTOR: The Actor run was aborted by the user.

From my most recent run https://console.apify.com/actors/AdwCDVyhFcWXQF9tg/runs/ZEv9daxdgiGbOQ8Ex#log

Thanks for sharing! It looks like you have aborted the execution after 57s: "2024-01-29T18:38:09.852Z ACTOR: The Actor run was aborted by the user."

You need to allow the actor to run for longer and it will eventually start spitting results.