Scrape search results from Bing.com. You can get the total number of results, organic results, paid results, people also ask, related queries and more.
How many results to fetch on each page. More results per page can speed up total crawl time but may take longer per request.
Default value of this property is 10
Max pages per search
maxPagesPerQueryintegerOptional
Maximum number of pages to retrieve for each query.
Default value of this property is 1
Market
marketCodeEnumOptional
Select the market for your search results. You can also use a lowercase country code (e.g. "us"), which will be automatically mapped to the appropriate market code (e.g. "en-US").
Store the raw HTML of each results page in the output. Useful for debugging or custom parsing, but increases dataset size.
Default value of this property is false
Save HTML snapshot URLs to output
saveHtmlSnapshotUrlsbooleanOptional
Save each page's HTML to the key-value store and include snapshot URLs in the output.
Default value of this property is false
Ignore soft blocking
ignoreSoftBlockingbooleanOptional
If enabled, the crawler creates a single request for the first page and does not retry on soft blocked results. If disabled, the crawler will try to detect soft blocking and automatically retry. It will also create multiple requests for the first page with different extra URL parameters until it obtains a full, valid response. This may significantly increase runtime due to multiple attempts.