# Similarweb Scraper (`epctex/similarweb-scraper`)

The most comprehensive Similarweb Scraper you will ever find. Obtain data on website popularity and receive it in formats such as JSON, XML, CSV, Excel, or an HTML table.

- **URL**: https://beta-securitybyobscurity.apify.com/epctex/similarweb-scraper.md
- **Developed by:** [epctex](https://beta-securitybyobscurity.apify.com/epctex) (community)
- **Categories:** SEO tools
- **Stats:** 296 total users, 23 monthly users, 100.0% runs succeeded, 9 bookmarks
- **User rating**: No ratings yet

## Pricing

$15.00/month + usage

To use this Actor, you pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period.
You also pay for the Apify platform usage, which gets cheaper the higher Apify subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#rental-actors

# README

## Actor - Similarweb Scraper

### Similarweb scraper

The most comprehensive Similarweb Scraper you will ever find. Obtain data on website popularity and receive it in formats such as JSON, XML, CSV, Excel, or an HTML table. Each scrape allows you to gather the subsequent details:

- Information on the company
- Metrics including total visits, average pages viewed, average time spent, and rate of visitors leaving quickly
- Rankings based on popularity (worldwide/by nation/by category)
- Origins of web traffic (like advertisements, direct links, search engines, social media, and more)
- Spread across social media platforms
- Rival websites
- Technologies implemented
- Demographic breakdown by age and gender
- Trending subjects and websites for users
- Leading visitor countries

### Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests you can create an issue from [here](https://github.com/epctex-support/similarweb-scraper/issues).

### Input Parameters

The input of this scraper should be JSON containing the list of pages on Similarweb that should be visited. Required fields are:

- `websites`: (Required) (Array) Domains or Similarweb full URLs that you want to retrieve the results from right away!

- `proxy`: (Required) (Proxy Object) Proxy configuration.

This solution requires the use of **Proxy servers**, either your own proxy servers or you can use [Apify Proxy](https://www.apify.com/docs/proxy).

#### Compute Unit Consumption

The actor is optimized to run blazing fast and scrape as many items as possible. Therefore, it forefronts all the detailed requests. If the actor doesn't block very often it'll scrape 100 websites in 2 minutes with ~0.02-0.05 compute units. (depending on proxy and number of retries).

#### Similarweb Scraper Input example

```json
{
  "websites": [
    "apify.com",
    "https://www.similarweb.com/website/example.com"
  ],
  "disableAnalytics": true,
  "proxy": {
    "useApifyProxy": true
  }
}

```

### During the Run

During the run, the actor will output messages letting you know what is going on. Each message always contains a short label specifying which page from the provided list is currently specified.
When items are loaded from the page, you should see a message about this event with a loaded item count and total item count for each page.

If you provide incorrect input to the actor, it will immediately stop with a failure state and output an explanation of what is wrong.

### Similarweb Export

During the run, the actor stores results into a dataset. Each item is a separate item in the dataset.

You can manage the results in any language (Python, PHP, Node JS/NPM). See the FAQ or <a href="https://www.apify.com/docs/api" target="blank">our API reference</a> to learn more about getting results from this Similarweb actor.

### Scraped Similarweb Properties

The structure of each item in Similarweb looks like this:

#### Item Detail

```json
{
	"Version": 1,
	"SiteName": "example.com",
	"Description": "",
	"TopCountryShares": [
		{
			"Country": 840,
			"CountryCode": "US",
			"Value": 0.11354659048803241
		},
		{
			"Country": 356,
			"CountryCode": "IN",
			"Value": 0.05341031007321983
		},
		{
			"Country": 392,
			"CountryCode": "JP",
			"Value": 0.03574842291398093
		},
		{
			"Country": 484,
			"CountryCode": "MX",
			"Value": 0.03247891294972819
		},
		{
			"Country": 76,
			"CountryCode": "BR",
			"Value": 0.031913874935595374
		}
	],
	"Title": "example domain",
	"Engagments": {
		"BounceRate": "0.6223348449483417",
		"Month": "10",
		"Year": "2024",
		"PagePerVisit": "2.2632025657133092",
		"Visits": "5072880",
		"TimeOnSite": "142.22218157397137"
	},
	"EstimatedMonthlyVisits": {
		"2024-08-01": 3598093,
		"2024-09-01": 3226856,
		"2024-10-01": 5072880
	},
	"GlobalRank": {
		"Rank": 15284
	},
	"CountryRank": {
		"Country": 840,
		"CountryCode": "US",
		"Rank": 23373
	},
	"CategoryRank": {
		"Rank": "513",
		"Category": "Computers_Electronics_and_Technology/Programming_and_Developer_Software"
	},
	"GlobalCategoryRank": null,
	"IsSmall": false,
	"Policy": 0,
	"TrafficSources": {
		"Social": 0.014411548636691814,
		"Paid Referrals": 0.01161774451691237,
		"Mail": 0.0006026721631872139,
		"Referrals": 0.20649697855611643,
		"Search": 0.1637504482738934,
		"Direct": 0.6031206053675295
	},
	"Category": "computers_electronics_and_technology/programming_and_developer_software",
	"LargeScreenshot": "https://site-images.similarcdn.com/image?url=example.com&t=1&s=1&h=b63fbdb6c1a27c3f1467398b04fb81fcac694d85223c8a8eb2ca7c3e276b4af8",
	"IsDataFromGa": false,
	"Countries": [
		{
			"Code": "AF",
			"UrlCode": "afghanistan",
			"Name": "Afghanistan"
		},
		{
			"Code": "AX",
			"UrlCode": "land-islands",
			"Name": "Åland Islands"
		},
		{
			"Code": "AL",
			"UrlCode": "albania",
			"Name": "Albania"
		},
		{
			"Code": "DZ",
			"UrlCode": "algeria",
			"Name": "Algeria"
		},
		{
			"Code": "AS",
			"UrlCode": "american-samoa",
			"Name": "American Samoa"
		},
		{
			"Code": "AD",
			"UrlCode": "andorra",
			"Name": "Andorra"
		},
		{
			"Code": "AO",
			"UrlCode": "angola",
			"Name": "Angola"
		},
		{
			"Code": "AI",
			"UrlCode": "anguilla",
			"Name": "Anguilla"
		},
		{
			"Code": "AQ",
			"UrlCode": "antarctica",
			"Name": "Antarctica"
		},
		{
			"Code": "AG",
			"UrlCode": "antigua-and-barbuda",
			"Name": "Antigua and Barbuda"
		},
		{
			"Code": "AR",
			"UrlCode": "argentina",
			"Name": "Argentina"
		},
		{
			"Code": "AM",
			"UrlCode": "armenia",
			"Name": "Armenia"
		},
		{
			"Code": "AW",
			"UrlCode": "aruba",
			"Name": "Aruba"
		},
		{
			"Code": "AU",
			"UrlCode": "australia",
			"Name": "Australia"
		},
		{
			"Code": "AT",
			"UrlCode": "austria",
			"Name": "Austria"
		},
		{
			"Code": "AZ",
			"UrlCode": "azerbaijan",
			"Name": "Azerbaijan"
		},
		{
			"Code": "BS",
			"UrlCode": "bahamas",
			"Name": "Bahamas"
		},
		{
			"Code": "BH",
			"UrlCode": "bahrain",
			"Name": "Bahrain"
		},
		{
			"Code": "BD",
			"UrlCode": "bangladesh",
			"Name": "Bangladesh"
		},
		{
			"Code": "BB",
			"UrlCode": "barbados",
			"Name": "Barbados"
		},
		{
			"Code": "BY",
			"UrlCode": "belarus",
			"Name": "Belarus"
		},
		{
			"Code": "BE",
			"UrlCode": "belgium",
			"Name": "Belgium"
		},
		{
			"Code": "BZ",
			"UrlCode": "belize",
			"Name": "Belize"
		},
		{
			"Code": "BJ",
			"UrlCode": "benin",
			"Name": "Benin"
		},
		{
			"Code": "BM",
			"UrlCode": "bermuda",
			"Name": "Bermuda"
		},
		{
			"Code": "BT",
			"UrlCode": "bhutan",
			"Name": "Bhutan"
		},
		{
			"Code": "BO",
			"UrlCode": "bolivia-plurinational-state-of",
			"Name": "Bolivia"
		},
		{
			"Code": "BQ",
			"UrlCode": "bonaire-sint-eustatius-and-saba",
			"Name": "Bonaire, Sint Eustatius and Saba"
		},
		{
			"Code": "BA",
			"UrlCode": "bosnia-and-herzegovina",
			"Name": "Bosnia and Herzegovina"
		},
		{
			"Code": "BW",
			"UrlCode": "botswana",
			"Name": "Botswana"
		},
		{
			"Code": "BV",
			"UrlCode": "bouvet-island",
			"Name": "Bouvet Island"
		},
		{
			"Code": "BR",
			"UrlCode": "brazil",
			"Name": "Brazil"
		},
		{
			"Code": "IO",
			"UrlCode": "british-indian-ocean-territory",
			"Name": "British Indian Ocean Territory"
		},
		{
			"Code": "BN",
			"UrlCode": "brunei-darussalam",
			"Name": "Brunei Darussalam"
		},
		{
			"Code": "BG",
			"UrlCode": "bulgaria",
			"Name": "Bulgaria"
		},
		{
			"Code": "BF",
			"UrlCode": "burkina-faso",
			"Name": "Burkina Faso"
		},
		{
			"Code": "BI",
			"UrlCode": "burundi",
			"Name": "Burundi"
		},
		{
			"Code": "CV",
			"UrlCode": "cabo-verde",
			"Name": "Cabo Verde"
		},
		{
			"Code": "KH",
			"UrlCode": "cambodia",
			"Name": "Cambodia"
		},
		{
			"Code": "CM",
			"UrlCode": "cameroon",
			"Name": "Cameroon"
		},
		{
			"Code": "CA",
			"UrlCode": "canada",
			"Name": "Canada"
		},
		{
			"Code": "KY",
			"UrlCode": "cayman-islands",
			"Name": "Cayman Islands"
		},
		{
			"Code": "CF",
			"UrlCode": "central-african-republic",
			"Name": "Central African Republic"
		},
		{
			"Code": "TD",
			"UrlCode": "chad",
			"Name": "Chad"
		},
		{
			"Code": "CL",
			"UrlCode": "chile",
			"Name": "Chile"
		},
		{
			"Code": "CN",
			"UrlCode": "china",
			"Name": "China"
		},
		{
			"Code": "CX",
			"UrlCode": "christmas-island",
			"Name": "Christmas Island"
		},
		{
			"Code": "CC",
			"UrlCode": "cocos-keeling-islands",
			"Name": "Cocos (Keeling) Islands"
		},
		{
			"Code": "CO",
			"UrlCode": "colombia",
			"Name": "Colombia"
		},
		{
			"Code": "KM",
			"UrlCode": "comoros",
			"Name": "Comoros"
		},
		{
			"Code": "CG",
			"UrlCode": "congo",
			"Name": "Congo"
		},
		{
			"Code": "CD",
			"UrlCode": "congo-the-democratic-republic-of-the",
			"Name": "Congo, the Democratic Republic of the"
		},
		{
			"Code": "CK",
			"UrlCode": "cook-islands",
			"Name": "Cook Islands"
		},
		{
			"Code": "CR",
			"UrlCode": "costa-rica",
			"Name": "Costa Rica"
		},
		{
			"Code": "CI",
			"UrlCode": "cte-divoire",
			"Name": "Côte d'Ivoire"
		},
		{
			"Code": "HR",
			"UrlCode": "croatia",
			"Name": "Croatia"
		},
		{
			"Code": "CU",
			"UrlCode": "cuba",
			"Name": "Cuba"
		},
		{
			"Code": "CW",
			"UrlCode": "curaao",
			"Name": "Curaçao"
		},
		{
			"Code": "CY",
			"UrlCode": "cyprus",
			"Name": "Cyprus"
		},
		{
			"Code": "CZ",
			"UrlCode": "czech-republic",
			"Name": "Czech Republic"
		},
		{
			"Code": "DK",
			"UrlCode": "denmark",
			"Name": "Denmark"
		},
		{
			"Code": "DJ",
			"UrlCode": "djibouti",
			"Name": "Djibouti"
		},
		{
			"Code": "DM",
			"UrlCode": "dominica",
			"Name": "Dominica"
		},
		{
			"Code": "DO",
			"UrlCode": "dominican-republic",
			"Name": "Dominican Republic"
		},
		{
			"Code": "EC",
			"UrlCode": "ecuador",
			"Name": "Ecuador"
		},
		{
			"Code": "EG",
			"UrlCode": "egypt",
			"Name": "Egypt"
		},
		{
			"Code": "SV",
			"UrlCode": "el-salvador",
			"Name": "El Salvador"
		},
		{
			"Code": "GQ",
			"UrlCode": "equatorial-guinea",
			"Name": "Equatorial Guinea"
		},
		{
			"Code": "ER",
			"UrlCode": "eritrea",
			"Name": "Eritrea"
		},
		{
			"Code": "EE",
			"UrlCode": "estonia",
			"Name": "Estonia"
		},
		{
			"Code": "ET",
			"UrlCode": "ethiopia",
			"Name": "Ethiopia"
		},
		{
			"Code": "FK",
			"UrlCode": "falkland-islands-malvinas",
			"Name": "Falkland Islands (Malvinas)"
		},
		{
			"Code": "FO",
			"UrlCode": "faroe-islands",
			"Name": "Faroe Islands"
		},
		{
			"Code": "FJ",
			"UrlCode": "fiji",
			"Name": "Fiji"
		},
		{
			"Code": "FI",
			"UrlCode": "finland",
			"Name": "Finland"
		},
		{
			"Code": "FR",
			"UrlCode": "france",
			"Name": "France"
		},
		{
			"Code": "GF",
			"UrlCode": "french-guiana",
			"Name": "French Guiana"
		},
		{
			"Code": "PF",
			"UrlCode": "french-polynesia",
			"Name": "French Polynesia"
		},
		{
			"Code": "TF",
			"UrlCode": "french-southern-territories",
			"Name": "French Southern Territories"
		},
		{
			"Code": "GA",
			"UrlCode": "gabon",
			"Name": "Gabon"
		},
		{
			"Code": "GM",
			"UrlCode": "gambia",
			"Name": "Gambia"
		},
		{
			"Code": "GE",
			"UrlCode": "georgia",
			"Name": "Georgia"
		},
		{
			"Code": "DE",
			"UrlCode": "germany",
			"Name": "Germany"
		},
		{
			"Code": "GH",
			"UrlCode": "ghana",
			"Name": "Ghana"
		},
		{
			"Code": "GI",
			"UrlCode": "gibraltar",
			"Name": "Gibraltar"
		},
		{
			"Code": "GR",
			"UrlCode": "greece",
			"Name": "Greece"
		},
		{
			"Code": "GL",
			"UrlCode": "greenland",
			"Name": "Greenland"
		},
		{
			"Code": "GD",
			"UrlCode": "grenada",
			"Name": "Grenada"
		},
		{
			"Code": "GP",
			"UrlCode": "guadeloupe",
			"Name": "Guadeloupe"
		},
		{
			"Code": "GU",
			"UrlCode": "guam",
			"Name": "Guam"
		},
		{
			"Code": "GT",
			"UrlCode": "guatemala",
			"Name": "Guatemala"
		},
		{
			"Code": "GG",
			"UrlCode": "guernsey",
			"Name": "Guernsey"
		},
		{
			"Code": "GN",
			"UrlCode": "guinea",
			"Name": "Guinea"
		},
		{
			"Code": "GW",
			"UrlCode": "guinea-bissau",
			"Name": "Guinea-Bissau"
		},
		{
			"Code": "GY",
			"UrlCode": "guyana",
			"Name": "Guyana"
		},
		{
			"Code": "HT",
			"UrlCode": "haiti",
			"Name": "Haiti"
		},
		{
			"Code": "HM",
			"UrlCode": "heard-island-and-mcdonald-islands",
			"Name": "Heard Island and McDonald Islands"
		},
		{
			"Code": "VA",
			"UrlCode": "holy-see-vatican-city-state",
			"Name": "Holy See (Vatican City State)"
		},
		{
			"Code": "HN",
			"UrlCode": "honduras",
			"Name": "Honduras"
		},
		{
			"Code": "HK",
			"UrlCode": "hong-kong",
			"Name": "Hong Kong"
		},
		{
			"Code": "HU",
			"UrlCode": "hungary",
			"Name": "Hungary"
		},
		{
			"Code": "IS",
			"UrlCode": "iceland",
			"Name": "Iceland"
		},
		{
			"Code": "IN",
			"UrlCode": "india",
			"Name": "India"
		},
		{
			"Code": "ID",
			"UrlCode": "indonesia",
			"Name": "Indonesia"
		},
		{
			"Code": "IR",
			"UrlCode": "iran-islamic-republic-of",
			"Name": "Iran"
		},
		{
			"Code": "IQ",
			"UrlCode": "iraq",
			"Name": "Iraq"
		},
		{
			"Code": "IE",
			"UrlCode": "ireland",
			"Name": "Ireland"
		},
		{
			"Code": "IM",
			"UrlCode": "isle-of-man",
			"Name": "Isle of Man"
		},
		{
			"Code": "IL",
			"UrlCode": "israel",
			"Name": "Israel"
		},
		{
			"Code": "IT",
			"UrlCode": "italy",
			"Name": "Italy"
		},
		{
			"Code": "JM",
			"UrlCode": "jamaica",
			"Name": "Jamaica"
		},
		{
			"Code": "JP",
			"UrlCode": "japan",
			"Name": "Japan"
		},
		{
			"Code": "JE",
			"UrlCode": "jersey",
			"Name": "Jersey"
		},
		{
			"Code": "JO",
			"UrlCode": "jordan",
			"Name": "Jordan"
		},
		{
			"Code": "KZ",
			"UrlCode": "kazakhstan",
			"Name": "Kazakhstan"
		},
		{
			"Code": "KE",
			"UrlCode": "kenya",
			"Name": "Kenya"
		},
		{
			"Code": "KI",
			"UrlCode": "kiribati",
			"Name": "Kiribati"
		},
		{
			"Code": "KP",
			"UrlCode": "korea-democratic-peoples-republic-of",
			"Name": "Korea, Democratic People's Republic of"
		},
		{
			"Code": "KR",
			"UrlCode": "korea-republic-of",
			"Name": "Korea, Republic of"
		},
		{
			"Code": "KW",
			"UrlCode": "kuwait",
			"Name": "Kuwait"
		},
		{
			"Code": "KG",
			"UrlCode": "kyrgyzstan",
			"Name": "Kyrgyzstan"
		},
		{
			"Code": "LA",
			"UrlCode": "lao-peoples-democratic-republic",
			"Name": "Lao People's Democratic Republic"
		},
		{
			"Code": "LV",
			"UrlCode": "latvia",
			"Name": "Latvia"
		},
		{
			"Code": "LB",
			"UrlCode": "lebanon",
			"Name": "Lebanon"
		},
		{
			"Code": "LS",
			"UrlCode": "lesotho",
			"Name": "Lesotho"
		},
		{
			"Code": "LR",
			"UrlCode": "liberia",
			"Name": "Liberia"
		},
		{
			"Code": "LY",
			"UrlCode": "libya",
			"Name": "Libya"
		},
		{
			"Code": "LI",
			"UrlCode": "liechtenstein",
			"Name": "Liechtenstein"
		},
		{
			"Code": "LT",
			"UrlCode": "lithuania",
			"Name": "Lithuania"
		},
		{
			"Code": "LU",
			"UrlCode": "luxembourg",
			"Name": "Luxembourg"
		},
		{
			"Code": "MO",
			"UrlCode": "macao",
			"Name": "Macao"
		},
		{
			"Code": "MK",
			"UrlCode": "macedonia-the-former-yugoslav-republic-of",
			"Name": "Macedonia (FYROM)"
		},
		{
			"Code": "MG",
			"UrlCode": "madagascar",
			"Name": "Madagascar"
		},
		{
			"Code": "MW",
			"UrlCode": "malawi",
			"Name": "Malawi"
		},
		{
			"Code": "MY",
			"UrlCode": "malaysia",
			"Name": "Malaysia"
		},
		{
			"Code": "MV",
			"UrlCode": "maldives",
			"Name": "Maldives"
		},
		{
			"Code": "ML",
			"UrlCode": "mali",
			"Name": "Mali"
		},
		{
			"Code": "MT",
			"UrlCode": "malta",
			"Name": "Malta"
		},
		{
			"Code": "MH",
			"UrlCode": "marshall-islands",
			"Name": "Marshall Islands"
		},
		{
			"Code": "MQ",
			"UrlCode": "martinique",
			"Name": "Martinique"
		},
		{
			"Code": "MR",
			"UrlCode": "mauritania",
			"Name": "Mauritania"
		},
		{
			"Code": "MU",
			"UrlCode": "mauritius",
			"Name": "Mauritius"
		},
		{
			"Code": "YT",
			"UrlCode": "mayotte",
			"Name": "Mayotte"
		},
		{
			"Code": "MX",
			"UrlCode": "mexico",
			"Name": "Mexico"
		},
		{
			"Code": "FM",
			"UrlCode": "micronesia-federated-states-of",
			"Name": "Micronesia, Federated States of"
		},
		{
			"Code": "MD",
			"UrlCode": "moldova-republic-of",
			"Name": "Moldova"
		},
		{
			"Code": "MC",
			"UrlCode": "monaco",
			"Name": "Monaco"
		},
		{
			"Code": "MN",
			"UrlCode": "mongolia",
			"Name": "Mongolia"
		},
		{
			"Code": "ME",
			"UrlCode": "montenegro",
			"Name": "Montenegro"
		},
		{
			"Code": "MS",
			"UrlCode": "montserrat",
			"Name": "Montserrat"
		},
		{
			"Code": "MA",
			"UrlCode": "morocco",
			"Name": "Morocco"
		},
		{
			"Code": "MZ",
			"UrlCode": "mozambique",
			"Name": "Mozambique"
		},
		{
			"Code": "MM",
			"UrlCode": "myanmar",
			"Name": "Myanmar"
		},
		{
			"Code": "NA",
			"UrlCode": "namibia",
			"Name": "Namibia"
		},
		{
			"Code": "NR",
			"UrlCode": "nauru",
			"Name": "Nauru"
		},
		{
			"Code": "NP",
			"UrlCode": "nepal",
			"Name": "Nepal"
		},
		{
			"Code": "NL",
			"UrlCode": "netherlands",
			"Name": "Netherlands"
		},
		{
			"Code": "AN",
			"UrlCode": "netherlands-antilles",
			"Name": "Netherlands Antilles"
		},
		{
			"Code": "NC",
			"UrlCode": "new-caledonia",
			"Name": "New Caledonia"
		},
		{
			"Code": "NZ",
			"UrlCode": "new-zealand",
			"Name": "New Zealand"
		},
		{
			"Code": "NI",
			"UrlCode": "nicaragua",
			"Name": "Nicaragua"
		},
		{
			"Code": "NE",
			"UrlCode": "niger",
			"Name": "Niger"
		},
		{
			"Code": "NG",
			"UrlCode": "nigeria",
			"Name": "Nigeria"
		},
		{
			"Code": "NU",
			"UrlCode": "niue",
			"Name": "Niue"
		},
		{
			"Code": "AP",
			"UrlCode": "non-spec-asia-pas-location",
			"Name": "Non-spec Asia Pas Location"
		},
		{
			"Code": "NF",
			"UrlCode": "norfolk-island",
			"Name": "Norfolk Island"
		},
		{
			"Code": "MP",
			"UrlCode": "northern-mariana-islands",
			"Name": "Northern Mariana Islands"
		},
		{
			"Code": "NO",
			"UrlCode": "norway",
			"Name": "Norway"
		},
		{
			"Code": "OM",
			"UrlCode": "oman",
			"Name": "Oman"
		},
		{
			"Code": "PK",
			"UrlCode": "pakistan",
			"Name": "Pakistan"
		},
		{
			"Code": "PW",
			"UrlCode": "palau",
			"Name": "Palau"
		},
		{
			"Code": "PS",
			"UrlCode": "palestine-state-of",
			"Name": "Palestine"
		},
		{
			"Code": "PA",
			"UrlCode": "panama",
			"Name": "Panama"
		},
		{
			"Code": "PG",
			"UrlCode": "papua-new-guinea",
			"Name": "Papua New Guinea"
		},
		{
			"Code": "PY",
			"UrlCode": "paraguay",
			"Name": "Paraguay"
		},
		{
			"Code": "PE",
			"UrlCode": "peru",
			"Name": "Peru"
		},
		{
			"Code": "PH",
			"UrlCode": "philippines",
			"Name": "Philippines"
		},
		{
			"Code": "PN",
			"UrlCode": "pitcairn",
			"Name": "Pitcairn"
		},
		{
			"Code": "PL",
			"UrlCode": "poland",
			"Name": "Poland"
		},
		{
			"Code": "PT",
			"UrlCode": "portugal",
			"Name": "Portugal"
		},
		{
			"Code": "PR",
			"UrlCode": "puerto-rico",
			"Name": "Puerto Rico"
		},
		{
			"Code": "QA",
			"UrlCode": "qatar",
			"Name": "Qatar"
		},
		{
			"Code": "RE",
			"UrlCode": "runion",
			"Name": "Réunion"
		},
		{
			"Code": "RO",
			"UrlCode": "romania",
			"Name": "Romania"
		},
		{
			"Code": "RU",
			"UrlCode": "russian-federation",
			"Name": "Russia"
		},
		{
			"Code": "RW",
			"UrlCode": "rwanda",
			"Name": "Rwanda"
		},
		{
			"Code": "BL",
			"UrlCode": "saint-barthlemy",
			"Name": "Saint Barthélemy"
		},
		{
			"Code": "SH",
			"UrlCode": "saint-helena-ascension-and-tristan-da-cunha",
			"Name": "Saint Helena, Ascension and Tristan da Cunha"
		},
		{
			"Code": "KN",
			"UrlCode": "saint-kitts-and-nevis",
			"Name": "Saint Kitts and Nevis"
		},
		{
			"Code": "LC",
			"UrlCode": "saint-lucia",
			"Name": "Saint Lucia"
		},
		{
			"Code": "MF",
			"UrlCode": "saint-martin-french-part",
			"Name": "Saint Martin (French part)"
		},
		{
			"Code": "PM",
			"UrlCode": "saint-pierre-and-miquelon",
			"Name": "Saint Pierre and Miquelon"
		},
		{
			"Code": "VC",
			"UrlCode": "saint-vincent-and-the-grenadines",
			"Name": "Saint Vincent and the Grenadines"
		},
		{
			"Code": "WS",
			"UrlCode": "samoa",
			"Name": "Samoa"
		},
		{
			"Code": "SM",
			"UrlCode": "san-marino",
			"Name": "San Marino"
		},
		{
			"Code": "ST",
			"UrlCode": "sao-tome-and-principe",
			"Name": "Sao Tome and Principe"
		},
		{
			"Code": "SA",
			"UrlCode": "saudi-arabia",
			"Name": "Saudi Arabia"
		},
		{
			"Code": "SN",
			"UrlCode": "senegal",
			"Name": "Senegal"
		},
		{
			"Code": "RS",
			"UrlCode": "serbia",
			"Name": "Serbia"
		},
		{
			"Code": "CS",
			"UrlCode": "serbia-and-montenegro",
			"Name": "SERBIA AND MONTENEGRO"
		},
		{
			"Code": "SC",
			"UrlCode": "seychelles",
			"Name": "Seychelles"
		},
		{
			"Code": "SL",
			"UrlCode": "sierra-leone",
			"Name": "Sierra Leone"
		},
		{
			"Code": "SG",
			"UrlCode": "singapore",
			"Name": "Singapore"
		},
		{
			"Code": "SX",
			"UrlCode": "sint-maarten-dutch-part",
			"Name": "Sint Maarten (Dutch part)"
		},
		{
			"Code": "SK",
			"UrlCode": "slovakia",
			"Name": "Slovakia"
		},
		{
			"Code": "SI",
			"UrlCode": "slovenia",
			"Name": "Slovenia"
		},
		{
			"Code": "SB",
			"UrlCode": "solomon-islands",
			"Name": "Solomon Islands"
		},
		{
			"Code": "SO",
			"UrlCode": "somalia",
			"Name": "Somalia"
		},
		{
			"Code": "ZA",
			"UrlCode": "south-africa",
			"Name": "South Africa"
		},
		{
			"Code": "GS",
			"UrlCode": "south-georgia-and-the-south-sandwich-islands",
			"Name": "South Georgia and the South Sandwich Islands"
		},
		{
			"Code": "SS",
			"UrlCode": "south-sudan",
			"Name": "South Sudan"
		},
		{
			"Code": "ES",
			"UrlCode": "spain",
			"Name": "Spain"
		},
		{
			"Code": "LK",
			"UrlCode": "sri-lanka",
			"Name": "Sri Lanka"
		},
		{
			"Code": "SD",
			"UrlCode": "sudan",
			"Name": "Sudan"
		},
		{
			"Code": "SR",
			"UrlCode": "suriname",
			"Name": "Suriname"
		},
		{
			"Code": "SJ",
			"UrlCode": "svalbard-and-jan-mayen",
			"Name": "Svalbard and Jan Mayen"
		},
		{
			"Code": "SZ",
			"UrlCode": "swaziland",
			"Name": "Swaziland"
		},
		{
			"Code": "SE",
			"UrlCode": "sweden",
			"Name": "Sweden"
		},
		{
			"Code": "CH",
			"UrlCode": "switzerland",
			"Name": "Switzerland"
		},
		{
			"Code": "SY",
			"UrlCode": "syrian-arab-republic",
			"Name": "Syrian Arab Republic"
		},
		{
			"Code": "TW",
			"UrlCode": "taiwan",
			"Name": "Taiwan"
		},
		{
			"Code": "TJ",
			"UrlCode": "tajikistan",
			"Name": "Tajikistan"
		},
		{
			"Code": "TZ",
			"UrlCode": "tanzania-united-republic-of",
			"Name": "Tanzania, United Republic of"
		},
		{
			"Code": "TH",
			"UrlCode": "thailand",
			"Name": "Thailand"
		},
		{
			"Code": "TL",
			"UrlCode": "timor-leste",
			"Name": "Timor-Leste"
		},
		{
			"Code": "TG",
			"UrlCode": "togo",
			"Name": "Togo"
		},
		{
			"Code": "TK",
			"UrlCode": "tokelau",
			"Name": "Tokelau"
		},
		{
			"Code": "TO",
			"UrlCode": "tonga",
			"Name": "Tonga"
		},
		{
			"Code": "TT",
			"UrlCode": "trinidad-and-tobago",
			"Name": "Trinidad and Tobago"
		},
		{
			"Code": "TN",
			"UrlCode": "tunisia",
			"Name": "Tunisia"
		},
		{
			"Code": "TR",
			"UrlCode": "turkey",
			"Name": "Turkey"
		},
		{
			"Code": "TM",
			"UrlCode": "turkmenistan",
			"Name": "Turkmenistan"
		},
		{
			"Code": "TC",
			"UrlCode": "turks-and-caicos-islands",
			"Name": "Turks and Caicos Islands"
		},
		{
			"Code": "TV",
			"UrlCode": "tuvalu",
			"Name": "Tuvalu"
		},
		{
			"Code": "UG",
			"UrlCode": "uganda",
			"Name": "Uganda"
		},
		{
			"Code": "UA",
			"UrlCode": "ukraine",
			"Name": "Ukraine"
		},
		{
			"Code": "AE",
			"UrlCode": "united-arab-emirates",
			"Name": "United Arab Emirates"
		},
		{
			"Code": "GB",
			"UrlCode": "united-kingdom",
			"Name": "United Kingdom"
		},
		{
			"Code": "US",
			"UrlCode": "united-states",
			"Name": "United States"
		},
		{
			"Code": "UM",
			"UrlCode": "united-states-minor-outlying-islands",
			"Name": "United States Minor Outlying Islands"
		},
		{
			"Code": "UY",
			"UrlCode": "uruguay",
			"Name": "Uruguay"
		},
		{
			"Code": "UZ",
			"UrlCode": "uzbekistan",
			"Name": "Uzbekistan"
		},
		{
			"Code": "VU",
			"UrlCode": "vanuatu",
			"Name": "Vanuatu"
		},
		{
			"Code": "VE",
			"UrlCode": "venezuela-bolivarian-republic-of",
			"Name": "Venezuela"
		},
		{
			"Code": "VN",
			"UrlCode": "vietnam",
			"Name": "Vietnam"
		},
		{
			"Code": "VG",
			"UrlCode": "virgin-islands-british",
			"Name": "Virgin Islands, British"
		},
		{
			"Code": "VI",
			"UrlCode": "virgin-islands-us",
			"Name": "Virgin Islands, U.S."
		},
		{
			"Code": "WF",
			"UrlCode": "wallis-and-futuna",
			"Name": "Wallis and Futuna"
		},
		{
			"Code": "EH",
			"UrlCode": "western-sahara",
			"Name": "Western Sahara"
		},
		{
			"Code": "YE",
			"UrlCode": "yemen",
			"Name": "Yemen"
		},
		{
			"Code": "ZM",
			"UrlCode": "zambia",
			"Name": "Zambia"
		},
		{
			"Code": "ZW",
			"UrlCode": "zimbabwe",
			"Name": "Zimbabwe"
		}
	],
	"Competitors": {
		"TopSimilarityCompetitors": []
	},
	"Notification": {
		"Content": null
	},
	"TopKeywords": [
		{
			"Name": "example",
			"EstimatedValue": 15866,
			"Volume": 86590,
			"Cpc": 0.9811741875
		},
		{
			"Name": "example.com",
			"EstimatedValue": 9082,
			"Volume": 5740,
			"Cpc": null
		},
		{
			"Name": "example.com/login",
			"EstimatedValue": 4829,
			"Volume": 70,
			"Cpc": null
		},
		{
			"Name": "exemple.com",
			"EstimatedValue": 3893,
			"Volume": 120,
			"Cpc": null
		},
		{
			"Name": "example website",
			"EstimatedValue": 3543,
			"Volume": 1520,
			"Cpc": null
		}
	],
	"SnapshotDate": "2024-10-01T00:00:00+00:00"
}
```

### Contact

Please visit us through [epctex.com](https://epctex.com) to see all the products that are available for you. If you are looking for any custom integration or so, please reach out to us through the chat box in [epctex.com](https://epctex.com). In need of support? <business@epctex.com> is at your service.

# Actor input Schema

## `websites` (type: `array`):

Similarweb websites to scrape. Both domains and full Similarweb URLs are accepted.

## `proxy` (type: `object`):

Select proxies to be used by your crawler.

## Actor input object example

```json
{
  "websites": [
    "apify.com",
    "https://www.similarweb.com/website/example.com"
  ],
  "proxy": {
    "useApifyProxy": true
  }
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "websites": [
        "apify.com",
        "https://www.similarweb.com/website/example.com"
    ],
    "proxy": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("epctex/similarweb-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "websites": [
        "apify.com",
        "https://www.similarweb.com/website/example.com",
    ],
    "proxy": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("epctex/similarweb-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "websites": [
    "apify.com",
    "https://www.similarweb.com/website/example.com"
  ],
  "proxy": {
    "useApifyProxy": true
  }
}' |
apify call epctex/similarweb-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=epctex/similarweb-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Similarweb Scraper",
        "description": "The most comprehensive Similarweb Scraper you will ever find. Obtain data on website popularity and receive it in formats such as JSON, XML, CSV, Excel, or an HTML table.",
        "version": "0.0",
        "x-build-id": "pKvKcVQOUKDgTIFCM"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/epctex~similarweb-scraper/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-epctex-similarweb-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/epctex~similarweb-scraper/runs": {
            "post": {
                "operationId": "runs-sync-epctex-similarweb-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/epctex~similarweb-scraper/run-sync": {
            "post": {
                "operationId": "run-sync-epctex-similarweb-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "required": [
                    "websites",
                    "proxy"
                ],
                "properties": {
                    "websites": {
                        "title": "Website(s)",
                        "type": "array",
                        "description": "Similarweb websites to scrape. Both domains and full Similarweb URLs are accepted.",
                        "items": {
                            "type": "string"
                        }
                    },
                    "proxy": {
                        "title": "Proxy configuration",
                        "type": "object",
                        "description": "Select proxies to be used by your crawler."
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```
