Skip to Content
SourcesElasticsearch

Elasticsearch

Required
Fields required for a valid configuration.
PathTypeRequiredDescriptionDefaultConstraints
requiredobjectYes
Masked
Sensitive fields under(secrets/credentials).
PathTypeRequiredDescriptionDefaultConstraints
maskedobjectNo
Optional
Optional configuration fields.
PathTypeRequiredDescriptionDefaultConstraints
optionalobjectNono extra properties
optional.connectionobjectNoCluster connection controls.no extra properties
optional.connection.request_timeout_secondsnumberNoNetwork timeout in seconds for cluster API calls30min 1, max 300
optional.connection.verify_sslbooleanNoTLS certificate verification toggletrue
optional.scopeobjectNoIndex selection scope.no extra properties
optional.scope.exclude_indicesarrayNoIndex denylist
optional.scope.exclude_indices[]stringNo
optional.scope.include_indicesarrayNoOptional index allowlist
optional.scope.include_indices[]stringNo
optional.scope.include_system_indicesbooleanNoInclude system indices (names starting with .)false
optional.scope.index_limitintegerNoOptional cap on number of index assetsmin 1
Extracted Metadata

Index

FieldTypeRequiredDescription
index_namestringYesIndex name
healthstringNoIndex health (green/yellow/red)
doc_countintegerYesNumber of documents in the index
store_size_bytesintegerNoIndex store size in bytes
primary_shardsintegerNoNumber of primary shards
replica_shardsintegerNoNumber of replica shards
Examples
Local dev cluster scan
Discover indices and sample documents on a local, unauthenticated Elasticsearch cluster

Config Payload

{
  "type": "ELASTICSEARCH",
  "required": {
    "auth_mode": "NONE",
    "url": "http://localhost:9200"
  },
  "optional": {
    "scope": {
      "include_system_indices": false
    }
  },
  "sampling": {
    "strategy": "LATEST",
    "rows_per_page": 50
  }
}

Schedule

{
  "enabled": true,
  "preset": "weekday_business",
  "cron": "15 6 * * 1-5",
  "timezone": "UTC"
}
Basic auth secrets detection
Sample documents from selected indices using basic auth and run secrets detection

Config Payload

{
  "type": "ELASTICSEARCH",
  "required": {
    "auth_mode": "BASIC",
    "url": "https://es.internal.example.com:9200"
  },
  "masked": {
    "username": "elastic",
    "password": "your-password"
  },
  "optional": {
    "connection": {
      "verify_ssl": true
    },
    "scope": {
      "include_indices": [
        "orders",
        "customers"
      ]
    }
  },
  "sampling": {
    "strategy": "RANDOM",
    "rows_per_page": 100
  },
  "detectors": [
    {
      "type": "SECRETS",
      "enabled": true
    },
    {
      "type": "PII",
      "enabled": true
    }
  ]
}

Schedule

{
  "enabled": true,
  "preset": "weekday_business",
  "cron": "40 8 * * 1-5",
  "timezone": "UTC"
}
Elastic Cloud with API key
Connect to an Elastic Cloud deployment using an API key (bearer token) instead of a username/password

Config Payload

{
  "type": "ELASTICSEARCH",
  "required": {
    "auth_mode": "API_KEY",
    "url": "https://my-deployment.es.us-east-1.aws.found.io:9243"
  },
  "masked": {
    "api_key": "your-base64-encoded-api-key"
  },
  "optional": {
    "scope": {
      "exclude_indices": [
        ".kibana*"
      ]
    }
  },
  "sampling": {
    "strategy": "AUTOMATIC",
    "rows_per_page": 100
  }
}

Schedule

{
  "enabled": true,
  "preset": "nightly",
  "cron": "10 2 * * *",
  "timezone": "UTC"
}