Skip to content

Elastic Search

The NAIS platform offers Elastic Search via Aiven.

Get your own

As there are few teams that need an Elastic Search instance we use a IaC-repo to provision each instance. Head over to aiven-iac to learn how to get your own instance.

Username and password

For now we are manually distributing the username and password for each instance. To make it easier for you, we're making four different users: admin, read, write, read/write.

Access from Nais-app

If you need access from an application, use the following nais.yaml-reference.

Access from laptop

With Naisdevice you have access to the aiven-prod gateway. This is a JITA (just in time access) gateway, so you need to describe why, but the access is automatically given.

Kibana

The URL for Kibana is the same as the Elastic instance, but using port 443 (regular https).

Support

We do not offer support on Elastic Search as software, but questions about Aiven and provisioning can be directed to #pig_aiven on Slack.

Alerts

We recommend that you set up your own alerts so that you can react to problems in your Elastic instance. Aiven uses Telegraf to collect and present metrics, so available metrics can be found in the Telegraf documentation.

We have configured our Prometheus instances in GCP to scrape the Elastic clusters in Aiven, so these metrics should be available in Grafana. New Elastic clusters currently need to be manually added to the Prometheus config, so if you can't find your cluster, please poke us.

Particularly relevant input plugins are:

O'Reilly has a useful article about metrics to watch in an Elastic cluster.

Awesome prometheus alerts is another good source of alerts to look out for.

Some metrics that might be useful to watch, based on above article (We need feedback on this list, as we have no practical experience to lean on):

  • elasticsearch_cluster_health_status_code
  • elasticsearch_cluster_health_active_shards
  • elasticsearch_cluster_health_initializing_shards
  • elasticsearch_cluster_health_relocating_shards
  • elasticsearch_cluster_health_unassigned_shards
  • elasticsearch_jvm_mem_heap_used_percent
  • elasticsearch_jvm_gc_collectors_old_collection_time_in_millis
  • elasticsearch_jvm_gc_collectors_young_collection_time_in_millis
  • elasticsearch_jvm_mem_pools_old_used_in_byte vs. elasticsearch_jvm_mem_pools_old_max_in_bytes
  • elasticsearch_jvm_mem_pools_survivor_used_in_byte vs. elasticsearch_jvm_mem_pools_survivor_max_in_bytes
  • elasticsearch_jvm_mem_pools_young_used_in_byte vs. elasticsearch_jvm_mem_pools_young_max_in_bytes
  • elasticsearch_indices_search_query_time_in_millis
  • elasticsearch_indices_fielddata_evictions
  • elasticsearch_indices_fielddata_memory_size_in_bytes
  • elasticsearch_indices_indexing_index_time_in_millis
  • elasticsearch_indices_indexing_index_total
  • elasticsearch_indices_merges_total_time_in_millis
  • elasticsearch_indices_store_size_in_bytes
  • cpu_usage_user
  • diskio_weighted_io_time