Elastic Search¶

Info

This feature is only available in GCP clusters.

The NAIS platform offers Elastic Search via Aiven.

Get your own¶

As there are few teams that need an Elastic Search instance we use a IaC-repo to provision each instance. Head over to aiven-iac to learn how to get your own instance.

Username and password¶

For now we are manually distributing the username and password for each instance. To make it easier for you, we're making four different users: admin, read, write, read/write.

Access from Nais-app¶

If you need access from an application, use the following nais.yaml-reference.

Access from laptop¶

With Naisdevice you have access to the aiven-prod gateway. This is a JITA (just in time access) gateway, so you need to describe why, but the access is automatically given.

Kibana¶

The URL for Kibana is the same as the Elastic instance, but using port 443 (regular https).

Support¶

We do not offer support on Elastic Search as software, but questions about Aiven and provisioning can be directed to #pig_aiven on Slack.

Alerts¶

We recommend that you set up your own alerts so that you can react to problems in your Elastic instance. Aiven uses Telegraf to collect and present metrics, so available metrics can be found in the Telegraf documentation.

We have configured our Prometheus instances in GCP to scrape the Elastic clusters in Aiven, so these metrics should be available in Grafana. New Elastic clusters currently need to be manually added to the Prometheus config, so if you can't find your cluster, please poke us.

Particularly relevant input plugins are:

O'Reilly has a useful article about metrics to watch in an Elastic cluster.

Awesome prometheus alerts is another good source of alerts to look out for.

Some metrics that might be useful to watch, based on above article (We need feedback on this list, as we have no practical experience to lean on):

elasticsearch_cluster_health_status_code
elasticsearch_cluster_health_active_shards
elasticsearch_cluster_health_initializing_shards
elasticsearch_cluster_health_relocating_shards
elasticsearch_cluster_health_unassigned_shards
elasticsearch_jvm_mem_heap_used_percent
elasticsearch_jvm_gc_collectors_old_collection_time_in_millis
elasticsearch_jvm_gc_collectors_young_collection_time_in_millis
elasticsearch_jvm_mem_pools_old_used_in_byte vs. elasticsearch_jvm_mem_pools_old_max_in_bytes
elasticsearch_jvm_mem_pools_survivor_used_in_byte vs. elasticsearch_jvm_mem_pools_survivor_max_in_bytes
elasticsearch_jvm_mem_pools_young_used_in_byte vs. elasticsearch_jvm_mem_pools_young_max_in_bytes
elasticsearch_indices_search_query_time_in_millis
elasticsearch_indices_fielddata_evictions
elasticsearch_indices_fielddata_memory_size_in_bytes
elasticsearch_indices_indexing_index_time_in_millis
elasticsearch_indices_indexing_index_total
elasticsearch_indices_merges_total_time_in_millis
elasticsearch_indices_store_size_in_bytes
cpu_usage_user
diskio_weighted_io_time