Elasticsearch monitoring requirements are required recently. Elasticsearch_export is used to collect monitoring indicators of ES for Prometheus, Grafana, and Kibana to display.
For details on elasticSearch_export metrics, see github.com/justwatchco… .
| Name | Type | Cardinality | Help |
|---|---|---|---|
| elasticsearch_breakers_estimated_size_bytes | gauge | 4 | Estimated Size in bytes of Breakerbreaker Estimated size of bytes |
| elasticsearch_breakers_limit_size_bytes | gauge | 4 | Limit size in bytes for breaker Limits the size of the breaker to bytes |
| elasticsearch_breakers_tripped | counter | 4 | Tripped for breaker |
| elasticsearch_cluster_health_active_primary_shards | gauge | 1 | The number of primary shards in your cluster. This is an aggregate total across all indices. Total number of active master shards |
| elasticsearch_cluster_health_active_shards | gauge | 1 | Aggregate total of all shards across all indices, which includes replica shards. Total number of active shards (including replicated shards) |
| elasticsearch_cluster_health_delayed_unassigned_shards | gauge | 1 | Shards delayed to reduce reallocation overhead Sharding delays to reduce reallocation overhead |
| elasticsearch_cluster_health_initializing_shards | gauge | 1 | Count of shards that are being freshly created. Number of fragments being initialized |
| elasticsearch_cluster_health_number_of_data_nodes | gauge | 1 | Number of data nodes in the cluster. Node Indicates the Number of nodes |
| elasticsearch_cluster_health_number_of_in_flight_fetch | gauge | 1 | The number of ongoing shard info requests. Number of fragment information requests in progress |
| elasticsearch_cluster_health_number_of_nodes | gauge | 1 | Number of nodes in the cluster. All nodes in the cluster |
| elasticsearch_cluster_health_number_of_pending_tasks | gauge | 1 | Cluster level changes which have not yet been executed Cluster level changes |
| elasticsearch_cluster_health_task_max_waiting_in_queue_millis | gauge | 1 | Max time in millis that a task is waiting in queue. The maximum time, in milliseconds, for a task to wait in the queue. |
| elasticsearch_cluster_health_relocating_shards | gauge | 1 | The number of shards that are currently moving from one node to another node. The number of shards that a node is currently migrating to another node. This value is usually 0 and increases when a node is added or exited from the cluster |
| elasticsearch_cluster_health_status | gauge | 3 | Whether all primary and replica shards are allocated. Cluster status: Green, yellow, or Red |
| elasticsearch_cluster_health_timed_out | gauge | 1 | Number of cluster health checks timed out. Cluster health check times out |
| elasticsearch_cluster_health_unassigned_shards | gauge | 1 | The number of shards that exist in the cluster state, but cannot be found in the cluster itself. Number of unallocated fragments |
| elasticsearch_filesystem_data_available_bytes | gauge | 1 | Available Space on block device in bytes Available space on a block device in bytes |
| elasticsearch_filesystem_data_free_bytes | gauge | 1 | Free Space on Block Device in bytes Free disk space |
| elasticsearch_filesystem_data_size_bytes | gauge | 1 | Size of block device in bytes Indicates the Size of the block device in bytes. |
| elasticsearch_filesystem_io_stats_device_operations_count | gauge | 1 | Count of Disk Operations Number of disk operations |
| elasticsearch_filesystem_io_stats_device_read_operations_count | gauge | 1 | Count of Disk Read Operations Number of disk read operations |
| elasticsearch_filesystem_io_stats_device_write_operations_count | gauge | 1 | Count of Disk Write Operations Number of disk write operations |
| elasticsearch_filesystem_io_stats_device_read_size_kilobytes_sum | gauge | 1 | Total kilobytes read from Disk Total kilobytes read from disk |
| elasticsearch_filesystem_io_stats_device_write_size_kilobytes_sum | gauge | 1 | Total kilobytes written to disk |
| elasticsearch_indices_docs | gauge | 1 | Count of Documents on this node Specifies the number of documents on this node |
| elasticsearch_indices_docs_deleted | gauge | 1 | Count of Deleted Documents on this node Indicates the number of deleted documents on this node |
| elasticsearch_indices_docs_primary | gauge | Count of Documents with only Primary shards on all nodes Indicates the number of documents that only have primary shards on all nodes | |
| elasticsearch_indices_fielddata_evictions | counter | 1 | Evictions from Field Data The number of Evictions from the FieldData cache |
| elasticsearch_indices_fielddata_memory_size_bytes | gauge | 1 | Field data cache Memory Usage in BytesfieldData |
| elasticsearch_indices_filter_cache_evictions | counter | 1 | Evictions from filter cache Number of Evictions from filter cache (version 2.x only) |
| elasticsearch_indices_filter_cache_memory_size_bytes | gauge | 1 | Filter Cache Memory Usage in bytes Filter cache size (bytes) (version 2.x only) |
| elasticsearch_indices_flush_time_seconds | counter | 1 | Cumulative Flush Time in seconds Cumulative Flush time in seconds |
| elasticsearch_indices_flush_total | counter | 1 | Total flushes Total number of index flushes to a disk |
| elasticsearch_indices_get_exists_time_seconds | counter | 1 | Total Time GET Exists in seconds Total time obtained in seconds |
| elasticsearch_indices_get_exists_total | counter | 1 | Total Get exists Operations Obtains the Total number of operations |
| elasticsearch_indices_get_missing_time_seconds | counter | 1 | Total Time of get missing in seconds Total time spent on GET requests with missing documents |
| elasticsearch_indices_get_missing_total | counter | 1 | Total Get Missing Total number of GET requests for missing files |
| elasticsearch_indices_get_time_seconds | counter | 1 | Total Get time in seconds Total get time in seconds |
| elasticsearch_indices_get_total | counter | 1 | Total get = Total get |
| elasticsearch_indices_indexing_delete_time_seconds_total | counter | 1 | Total Time Indexing DELETE in seconds Total time for indexing files to be deleted |
| elasticsearch_indices_indexing_delete_total | counter | 1 | Total Indexing Deletes The Total number of file deletes that are indexed |
| elasticsearch_indices_indexing_index_time_seconds_total | counter | 1 | Cumulative Index Time in seconds Cumulative index time in seconds |
| elasticsearch_indices_indexing_index_total | counter | 1 | Total Index Calls Indicates the Total number of files to be indexed |
| elasticsearch_indices_merges_docs_total | counter | 1 | Cumulative docs merged Cumulative document merge |
| elasticsearch_indices_merges_total | counter | 1 | Total merges Total number of merges |
| elasticsearch_indices_merges_total_size_bytes_total | counter | 1 | Total Merge Size in bytes Total merge size in bytes |
| elasticsearch_indices_merges_total_time_seconds_total | counter | 1 | Total time spent merging in seconds |
| elasticsearch_indices_query_cache_cache_total | counter | 1 | Count of Query Cache Number of query caches |
| elasticsearch_indices_query_cache_cache_size | gauge | 1 | Size of Query Cache Specifies the Size of the query cache |
| elasticsearch_indices_query_cache_count | counter | 2 | Count of Query Cache hit/ Miss Indicates the number of cache hits or misses |
| elasticsearch_indices_query_cache_evictions | counter | 1 | Evictions from Query Cache Evictions from query cache |
| elasticsearch_indices_query_cache_memory_size_bytes | gauge | 1 | Query Cache Memory Usage in bytes Query cache memory usage in bytes |
| elasticsearch_indices_query_cache_total | counter | 1 | Size of Query Cache Total Total Size of query cache |
| elasticsearch_indices_refresh_time_seconds_total | counter | 1 | Total Time Spent refreshing in seconds Total time of refreshing the index |
| elasticsearch_indices_refresh_total | counter | 1 | Total Refreshes Total number of index refreshes |
| elasticsearch_indices_request_cache_count | counter | 2 | Count of Request Cache hit/miss Count of cache hits/misses |
| elasticsearch_indices_request_cache_evictions | counter | 1 | Evictions from request cache Evictions from request cache |
| elasticsearch_indices_request_cache_memory_size_bytes | gauge | 1 | Request Cache Memory Usage in bytes Request cache memory usage in bytes |
| elasticsearch_indices_search_fetch_time_seconds | counter | 1 | Total Search fetch Time in seconds Total search fetch time in seconds |
| elasticsearch_indices_search_fetch_total | counter | 1 | Total number of fetches Total number of fetches |
| elasticsearch_indices_search_query_time_seconds | counter | 1 | Total Search Query Time in seconds Total query time (performance) |
| elasticsearch_indices_search_query_total | counter | 1 | Total Number of queries Total number of queries |
| elasticsearch_indices_segments_count | gauge | 1 | Count of index segments on this node Specifies the number of index segments on this node |
| elasticsearch_indices_segments_memory_bytes | gauge | 1 | Current memory size of segments in bytes Current memory size (in bytes) |
| elasticsearch_indices_settings_stats_read_only_indices | gauge | 1 | Count of indices that have read_only_ALLOW_DELETE =true Count of indices that have read_only_ALLOW_DELETE =true |
| elasticsearch_indices_shards_docs | gauge | 3 | Count of Documents on this shard Specifies the number of documents on the shard |
| elasticsearch_indices_shards_docs_deleted | gauge | 3 | Count of Deleted Documents on each shard Indicates the number of deleted documents on each fragment |
| elasticsearch_indices_store_size_bytes | gauge | 1 | Current size of stored index data in bytes Specifies the Current size of the index data in bytes. |
| elasticsearch_indices_store_size_bytes_primary | gauge | Current size of stored index data in bytes with only primary shards on all nodes Indicates the size (in bytes) of the index data currently stored on all nodes. Only the primary shard exists on all nodes | |
| elasticsearch_indices_store_size_bytes_total | gauge | Current size of stored index data in bytes with all shards on all Nodes The Current size (in bytes) of all shards of stored index data on all nodes | |
| elasticsearch_indices_store_throttle_time_seconds_total | counter | 1 | Throttle time for index store in seconds Throttle time for index store in seconds |
| elasticsearch_indices_translog_operations | counter | 1 | Total Translog Operations Total transfer operations |
| elasticsearch_indices_translog_size_in_bytes | counter | 1 | Total Translog Size in bytes Total Translog size in bytes |
| elasticsearch_indices_warmer_time_seconds_total | counter | 1 | Total warmer time in seconds |
| elasticsearch_indices_warmer_total | counter | 1 | Total warmer Count Total warmer count |
| elasticsearch_jvm_gc_collection_seconds_count | counter | 2 | Count of Number of JVM GC runs garbage collections |
| elasticsearch_jvm_gc_collection_seconds_sum | counter | 2 | GC Run Time in seconds Garbage collection time |
| elasticsearch_jvm_memory_committed_bytes | gauge | 2 | JVM memory currently committed by area Maximum memory limit |
| elasticsearch_jvm_memory_max_bytes | gauge | 1 | JVM Memory Max Specifies the maximum JVM value configured |
| elasticsearch_jvm_memory_used_bytes | gauge | 2 | JVM memory currently used by area Memory usage |
| elasticsearch_jvm_memory_pool_used_bytes | gauge | 3 | JVM memory currently used by Pool Specifies the JVM memory pool currently in use |
| elasticsearch_jvm_memory_pool_max_bytes | counter | 3 | JVM Memory Max by poolMaximum number of MEMORY pools in the JVM |
| elasticsearch_jvm_memory_pool_peak_used_bytes | counter | 3 | JVM Memory Peak Used by Pool Indicates the JVM memory peak used by the pool |
| elasticsearch_jvm_memory_pool_peak_max_bytes | counter | 3 | JVM Memory Peak Max by pool Indicates the maximum JVM memory peak value |
| elasticsearch_os_cpu_percent | gauge | 1 | Percent CPU used by the CPU used by the OS |
| elasticsearch_os_load1 | gauge | 1 | Shortterm Load Average Short-term load |
| elasticsearch_os_load5 | gauge | 1 | Midterm load Average |
| elasticsearch_os_load15 | gauge | 1 | Longterm Load Average Long-term load |
| elasticsearch_process_cpu_percent | gauge | 1 | Percent CPU Used by processCPU usage |
| elasticsearch_process_cpu_time_seconds_sum | counter | 3 | Process CPU time in seconds Process CPU time in seconds |
| elasticsearch_process_mem_resident_size_bytes | gauge | 1 | Resident memory in use by process in bytes Resident memory in use by process in bytes |
| elasticsearch_process_mem_share_size_bytes | gauge | 1 | Shared memory in use by process in bytes Shared memory in use by process in bytes |
| elasticsearch_process_mem_virtual_size_bytes | gauge | 1 | Total Virtual Memory Used in bytes Total virtual memory used in bytes |
| elasticsearch_process_open_files_count | gauge | 1 | Open File descriptorsES File descriptor opened by the process |
| elasticsearch_snapshot_stats_number_of_snapshots | gauge | 1 | Total number of snapshots |
| elasticsearch_snapshot_stats_oldest_snapshot_timestamp | gauge | 1 | Oldest Snapshot timestamp Indicates the earliest snapshot timestamp |
| elasticsearch_snapshot_stats_snapshot_start_time_timestamp | gauge | 1 | Last snapshot start timestamp Indicates the start time of the Last snapshot |
| elasticsearch_snapshot_stats_snapshot_end_time_timestamp | gauge | 1 | Last Snapshot end timestamp Indicates the end time of the Last snapshot |
| elasticsearch_snapshot_stats_snapshot_number_of_failures | gauge | 1 | Last Snapshot Number of Failures Last snapshot failures |
| elasticsearch_snapshot_stats_snapshot_number_of_indices | gauge | 1 | Last Snapshot Number of Indices Last snapshot number |
| elasticsearch_snapshot_stats_snapshot_failed_shards | gauge | 1 | Last Snapshot failed Shards Fragment that the Last snapshot failed |
| elasticsearch_snapshot_stats_snapshot_successful_shards | gauge | 1 | Last Snapshot successful shards The Last snapshot is successfully fragmented |
| elasticsearch_snapshot_stats_snapshot_total_shards | gauge | 1 | Last Snapshot Total Shard Total shard of the Last snapshot |
| elasticsearch_thread_pool_active_count | gauge | 14 | Thread Pool threads active Bulk, index, search, force_merge |
| elasticsearch_thread_pool_completed_count | counter | 14 | Thread Pool operations completed The Thread Pool operations (BULK, index, search, force_MERGE) are completed. |
| elasticsearch_thread_pool_largest_count | gauge | 14 | Largest threads count Maximum number of threads in a Thread Pool (BULK, index, search, force_MERGE) |
| elasticsearch_thread_pool_queue_count | gauge | 14 | Thread Pool Operations Queued Number of queued threads in the Thread Pool (BULK, index, search, force_MERGE) |
| elasticsearch_thread_pool_rejected_count | counter | 14 | Thread Pool Operations Indicates the number of rejected threads in the Thread Pool |
| elasticsearch_thread_pool_threads_count | gauge | 14 | Thread Pool Current Threads Count Number of current threads in the Thread Pool |
| elasticsearch_transport_rx_packets_total | counter | 1 | Count of packets receivedES Incoming network traffic between nodes |
| elasticsearch_transport_rx_size_bytes_total | counter | 1 | Total Number of bytes received Total number of bytes received |
| elasticsearch_transport_tx_packets_total | counter | 1 | Count of packets sentES Indicates the outgoing network traffic between nodes |
| elasticsearch_transport_tx_size_bytes_total | counter | 1 | Total Number of bytes sent Total number of bytes sent |
| elasticsearch_clusterinfo_last_retrieval_success_ts | gauge | 1 | Timestamp of the last successful Cluster info Retrieval Timestamp of the last successful cluster information retrieval |
| elasticsearch_clusterinfo_up | gauge | 1 | Up metric for the cluster info collector Startup metric for the cluster information collector |
| elasticsearch_clusterinfo_version_info | gauge | 6 | Constant metric with ES version information as labels Constant metric with ES version information as labels |