InfluxDB OSS metrics

Get metrics about the workload performance of an InfluxDB OSS instance.

InfluxDB OSS exposes a /metrics endpoint that returns performance, resource, and usage metrics formatted in the Prometheus plain-text exposition format.

GET http://localhost:8086/metrics

Metrics contain a name, an optional set of key-value pairs, and a value.

The following descriptors precede each metric:

HELP: description of the metric
TYPE: Prometheus metric type (counter, gauge, histogram, or summary)

Example

# HELP go_info Information about the Go environment.
# TYPE go_info gauge
go_info{version="go1.17"} 1
# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 2.27988488e+08
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 9.68016566648e+11

The InfluxDB /metrics endpoint returns metrics associated with the following categories:

Boltdb
Go runtime
HTTP API
InfluxDB objects and queries
- QC (query controller)
InfluxDB services
InfluxDB storage
InfluxDB tasks

Boltdb statistics

Reads total

Total number of boltdb reads.

Example

# HELP boltdb_reads_total Total number of boltdb reads
# TYPE boltdb_reads_total counter
boltdb_reads_total 75129

Writes total

Total number of boltdb writes.

Example

# HELP boltdb_writes_total Total number of boltdb writes
# TYPE boltdb_writes_total counter
boltdb_writes_total 201591

Go runtime statistics

For more detail about Go runtime statistics, see the following:

GC (garbage collection) duration seconds

Summary of the pause duration of garbage collection cycles.

Example

# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 5.1467e-05
--

Goroutines

Number of goroutines that currently exist.

Example

# HELP go_goroutines Number of goroutines that currently exist.
# TYPE go_goroutines gauge
go_goroutines 1566

Info

Information about the Go environment.

Example

# HELP go_info Information about the Go environment.
# TYPE go_info gauge
go_info{version="go1.17"} 1

Memory allocated bytes

Number of bytes allocated and still in use.

Example

# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 2.27988488e+08

Memory allocated bytes total

Total number of bytes allocated, even if freed.

Example

# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 9.68016566648e+11

Memory bucket hash system bytes

Number of bytes used by the profiling bucket hash table.

Example

# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
# TYPE go_memstats_buck_hash_sys_bytes gauge
go_memstats_buck_hash_sys_bytes 1.0067613e+07

Memory frees total

Total number of frees.

Example

# HELP go_memstats_frees_total Total number of frees.
# TYPE go_memstats_frees_total counter
go_memstats_frees_total 1.3774541795e+10

Memory GC (garbage collection) CPU fraction

Fraction of this program’s available CPU time used by the GC since the program started.

Example

# HELP go_memstats_gc_cpu_fraction The fraction of this program's available CPU time used by the GC since the program started.
# TYPE go_memstats_gc_cpu_fraction gauge
go_memstats_gc_cpu_fraction 0.011634918451016558

Memory GC (garbage collection) system bytes

Number of bytes used for garbage collection system metadata.

Example

# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
# TYPE go_memstats_gc_sys_bytes gauge
go_memstats_gc_sys_bytes 4.63048016e+08

Memory heap allocated bytes

Number of heap bytes allocated and still in use.

Example

# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
# TYPE go_memstats_heap_alloc_bytes gauge
go_memstats_heap_alloc_bytes 2.27988488e+08

Memory heap idle bytes

Number of heap bytes waiting to be used.

Example

# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
# TYPE go_memstats_heap_idle_bytes gauge
go_memstats_heap_idle_bytes 1.0918273024e+10

Memory heap in use bytes

Number of heap bytes that are in use.

Example

# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
# TYPE go_memstats_heap_inuse_bytes gauge
go_memstats_heap_inuse_bytes 3.5975168e+08

Memory heap objects

Number of allocated objects. Allocated heap objects include all reachable objects, as well as unreachable objects that the garbage collector has not yet freed.

Example

# HELP go_memstats_heap_objects Number of allocated objects.
# TYPE go_memstats_heap_objects gauge
go_memstats_heap_objects 2.404017e+06

Memory heap released bytes

Number of heap bytes released to the OS.

Example

# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.
# TYPE go_memstats_heap_released_bytes gauge
go_memstats_heap_released_bytes 2.095038464e+09

Memory heap system bytes

Number of heap bytes obtained from the system.

Example

# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
# TYPE go_memstats_heap_sys_bytes gauge
go_memstats_heap_sys_bytes 1.1278024704e+10

Memory last GC (garbage collection) time seconds

Number of seconds since 1970 of the last garbage collection.

Example

# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
# TYPE go_memstats_last_gc_time_seconds gauge
go_memstats_last_gc_time_seconds 1.64217120199452e+09

Memory lookups total

Total number of pointer lookups.

Example

# HELP go_memstats_lookups_total Total number of pointer lookups.
# TYPE go_memstats_lookups_total counter
go_memstats_lookups_total 0

Memory allocations total

Cumulative count of heap objects allocated.

Example

# HELP go_memstats_mallocs_total Total number of mallocs.
# TYPE go_memstats_mallocs_total counter
go_memstats_mallocs_total 1.3776945812e+10

Memory mcache in use bytes

Number of bytes in use by mcache structures.

Example

# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
# TYPE go_memstats_mcache_inuse_bytes gauge
go_memstats_mcache_inuse_bytes 9600

Memory mcache system bytes

Number of bytes used for mcache structures obtained from system.

Example

# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
# TYPE go_memstats_mcache_sys_bytes gauge
go_memstats_mcache_sys_bytes 16384

Memory mspan in use bytes

Number of bytes of allocated mspan structures.

Example

# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
# TYPE go_memstats_mspan_inuse_bytes gauge
go_memstats_mspan_inuse_bytes 4.199e+06

Memory mspan system bytes

Bytes of memory obtained from the OS for mspan structures.

Example

# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
# TYPE go_memstats_mspan_sys_bytes gauge
go_memstats_mspan_sys_bytes 1.65609472e+08

Memory next GC (garbage collection) bytes

Number of heap bytes when next garbage collection will take place.

Example

# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
# TYPE go_memstats_next_gc_bytes gauge
go_memstats_next_gc_bytes 4.45628016e+08

Memory other system bytes

Number of bytes used for other system allocations.

Example

# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.
# TYPE go_memstats_other_sys_bytes gauge
go_memstats_other_sys_bytes 8.1917722e+07

Memory stack in use bytes

Number of bytes in use by the stack allocator.

Example

# HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
# TYPE go_memstats_stack_inuse_bytes gauge
go_memstats_stack_inuse_bytes 8.84736e+06

Memory stack system bytes

Number of bytes obtained from system for stack allocator.

Example

# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
# TYPE go_memstats_stack_sys_bytes gauge
go_memstats_stack_sys_bytes 8.84736e+06

Memory system bytes

Number of bytes obtained from system.

Example

# HELP go_memstats_sys_bytes Number of bytes obtained from system.
# TYPE go_memstats_sys_bytes gauge
go_memstats_sys_bytes 1.2007531271e+10

Threads

Number of OS threads created.

Example

# HELP go_threads Number of OS threads created.
# TYPE go_threads gauge
go_threads 27

HTTP API statistics

API request duration seconds

How long InfluxDB took to respond to the HTTP request.

Example

# HELP http_api_request_duration_seconds Time taken to respond to HTTP request
# TYPE http_api_request_duration_seconds histogram
http_api_request_duration_seconds_bucket{handler="platform",method="DELETE",path="/api/v2/authorizations/:id",response_code="204",status="2XX",user_agent="Chrome",le="0.005"} 0
--

API requests total

Number of HTTP requests received.

Example

# HELP http_api_requests_total Number of http requests received
# TYPE http_api_requests_total counter
http_api_requests_total{handler="platform",method="DELETE",path="/api/v2/authorizations/:id",response_code="204",status="2XX",user_agent="Chrome"} 1
--

Query request bytes

Count of bytes received.

Example

# HELP http_query_request_bytes Count of bytes received
# TYPE http_query_request_bytes counter
http_query_request_bytes{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 727

Query request count

Total number of query requests.

Example

# HELP http_query_request_count Total number of query requests
# TYPE http_query_request_count counter
http_query_request_count{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 2

Query response bytes

Count of bytes returned by the query endpoint.

Example

# HELP http_query_response_bytes Count of bytes returned
# TYPE http_query_response_bytes counter
http_query_response_bytes{endpoint="/api/v2/query",org_id="48c88459ee424a04",status="200"} 103

InfluxDB object and query statistics

Buckets total

Total number of buckets on the server.

Example

# HELP influxdb_buckets_total Number of total buckets on the server
# TYPE influxdb_buckets_total counter
influxdb_buckets_total 9

Dashboards total

Total number of dashboards on the server.

Example

# HELP influxdb_dashboards_total Number of total dashboards on the server
# TYPE influxdb_dashboards_total counter
influxdb_dashboards_total 2

Info

Information about the InfluxDB environment.

Example

# HELP influxdb_info Information about the influxdb environment.
# TYPE influxdb_info gauge
influxdb_info{arch="amd64",build_date="2021-12-28T22:12:40Z",commit="657e1839de",cpus="8",os="darwin",version="v2.1.1"} 1

Organizations total

Total number of organizations on the server.

Example

# HELP influxdb_organizations_total Number of total organizations on the server
# TYPE influxdb_organizations_total counter
influxdb_organizations_total 2

Scrapers total

Total number of scrapers on the server.

Example

# HELP influxdb_scrapers_total Number of total scrapers on the server
# TYPE influxdb_scrapers_total counter
influxdb_scrapers_total 0

Telegrafs total

Total number of Telegraf configurations on the server.

Example

# HELP influxdb_telegrafs_total Number of total telegraf configurations on the server
# TYPE influxdb_telegrafs_total counter
influxdb_telegrafs_total 0

Token services total

Total number of API tokens on the server.

Example

# HELP influxdb_tokens_total Number of total tokens on the server
# TYPE influxdb_tokens_total counter
influxdb_tokens_total 23

Uptime seconds

InfluxDB process uptime in seconds.

Example

# HELP influxdb_uptime_seconds influxdb process uptime in seconds
# TYPE influxdb_uptime_seconds gauge
influxdb_uptime_seconds{id="077238f9ca108000"} 343354.914499305

Users total

Total number of users on the server.

Example

# HELP influxdb_users_total Number of total users on the server
# TYPE influxdb_users_total counter
influxdb_users_total 84

QC (query controller) statistics

All active

Number of queries in all states.

Example

# HELP qc_all_active Number of queries in all states
# TYPE qc_all_active gauge
qc_all_active{org="48c88459ee424a04"} 0
--

All duration seconds

Total time spent in all query states.

Example

# HELP qc_all_duration_seconds Histogram of total times spent in all query states
# TYPE qc_all_duration_seconds histogram
qc_all_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 0
--

Compiling active

Number of queries actively compiling.

Example

# HELP qc_compiling_active Number of queries actively compiling
# TYPE qc_compiling_active gauge
qc_compiling_active{compiler_type="ast",org="ed32b47572a0137b"} 0
--

Compiling duration seconds

Histogram of times spent compiling queries.

Example

# HELP qc_compiling_duration_seconds Histogram of times spent compiling queries
# TYPE qc_compiling_duration_seconds histogram
qc_compiling_duration_seconds_bucket{compiler_type="ast",org="ed32b47572a0137b",le="0.001"} 999
--

Executing active

Number of queries actively executing.

Example

# HELP qc_executing_active Number of queries actively executing
# TYPE qc_executing_active gauge
qc_executing_active{org="48c88459ee424a04"} 0
--

Executing duration seconds

Histogram of times spent executing queries.

Example

# HELP qc_executing_duration_seconds Histogram of times spent executing queries
# TYPE qc_executing_duration_seconds histogram
qc_executing_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 0
--

Memory unused bytes

Free memory as seen by the internal memory manager.

Example

# HELP qc_memory_unused_bytes The free memory as seen by the internal memory manager
# TYPE qc_memory_unused_bytes gauge
qc_memory_unused_bytes{org="48c88459ee424a04"} 0
--

Queueing active

Number of queries actively queueing.

Example

# HELP qc_queueing_active Number of queries actively queueing
# TYPE qc_queueing_active gauge
qc_queueing_active{org="48c88459ee424a04"} 0
--

Queueing duration seconds

Histogram of times spent queueing queries.

Example

# HELP qc_queueing_duration_seconds Histogram of times spent queueing queries
# TYPE qc_queueing_duration_seconds histogram
qc_queueing_duration_seconds_bucket{org="48c88459ee424a04",le="0.001"} 2
--

Requests total

Count of the query requests.

Example

# HELP qc_requests_total Count of the query requests
# TYPE qc_requests_total counter
qc_requests_total{org="48c88459ee424a04",result="success"} 2
--

Read request duration

Histogram of times spent in read requests.

Example

# HELP query_influxdb_source_read_request_duration_seconds Histogram of times spent in read requests
# TYPE query_influxdb_source_read_request_duration_seconds histogram
query_influxdb_source_read_request_duration_seconds_bucket{op="readTagKeys",org="48c88459ee424a04",le="0.001"} 0
--

InfluxDB service statistics

Bucket service new call total

Number of calls to the bucket creation service.

Example

# HELP service_bucket_new_call_total Number of calls
# TYPE service_bucket_new_call_total counter
service_bucket_new_call_total{method="find_bucket"} 6177
--

Bucket service new duration

Duration of calls to the bucket creation service.

Example

# HELP service_bucket_new_duration Duration of calls
# TYPE service_bucket_new_duration histogram
service_bucket_new_duration_bucket{method="find_bucket",le="0.005"} 5876
--

Bucket service new error total

Number of errors encountered by the bucket creation service.

Example

# HELP service_bucket_new_error_total Number of errors encountered
# TYPE service_bucket_new_error_total counter
service_bucket_new_error_total{code="not found",method="find_bucket_by_id"} 76

Onboard service new call total

Number of calls to the onboarding service.

Example

# HELP service_onboard_new_call_total Number of calls
# TYPE service_onboard_new_call_total counter
service_onboard_new_call_total{method="is_onboarding"} 11

Onboard service new duration

Duration of calls to the onboarding service.

Example

# HELP service_onboard_new_duration Duration of calls
# TYPE service_onboard_new_duration histogram
service_onboard_new_duration_bucket{method="is_onboarding",le="0.005"} 11
--

Organization service call total

Number of calls to the organization service.

Example

# HELP service_org_call_total Number of calls
# TYPE service_org_call_total counter
service_org_call_total{method="find_labels_for_resource"} 10

Organization service duration

Duration of calls to the organization service.

Example

# HELP service_org_duration Duration of calls
# TYPE service_org_duration histogram
service_org_duration_bucket{method="find_labels_for_resource",le="0.005"} 10
--

Organization service new call total

Number of calls to the organization creation service.

Example

# HELP service_org_new_call_total Number of calls
# TYPE service_org_new_call_total counter
service_org_new_call_total{method="find_org"} 1572
--

Organization service new duration

Duration of calls to the organization creation service.

Example

# HELP service_org_new_duration Duration of calls
# TYPE service_org_new_duration histogram
service_org_new_duration_bucket{method="find_org",le="0.005"} 1475
--

Organization service new error total

Number of errors encountered by the organization creation service.

Example

# HELP service_org_new_error_total Number of errors encountered
# TYPE service_org_new_error_total counter
service_org_new_error_total{code="not found",method="find_orgs"} 1

Password service new call total

Number of calls to the password creation service.

Example

# HELP service_password_new_call_total Number of calls
# TYPE service_password_new_call_total counter
service_password_new_call_total{method="compare_password"} 4

Password service new duration

Duration of calls to the password creation service.

Example

# HELP service_password_new_duration Duration of calls
# TYPE service_password_new_duration histogram
service_password_new_duration_bucket{method="compare_password",le="0.005"} 0
--

Password service new error total

Number of errors encountered by the password creation service.

Example

# HELP service_password_new_error_total Number of errors encountered
# TYPE service_password_new_error_total counter
service_password_new_error_total{code="forbidden",method="compare_password"} 1

Pkger service call total

Number of calls to the pkger service.

Example

# HELP service_pkger_call_total Number of calls
# TYPE service_pkger_call_total counter
service_pkger_call_total{method="export"} 3

Pkger service duration

Duration of calls to the pkger service.

Example

# HELP service_pkger_duration Duration of calls
# TYPE service_pkger_duration histogram
service_pkger_duration_bucket{method="export",le="0.005"} 0
--

Pkger service template export

Metrics for exported resources.

Example

# HELP service_pkger_template_export Metrics for resources being exported
# TYPE service_pkger_template_export counter
service_pkger_template_export{buckets="0",by_stack="false",checks="0",dashboards="0",endpoints="0",label_mappings="0",labels="0",method="export",num_org_ids="1",rules="0",tasks="0",telegraf_configs="0",variables="0"} 3

Session service call total

Number of calls to the session service.

Example

# HELP service_session_call_total Number of calls
# TYPE service_session_call_total counter
service_session_call_total{method="create_session"} 3
--

Session service duration

Duration of calls to the session service.

Example

# HELP service_session_duration Duration of calls
# TYPE service_session_duration histogram
service_session_duration_bucket{method="create_session",le="0.005"} 3
--

Session service error total

Number of errors encountered by the session service.

Example

# HELP service_session_error_total Number of errors encountered
# TYPE service_session_error_total counter
service_session_error_total{code="not found",method="find_session"} 4

Token service call total

Number of calls to the token service.

Example

# HELP service_token_call_total Number of calls
# TYPE service_token_call_total counter
service_token_call_total{method="delete_authorization"} 3
--

Token service duration

Duration of calls to the token service.

Example

# HELP service_token_duration Duration of calls
# TYPE service_token_duration histogram
service_token_duration_bucket{method="delete_authorization",le="0.005"} 1
--

Token service error total

Number of errors encountered by the token service.

Example

# HELP service_token_error_total Number of errors encountered
# TYPE service_token_error_total counter
service_token_error_total{code="not found",method="delete_authorization"} 1

URM new call total

Number of calls to the URM (unified resource management) creation service.

Example

# HELP service_urm_new_call_total Number of calls
# TYPE service_urm_new_call_total counter
service_urm_new_call_total{method="find_urms"} 6451

urm new duration

Duration of calls to the URM creation service.

Example

# HELP service_urm_new_duration Duration of calls
# TYPE service_urm_new_duration histogram
service_urm_new_duration_bucket{method="find_urms",le="0.005"} 6198
--

User new call total

Number of calls to the user creation service.

Example

# HELP service_user_new_call_total Number of calls
# TYPE service_user_new_call_total counter
service_user_new_call_total{method="find_permission_for_user"} 4806
--

User new duration

Duration of calls to the user creation service.

Example

# HELP service_user_new_duration Duration of calls
# TYPE service_user_new_duration histogram
service_user_new_duration_bucket{method="find_permission_for_user",le="0.005"} 4039
--

InfluxDB storage statistics

To learn how InfluxDB writes, stores, and caches data, see InfluxDB storage engine.

Bucket measurement number

Number of measurements in a bucket.

Example

# HELP storage_bucket_measurement_num Gauge of measurement cardinality per bucket
# TYPE storage_bucket_measurement_num gauge
storage_bucket_measurement_num{bucket="0c3dd7d2d97f4b23"} 4
--

Bucket series number

Number of series in a bucket.

Example

# HELP storage_bucket_series_num Gauge of series cardinality per bucket
# TYPE storage_bucket_series_num gauge
storage_bucket_series_num{bucket="0c3dd7d2d97f4b23"} 38
--

Cache disk bytes

Size (in bytes) of the most recent snapshot.

Example

# HELP storage_cache_disk_bytes Gauge of size of most recent snapshot
# TYPE storage_cache_disk_bytes gauge
storage_cache_disk_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Cache in use bytes

Current memory consumption (in bytes) of the cache.

Example

# HELP storage_cache_inuse_bytes Gauge of current memory consumption of cache
# TYPE storage_cache_inuse_bytes gauge
storage_cache_inuse_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Cache latest snapshot

Unix time of the most recent snapshot.

Example

# HELP storage_cache_latest_snapshot Unix time of most recent snapshot
# TYPE storage_cache_latest_snapshot gauge
storage_cache_latest_snapshot{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 1.644269658196893e+09
--

Cache writes with dropped points

Cumulative number of cached writes that had rejected points. Writes with rejected points also increment the write errors counter (storage_cache_writes_err).

Example

# HELP storage_cache_writes_dropped Counter of writes to cache with some dropped points
# TYPE storage_cache_writes_dropped counter
storage_cache_writes_dropped{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Cache writes failed

Cumulative number of cached writes that failed, inclusive of cache writes with dropped points (storage_cache_writes_dropped).

Example

# HELP storage_cache_writes_err Counter of failed writes to cache
# TYPE storage_cache_writes_err counter
storage_cache_writes_err{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Cache writes total

Cumulative number of writes to cache.

Example

# HELP storage_cache_writes_total Counter of all writes to cache
# TYPE storage_cache_writes_total counter
storage_cache_writes_total{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Compactions active

Currently running TSM compactions (by level).

Example

# HELP storage_compactions_active Gauge of compactions (by level) currently running
# TYPE storage_compactions_active gauge
storage_compactions_active{bucket="ec3f82d1de90eddf",engine="tsm1",id="565",level="1",path="/Users/me/.influxdbv2/engine/data/ec3f82d1de90eddf/autogen/565",walPath="/Users/me/.influxdbv2/engine/wal/ec3f82d1de90eddf/autogen/565"} 0
--

Compactions since startup

TSM compactions (by level) since startup.

Example

# HELP storage_compactions_duration_seconds Histogram of compactions by level since startup
# TYPE storage_compactions_duration_seconds histogram
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="60"} 1
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="600"} 1
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="6000"} 1
storage_compactions_duration_seconds_bucket{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567",le="+Inf"} 1
storage_compactions_duration_seconds_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 0.167250668
storage_compactions_duration_seconds_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="cache",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 1
--

Compactions failed

Failed TSM compactions (by level).

Example

# HELP storage_compactions_failed Counter of TSM compactions (by level) that have failed due to error
# TYPE storage_compactions_failed counter
storage_compactions_failed{bucket="ec3f82d1de90eddf",engine="tsm1",id="565",level="1",path="/Users/me/.influxdbv2/engine/data/ec3f82d1de90eddf/autogen/565",walPath="/Users/me/.influxdbv2/engine/wal/ec3f82d1de90eddf/autogen/565"} 0
--

Compactions queued

Queued TSM compactions (by level).

Example

# HELP storage_compactions_queued Counter of TSM compactions (by level) that are currently queued
# TYPE storage_compactions_queued gauge
storage_compactions_queued{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="567",level="1",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/567",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/567"} 0
--

Retention check duration

Retention policy check duration (in seconds).

Example

# HELP storage_retention_check_duration Histogram of duration of retention check (in seconds)
# TYPE storage_retention_check_duration histogram
storage_retention_check_duration_bucket{le="0.005"} 1
storage_retention_check_duration_bucket{le="0.01"} 1
storage_retention_check_duration_bucket{le="0.025"} 1
storage_retention_check_duration_bucket{le="0.05"} 1
storage_retention_check_duration_bucket{le="0.1"} 1
storage_retention_check_duration_bucket{le="0.25"} 1
storage_retention_check_duration_bucket{le="0.5"} 1
storage_retention_check_duration_bucket{le="1"} 1
storage_retention_check_duration_bucket{le="2.5"} 1
storage_retention_check_duration_bucket{le="5"} 1
storage_retention_check_duration_bucket{le="10"} 1
storage_retention_check_duration_bucket{le="+Inf"} 1
storage_retention_check_duration_sum 0.000351857
storage_retention_check_duration_count 1
--

Shard disk size

Disk size (in bytes) of the shard.

Example

# HELP storage_shard_disk_size Gauge of the disk size for the shard
# TYPE storage_shard_disk_size gauge
storage_shard_disk_size{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 4.188743e+06
--

Shard fields created

Number of shard fields created.

Example

# HELP storage_shard_fields_created Counter of the number of fields created
# TYPE storage_shard_fields_created counter
storage_shard_fields_created{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Shard series

Number of series in the shard index.

Example

# HELP storage_shard_series Gauge of the number of series in the shard index
# TYPE storage_shard_series gauge
storage_shard_series{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 38
--

Shard writes

Number of shard write requests.

Example

# HELP storage_shard_write_count Count of the number of write requests
# TYPE storage_shard_write_count counter
storage_shard_write_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Shard dropped points

Number of rejected points in shard writes.

Example

# HELP storage_shard_write_dropped_sum Counter of the number of points dropped
# TYPE storage_shard_write_dropped_sum counter
storage_shard_write_dropped_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Shard writes with errors

Number of shard write requests with errors.

Example

# HELP storage_shard_write_err_count Count of the number of write requests with errors
# TYPE storage_shard_write_err_count counter
storage_shard_write_err_count{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Points in shard writes with errors

Number of points in shard write requests with errors.

Example

# HELP storage_shard_write_err_sum Counter of the number of points for write requests with errors
# TYPE storage_shard_write_err_sum counter
storage_shard_write_err_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Points in shard writes

Number of points in shard write requests.

Example

# HELP storage_shard_write_sum Counter of the number of points for write requests
# TYPE storage_shard_write_sum counter
storage_shard_write_sum{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Shard data size

Gauge of the data size (in bytes) for each shard.

Example

# HELP storage_tsm_files_disk_bytes Gauge of data size in bytes for each shard
# TYPE storage_tsm_files_disk_bytes gauge
storage_tsm_files_disk_bytes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 4.188743e+06
--

Shard files

Number of files per shard.

Example

# HELP storage_tsm_files_total Gauge of number of files per shard
# TYPE storage_tsm_files_total gauge
storage_tsm_files_total{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 1
--

WAL size

WAL size (in bytes).

Example

# HELP storage_wal_size Gauge of size of WAL in bytes
# TYPE storage_wal_size gauge
storage_wal_size{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

WAL write attempts

Cumulative number of write attempts to the WAL.

Example

# HELP storage_wal_writes Number of write attempts to the WAL
# TYPE storage_wal_writes counter
storage_wal_writes{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

WAL failed write attempts

Cumulative number of failed write attempts to the WAL.

Example

# HELP storage_wal_writes_err Number of failed write attempts to the WAL
# TYPE storage_wal_writes_err counter
storage_wal_writes_err{bucket="0c3dd7d2d97f4b23",engine="tsm1",id="561",path="/Users/me/.influxdbv2/engine/data/0c3dd7d2d97f4b23/autogen/561",walPath="/Users/me/.influxdbv2/engine/wal/0c3dd7d2d97f4b23/autogen/561"} 0
--

Points dropped due to partial writes

Number of points dropped due to partial writes.

Example

# HELP storage_writer_dropped_points Histogram of number of points dropped due to partial writes
# TYPE storage_writer_dropped_points histogram
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 0
storage_writer_dropped_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 0
storage_writer_dropped_points_sum{path="/Users/me/.influxdbv2/engine"} 0
storage_writer_dropped_points_count{path="/Users/me/.influxdbv2/engine"} 0
--

Points in shard write requests with errors

Number of points in shard write requests with errors.

Example

# HELP storage_writer_err_points Histogram of number of points in errored shard write requests
# TYPE storage_writer_err_points histogram
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 0
storage_writer_err_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 0
storage_writer_err_points_sum{path="/Users/me/.influxdbv2/engine"} 0
storage_writer_err_points_count{path="/Users/me/.influxdbv2/engine"} 0
--

Points in successful shard write requests

Number of points in successful shard write requests.

Example

# HELP storage_writer_ok_points Histogram of number of points in successful shard write requests
# TYPE storage_writer_ok_points histogram
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 6
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 6
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 8
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 20
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 24
storage_writer_ok_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 24
storage_writer_ok_points_sum{path="/Users/me/.influxdbv2/engine"} 125787
storage_writer_ok_points_count{path="/Users/me/.influxdbv2/engine"} 24
--

Points in write requests

Number of points in write requests.

Example

# HELP storage_writer_req_points Histogram of number of points requested to be written
# TYPE storage_writer_req_points histogram
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="10"} 6
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="100"} 6
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="1000"} 6
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="10000"} 14
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="100000"} 18
storage_writer_req_points_bucket{path="/Users/me/.influxdbv2/engine",le="+Inf"} 18
storage_writer_req_points_sum{path="/Users/me/.influxdbv2/engine"} 125787
storage_writer_req_points_count{path="/Users/me/.influxdbv2/engine"} 18
--

Shard write request timeouts

Cumulative number of shard write request timeouts.

Example

# HELP storage_writer_timeouts Number of shard write request timeouts
# TYPE storage_writer_timeouts counter
storage_writer_timeouts{path="/Users/me/.influxdbv2/engine"} 0
--

InfluxDB task statistics

Task executor errors

Number of errors thrown by the executor with the type of error (ex. Invalid, Internal, etc.)

Example

# HELP task_executor_errors_counter The number of errors thrown by the executor with the type of error (ex. Invalid, Internal, etc.)
# TYPE task_executor_errors_counter counter
task_executor_errors_counter{errorType="internal error",task_type="system"} 1183
--

Task executor promise queue usage

Percent of the promise queue that is currently full.

Example

# HELP task_executor_promise_queue_usage Percent of the promise queue that is currently full
# TYPE task_executor_promise_queue_usage gauge
task_executor_promise_queue_usage 0

Task executor run duration

Duration (in seconds) between a task run starting and finishing.

Example

# HELP task_executor_run_duration The duration in seconds between a run starting and finishing.
# TYPE task_executor_run_duration summary

task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.5"} 0.865043855
task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.9"} 0.865043855
task_executor_run_duration{taskID="08017725990f6000",task_type="",quantile="0.99"} 0.865043855
task_executor_run_duration_sum{taskID="08017725990f6000",task_type=""} 1.524920552
task_executor_run_duration_count{taskID="08017725990f6000",task_type=""} 2
--

Task executor run latency seconds

Latency between the task run’s scheduled start time and the execution time, by task type.

Example

# HELP task_executor_run_latency_seconds Records the latency between the time the run was due to run and the time the task started execution, by task type
# TYPE task_executor_run_latency_seconds histogram
task_executor_run_latency_seconds_bucket{task_type="system",le="0.005"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.01"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.025"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.05"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.1"} 0
task_executor_run_latency_seconds_bucket{task_type="system",le="0.25"} 2
task_executor_run_latency_seconds_bucket{task_type="system",le="0.5"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="1"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="2.5"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="5"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="10"} 6
task_executor_run_latency_seconds_bucket{task_type="system",le="+Inf"} 6
task_executor_run_latency_seconds_sum{task_type="system"} 2.237636
task_executor_run_latency_seconds_count{task_type="system"} 6
--

Task executor run queue delta

Duration (in seconds) between the task run’s scheduled start time and the execution time.

Example

# HELP task_executor_run_queue_delta The duration in seconds between a run being due to start and actually starting.
# TYPE task_executor_run_queue_delta summary
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.5"} 0.324742
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.9"} 0.324742
task_executor_run_queue_delta{taskID="08017725990f6000",task_type="",quantile="0.99"} 0.324742
task_executor_run_queue_delta_sum{taskID="08017725990f6000",task_type=""} 0.674875
task_executor_run_queue_delta_count{taskID="08017725990f6000",task_type=""} 2
--

Task executor total runs active

Number of workers currently running tasks.

Example

# HELP task_executor_total_runs_active Total number of workers currently running tasks
# TYPE task_executor_total_runs_active gauge
task_executor_total_runs_active 0

Task executor total runs complete

Number of task runs completed across all tasks, split out by success or failure.

Example

# HELP task_executor_total_runs_complete Total number of runs completed across all tasks, split out by success or failure.
# TYPE task_executor_total_runs_complete counter
task_executor_total_runs_complete{status="failed",task_type="system"} 1384
task_executor_total_runs_complete{status="success",task_type="system"} 6
--

Task executor workers busy

Percent of total available workers that are currently busy.

Example

# HELP task_executor_workers_busy Percent of total available workers that are currently busy
# TYPE task_executor_workers_busy gauge
task_executor_workers_busy 0

Task scheduler current execution

Number of tasks currently being executed.

Example

# HELP task_scheduler_current_execution Number of tasks currently being executed
# TYPE task_scheduler_current_execution gauge
task_scheduler_current_execution 128

Task scheduler execute delta

Duration (in seconds) between a task run starting and finishing.

Example

# HELP task_scheduler_execute_delta The duration in seconds between a run starting and finishing.
# TYPE task_scheduler_execute_delta summary
task_scheduler_execute_delta{quantile="0.5"} NaN
--

Task scheduler schedule delay

Summary of the delay between when a task is scheduled to run and when it is told to execute.

Example

# HELP task_scheduler_schedule_delay The duration between when a Item should be scheduled and when it is told to execute.
# TYPE task_scheduler_schedule_delay summary
task_scheduler_schedule_delay{quantile="0.5"} 120.001036
task_scheduler_schedule_delay{quantile="0.9"} 120.001074
task_scheduler_schedule_delay{quantile="0.99"} 120.001074
task_scheduler_schedule_delay_sum 720.0033010000001
task_scheduler_schedule_delay_count 6
--

Task scheduler total execute failure

Number of times a scheduled task execution has failed.

Example

# HELP task_scheduler_total_execute_failure Total number of times an execution has failed.
# TYPE task_scheduler_total_execute_failure counter
task_scheduler_total_execute_failure 0

Task scheduler total execution calls

Number of scheduled executions across all tasks.

Example

# HELP task_scheduler_total_execution_calls Total number of executions across all tasks.
# TYPE task_scheduler_total_execution_calls counter
task_scheduler_total_execution_calls 4806

Task scheduler total release calls

Number of release requests.

Example

# HELP task_scheduler_total_release_calls Total number of release requests.
# TYPE task_scheduler_total_release_calls counter
task_scheduler_total_release_calls 0

Task scheduler total schedule calls

Number of schedule requests.

Example

# HELP task_scheduler_total_schedule_calls Total number of schedule requests.
# TYPE task_scheduler_total_schedule_calls counter
task_scheduler_total_schedule_calls 6

Task scheduler total schedule fails

Number of schedule requests that fail to schedule.

Example

# HELP task_scheduler_total_schedule_fails Total number of schedule requests that fail to schedule.
# TYPE task_scheduler_total_schedule_fails counter
task_scheduler_total_schedule_fails 0

cpu memory metrics performance Prometheus storage usage

Was this page helpful?

Thank you for your feedback!

Support and feedback

Thank you for being part of our community! We welcome and encourage your feedback and bug reports for InfluxDB and this documentation. To find support, use the following resources:

Customers with an annual or support contract can contact InfluxData Support.

Edit this page Submit docs issue Submit InfluxDB issue