Metrics q through z
note
Metrics for materialized views and shared-data clusters are detailed in the corresponding sections:
- Metrics for asynchronous materialized view metrics
- Metrics for Shared-data Dashboard metrics, and Starlet Dashboard metrics
For more information on how to build a monitoring service for your StarRocks cluster, see Monitor and Alert.
query_cache_capacityβ
- Description: Capacity of query cache.
query_cache_hit_countβ
- Unit: Count
- Description: Number of query cache hits.
query_cache_hit_ratioβ
- Unit: -
- Description: Hit ratio of query cache.
query_cache_lookup_countβ
- Unit: Count
- Description: Total number of query cache lookups.
query_cache_usageβ
- Unit: Bytes
- Description: Current query cache usages.
query_cache_usage_ratioβ
- Unit: -
- Description: Current query cache usage ratio.
query_mem_bytesβ
- Unit: Bytes
- Description: Memory used by queries.
query_scan_bytesβ
- Unit: Bytes
- Description: Total number of scanned bytes.
query_scan_bytes_per_secondβ
- Unit: Bytes/s
- Description: Estimated rate of scanned bytes per second.
query_scan_rowsβ
- Unit: Count
- Description: Total number of scanned rows.
query_spill_trigger_totalβ
- Unit: Count
- Labels:
storage_type - Description: Number of spillable operator instances that triggered at least one spill, broken down by storage backend (
local,remote). Incremented once per operator instance at the first flush callback.
query_spill_bytes_write_totalβ
- Unit: Bytes
- Labels:
storage_type - Description: Cumulative payload bytes written by spillable operators to spill storage, broken down by storage backend (
local,remote).
query_spill_bytes_read_totalβ
- Unit: Bytes
- Labels:
storage_type - Description: Cumulative payload bytes read back from spill storage during restore, broken down by storage backend.
query_spill_blocks_write_totalβ
- Unit: Count
- Labels:
storage_type - Description: Number of spill blocks allocated for writing, broken down by storage backend. Useful for estimating IO count scale on the write path.
query_spill_blocks_read_totalβ
- Unit: Count
- Labels:
storage_type - Description: Number of spill blocks opened for reading, broken down by storage backend. Useful for estimating IO count scale on the read path.
query_spill_write_io_duration_ns_totalβ
- Unit: Nanoseconds
- Labels:
storage_type - Description: Cumulative wall-clock time spent in write-side spill IO (block append and flush), broken down by storage backend. Useful for tracking write-side spill performance.
query_spill_read_io_duration_ns_totalβ
- Unit: Nanoseconds
- Labels:
storage_type - Description: Cumulative wall-clock time spent in read-side spill IO (block reads during restore), broken down by storage backend. Useful for tracking read-side spill performance.
readable_blocks_total (Deprecated)β
recycle_bin_database_numβ
- Unit: Count
- Description: Number of databases currently held in the FE catalog recycle bin.
recycle_bin_partition_numβ
- Unit: Count
- Description: Number of partitions currently held in the FE catalog recycle bin.
recycle_bin_table_numβ
- Unit: Count
- Description: Number of tables currently held in the FE catalog recycle bin.
resource_group_bigquery_countβ
- Unit: Count
- Description: Number of queries in each resource group that have triggered the limit for big queries. This is an instantaneous value.
resource_group_concurrency_overflow_countβ
- Unit: Count
- Description: Number of queries in each resource group that have triggered the concurrency limit. This is an instantaneous value.
resource_group_connector_scan_use_ratio (Deprecated)β
- Unit: -
- Description: Ratio of external table scan thread time slices used by each resource group to the total used by all resource groups. This is an average value over the time interval between two metric retrievals.
resource_group_cpu_limit_ratioβ
- Unit: -
- Description: Ratio of the CPU core limit for each resource group to the total CPU core limit for all resource groups. This is an instantaneous value.
resource_group_cpu_use_ratio (Deprecated)β
- Unit: -
- Description: Ratio of pipeline thread time slices used by each resource group to the total used by all resource groups. This is an average value over the time interval between two metric retrievals.
resource_group_inuse_cpu_coresβ
- Unit: Count
- Description: Estimated number of CPU cores currently in use by each resource group. This is an average value over the time interval between two metric retrievals.
resource_group_mem_inuse_bytesβ
- Unit: Bytes
- Description: Currently used memory by each resource group, measured in bytes. This is an instantaneous value.
resource_group_mem_limit_bytesβ
- Unit: Bytes
- Description: Memory limit for each resource group, measured in bytes. This is an instantaneous value.
resource_group_running_queriesβ
- Unit: Count
- Description: Number of queries currently running in each resource group. This is an instantaneous value.
resource_group_scan_use_ratio (Deprecated)β
- Unit: -
- Description: Ratio of internal table scan thread time slices used by each resource group to the total used by all resource groups. This is an average value over the time interval between two metric retrievals.
resource_group_total_queriesβ
- Unit: Count
- Description: Total number of queries executed in each resource group, including those currently running. This is an instantaneous value.
result_block_queue_countβ
- Unit: Count
- Description: Number of results in the result block queue.
result_buffer_block_countβ
- Unit: Count
- Description: Number of blocks in the result buffer.
routine_load_task_countβ
- Unit: Count
- Description: Number of currently running Routine Load tasks.
rowset_count_generated_and_in_useβ
- Unit: Count
- Description: Number of rowset IDs currently in use.
rowset_metadata_mem_bytesβ
- Unit: Bytes
- Description: Total number of bytes for rowset metadata.
running_base_compaction_task_numβ
- Unit: Count
- Description: Total number of running base compaction tasks.
running_cumulative_compaction_task_numβ
- Unit: Count
- Description: Total number of running cumulative compactions.
running_update_compaction_task_numβ
- Unit: Count
- Description: Total number of currently running Primary Key table compaction tasks.
schema_change_mem_bytesβ
- Unit: Bytes
- Description: Memory used for Schema Change.
segment_flush_queue_countβ
- Unit: Count
- Description: Number of queued tasks in the segment flush thread pool.
segment_metadata_mem_bytesβ
- Unit: Bytes
- Description: Memory used by segment metadata.
segment_readβ
- Unit: Count
- Description: Total number of segment reads.
segment_replicate_queue_countβ
- Unit: Count
- Description: Queued task count in the Segment Replicate thread pool.
segment_zonemap_mem_bytesβ
- Unit: Bytes
- Description: Memory used by segment zonemap.
short_key_index_mem_bytesβ
- Unit: Bytes
- Description: Memory used by the short key index.
small_file_cache_countβ
- Unit: Count
- Description: Number of small file caches.
spill_disk_bytes_usedβ
- Unit: Bytes
- Labels:
storage_type - Description: Current disk bytes reserved across all spill storage directories. The
storage_type=localvariant aggregates the live reserved bytes across every directory managed by the BE's spillDirManager. Thestorage_type=remotevariant is reported for completeness and is currently always 0 because remote spill storage is tracked per-query rather than globally.
snmpβ
- Unit: -
- Description: Metrics returned by
/proc/net/snmp.
starrocks_be_clone_task_copy_bytesβ
- Unit: Bytes
- Type: Cumulative
- Description: The total file size copied by Clone tasks in the BE node, including both INTER_NODE and INTRA_NODE types.
starrocks_be_clone_task_copy_duration_msβ
- Unit: ms
- Type: Cumulative
- Description: The total time for copy consumed by Clone tasks in the BE node, including both INTER_NODE and INTRA_NODE types.
starrocks_be_exec_state_report_active_threadsβ
- Unit: Count
- Type: Instantaneous
- Description: The number of tasks being executed in the thread pool that reports the execution status of the Fragment instance.
starrocks_be_exec_state_report_queue_countβ
- Unit: Count
- Type: Instantaneous
- Description: The number of tasks queued in the thread pool that reports the execution status of the Fragment instance, up to a maximum of 1000.
starrocks_be_exec_state_report_running_threadsβ
- Unit: Count
- Type: Instantaneous
- Description: The number of threads in the thread pool that reports the execution status of the Fragment instance, with a minimum of 1 and a maximum of 2.
starrocks_be_exec_state_report_threadpool_sizeβ
- Unit: Count
- Type: Instantaneous
- Description: The maximum number of threads in the thread pool that reports the execution status of the Fragment instance, defaults to 2.
starrocks_be_files_scan_num_bytes_readβ
- Unit: Bytes
- Description: Total bytes read from external storage. Labels:
file_format,scan_type.
starrocks_be_files_scan_num_files_readβ
- Unit: Count
- Description: Number of files read from external storage (CSV, Parquet, ORC, JSON, Avro). Labels:
file_format,scan_type.
starrocks_be_files_scan_num_raw_rows_readβ
- Unit: Count
- Description: Total raw rows read from external storage before format validation and predicate filtering. Labels:
file_format,scan_type.
starrocks_be_files_scan_num_rows_returnβ
- Unit: Count
- Description: Number of rows returned after predicate filtering. Labels:
file_format,scan_type.
starrocks_be_files_scan_num_valid_rows_readβ
- Unit: Count
- Description: Number of valid rows read (excluding rows with invalid format). Labels:
file_format,scan_type.
starrocks_be_lake_tablet_metadata_get_not_found_totalβ
- Unit: Count
- Type: Cumulative
- Description: Shared-data only. Total number of remote storage read attempts for lake tablet metadata that return
NotFound. A tablet's metadata lives either in its own metadata object or inside a bundled metadata file, never in both, and reads of either location are counted, including the bundle reads issued by vacuum. Each failed fallback read is counted separately. Cache misses and successful reads do not increment this metric. Reads of a source cluster's metadata during replication and of snapshot metadata during restore are not counted.
starrocks_be_mem_pool_mem_limit_bytesβ
- Unit: Bytes
- Type: Instantaneous
- Description: Memory limit for each memory pool, measured in bytes.
starrocks_be_mem_pool_mem_usage_bytesβ
- Unit: Bytes
- Type: Instantaneous
- Description: Currently used total memory by each memory pool, measured in bytes.
starrocks_be_mem_pool_mem_usage_ratioβ
- Unit: -
- Type: Instantaneous
- Description: Ratio of the memory usage of the memory pool to the memory limit of the memory pool.
starrocks_be_mem_pool_workgroup_countβ
- Unit: Count
- Type: Instantaneous
- Description: Number of resource groups assigned to each memory pool.
starrocks_be_pipe_prepare_pool_queue_lenβ
- Unit: Count
- Type: Instantaneous
- Description: Instantaneous value of pipeline prepare thread pool task queue length.
starrocks_be_priority_exec_state_report_active_threadsβ
- Unit: Count
- Type: Instantaneous
- Description: The number of tasks being executed in the thread pool that reports the final execution state of the Fragment instance.
starrocks_be_priority_exec_state_report_queue_countβ
- Unit: Count
- Type: Instantaneous
- Description: The number of tasks queued in the thread pool that reports the final execution status of the Fragment instance, up to a maximum of 2147483647.
starrocks_be_priority_exec_state_report_running_threadsβ
- Unit: Count
- Type: Instantaneous
- Description: The number of threads in the thread pool that reports the final execution status of the Fragment instance, with a minimum of 1 and a maximum of 2.
starrocks_be_priority_exec_state_report_threadpool_sizeβ
- Unit: Count
- Type: Instantaneous
- Description: The maximum number of threads in the thread pool that reports the final execution status of the Fragment instance, defaults to 2.
starrocks_be_resource_group_cpu_limit_ratioβ
- Unit: -
- Type: Instantaneous
- Description: Instantaneous value of resource group cpu quota ratio.
starrocks_be_resource_group_cpu_use_ratioβ
- Unit: -
- Type: Average
- Description: The ratio of CPU time used by the resource group to the CPU time of all resource groups.
starrocks_be_resource_group_mem_inuse_bytesβ
- Unit: Bytes
- Type: Instantaneous
- Description: Instantaneous value of resource group memory usage.
starrocks_be_resource_group_mem_limit_bytesβ
- Unit: Bytes
- Type: Instantaneous
- Description: Instantaneous value of resource group memory quota.
starrocks_be_segment_file_not_found_totalβ
- Unit: Count
- Description: Total number of times a segment file was not found (file missing) during segment open. A continuously increasing value may indicate data loss or storage inconsistency.
starrocks_be_staros_shard_info_fallback_totalβ
- Unit: Count
- Type: Cumulative
- Description: Shared-data only. Total number of actual starmgr RPCs (
g_starlet->get_shard_info()) that the BE's StarOSWorker had to issue because the requested shard info was not in the local cache (i.e. the FE had not pushed the shard to this BE before a query/compaction/lake operation referenced it). Only counted when the starlet readiness check passes and the RPC is actually dispatched; starlet-not-ready timeouts are not included. Should normally be near zero. A sustained or rising rate is a strong signal that FE-side task or node selection is scheduling work on a BE that does not yet have the shard, or that shard push propagation from FE is lagging. Recommended alert: high per-BE rate over a 5-minute window.