Databases for Observability

Lucene-based distributed search and analytics engine for text, vectors, logs and metrics.

CNCF-graduated pull-based monitoring system with a local TSDB, PromQL and alerting rules.

Open-source columnar OLAP database known for very fast aggregations over billions of rows.

Apache-licensed, foundation-governed fork of Elasticsearch for search, vectors and observability.

Purpose-built time-series database, rebuilt in Rust on Arrow, DataFusion and Parquet for version 3.

Machine-data indexing and search platform with schema-on-read SPL queries, now owned by Cisco.

PostgreSQL extension adding hypertables, columnar compression and continuous aggregates for time series.

Real-time analytics database for sub-second slice-and-dice over streaming event data.

Columnar time-series SQL database built for market data and very high ingest rates.

Microsoft's Kusto engine: fast KQL analytics over logs, telemetry and time series at petabyte scale.

Real-time OLAP store from LinkedIn for user-facing analytics at very high query rates.

Label-indexed log aggregation: Prometheus-style streams, chunks on object storage, LogQL queries.

Resource-frugal, Prometheus-compatible metrics database, run as a single binary or a sharded cluster.

Veteran metrics stack: Carbon ingestion, Whisper files and the render API that shaped modern dashboards.

Single-binary Rust observability platform storing logs, metrics and traces as Parquet on object storage.

Log database from the VictoriaMetrics team: schemaless ingestion, LogsQL and low RAM and disk use.

Fast SQL-first search database, forked from Sphinx, with columnar storage and vector KNN.

Rust telemetry datalake for logs, metrics and traces on S3, queried with SQL.

OpenTelemetry-native APM and observability platform storing logs, metrics and traces in ClickHouse.

A single C++ binary for streaming SQL, built on ClickHouse's engine with streams and windows.

Real-time MPP analytical database with MySQL compatibility, search indexes and lakehouse access.

Grafana Labs' horizontally scalable, multi-tenant long-term store for Prometheus and OTLP metrics.

Rust observability database that keeps metrics, logs and traces in one columnar engine on object storage.

Object-storage-backed distributed tracing backend with TraceQL search and trace-derived metrics.

Sidecar-plus-object-storage layer giving Prometheus global queries, HA dedup and long retention.

Continuous profiling database that stores CPU and memory profiles over time on object storage.

Managed ClickHouse platform that turns SQL pipes into low-latency, versioned HTTP APIs.

Cloud-native search engine on object storage for logs and traces, built on Tantivy.

Managed event and telemetry store with schema-on-read ingest and the piped APL query language.

CNCF multi-tenant, horizontally scalable long-term storage for Prometheus metrics on object storage.

HBase-backed time-series database from the Hadoop era; still in service, rarely chosen for new work.

Rust cloud-native time-series database with SQL on DataFusion and InfluxDB-style ingestion.

CNCF sandbox distributed time-series database from Huawei Cloud, compatible with InfluxQL.

Java time-series database layered on Cassandra or ScyllaDB, from the OpenTSDB lineage.

Compressed columnar analytics engine on a MySQL front end, now sold by IgniteTech as Infobright AI.

Uber-born distributed TSDB and aggregator for Prometheus-scale metrics with tunable replication.

Small-footprint, clusterable time-series database with a query language built for grouping series.

AWS time-series services: managed InfluxDB today, with serverless LiveAnalytics closed to new customers.

Netflix's in-memory dimensional time-series database for operational metrics, queried with a stack language.

Commercial cloud and enterprise distribution of Apache Doris from its core maintainers.

Distributed in-memory time-series database with PromQL, ingesting from Kafka and persisting to Cassandra.

Experimental Rust columnar analytics engine built to scan billions of rows per second on one machine.

Multi-model database for IoT and observability: time series, full-text, vector and key-value on Parquet.

Erlang metric store on riak_core and ZFS with a SQL-like query language; dormant since 2019.

Rackspace's multi-tenant metrics ingestion, rollup and query service on Cassandra; dormant since 2022.

Streaming data lake for log-scale event data, with ClickHouse-based SQL over object storage.

Masterless wide-column database built for always-on writes across data centers.

Google's managed wide-column store, the original Bigtable, with HBase API and SQL access.

Cheap, schemaless key-attribute store inside an Azure Storage account.