Apache Kylin
activeby Apache Software Foundation · since 2014 · also known as Kylin
OLAP engine that pre-computes cubes and aggregate indexes for sub-second SQL on huge datasets.
Overview
Apache Kylin, open-sourced by eBay in 2014, answers SQL over billions of rows in sub-second time by pre-computing aggregates: you define a model (fact and dimension tables), Kylin builds cube or aggregate indexes with Spark, and queries are routed to the smallest matching index. Kylin 5 reworked this around flexible indexes, internal tables, a Spark-based query engine and Parquet storage. It suits stable, dimensional BI workloads with predictable queries; ad-hoc analysis and fast-changing schemas fit modern MPP engines better. Kyligence sells the commercial version.
Strengths & trade-offs
Strengths
- +Sub-second queries on huge datasets via pre-computed aggregate indexes
- +Predictable latency for dashboards regardless of raw data size
- +Standard SQL and BI connectors (Tableau, Power BI, Excel MDX via Kyligence)
- +Proven at eBay, Meituan and other large internet companies
Trade-offs
- −Requires upfront modeling and index builds; poor for ad-hoc queries
- −Index build time and storage grow with dimensions
- −Small, mostly China-based community and slow releases
Great for
- +Enterprise BI dashboards with fixed dimensions
- +Replacing legacy MOLAP cubes
- +High-concurrency reporting
Think twice for
- −Ad-hoc exploration
- −Real-time streaming analytics
- −Small datasets
Capabilities
Native or official first-party support · 6 of 25 tracked
Scale & consistency
- Comfortable data size
- Massive · Multi-PB
- Horizontal scaling
- Native
- Multi-region
- No
- Transactions
- None
- Consistency
- Eventual
- Schema
- Strict
- Architecture
- Distributed, Client server
- Query languages
- SQL (ANSI)
Cube builds run on Spark; query nodes scale out; trillion-row deployments reported by users.
Deployment
Ecosystem
Alternatives to Apache Kylin
Real-time analytics database for sub-second slice-and-dice over streaming event data.
apache-kylin vs apache-druid →MPP OLAP database with a fast vectorized engine, real-time upserts and native lakehouse queries.
apache-kylin vs starrocks →Open-source columnar OLAP database known for very fast aggregations over billions of rows.
apache-kylin vs clickhouse →Real-time MPP analytical database with MySQL compatibility, search indexes and lakehouse access.
apache-kylin vs apache-doris →Real-time OLAP store from LinkedIn for user-facing analytics at very high query rates.
apache-kylin vs apache-pinot →Sybase's pioneering columnar warehouse, now SAP IQ and the engine behind HANA Cloud's data lake.
apache-kylin vs sap-iq →Apache Kylin FAQ
What is Apache Kylin?
Apache Kylin is a columnar / OLAP database by Apache Software Foundation, first released in 2014. Apache Kylin, open-sourced by eBay in 2014, answers SQL over billions of rows in sub-second time by pre-computing aggregates: you define a model (fact and dimension tables), Kylin builds cube or aggregate indexes with Spark, and queries are routed to the smallest matching index. Kylin 5 reworked this around flexible indexes, internal tables, a Spark-based query engine and Parquet storage. It suits stable, dimensional BI workloads with predictable queries; ad-hoc analysis and fast-changing schemas fit modern MPP engines better. Kyligence sells the commercial version.
Is Apache Kylin open source?
Yes. Apache Kylin is open source. License: Apache License 2.0.
Does Apache Kylin support ACID transactions?
No. Apache Kylin does not provide ACID transactions; its consistency model is eventual.
Does Apache Kylin scale horizontally?
Apache Kylin scales horizontally out of the box, with built-in sharding or partitioning. It is comfortable at massive scale (Multi-PB).
How can I run Apache Kylin?
You can self-host it.
What is Apache Kylin best for?
Apache Kylin is a strong fit for enterprise BI dashboards with fixed dimensions, replacing legacy MOLAP cubes and high-concurrency reporting. Think twice for ad-hoc exploration.
What are the best alternatives to Apache Kylin?
Common alternatives to Apache Kylin include Apache Druid, StarRocks, ClickHouse, Apache Doris and Apache Pinot. The right choice depends on your workload, scale and hosting; WhichDB's smart match ranks them against your requirements.
How popular is Apache Kylin?
Apache Kylin ranks #196 of 844 databases on the WhichDB Score (16.9/100), and #19 among columnar / OLAP databases. The score combines public adoption signals such as package downloads, GitHub activity, job posts and developer discussion.