Create full-fledged APIs for slowly moving datasets without writing a single line of code.
New and extensible file format for storage of large columnar datasets.
Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL
DuckDB-powered data lake analytics from Postgres
Open-source IFC toolkit: WebGPU rendering, columnar in-memory store, exact-arithmetic geometry kernel. Runs from a CDN. 30+ TypeScript packages and 5 Rust crates.
SIMD-accelerated columnar database for analytics — pure C, zero dependencies
Manipulate arrays of complex data structures as easily as Numpy.
The memory & storage engine for AI agents. Multi-model, edge-to-cloud, PostgreSQL-compatible.
🧊 A curated list of OLAP databases, data lake tools, columnar engines, and analytics frameworks for data engineers.
Graph database native to the cloud. Embedded, multi-tenant, built on object storage.
Fast, minimal, and ergonomic zero-copy Apache Arrow tabular data implementation in Rust, with PyO3, Python bindings, NdArray, XArray, shared-memory and low-latency SIMD for data-engineering and columnar workloads. Bridge to Polars and Arrow-rs over FFI effortlessly.
Uni is a modern, embedded database that combines property graph (OpenCypher), vector search, and columnar storage (Lance) into a single, cohesive engine. It is designed for applications requiring local, fast, and multimodal data access, backed by object storage (S3/GCS) durability.
C-Store : A column-oriented DBMS prototype (frozen)
In-memory, columnar, arrow-based database.
ergonomic columnar storage encoding crate
Full-stack performance engineering handbook — Linux kernel & eBPF, profiling/tracing, network & JVM/GPU tuning, storage engines, databases, distributed systems and streaming/ML data architectures, plus the high-performance data structures behind them: probabilistic sketches, vector/ANN indexes, columnar encoding, LSM & learned indexes, HFT C++.
Quick Data Format — fast, compact binary serialization for Go. encoding/json-style API, columnar per-column codecs, up to 68% smaller than Protobuf.
Format- and source-agnostic ingestion framework: a common execution runtime for turning record-oriented data sources into typed columnar data. Rust core, Python bindings; adapters live in separate packages.
To associate your repository with the columnar topic, visit your repo's landing page and select "manage topics."