columnar

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

New and extensible file format for storage of large columnar datasets.

Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL

DuckDB-powered data lake analytics from Postgres

Open-source IFC toolkit: WebGPU rendering, columnar in-memory store, exact-arithmetic geometry kernel. Runs from a CDN. 30+ TypeScript packages and 5 Rust crates.

SIMD-accelerated columnar database for analytics — pure C, zero dependencies

Manipulate arrays of complex data structures as easily as Numpy.

The memory & storage engine for AI agents. Multi-model, edge-to-cloud, PostgreSQL-compatible.

🧊 A curated list of OLAP databases, data lake tools, columnar engines, and analytics frameworks for data engineers.

Graph database native to the cloud. Embedded, multi-tenant, built on object storage.

Fast, minimal, and ergonomic zero-copy Apache Arrow tabular data implementation in Rust, with PyO3, Python bindings, NdArray, XArray, shared-memory and low-latency SIMD for data-engineering and columnar workloads. Bridge to Polars and Arrow-rs over FFI effortlessly.

Uni is a modern, embedded database that combines property graph (OpenCypher), vector search, and columnar storage (Lance) into a single, cohesive engine. It is designed for applications requiring local, fast, and multimodal data access, backed by object storage (S3/GCS) durability.

C-Store : A column-oriented DBMS prototype (frozen)

In-memory, columnar, arrow-based database.

Backend for columnar, fully orchestrated HEP analyses with pure Python, law and order.

ergonomic columnar storage encoding crate

Full-stack performance engineering handbook — Linux kernel & eBPF, profiling/tracing, network & JVM/GPU tuning, storage engines, databases, distributed systems and streaming/ML data architectures, plus the high-performance data structures behind them: probabilistic sketches, vector/ANN indexes, columnar encoding, LSM & learned indexes, HFT C++.

Columnar type support for Rust

Quick Data Format — fast, compact binary serialization for Go. encoding/json-style API, columnar per-column codecs, up to 68% smaller than Protobuf.

Memory-safe, clean-room Rust reimplementation of pandas with packetized conformance gates, strict/hardened runtime modes, and RaptorQ-backed artifact durability.