Lib.rs

tantivy

Search engine library

redb

Rust Embedded DataBase

surrealdb

A scalable, distributed, collaborative, document-graph database, for the realtime web

fjall

LSM-based key-value storage engine

sonic-server

Fast, lightweight and schema-less search backend

deltalake

Native Delta Lake implementation in Rust

indicium

in-memory search for collections and key-value stores

rustsec

Client library for the RustSec security advisory database

dittolive-ditto

Ditto is a peer to peer cross-platform database that allows mobile, web, IoT and server apps to sync with or without an internet connection

arrow-ord

Ordering kernels for arrow arrays

oxigraph

a SPARQL database and RDF toolkit

fastdivide

partial port of libdivide. It makes it possible to reduce the cost of divisions.

datafusion-functions-json

JSON functions for DataFusion

grovedb

Fully featured database using balanced hierarchical authenticated data structures

polars-parquet

Apache Parquet I/O operations for Polars

persy

Transactional Persistence Engine

canopydb

Transactional key-value storage engine

yedb

Rugged crash-free embedded and client/server key-value database

marble

garbage-collecting on-disk object store

seekstorm

Search engine library & multi-tenancy server

tickv

(Tiny Circular Key Value) is a small file system allowing key value pairs to be stored in Flash Memory

lancedb

serverless, low-latency vector database for AI applications

native_db

Drop-in embedded database

pokemon-rs

getting Pokémon names

pciid-parser

parsing PCI ID tables

izihawa-tantivy-sstable

sstables for tantivy

tantivy-cli

Command line interface for Tantivy, a search engine library

rustdb

SQL database

process_mining

Process Mining library for working with (object-centric) event data

mmkv

Rust version of MMKV

Alice-Database_DBMS

Alice-Database is a comprehensive data management solution designed to integrate seamlessly with the Kingdom System. This plugin provides robust functionality for creating, updating…

surrealdb-nightly

A nightly release of the surrealdb crate

vortex-roaring

Vortex roaring bitmap arrays

polars-lazy

Lazy query engine for the Polars DataFrame library

adguard-flm

represents a library for managing AdGuard filter lists

pickledb

A lightweight and simple key-value store written in Rust, heavily inspired by Python's PickleDB (https://pythonhosted.org/pickleDB/)

terminus-store

a triple store library

lemmy_db_schema

A link aggregator for the fediverse

qubl-rs

Low level And flexible query builder that gives you full control of your queries

datafusion-common

Common functionality for DataFusion query engine

value-log

Value log implementation for key-value separated LSM storage

valor_kv

efficient key value store built with Rust

vortex-datetime-dtype

Vortex datetime extension dtype

worterbuch

A message broker / database hybrid

wild-doc-server

wild-doc server

parquet_aramid

Query engine using Parquet tables as a Key-Value store

rimilo

Jam Alia Vort{ar,il}o por trci rimvortojn

izihawa-tantivy-columnar

column oriented storage for tantivy

deltalake-hdfs

Native Delta Lake implementation in Rust

tea-core

Core data structures and traits for tevec

dbutils

Utils for developing databases

sanakirja

Copy-on-write datastructures, storable on disk (or elsewhere) with a stable format

rowboat

A package for working with row/column/cell structured data AKA dataframe

searchy

Search index (in-memory), that can be constructed and searched using a bag of words model, with cosine similarity scoring based on tf-idf. Supports multiple search terms, permissions…

obkv

Optimized-bytes key and a value store

nu_plugin_polars

Nushell dataframe plugin commands based on polars

sled-overlay

Overlay mechanism for sled

shmap

A key-value store based on linux shared-memory files (shm) for persisting state across program restarts

os-checker-database

The output transformer of os-checker CLI, used to generate static data for os-checker WebUI

surrealdb-migrator

SurrealDB migrator

s3b

A command line tool for uploading data to Amazon S3, backed by an embedded database

cityhasher

A pure Rust implementation of Google's CityHash hashing algorithm

ddnet-account-client-http-fs

The base client implementation for accounts, assuming no HTTP client

tf-idf-vectorizer

search and analyze engine

redsumer

Lightweight implementation of Redis Streams for Rust

tantivy-sstable

sstables for tantivy

queued

Fast zero-configuration single-binary simple queue service

velarixdb

An LSM Storage Engine focused on reduced IO amplification

rumdb

Blazing fast key-value storage basec on Bitcask whitepaper

tavily

A tiny tool for calling Tavily's REST API in the simplest way!

fish-lib

A work-in-progress fishing game library containing the game/storage logic for a discord fishing game I'm working on

nebari

ACID-compliant database storage implementation using an append-only file format

simd-r-drive

SIMD-optimized append-only schema-less storage engine. Key-based binary storage in a single-file storage container.

trivialdb

Rust bindings for the TDB database library

tinysearch

A tiny search engine for static websites

furdb

A minimal Database Management System that prioritizes storage space usage and fast lookup/query times

icbiadb

I can't believe it's a database | Simple embedded 3-in-1 database

arroyo-udf-common

Common utilities for the Arroyo UDF FFI API

aora

Append-only random-accessed data persistence

redb-bincode

redb + bincode wrapper around redb

memory-db

In-memory implementation of hash-db, useful for tests

victor-db

A browser-optimized vector database

tantivy-jieba

that bridges between tantivy and jieba-rs

prefixed-tsid

Create Stripe-style prefixed database IDs that are type-safe and portable

indradb

A graph database server

mmdb

A std-collection-like database

moogle

data structures for relational code

eyros

multi-dimensional interval database

polars-pipe

Lazy query engine for the Polars DataFrame library

polars-rows-iter

easy and convenient row iteration of polars dataframes

bitask

Bitcask, a log-structured key-value store optimized for high-performance reads and writes

struct_db

Drop-in embedded database

moiradb

An experimental deterministic database

starry

Current stars history tells only half the story

re_dataframe

High-level query APIs

airomem

persistence library inspired by Prevayler and @jarekratajski

skipdb

An embedded, in-memory, zero-copy, atomicity, consistency, MVCC, almost lock-free and serializable snapshot isolation database engine

arrowdb

高性能本地向量数据库

typed-sled

Sled with types instead of bytes

soph-console

Framework for Web Rustceans

tantivy-columnar

column oriented storage for tantivy

bbolt-rs

port of the Bolt database

excel2df

converting Excel files to Polars DataFrame.It supports multiple threads to improve performance

orderwal

A generic-purpose, atomic, ordered, zero-copy read, zero-cost (in-place) write, Write-Ahead Log implementation for Rust

vortex-dtype

Vortex's core type system

vector

The package provides a vector database allowing for efficient search of nearest neighbors

buffdb

Embedded storage at the speed of light

izihawa-tantivy

Search engine library

veresiye

Database

noise_search

Nested Object Inverted Search Engine

kv

An embedded key/value store for Rust

pikodb

A Pico-sized In-memory Vector Database

flinch

in-memory database

yaml-datastore

API for using a set of YAML files as a cohesive datastore

tag_index

searchable index over key-value tags

disk-chan

An on-disk, (almost) lock-free, async, mpmc channel

frugalos

Frugal Object Storage

vinculum

Lock-Free Deduplication in Rust

vitasdk-sys

Raw bindings to vitasdk

nu-cmd-dataframe

Nushell's dataframe commands based on polars

mosquitto-auth

Plugin for mosquitto authentication

parquetry-sort

Runtime sorting library for Parquet code generator

rustsec-admin

Admin utility for maintaining the RustSec Advisory Database

humus

A composting database. This is a small experiment in deliberate data decaay: A simple in-memory database that slowly forgets the things that you don't revisit.

tegdb

The name TegridyDB (short for TegDB) is inspired by the Tegridy Farm in South Park and tries to correct some of the wrong database implementations, such as null support, implicit conversion support, etc

tectonicdb

server

xapian-rusty

Rust bindings to Xapian

mbf_gtf

Fast Parser for Ensembl formated GTF Files to Pandas DataFrames

graphannis-cli

command-line interface to the new backend implementation of the ANNIS linguistic search and visualization system

db-core

dbms engine

simplebase

database library

cannyls

Embedded persistent key-value storage optimized for random-access workload and huge-capacity HDD

vectordb

LanceDB: A serverless, low-latency vector database for AI applications

syn-select

A lightweight selector engine for searching Rust source code

kermit

Relational data structures, iterators and algorithms

df-interchange

Seamless interoperability between Polars and Arrow

rustque

fast on disk perstant memeory mapped que for rust it stores Vec<u8> to a file on a disk

ghaladb

LSM tree based key value store with keys and values separation

avlon-db

embedded struct database wrapper based on Sled

risinglight

An OLAP database system for educational purpose

pallet

Document store built with sled and tantivy

shortcut

an indexed, queryable column-based storage system

doublets

Modular framework to automation by automation

website_crawler

gRPC tokio based web crawler built with spider

xapian-rs

Rust bindings for the Xapian search engine

re_data_store

An in-memory time series database for Rerun log data, based on Apache Arrow

vortex-scalar

Vortex Scalars

langmore

A KV Store Based On Write-Ahead Log

simple_ml

Functions required for data analysis and machine learning tasks

structsy

single file structs database

axum_session_surreal

📝 Surreal Persistent Database layer for axum_session

versatile-data

databases that has convenient datasets that group together commonly used fields and gives you the flexibility to create your own fields

raindb

A persistent key-value store based on an LSM tree implemented in Rust

quotick

Embedded tick market data (trade, quote, ..) database storage optimized for billions of data points

tinkv

A fast and simple key-value storage engine

yakv

persistent key-value storage based on B-Tree

bjsmiley-surrealdb

A scalable, distributed, collaborative, document-graph database, for the realtime web

raft-engine-ctl

A control tool for Raft Engine

izihawa-tantivy-stacker

term hashmap used for indexing

dtodo

a cli tool for keeping track of your tasks

codd

minimal in-memory database with relational algebraic expressions as queries

hkvdb

key-value store tracking historical information

valor_kv_client

A client library for interacting with the valor_kv key-value store

notes_r_us_migrations

Database Migrations For Notesrus

vortex-layout

Vortex layouts provide a way to perform lazy push-down scans over abstract storage

summavy_fastfield_codecs

Fast field codecs used by tantivy

pagecache

lock-free pagecache and log for high-performance databases

simd-r-drive-extensions

Storage extensions for SIMD R Drive

azure_cosmos_mirror

Rust wrappers around Microsoft Azure REST APIs - Azure Cosmos DB

kvstore

typesafe key-value store, that allows users to set, get, and delete key-value pairs, with each key stored in a separate file on disk

izihawa-ownedbytes

Expose data as static slice

palletizer

self-hosted Cargo registry

ciff

The inverted index exchange format as defined as part of the Open-Source IR Replicability Challenge (OSIRRC) initiative

summavy

Search engine library

tinybase

A tiny embedded database built in Rust

kafka-to-worterbuch

Dump kafka topics into a Wörterbuch

object-warehouse

A lightweight object storage database

extremedb

McObject eXtremeDB bindings

Alice-DBMS

Alice-Database is a comprehensive data management solution designed to integrate seamlessly with the Kingdom System. This plugin provides robust functionality for creating, updating…

surrealdb-next

A next release of the surrealdb crate

vegafusion-dataframe

VegaFusion's DataFrame and Connection traits

polars-expr

Physical expression implementation of the Polars project

black-jack

DataFrame / Series / general data processing in Rust

sorted_array

A sorted array data structure adapted from StackMap

ng-oxigraph

a SPARQL database and RDF toolkit. fork for NextGraph

rsdb

a flash-sympathetic persistent lock-free B+ tree, pagecache, and log

tantivy-stacker

term hashmap used for indexing

vortex-all

Vortex file format with all builtin codecs and a sampling compressor

dawnsearch

An open source distributed web search engine that searches by meaning

grebedb

Lightweight embedded key-value store/database backed by files in a virtual file system interface

readb

efficient, and modular embedded read-first key-value database in Rust

bonsaidb-local

Local database storage for BonsaiDb

snapshotor

An abstraction layer of snapshot for developing multiple versions storage

froogle

A local Search Engine

roogle-engine

API search engine

crepedb-redb

An versioned and forkable embedded Key-Value database

qpml

Query Plan Markup Language (QPML)

paxos

a well-tested implementation of the CASPaxos protocol for the sled lightweight database kit

json_store

JSON STORE

bonsaidb-client

Client for accessing BonsaiDb servers

leveldb-rs

Bindings to the LevelDB key/value storage library (https://github.com/google/leveldb)

pouch-server

A really tiny KV store

etwin_link_store

Link store implementation

reddb

Minimalistic in-memory embedded database with persistance

ejdb

Bindings for EJDB, and embedded JSON database

index

a flash-sympathetic persistent lock-free B+ tree

caves

A collection of embedded, thread-safe key-value stores in Rust

EasyAlgolia

EasyAlgolia is a Rust crate designed for utilizing the Algolia admin client. It simplifies the process of updating and inserting documents into Algolia's search index.

mmdb-grpc

The gRPC service that provides a query to Maxmind's GeoLite2 databases

vortex-ipc

IPC message format to exchange Vortex arrays across processes

feophant

A SQL database server written in Rust and inspired by PostreSQL

aol

Generic purpose append only log implementation

alex-db-server

AlexDB server

solomondb

An embedded and distributed Gremlin-compatible graph database

bunbun

Re-implementation of bunny1 in Rust

husky

creating databases like iterators

deltalake-core

Native Delta Lake implementation in Rust

meilisearch-importer

import massive datasets into Meilisearch by sending them in batches

indradb-lib

A graph database library

disk-mpmc

on-disk mpmc

dbeel

fast and minimal distributed thread-per-core document database

mini-lsm

A tutorial for building an LSM tree storage engine in a week

person_info

一个库用于记录个人信息

vineyard-datafusion

Vineyard Rust SDK: arrow datafusion integration for DataFrame

hive-mind

key-value database with easy struct support powered on sled

vortex-schema

Vortex file schema abstraction

waffle-trie

Trie mapping for waffle

bonsaidb-utils

used within BonsaiDb

arroyo-udf-plugin

Plugin interface for Arroyo UDFs

vortex-tui

a small but might tool for working with Vortex files

scursor

Secure cursor library with support for read and write transactions

sqlo

Syntactic sugar for sqlx. Sqlo is another attempt to make a nice/pleasant API in Rust using relational database. Sqlo is built on top of sqlx and uses sqlx macros so you keep all the…

nodb

A lightweight and simple key-value store written in Rust

doc_store

document search by hnsw

bonsaidb-server

Database server for BonsaiDb

volcengine-sdk-protobuf

volcengine sdk protobuf

terminusdb-10-to-11

Converts a terminusdb v10 store to a v11 store

smolldb

small in-memory key-value database, which can be easly backed up in a file and later loaded from it

koala

Python's pandas implementation in Rust

mhdb

Pure rust embeddable key-value store database

disk_log

High Throughout, NonBlocking Disk-based logger

locustdb-compression-utils

compressing and decompressing sequences used in LocustDB

tstorage

Embedded time-series database

grep-matcher

A trait for regular expressions, with a focus on line oriented search

cdb2

Pure Rust library to read and write CDB files

wild-doc-webserver

still in development

re_dataframe_ui

Rich table widget over DataFusion

surql-definition

procedural macro for generating SurrealDB table and field definitions

ntap-db-tcp-service

paradedb-tantivy

Search engine library

waxy

web crawler for community driven search engine

small-db

A small database writing in rust, inspired from mit 6.830

ejdb2

Binding for EJDB2, a single file embedded no-sql database

brassfibre

multiple-dtype columner storage, known as DataFrame in pandas/R

valog

A lock-free, generic, lightweight value log

macrodb

Macro-generated in-memory relational database for Rust

koit

asynchronous, pure-Rust, structured, embedded database

memorydb

in-memory implementation of hashdb

sdb

a user-friendly wrapper for sanakirja database

prevayler-rs

System prevalence in rust

surrealdb-alpha

A alpha release of the surrealdb crate

wired

WIP: Collection of embeddable database models for Rust

pstream

A persistent byte stream over block storage

dtlog

A log for tracking discard stats of multi-files databases

tantivy-ik

chinese segment, ik-rs for tantivy

roo_engine

Roo is a smart bookmarking and productivity tool that works as a custom search engine for your browser

typedb

persistent generic HashMap/Key-value store

cube-query

querying the CubeMX database

grafite

Range Filter

surrealdb-core

A scalable, distributed, collaborative, document-graph database, for the realtime web

sparkv

Expirable in-memory key-value store

background-jobs-sled-storage

Sled storage backend for background-jobs

db-introspector-gadget

A MySql and Postgres database introspection tool that generates Python types

binstore

key-value store written in Rust. Uses its own compact file format.

upend

A user-oriented all-purpose graph database

textdb

A high performance read only text database

bincode-sled

Sled with types instead of bytes. Powered by bincode-v2

neighbor

content management system

polars-mem-engine

In memory engine of the Polars project

bitcasky-common

Common part for bitcasky lib

sled-native

a C-compatible API for sled

camelliakv

Embedded persistent key-value storage optimized for random-access workload and huge-capacity HDD

simple-raft

A minimal implementation of the Raft consensus algorithm

polygraph

A multiple-interconnected graph library or in-memory relational database

spyglass-lens

A small library for reading/writing spyglass lens files

quickwit-metastore

Quickwit's metastore

fs2db

migration helper

orthanc-plugin-bindings

Orthanc Server Bindings

rebacdb

A relationship-based access control database inspired by google zanzibar

koit-toml

asynchronous, pure-Rust, structured, embedded database

tigers

DataFrame library for Rust, inspired by Pandas

reindexer-rs

Reindexer library for Rust

tavlars

Tabular data processing for humans

daybreak

A modular and configurable database, continuation of the Rustbreak project

essential-storage

A storage abstraction for the Essential server

local-jcs-store

Store a directory of JSON objects, indexed by a cannonical hash

summavy-query-grammar

Search engine library

rucksack-db

The rucksack encrypted database

persistent-keystore-rs

Lightweight Persistent Database library written in Rust

ancla

command line tool of golang's bolt database

mintdb

open source document based database built in Rust

async-skipdb

An embedded, in-memory, zero-copy, atomicity, consistency, MVCC, almost lock-free and serializable snapshot isolation database engine

ella

A streaming time-series datastore for low-latency applications

docdb

A lightweight and simple key-value store written in Rust

summa-server

Fast full-text search server

lsmdb

efficient storage engine that implements the Log-Structured Merge Tree (LSM-Tree) data structure, designed specifically for handling key-value pairs

tqdb

Tiny Query Database (TQDB) is a small library for creating a query-able database that is encoded with json

edma_storage

EDMA: Embedded Database Management for All

lsm-tree

A K.I.S.S. implementation of log-structured merge trees (LSM-trees/LSMTs)

arroyo

distributed stream processor that lets users ask complex questions of high-volume real-time data by writing SQL. This CLI can be used to run Arroyo clusters in Docker

arrow_util

Tools for Apache Arrow

notum

intelligent note-taking and management

tushare

read the data from tushare and tranform it into polars dataframe object

MMDB_Server

{InDev} A simple,easy to use database server

google-customsearch1-cli

A complete library to interact with CustomSearch API (protocol v1)

rsi

A lightweight RSI library in Rust

vortex-sampling-compressor

Vortex compressor that uses statistical sampling

append-log

Append-only log for fail-safe backups

dinglebit-store

simplified storage interface

constdb

fast read-only embedded key value datastore

redrust

port of the popular Redis database system written in Rust programming language. This port aims to provide all the features of Redis while taking advantage of the Rust language's safety…

vortex

file format with all builtin codecs and a sampling compressor

fcs_rs

Basic tool for manipulating and analyzing Flow Cytometry Standard (FCS) files

lrdf

Commandline tool to generate a dataframe from Oxford Nanopore FastQ

titanit

File share server for Titan protocol with Gemini frontend

crabfish

chess engine

enzymeml

The EnzymeML Rust library

project_my_package

Online store library

text_index

Scan a text file, build a sorted index, persist it, query it

vortex-alp

Vortex ALP array

vortex-fastlanes

Vortex fastlanes arrays

inv

Command Line Inventory Manager. Prevent food waste and never lose track of your items!

acrudjson

Modern Rustlang with async support for CRUD operation based on JSONRPC specification

bonsaidb-core

Core functionality and types for BonsaiDb

tantivy-query-grammar

Search engine library

roogle

API search engine

bable

Badger's high performance sst table implementation

db_ip_core

db_ip

vortex-array

Vortex in memory columnar data format

MMDB_Client

{InDev} A simple,easy to use database server

trso-migrator

easy migrator for Turso

vortex-sparse

Vortex Sparse array

vortex-datetime-parts

Vortex physical encoding that compresses temporal components individually

unobtanium

Opinioated Web search engine library with crawler and viewer companion

emseries

an Embedded Time Series database

fake-sql

generate create table, alter table, drop table, insert, update, delete and select sql

vortex-runend-bool

Vortex run end encoded boolean array, strictly better than runend for bool arrays

vortex-error

Vortex errors

vortex-dict

Vortex dictionary array

solrs

A Solr client for Rust

summa-publisher

publishing directories with symlinks to iroh

surrealkv

A low-level, versioned, embedded, ACID-compliant, key-value database for Rust

newbee

rdb streamed parser

vortex-runend

Vortex run end encoded array

rustbreak

A modular and configurable database

vortex-mask

Vortex Mask - sorted, unique, non-negative integers

kupo

debugger for moogle, logic programming language

bin_store

BINCODE STORE

toboggan

Key/value TCP-based database server and client cli based on the sled embedded database

joydb_macros

An in-memory embedded database with persistence and multiple adapters (JSON, CSV, etc). Acts like a minimalistic ORM with zero setup. Simple, lightweight, and perfect for prototypes, small apps, or experiments.

stors

File storage database

vortex-bytebool

Vortex byte-boolean array

utah

dataframe structure and operations

vortex-buffer

A byte buffer implementation for Vortex

bloomur

Bloom filter for databases

emissary

Stateful caching and serialization framework in 100 lines or less!

google-cloudevents

Prost/Serde structs for Google CloudEvent types with axum integration

tuple_storage

A type-safe and small table engine for any Tuple of Ints

vortex-proto

Protocol buffer definitions for Vortex types

chord-dht

A DHT implementation in Rust based on Chord with high peformance and data replication

titanium-common

Messages to be sent between the web browser and the web extension

vortex-scan

Vortex scan contains logic for smartly performing a filter + projection scan operation

vortex-zigzag

Vortex zig zag array

radish-types

Types for interact with Radish Database

mmdb_core

A std-collection-like database

polars-time

Time related code for the Polars DataFrame library

vortex-btrblocks

BtrBlocks style compressor

vortex-io

Core async and blocking IO traits and implementations, used by IPC and file format

unobtanium-viewer

The default web-frontend for unobtanium

infinitree-backends

Embedded, encrypted database with tiered cache -- backends

combid

Generate numeric identifiers

rustix-bl

Backend for cervisia application

vortex-metrics

Vortex Metrics

bitrust

Bitcask, usable as a binary or a library

xunmi

A user-friendly search library base on tanvity

inges

A basic clap command line tool implementation

sample-arrow2

Samplers for arrow2 for use with sample-test

tantivy-tokenizer-api

Tokenizer API of tantivy

disk-ringbuffer

lock free on disk ringbuffer to be used in the implementation of Franz

gsgdt

Generic Stringly Typed Graph Datatype