rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Igor Canadi a2bb7c3c33 Push- instead of pull-model for managing Write stalls Summary: Introducing WriteController, which is a source of truth about per-DB write delays. Let's define an DB epoch as a period where there are no flushes and compactions (i.e. new epoch is started when flush or compaction finishes). Each epoch can either: * proceed with all writes without delay * delay all writes by fixed time * stop all writes The three modes are recomputed at each epoch change (flush, compaction), rather than on every write (which is currently the case). When we have a lot of column families, our current pull behavior adds a big overhead, since we need to loop over every column family for every write. With new push model, overhead on Write code-path is minimal. This is just the start. Next step is to also take care of stalls introduced by slow memtable flushes. The final goal is to eliminate function MakeRoomForWrite(), which currently needs to be called for every column family by every write. Test Plan: make check for now. I'll add some unit tests later. Also, perf test. Reviewers: dhruba, yhchiang, MarkCallaghan, sdong, ljin Reviewed By: ljin Subscribers: leveldb Differential Revision: https://reviews.facebook.net/D22791		10 years ago
build_tools	Add db_bench with lots of column families to regression tests	10 years ago
coverage	Disable the html-based coverage report by default	11 years ago
db	Push- instead of pull-model for managing Write stalls	10 years ago
doc	Remove seek compaction	11 years ago
examples	Make it easier to start using RocksDB	11 years ago
hdfs	hdfs cleanup and compile test against CDH 4.4.	11 years ago
helpers/memenv	Expose in memory Env to the world	11 years ago
include	Push- instead of pull-model for managing Write stalls	10 years ago
java	Remove path with arena==nullptr from NewInternalIterator	10 years ago
linters	allow lambda function syntax in cpplint	11 years ago
port	Avoid off-by-one error when using readlink	10 years ago
table	Implement full filter for block based table.	10 years ago
third-party/rapidjson	Fix a rapidjson compile error in mac.	11 years ago
tools	Implement full filter for block based table.	10 years ago
util	Push- instead of pull-model for managing Write stalls	10 years ago
utilities	Add missing break statement	10 years ago
.arcconfig	Improve/fix bugs for the cpp linter	11 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	Changes to support unity build:	10 years ago
.travis.yml	Fix travis builds	10 years ago
CONTRIBUTING.md	facebook accounts are not required for CLA signers	10 years ago
HISTORY.md	Push- instead of pull-model for managing Write stalls	10 years ago
INSTALL.md	specify the command to install build_tools/mac-install-gflags.sh file in doc	11 years ago
LICENSE	Fix copyright year	11 years ago
Makefile	Push- instead of pull-model for managing Write stalls	10 years ago
PATENTS	Fix the patent format	11 years ago
README.md	Update README.md	11 years ago
ROCKSDB_LITE.md	RocksDBLite	11 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/