rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Islam AbdelRahman cce702a6e4 [db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN) Summary: This diff allow us to run a single benchmark X times and warm it up for Y times. and see the AVG & MEDIAN throughput of these X runs for example ``` $ ./db_bench --benchmarks="fillseq,readseq[X5-W2]" Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags RocksDB: version 4.12 Date: Wed Aug 24 10:45:26 2016 CPU: 32 * Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz CPUCache: 20480 KB Keys: 16 bytes each Values: 100 bytes each (50 bytes after compression) Entries: 1000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 110.6 MB (estimated) FileSize: 62.9 MB (estimated) Write rate: 0 bytes/second Compression: Snappy Memtablerep: skip_list Perf Level: 1 WARNING: Assertions are enabled; benchmarks unnecessarily slow ------------------------------------------------ Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags DB path: [/tmp/rocksdbtest-8616/dbbench] fillseq : 4.695 micros/op 212971 ops/sec; 23.6 MB/s DB path: [/tmp/rocksdbtest-8616/dbbench] Warming up benchmark by running 2 times readseq : 0.214 micros/op 4677005 ops/sec; 517.4 MB/s readseq : 0.212 micros/op 4706834 ops/sec; 520.7 MB/s Running benchmark for 5 times readseq : 0.218 micros/op 4588187 ops/sec; 507.6 MB/s readseq : 0.208 micros/op 4816538 ops/sec; 532.8 MB/s readseq : 0.213 micros/op 4685376 ops/sec; 518.3 MB/s readseq : 0.214 micros/op 4676787 ops/sec; 517.4 MB/s readseq : 0.217 micros/op 4618532 ops/sec; 510.9 MB/s readseq [AVG 5 runs] : 4677084 ops/sec; 517.4 MB/sec readseq [MEDIAN 5 runs] : 4676787 ops/sec; 517.4 MB/sec ``` Test Plan: run db_bench Reviewers: sdong, andrewkr, yhchiang Reviewed By: yhchiang Subscribers: andrewkr, dhruba Differential Revision: https://reviews.facebook.net/D62235		8 years ago
arcanist_util	cat tests logs sorted by exit code	8 years ago
build_tools	Update and slightly clarify instructions in build_detect_platform (#1301 )	8 years ago
coverage	Fix coverage script	10 years ago
db	Persist data during user initiated shutdown	8 years ago
doc	Lint everything	9 years ago
docs	Add initial GitHub pages infra for RocksDB documentation move and update. (#1294 )	8 years ago
examples	Introduce FullMergeV2 (eliminate memcpy from merge operators)	9 years ago
hdfs	using java7 in runtime for hdfs env (#1072 )	9 years ago
include/rocksdb	Option to cache index/filter blocks with priority	8 years ago
java	Fix the Windows build of RocksDB Java. Similar to https://github.com/facebook/rocksdb/issues/1220 (#1284 )	8 years ago
memtable	Updated all copyright headers to the new format.	9 years ago
port	stack_trace,cc: The current Stacktrace code does not compile for FreeBSD (#1153 )	9 years ago
table	fix data race in NewIndexIterator() in block_based_table_reader.cc	8 years ago
third-party	Fix clang analyzer errors	9 years ago
tools	[db_bench] Support single benchmark arguments (Repeat for X times, Warm up for X times), Support CombinedStats (AVG / MEDIAN)	8 years ago
util	Relax consistency for thread-local ticker stats	8 years ago
utilities	LRU cache mid-point insertion	8 years ago
.arcconfig	Integrate Jenkins with Phabricator	10 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	Experiments on column-aware encodings	9 years ago
.travis.yml	set travis open file descriptor limit	9 years ago
AUTHORS	Add AUTHORS file. Fix #203	10 years ago
CMakeLists.txt	LRU cache mid-point insertion	8 years ago
CONTRIBUTING.md	facebook accounts are not required for CLA signers	11 years ago
DEFAULT_OPTIONS_HISTORY.md	Release RocksDB 4.8.0	9 years ago
DUMP_FORMAT.md	First version of rocksdb_dump and rocksdb_undump.	10 years ago
HISTORY.md	Introduce ClockCache	8 years ago
INSTALL.md	Simple changes to support builds for ppc64[le] consistent with X86	9 years ago
LANGUAGE-BINDINGS.md	Update LANGUAGE-BINDINGS.md	9 years ago
LICENSE	Updated all copyright headers to the new format.	9 years ago
Makefile	Fix parallel valgrind (valgrind_check)	8 years ago
PATENTS	Update Patent Grant.	10 years ago
README.md	Appveyor badge to show master branch	9 years ago
ROCKSDB_LITE.md	Optimistic Transactions	10 years ago
USERS.md	Update USER.md to include more services at Facebook.	9 years ago
Vagrantfile	RocksDB on FreeBSD support	10 years ago
WINDOWS_PORT.md	Commit both PR and internal code review changes	10 years ago
appveyor.yml	fix vs generator (#1269 )	9 years ago
src.mk	Add Status to RocksDBException so that meaningful function result Status from the C++ API isn't lost (#1273 )	8 years ago
thirdparty.inc	Introduce XPRESS compresssion on Windows. (#1081 )	9 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/