fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Dhruba Borthakur 554c06dd18 Reduce write amplification by merging files in L0 back into L0 ... Summary: There is a new option called hybrid_mode which, when switched on, causes HBase style compactions. Files from L0 are compacted back into L0. This meat of this compaction algorithm is in PickCompactionHybrid(). All files reside in L0. That means all files have overlapping keys. Each file has a time-bound, i.e. each file contains a range of keys that were inserted around the same time. The start-seqno and the end-seqno refers to the timeframe when these keys were inserted. Files that have contiguous seqno are compacted together into a larger file. All files are ordered from most recent to the oldest. The current compaction algorithm starts to look for candidate files starting from the most recent file. It continues to add more files to the same compaction run as long as the sum of the files chosen till now is smaller than the next candidate file size. This logic needs to be debated and validated. The above logic should reduce write amplification to a large extent... will publish numbers shortly. Test Plan: dbstress runs for 6 hours with no data corruption (tested so far). Differential Revision: https://reviews.facebook.net/D11289		12 years ago
..
shell	Titile: a command line shell to read/write data from a leveldb thrift server	12 years ago
db_crashtest.py	[RocksDB] add back --mmap_read options to crashtest	12 years ago
db_crashtest2.py	[RocksDB] add back --mmap_read options to crashtest	12 years ago
db_repl_stress.cc	Do not allow Transaction Log Iterator to fall ahead when writer is writing the same file	12 years ago
db_stress.cc	Reduce write amplification by merging files in L0 back into L0	12 years ago
ldb.cc	[RocksDB] Expose LDB functioanality as a library call - clients can build their own LDB binary with additional options	12 years ago
ldb_test.py	Enhance the ldb tool to support ttl databases	12 years ago
reduce_levels_test.cc	[Rocksdb] codemod NULL to nullptr in tools/*.cc	12 years ago
sst_dump.cc	[RocksDB] cleanup EnvOptions	12 years ago