fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Dhruba Borthakur 47c4191fe8 Reduce write amplification by merging files in L0 back into L0 ... Summary: There is a new option called hybrid_mode which, when switched on, causes HBase style compactions. Files from L0 are compacted back into L0. This meat of this compaction algorithm is in PickCompactionHybrid(). All files reside in L0. That means all files have overlapping keys. Each file has a time-bound, i.e. each file contains a range of keys that were inserted around the same time. The start-seqno and the end-seqno refers to the timeframe when these keys were inserted. Files that have contiguous seqno are compacted together into a larger file. All files are ordered from most recent to the oldest. The current compaction algorithm starts to look for candidate files starting from the most recent file. It continues to add more files to the same compaction run as long as the sum of the files chosen till now is smaller than the next candidate file size. This logic needs to be debated and validated. The above logic should reduce write amplification to a large extent... will publish numbers shortly. Test Plan: dbstress runs for 6 hours with no data corruption (tested so far). Differential Revision: https://reviews.facebook.net/D11289		12 years ago
..
arena.cc	Codemod NULL to nullptr	12 years ago
arena.h	A number of fixes:	13 years ago
arena_test.cc	Fix all warnings generated by -Wall option to the compiler.	12 years ago
auto_roll_logger.cc	[RocksDB] Fix PosixLogger and AutoRollLogger thread safety	12 years ago
auto_roll_logger.h	[RocksDB] Fix PosixLogger and AutoRollLogger thread safety	12 years ago
auto_roll_logger_test.cc	[RocksDB] Fix PosixLogger and AutoRollLogger thread safety	12 years ago
bit_set.h	[Rocksdb] Implement filluniquerandom	12 years ago
bloom.cc	Fix all the lint errors.	12 years ago
bloom_test.cc	Fix all warnings generated by -Wall option to the compiler.	12 years ago
build_version.h	Stop continually re-creating build_version.c	12 years ago
cache.cc	[RocksDB] Fix LRUCache Eviction problem	12 years ago
cache_test.cc	[RocksDB] Fix LRUCache Eviction problem	12 years ago
coding.cc	Codemod NULL to nullptr	12 years ago
coding.h	Codemod NULL to nullptr	12 years ago
coding_test.cc	Codemod NULL to nullptr	12 years ago
comparator.cc	merge 1.5	12 years ago
crc32c.cc	Codemod NULL to nullptr	12 years ago
crc32c.h	A number of fixes:	13 years ago
crc32c_test.cc	Fix all warnings generated by -Wall option to the compiler.	12 years ago
env.cc	[RocksDB] Option for incremental sync	12 years ago
env_hdfs.cc	Ability to configure bufferedio-reads, filesystem-readaheads and mmap-read-write per database.	12 years ago
env_posix.cc	[RocksDB] Add mmap_read option for db_stress	12 years ago
env_test.cc	[RocksDB] cleanup EnvOptions	12 years ago
filelock_test.cc	Prevent concurrent multiple opens of leveldb database.	12 years ago
filter_policy.cc	Added bloom filter support.	13 years ago
hash.cc	A number of fixes:	13 years ago
hash.h	reverting disastrous MOE commit, returning to r21	14 years ago
histogram.cc	[Rocksdb] Remove unused double apis to record into histograms	12 years ago
histogram.h	[Rocksdb] Remove unused double apis to record into histograms	12 years ago
histogram_test.cc	Introduce histogram in statistics.h	12 years ago
ldb_cmd.cc	Simplify bucketing logic in ldb-ttl	12 years ago
ldb_cmd.h	Introducing timeranged scan, timeranged dump in ldb. Also the ability to count in time-batches during Dump	12 years ago
ldb_cmd_execute_result.h	Enhanced ldb to support data access commands	12 years ago
ldb_tool.cc	Introducing timeranged scan, timeranged dump in ldb. Also the ability to count in time-batches during Dump	12 years ago
logging.cc	Fix all warnings generated by -Wall option to the compiler.	12 years ago
logging.h	A number of fixes:	13 years ago
manual_compaction_test.cc	[rocksdb] do not trim range for level0 in manual compaction	12 years ago
murmurhash.cc	Implement RowLocks for assoc schema	12 years ago
murmurhash.h	Implement RowLocks for assoc schema	12 years ago
mutexlock.h	Implement ReadWrite locks for leveldb	12 years ago
options.cc	Reduce write amplification by merging files in L0 back into L0	12 years ago
posix_logger.h	[RocksDB] Fix PosixLogger and AutoRollLogger thread safety	12 years ago
random.h	[RocksDB] Include 64bit random number generator	12 years ago
signal_test.cc	[RocksDB] fix build	12 years ago
stack_trace.h	[RocksDB] Add stacktrace signal handler	12 years ago
statistics.cc	[rocksdb][refactor] statistic printing code to one place	12 years ago
stats_logger.h	Clean up compiler warnings generated by -Wall option.	12 years ago
status.cc	[Rocksdb] Support Merge operation in rocksdb	12 years ago
stop_watch.h	[RocksDB] Simplify StopWatch implementation	12 years ago
string_util.cc	Ability to set different size fanout multipliers for every level.	12 years ago
string_util.h	Ability to set different size fanout multipliers for every level.	12 years ago
testharness.cc	Codemod NULL to nullptr	12 years ago
testharness.h	A number of fixes:	13 years ago
testutil.cc	Fix all warnings generated by -Wall option to the compiler.	12 years ago
testutil.h	Ability to configure bufferedio-reads, filesystem-readaheads and mmap-read-write per database.	12 years ago