rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Yueh-Hsuan Chiang a7d4eb2f34 Fix a bug where flush does not happen when a manual compaction is running Summary: Currently, when rocksdb tries to run manual compaction to refit data into a level, there's a ReFitLevel() process that requires no bg work is currently running. When RocksDB plans to ReFitLevel(), it will do the following: 1. pause scheduling new bg work. 2. wait until all bg work finished 3. do the ReFitLevel() 4. unpause scheduling new bg work. However, as it pause scheduling new bg work at step one and waiting for all bg work finished in step 2, RocksDB will stop flushing until all bg work is done (which could take a long time.) This patch fix this issue by changing the way ReFitLevel() pause the background work: 1. pause scheduling compaction. 2. wait until all bg work finished. 3. pause scheduling flush 4. do ReFitLevel() 5. unpause both flush and compaction. The major difference is that. We only pause scheduling compaction in step 1 and wait for all bg work finished in step 2. This prevent flush being blocked for a long time. Although there's a very rare case that ReFitLevel() might be in starvation in step 2, but it's less likely the case as flush typically finish very fast. Test Plan: existing test. Reviewers: anthony, IslamAbdelRahman, kradhakrishnan, sdong Reviewed By: sdong Subscribers: dhruba, leveldb Differential Revision: https://reviews.facebook.net/D55029		9 years ago
arcanist_util	Updated all copyright headers to the new format.	9 years ago
build_tools	Modify build_tools/build_detect_platform to detect and set -march=z10 on Linux s390x.	9 years ago
coverage	Fix coverage script	10 years ago
db	Fix a bug where flush does not happen when a manual compaction is running	9 years ago
doc	Lint everything	9 years ago
examples	Updated all copyright headers to the new format.	9 years ago
hdfs	Updated all copyright headers to the new format.	9 years ago
include/rocksdb	[backupable db] Remove file size embedded in name workaround	9 years ago
java	Updated all copyright headers to the new format.	9 years ago
memtable	Updated all copyright headers to the new format.	9 years ago
port	Implement ConsistentChildrenAttribute	9 years ago
table	Add Iterator Property rocksdb.iterator.version_number	9 years ago
third-party	Updated all copyright headers to the new format.	9 years ago
tools	Update benchmarks used to measure subcompaction performance	9 years ago
util	Add parsing of missing DB options	9 years ago
utilities	Fix Windows build	9 years ago
.arcconfig	Integrate Jenkins with Phabricator	10 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	New amalgamation target	9 years ago
.travis.yml	Travis CI to disable ROCKSDB_LITE tests	9 years ago
AUTHORS	Add AUTHORS file. Fix #203	10 years ago
CMakeLists.txt	Add Iterator Property rocksdb.iterator.version_number	9 years ago
CONTRIBUTING.md	facebook accounts are not required for CLA signers	11 years ago
DUMP_FORMAT.md	First version of rocksdb_dump and rocksdb_undump.	10 years ago
HISTORY.md	Change BlockBasedTableOptions.format_version default to 2	9 years ago
INSTALL.md	Simple changes to support builds for ppc64[le] consistent with X86	9 years ago
LICENSE	Updated all copyright headers to the new format.	9 years ago
Makefile	Add Iterator Property rocksdb.iterator.version_number	9 years ago
PATENTS	Update Patent Grant.	10 years ago
README.md	Replaced "built on on earlier work" by "built on earlier work" in README.md	10 years ago
ROCKSDB_LITE.md	Optimistic Transactions	10 years ago
USERS.md	Add Wingify to USERS.md	9 years ago
Vagrantfile	RocksDB on FreeBSD support	10 years ago
WINDOWS_PORT.md	Commit both PR and internal code review changes	10 years ago
appveyor.yml	Exclude DBTest.FileCreationRandomFailure as a long running test	9 years ago
src.mk	IOStatsContext::ToString() add option to exclude zero counters	9 years ago
thirdparty.inc	Enable override to 3rd party linkage	9 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/