rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Andrew Kryczka 46e599fc6b fix live WALs purged while file deletions disabled Summary: When calling `DisableFileDeletions` followed by `GetSortedWalFiles`, we guarantee the files returned by the latter call won't be deleted until after file deletions are re-enabled. However, `GetSortedWalFiles` didn't omit files already planned for deletion via `PurgeObsoleteFiles`, so the guarantee could be broken. We fix it by making `GetSortedWalFiles` wait for the number of pending purges to hit zero if file deletions are disabled. This condition is eventually met since `PurgeObsoleteFiles` is guaranteed to be called for the existing pending purges, and new purges cannot be scheduled while file deletions are disabled. Once the condition is met, `GetSortedWalFiles` simply returns the content of DB and archive directories, which nobody can delete (except for deletion scheduler, for which I plan to fix this bug later) until deletions are re-enabled. Closes https://github.com/facebook/rocksdb/pull/3341 Differential Revision: D6681131 Pulled By: ajkr fbshipit-source-id: 90b1e2f2362ea9ef715623841c0826611a817634		7 years ago
buckifier	Remove `import` use from TARGETS	7 years ago
build_tools	FreeBSD build support for RocksDB and RocksJava	7 years ago
cache	fix gflags namespace	7 years ago
cmake	add missing config checks to CMakeLists.txt	7 years ago
coverage	Fix /bin/bash shebangs	8 years ago
db	fix live WALs purged while file deletions disabled	7 years ago
docs	fix Gemfile.lock nokogiri dependencies	7 years ago
env	Add a Close() method to DB to return status when closing a db	7 years ago
examples	Pinnableslice examples and blog post	7 years ago
hdfs	Revert "comment out unused parameters"	8 years ago
include/rocksdb	Add a Close() method to DB to return status when closing a db	7 years ago
java	FreeBSD build support for RocksDB and RocksJava	7 years ago
memtable	fix gflags namespace	7 years ago
monitoring	fix ThreadStatus for bottom-pri compaction threads	7 years ago
options	Consider an increase to buffer size when reading option file, from 4K to 8K.	7 years ago
port	FreeBSD build support for RocksDB and RocksJava	7 years ago
table	Fix multiple build failures	7 years ago
third-party	Enable MSVC W4 with a few exceptions. Fix warnings and bugs	7 years ago
tools	Add a BlockBasedTableOption to turn off index block compression.	7 years ago
util	Add a Close() method to DB to return status when closing a db	7 years ago
utilities	Fix checkpoint_test directory setup/cleanup	7 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	Remove leftover references to phutil_module_cache	7 years ago
.travis.yml	CMake cross platform Java support and add JNI to travis	7 years ago
AUTHORS	Update RocksDB Authors File	7 years ago
CMakeLists.txt	Issue #3370 Broken CMakeLists.txt	7 years ago
CODE_OF_CONDUCT.md	Add Code of Conduct	7 years ago
CONTRIBUTING.md	Add Code of Conduct	7 years ago
COPYING	Add GPLv2 as an alternative license.	8 years ago
DEFAULT_OPTIONS_HISTORY.md	options.delayed_write_rate use the rate of rate_limiter by default.	8 years ago
DUMP_FORMAT.md	First version of rocksdb_dump and rocksdb_undump.	10 years ago
HISTORY.md	fix live WALs purged while file deletions disabled	7 years ago
INSTALL.md	FreeBSD build support for RocksDB and RocksJava	7 years ago
LANGUAGE-BINDINGS.md	Add Elixir to the list of language bindings	7 years ago
LICENSE.Apache	Change RocksDB License	8 years ago
LICENSE.leveldb	Add back the LevelDB license file	8 years ago
Makefile	Revert Snappy version upgrade	7 years ago
README.md	Add Jenkins for PPC64le build status badge	7 years ago
ROCKSDB_LITE.md	Optimistic Transactions	10 years ago
TARGETS	WritePrepared Txn: make buck tests parallel	7 years ago
USERS.md	Added ProfaneDB	7 years ago
Vagrantfile	Update Vagrant file (test internal phabricator workflow)	8 years ago
WINDOWS_PORT.md	Commit both PR and internal code review changes	10 years ago
appveyor.yml	Make Windows dep switches compatible with other builds	7 years ago
issue_template.md	Add a template for issues	7 years ago
src.mk	Refactor ReadBlockContents()	7 years ago
thirdparty.inc	Make Windows dep switches compatible with other builds	7 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/