rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Cheng Chang e44948295e Make it able to ignore WAL related VersionEdits in older versions (#7873 ) Summary: Although the tags for `WalAddition`, `WalDeletion` are after `kTagSafeIgnoreMask`, to actually be able to skip these entries in older versions of RocksDB, we require that they are encoded with their encoded size as the prefix. This requirement is not met in the current codebase, so a downgraded DB may fail to open if these entries exist in the MANIFEST. If a DB wants to downgrade, and its MANIFEST contains `WalAddition` or `WalDeletion`, it can set `track_and_verify_wals_in_manifest` to `false`, then restart twice, then downgrade. On the first restart, a new MANIFEST will be created with a `WalDeletion` indicating that all previously tracked WALs are removed from MANIFEST. On the second restart, since there is no tracked WALs in MANIFEST now, a new MANIFEST will be created with neither `WalAddition` nor `WalDeletion`. Then the DB can downgrade. Tags for `BlobFileAddition`, `BlobFileGarbage` also have the same problem, but this PR focuses on solving the problem for WAL edits. Pull Request resolved: https://github.com/facebook/rocksdb/pull/7873 Test Plan: Added a `VersionEditTest::IgnorableTags` unit test to verify all entries with tags larger than `kTagSafeIgnoreMask` can actually be skipped and won't affect parsing of other entries. Reviewed By: ajkr Differential Revision: D25935930 Pulled By: cheng-chang fbshipit-source-id: 7a02fdba4311d6084328c14aed110a26d08c3efb		4 years ago
.circleci	Small improvements to CircleCI Windows jobs (#7852 )	4 years ago
.github/workflows	Update clang-format-diff.py (#7609 )	4 years ago
buckifier	Fix use of positional args in BUCK rules (#7760 )	4 years ago
build_tools	Migrate away from Travis+Linux+amd64 (#7791 )	4 years ago
cache	Fix typos in comments (#7687 )	4 years ago
cmake	Add `find_dependency()` in cmake config file. (#6791 )	5 years ago
coverage	Find the correct gcov (#6904 )	5 years ago
db	Make it able to ignore WAL related VersionEdits in older versions (#7873 )	4 years ago
db_stress_tool	Increase the txn lock timeout in stress test (#7823 )	4 years ago
docs	Update github-pages and dependencies (#7850 )	4 years ago
env	Improvements to Env::GetChildren (#7819 )	4 years ago
examples	Bring the Configurable options together (#5753 )	4 years ago
file	Improvements to Env::GetChildren (#7819 )	4 years ago
fuzz	Update SstFileWriter fuzzer to iterate and check all key-value pairs (#7761 )	4 years ago
hdfs	fix build with 'USE_HDFS' on windows (#6950 )	5 years ago
include/rocksdb	Fix various spelling errors still found in code (#7785 )	4 years ago
java	Fixing Windows build using CMake (#7854 )	4 years ago
logging	No elide constructors (#7798 )	4 years ago
memory	slightly improve jemalloc allocator API header (#7592 )	4 years ago
memtable	Add new API to report dummy entries size in cache in WriteBufferManager (#7837 )	4 years ago
monitoring	Use mock time for histogram_test (#7799 )	4 years ago
options	Make StringEnv, StringSink, StringSource use FS classes (#7786 )	4 years ago
port	Improvements to Env::GetChildren (#7819 )	4 years ago
table	Add more tests to ASSERT_STATUS_CHECKED (3), API change (#7715 )	4 years ago
test_util	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
third-party	Fix Compilation on ppc64le using Clang 11 (#7713 )	4 years ago
tools	Make regression test load options from file for checkpoint (#7864 )	4 years ago
trace_replay	Add tests in ASSERT_STATUS_CHECKED (#7793 )	4 years ago
util	Cover all status codes in `Status::ToString()` (#7872 )	4 years ago
utilities	Fixing Windows build using CMake (#7854 )	4 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	Fuzzing RocksDB (#7685 )	4 years ago
.lgtm.yml	Create lgtm.yml for LGTM.com C/C++ analysis (#4058 )	7 years ago
.travis.yml	Cleanup Travis CI config (#7848 )	4 years ago
.watchmanconfig	Added .watchmanconfig file to rocksdb repo (#5593 )	6 years ago
AUTHORS	Update RocksDB Authors File	7 years ago
CMakeLists.txt	Range Locking: Implementation of range locking (#7506 )	4 years ago
CODE_OF_CONDUCT.md	Adopt Contributor Covenant	5 years ago
CONTRIBUTING.md	Add Code of Conduct	7 years ago
COPYING	Add GPLv2 as an alternative license.	8 years ago
DEFAULT_OPTIONS_HISTORY.md	options.delayed_write_rate use the rate of rate_limiter by default.	8 years ago
DUMP_FORMAT.md	First version of rocksdb_dump and rocksdb_undump.	10 years ago
HISTORY.md	Update HISTORY.md (#7874 )	4 years ago
INSTALL.md	Update the version of the dependencies used by the RocksJava static build (#4761 )	6 years ago
LANGUAGE-BINDINGS.md	Add RestoreDBFromLatestBackup to C API, add new C# package (#7092 )	5 years ago
LICENSE.Apache	Change RocksDB License	8 years ago
LICENSE.leveldb	Add back the LevelDB license file	8 years ago
Makefile	Update the versions of the test dependencies used for RocksJava (#7805 )	4 years ago
README.md	Fix the CI badge for ppc64le Jenkins (#7561 )	4 years ago
ROCKSDB_LITE.md	Fix some typos in comments and docs.	7 years ago
TARGETS	Range Locking: Implementation of range locking (#7506 )	4 years ago
USERS.md	Add Apache Doris to USERS (#7865 )	4 years ago
Vagrantfile	Adding CentOS 7 Vagrantfile & build script	7 years ago
WINDOWS_PORT.md	#5145 , rename port/dirent.h to port/port_dirent.h to avoid compile err when use port dir as header dir output (#5152 )	6 years ago
appveyor.yml	Remove 2019 from appveyor (#7038 )	5 years ago
defs.bzl	Make testpilot recognize that these tests have coverage instrumentation	5 years ago
issue_template.md	Add Google Group to Issue Template	5 years ago
src.mk	Range Locking: Implementation of range locking (#7506 )	4 years ago
thirdparty.inc	Fix build jemalloc api (#5470 )	6 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key-value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it especially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/ and https://rocksdb.slack.com/

License

RocksDB is dual-licensed under both the GPLv2 (found in the COPYING file in the root directory) and Apache 2.0 License (found in the LICENSE.Apache file in the root directory). You may select, at your option, one of the above-listed licenses.