rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

mrambacher e628f59e87 Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 ) Summary: This PR does the following: -> Creates a WinFileSystem class. This class is the Windows equivalent of the PosixFileSystem and will be used on Windows systems. -> Introduces a CustomEnv class. A CustomEnv is an Env that takes a FileSystem as constructor argument. I believe there will only ever be two implementations of this class (PosixEnv and WinEnv). There is still a CustomEnvWrapper class that takes an Env and a FileSystem and wraps the Env calls with the input Env but uses the FileSystem for the FileSystem calls -> Eliminates the public uses of the LegacyFileSystemWrapper. With this change in place, there are effectively the following patterns of Env: - "Base Env classes" (PosixEnv, WinEnv). These classes implement the core Env functions (e.g. Threads) and have a hard-coded input FileSystem. These classes inherit from CompositeEnv, implement the core Env functions (threads) and delegate the FileSystem-like calls to the input file system. - Wrapped Composite Env classes (MemEnv). These classes take in an Env and a FileSystem. The core env functions are re-directed to the wrapped env. The file system calls are redirected to the input file system - Legacy Wrapped Env classes. These classes take in an Env input (but no FileSystem). The core env functions are re-directed to the wrapped env. A "Legacy File System" is created using this env and the file system calls directed to the env itself. With these changes in place, the PosixEnv becomes a singleton -- there is only ever one created. Any other use of the PosixEnv is via another wrapped env. This cleans up some of the issues with the env construction and destruction. Additionally, there were places in the code that required had an Env when they required a FileSystem. Many of these places would wrap the Env with a LegacyFileSystemWrapper instead of using the env->GetFileSystem(). These places were changed, thereby removing layers of additional redirection (LegacyFileSystem --> Env --> Env::FileSystem). Pull Request resolved: https://github.com/facebook/rocksdb/pull/7703 Reviewed By: zhichao-cao Differential Revision: D25762190 Pulled By: anand1976 fbshipit-source-id: 1a088e97fc916f28ac69c149cd1dcad0ab31704b		4 years ago
.circleci	Migrate away from Travis+Linux+amd64 (#7791 )	4 years ago
.github/workflows	Update clang-format-diff.py (#7609 )	4 years ago
buckifier	Fix use of positional args in BUCK rules (#7760 )	4 years ago
build_tools	Migrate away from Travis+Linux+amd64 (#7791 )	4 years ago
cache	Fix typos in comments (#7687 )	4 years ago
cmake	Add `find_dependency()` in cmake config file. (#6791 )	4 years ago
coverage	Find the correct gcov (#6904 )	4 years ago
db	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
db_stress_tool	Increase the txn lock timeout in stress test (#7823 )	4 years ago
docs	Update github-pages to v207 (#7235 )	4 years ago
env	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
examples	Bring the Configurable options together (#5753 )	4 years ago
file	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
fuzz	Update SstFileWriter fuzzer to iterate and check all key-value pairs (#7761 )	4 years ago
hdfs	fix build with 'USE_HDFS' on windows (#6950 )	4 years ago
include/rocksdb	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
java	Fix various small build issues, Java API naming (#7776 )	4 years ago
logging	No elide constructors (#7798 )	4 years ago
memory	slightly improve jemalloc allocator API header (#7592 )	4 years ago
memtable	Test for LoadLatestOptions (#7554 )	4 years ago
monitoring	Use mock time for histogram_test (#7799 )	4 years ago
options	Make StringEnv, StringSink, StringSource use FS classes (#7786 )	4 years ago
port	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
table	Make StringEnv, StringSink, StringSource use FS classes (#7786 )	4 years ago
test_util	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
third-party	Fix Compilation on ppc64le using Clang 11 (#7713 )	4 years ago
tools	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
trace_replay	Add tests in ASSERT_STATUS_CHECKED (#7793 )	4 years ago
util	Make StringEnv, StringSink, StringSource use FS classes (#7786 )	4 years ago
utilities	Create a CustomEnv class; Add WinFileSystem; Make LegacyFileSystemWrapper private (#7703 )	4 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	Fuzzing RocksDB (#7685 )	4 years ago
.lgtm.yml	Create lgtm.yml for LGTM.com C/C++ analysis (#4058 )	6 years ago
.travis.yml	Migrate away from Travis+Linux+amd64 (#7791 )	4 years ago
.watchmanconfig	Added .watchmanconfig file to rocksdb repo (#5593 )	5 years ago
AUTHORS	Update RocksDB Authors File	7 years ago
CMakeLists.txt	Range Locking: Implementation of range locking (#7506 )	4 years ago
CODE_OF_CONDUCT.md	Adopt Contributor Covenant	5 years ago
CONTRIBUTING.md	Add Code of Conduct	7 years ago
COPYING	Add GPLv2 as an alternative license.	7 years ago
DEFAULT_OPTIONS_HISTORY.md	options.delayed_write_rate use the rate of rate_limiter by default.	7 years ago
DUMP_FORMAT.md	First version of rocksdb_dump and rocksdb_undump.	9 years ago
HISTORY.md	Verify file checksum generator name (#7824 )	4 years ago
INSTALL.md	Update the version of the dependencies used by the RocksJava static build (#4761 )	6 years ago
LANGUAGE-BINDINGS.md	Add RestoreDBFromLatestBackup to C API, add new C# package (#7092 )	4 years ago
LICENSE.Apache	Change RocksDB License	7 years ago
LICENSE.leveldb	Add back the LevelDB license file	7 years ago
Makefile	Update RocksJava static compression dependencies (#7804 )	4 years ago
README.md	Fix the CI badge for ppc64le Jenkins (#7561 )	4 years ago
ROCKSDB_LITE.md	Fix some typos in comments and docs.	6 years ago
TARGETS	Range Locking: Implementation of range locking (#7506 )	4 years ago
USERS.md	add ArangoDB to USERS.md, and fix typos in that file (#7675 )	4 years ago
Vagrantfile	Adding CentOS 7 Vagrantfile & build script	6 years ago
WINDOWS_PORT.md	#5145 , rename port/dirent.h to port/port_dirent.h to avoid compile err when use port dir as header dir output (#5152 )	5 years ago
appveyor.yml	Remove 2019 from appveyor (#7038 )	4 years ago
defs.bzl	Make testpilot recognize that these tests have coverage instrumentation	4 years ago
issue_template.md	Add Google Group to Issue Template	4 years ago
src.mk	Range Locking: Implementation of range locking (#7506 )	4 years ago
thirdparty.inc	Fix build jemalloc api (#5470 )	5 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key-value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it especially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/ and https://rocksdb.slack.com/

License

RocksDB is dual-licensed under both the GPLv2 (found in the COPYING file in the root directory) and Apache 2.0 License (found in the LICENSE.Apache file in the root directory). You may select, at your option, one of the above-listed licenses.