rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Anand Ananthabhotla 9a5886bd8c Extend Get/MultiGet deadline support to table open (#6982 ) Summary: Current implementation of the ```read_options.deadline``` option only checks the deadline for random file reads during point lookups. This PR extends the checks to file opens, prefetches and preloads as part of table open. The main changes are in the ```BlockBasedTable```, partitioned index and filter readers, and ```TableCache``` to take ReadOptions as an additional parameter. In ```BlockBasedTable::Open```, in order to retain existing behavior w.r.t checksum verification and block cache usage, we filter out most of the options in ```ReadOptions``` except ```deadline```. However, having the ```ReadOptions``` gives us more flexibility to honor other options like verify_checksums, fill_cache etc. in the future. Additional changes in callsites due to function signature changes in ```NewTableReader()``` and ```FilePrefetchBuffer```. Pull Request resolved: https://github.com/facebook/rocksdb/pull/6982 Test Plan: Add new unit tests in db_basic_test Reviewed By: riversand963 Differential Revision: D22219515 Pulled By: anand1976 fbshipit-source-id: 8a3b92f4a889808013838603aa3ca35229cd501b		5 years ago
.circleci	Remove 2019 from appveyor (#7038 )	5 years ago
.github/workflows	Clean up some code related to file checksums (#6861 )	5 years ago
buckifier	Directly use unit test tempalte buck (#6926 )	5 years ago
build_tools	Portable backward compatibility with MacOS 10.12+ (#7016 )	5 years ago
cache	Revert "Update googletest from 1.8.1 to 1.10.0 (#6808 )" (#6923 )	5 years ago
cmake	Add `find_dependency()` in cmake config file. (#6791 )	5 years ago
coverage	Find the correct gcov (#6904 )	5 years ago
db	Extend Get/MultiGet deadline support to table open (#6982 )	5 years ago
db_stress_tool	Minimize memory internal fragmentation for Bloom filters (#6427 )	5 years ago
docs	Log warning for high bits/key in legacy Bloom filter (#6312 )	5 years ago
env	Move away from direct TmpDir() call in some tests (#7030 )	5 years ago
examples	add WITH_EXAMPLES options to cmake and cleanups. (#6580 )	5 years ago
file	Extend Get/MultiGet deadline support to table open (#6982 )	5 years ago
hdfs	fix build with 'USE_HDFS' on windows (#6950 )	5 years ago
include/rocksdb	Extend Get/MultiGet deadline support to table open (#6982 )	5 years ago
java	Add logs and stats in DeleteScheduler (#6927 )	5 years ago
logging	Fix info log source file display length (#5824 )	5 years ago
memory	C++20 compatibility (#6697 )	5 years ago
memtable	Fix more defects reported by Coverity Scan (#6935 )	5 years ago
monitoring	Add logs and stats in DeleteScheduler (#6927 )	5 years ago
options	Test CircleCI with CLANG-10 (#7025 )	5 years ago
port	build fixes for GNU/kFreeBSD (#6992 )	5 years ago
table	Extend Get/MultiGet deadline support to table open (#6982 )	5 years ago
test_util	Remove racially charged terms "whitelist" and "blacklist" (#7008 )	5 years ago
third-party	Revert "Update googletest from 1.8.1 to 1.10.0 (#6808 )" (#6923 )	5 years ago
tools	Move away from direct TmpDir() call in some tests (#7030 )	5 years ago
trace_replay	Fix unity build broken by #7007 (#7024 )	5 years ago
util	filelock_test: add freebsd headers for waitpid (#7010 )	5 years ago
utilities	Extend Get/MultiGet deadline support to table open (#6982 )	5 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	Allow missing "unversioned" python, as in CentOS 8 (#6883 )	5 years ago
.lgtm.yml	Create lgtm.yml for LGTM.com C/C++ analysis (#4058 )	7 years ago
.travis.yml	Use official CMake snap on Travis Linux (#6892 )	5 years ago
.watchmanconfig	Added .watchmanconfig file to rocksdb repo (#5593 )	6 years ago
AUTHORS	Update RocksDB Authors File	7 years ago
CMakeLists.txt	freebsd: malloc_usable_size check malloc_np.h (#7009 )	5 years ago
CODE_OF_CONDUCT.md	Adopt Contributor Covenant	5 years ago
CONTRIBUTING.md	Add Code of Conduct	7 years ago
COPYING	Add GPLv2 as an alternative license.	8 years ago
DEFAULT_OPTIONS_HISTORY.md	options.delayed_write_rate use the rate of rate_limiter by default.	8 years ago
DUMP_FORMAT.md	First version of rocksdb_dump and rocksdb_undump.	10 years ago
HISTORY.md	`BackupEngine::VerifyBackup` verifies checksum by default (#7014 )	5 years ago
INSTALL.md	Update the version of the dependencies used by the RocksJava static build (#4761 )	6 years ago
LANGUAGE-BINDINGS.md	LANGUAGE-BINDINGS.md: mention python-rocksdb	6 years ago
LICENSE.Apache	Change RocksDB License	8 years ago
LICENSE.leveldb	Add back the LevelDB license file	8 years ago
Makefile	Add unity build to CircleCI (#7026 )	5 years ago
README.md	Add CircleCI gadget (#7028 )	5 years ago
ROCKSDB_LITE.md	Fix some typos in comments and docs.	7 years ago
TARGETS	Add a new option for BackupEngine to store table files under shared_checksum using DB session id in the backup filenames (#6997 )	5 years ago
USERS.md	Add YugabyteDB to USERS (#6786 )	5 years ago
Vagrantfile	Adding CentOS 7 Vagrantfile & build script	7 years ago
WINDOWS_PORT.md	#5145 , rename port/dirent.h to port/port_dirent.h to avoid compile err when use port dir as header dir output (#5152 )	6 years ago
appveyor.yml	Remove 2019 from appveyor (#7038 )	5 years ago
defs.bzl	Make testpilot recognize that these tests have coverage instrumentation	5 years ago
issue_template.md	Add Google Group to Issue Template	5 years ago
src.mk	Add a new option for BackupEngine to store table files under shared_checksum using DB session id in the backup filenames (#6997 )	5 years ago
thirdparty.inc	Fix build jemalloc api (#5470 )	6 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key-value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it especially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/ and https://rocksdb.slack.com/

License

RocksDB is dual-licensed under both the GPLv2 (found in the COPYING file in the root directory) and Apache 2.0 License (found in the LICENSE.Apache file in the root directory). You may select, at your option, one of the above-listed licenses.