rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Sagar Vemuri 89ad9f3adb Allow ignoring unknown options when loading options from a file Summary: Added a flag, `ignore_unknown_options`, to skip unknown options when loading an options file (using `LoadLatestOptions`/`LoadOptionsFromFile`) or while verifying options (using `CheckOptionsCompatibility`). This will help in downgrading the db to an older version. Also added `--ignore_unknown_options` flag to ldb Example Use case: In MyRocks, if copying from newer version to older version, it is often impossible to start because of new RocksDB options that don't exist in older version, even though data format is compatible. MyRocks uses these load and verify functions in [ha_rocksdb.cc::check_rocksdb_options_compatibility](`e004fd9f41/storage/rocksdb/ha_rocksdb.cc (L3348-L3401)`). Test Plan: Updated the unit tests. `make check` ldb: $ ./ldb --db=/tmp/test_db --create_if_missing put a1 b1 OK Now edit /tmp/test_db/<OPTIONS-file> and add an unknown option. Try loading the options now, and it fails: $ ./ldb --db=/tmp/test_db --try_load_options get a1 Failed: Invalid argument: Unrecognized option DBOptions:: abcd Passes with the new --ignore_unknown_options flag $ ./ldb --db=/tmp/test_db --try_load_options --ignore_unknown_options get a1 b1 Closes https://github.com/facebook/rocksdb/pull/2423 Differential Revision: D5212091 Pulled By: sagar0 fbshipit-source-id: 2ec17636feb47dc0351b53a77e5f15ef7cbf2ca7		8 years ago
arcanist_util	Fix arc setting for Facebook internal tools	8 years ago
buckifier	update buckifer/TARGETS	8 years ago
build_tools	fixed typo	8 years ago
cache	Add GPLv2 as an alternative license.	8 years ago
cmake/modules	CMake: more MinGW fixes	8 years ago
coverage	Fix coverage script	10 years ago
db	fixed typo	8 years ago
docs	RocksDB 5.4.5 release blog post	8 years ago
env	GNU C library for struct tm has 2 additional fields.	8 years ago
examples	CMake: more MinGW fixes	8 years ago
hdfs	New API for background work in single thread pool	8 years ago
include/rocksdb	Allow ignoring unknown options when loading options from a file	8 years ago
java	fixed typo	8 years ago
memtable	Improve write buffer manager (and allow the size to be tracked in block cache)	8 years ago
monitoring	Sample number of reads per SST file	8 years ago
options	Allow ignoring unknown options when loading options from a file	8 years ago
port	Dedup release	8 years ago
table	record index partition properties	8 years ago
third-party	fixed typo	8 years ago
tools	Allow ignoring unknown options when loading options from a file	8 years ago
util	fixed typo	8 years ago
utilities	Allow ignoring unknown options when loading options from a file	8 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.deprecated_arcconfig	Update ShipIt to honor TARGETS updates	8 years ago
.gitignore	Simple blob file dumper	8 years ago
.travis.yml	Force travis to build with clang on MacOS	8 years ago
AUTHORS	Add AUTHORS file. Fix #203	10 years ago
CMakeLists.txt	Improve write buffer manager (and allow the size to be tracked in block cache)	8 years ago
CONTRIBUTING.md	facebook accounts are not required for CLA signers	11 years ago
COPYING	Add GPLv2 as an alternative license.	8 years ago
DEFAULT_OPTIONS_HISTORY.md	options.delayed_write_rate use the rate of rate_limiter by default.	8 years ago
DUMP_FORMAT.md	First version of rocksdb_dump and rocksdb_undump.	10 years ago
HISTORY.md	Call RateLimiter for compaction reads	8 years ago
INSTALL.md	cross-platform compatibility improvements	8 years ago
LANGUAGE-BINDINGS.md	Adding Dlang to the list	8 years ago
LICENSE	Updated all copyright headers to the new format.	9 years ago
Makefile	Switch from CentOS 5 to CentOS 6 for crossbuilding RocksJava	8 years ago
PATENTS	Update Patent Grant.	10 years ago
README.md	Appveyor badge to show master branch	9 years ago
ROCKSDB_LITE.md	Optimistic Transactions	10 years ago
TARGETS	Improve write buffer manager (and allow the size to be tracked in block cache)	8 years ago
USERS.md	fixed typo	8 years ago
Vagrantfile	Update Vagrant file (test internal phabricator workflow)	8 years ago
WINDOWS_PORT.md	Commit both PR and internal code review changes	10 years ago
appveyor.yml	Rework test running script.	8 years ago
src.mk	Improve write buffer manager (and allow the size to be tracked in block cache)	8 years ago
thirdparty.inc	Introduce XPRESS compresssion on Windows. (#1081 )	9 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/