rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Zhongyi Xie 51c2ea0feb Reduce heavy hitter for Get operation Summary: This PR addresses the following heavy hitters in `Get` operation by moving calls to `StatisticsImpl::recordTick` from `BlockBasedTable` to `Version::Get` - rocksdb.block.cache.bytes.write - rocksdb.block.cache.add - rocksdb.block.cache.data.miss - rocksdb.block.cache.data.bytes.insert - rocksdb.block.cache.data.add - rocksdb.block.cache.hit - rocksdb.block.cache.data.hit - rocksdb.block.cache.bytes.read The db_bench statistics before and after the change are: \|1GB block read\|Children \|Self \|Command \|Shared Object \|Symbol\| \|---\|---\|---\|---\|---\|---\| \|master: \|4.22% \|1.31% \|db_bench \|db_bench \|[.] rocksdb::StatisticsImpl::recordTick\| \|updated: \|0.51% \|0.21% \|db_bench \|db_bench \|[.] rocksdb::StatisticsImpl::recordTick\| \| \|0.14% \|0.14% \|db_bench \|db_bench \|[.] rocksdb::GetContext::record_counters\| \|1MB block read\|Children \|Self \|Command \|Shared Object \|Symbol\| \|---\|---\|---\|---\|---\|---\| \|master: \|3.48% \|1.08% \|db_bench \|db_bench \|[.] rocksdb::StatisticsImpl::recordTick\| \|updated: \|0.80% \|0.31% \|db_bench \|db_bench \|[.] rocksdb::StatisticsImpl::recordTick\| \| \|0.35% \|0.35% \|db_bench \|db_bench \|[.] rocksdb::GetContext::record_counters\| Closes https://github.com/facebook/rocksdb/pull/3172 Differential Revision: D6330532 Pulled By: miasantreble fbshipit-source-id: 2b492959e00a3db29e9437ecdcc5e48ca4ec5741		7 years ago
buckifier	Remove `import` use from TARGETS	7 years ago
build_tools	revert fbcode build behavior	7 years ago
cache	fix gflags namespace	7 years ago
cmake	add missing config checks to CMakeLists.txt	7 years ago
coverage	Fix /bin/bash shebangs	7 years ago
db	Reduce heavy hitter for Get operation	7 years ago
docs	Blog post for 5.8 release	7 years ago
env	Suppress valgrind "unimplemented functionality" error	7 years ago
examples	Pinnableslice examples and blog post	7 years ago
hdfs	Revert "comment out unused parameters"	7 years ago
include/rocksdb	Switch version to 5.10	7 years ago
java	CMake cross platform Java support and add JNI to travis	7 years ago
memtable	fix gflags namespace	7 years ago
monitoring	Add a ticker stat for number of keys skipped during iteration	7 years ago
options	Make Universal compaction options dynamic	7 years ago
port	Fix a race condition in WindowsThread (port::Thread)	7 years ago
table	Reduce heavy hitter for Get operation	7 years ago
third-party	Enable MSVC W4 with a few exceptions. Fix warnings and bugs	7 years ago
tools	Fix clang-analyzer false-positive on ldb_cmd.cc	7 years ago
util	Fix DeleteScheduler::MarkAsTrash() handling existing trash	7 years ago
utilities	BlobDB: refactor DB open logic	7 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	Remove leftover references to phutil_module_cache	7 years ago
.travis.yml	CMake cross platform Java support and add JNI to travis	7 years ago
AUTHORS	Update RocksDB Authors File	7 years ago
CMakeLists.txt	Refactor ReadBlockContents()	7 years ago
CODE_OF_CONDUCT.md	Add Code of Conduct	7 years ago
CONTRIBUTING.md	Add Code of Conduct	7 years ago
COPYING	Add GPLv2 as an alternative license.	8 years ago
DEFAULT_OPTIONS_HISTORY.md	options.delayed_write_rate use the rate of rate_limiter by default.	8 years ago
DUMP_FORMAT.md	First version of rocksdb_dump and rocksdb_undump.	10 years ago
HISTORY.md	Switch version to 5.10	7 years ago
INSTALL.md	Default one to rocksdb:x64-windows	7 years ago
LANGUAGE-BINDINGS.md	Add Elixir to the list of language bindings	7 years ago
LICENSE.Apache	Change RocksDB License	7 years ago
LICENSE.leveldb	Add back the LevelDB license file	7 years ago
Makefile	Suppress valgrind "unimplemented functionality" error	7 years ago
README.md	Appveyor badge to show master branch	8 years ago
ROCKSDB_LITE.md	Optimistic Transactions	10 years ago
TARGETS	Refactor ReadBlockContents()	7 years ago
USERS.md	Added ProfaneDB	7 years ago
Vagrantfile	Update Vagrant file (test internal phabricator workflow)	8 years ago
WINDOWS_PORT.md	Commit both PR and internal code review changes	9 years ago
appveyor.yml	Add -DPORTABLE=1 to MSVC CI build	7 years ago
issue_template.md	Add a template for issues	7 years ago
src.mk	Refactor ReadBlockContents()	7 years ago
thirdparty.inc	Enable cacheline_aligned_alloc() to allocate from jemalloc if enabled.	7 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/