rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

krad d9f4875e52 Disable pre-fetching of index and filter blocks for sst_dump_tool. Summary: BlockBasedTable pre-fetches the filter and index blocks on Open call. This is an optimistic optimization targeted for runtime scenario. The optimization is unnecessary for sst_dump_tool - Added a provision to disable pre-fetching of index and filter blocks in BlockBasedTable - Disabled pre-fetching for the sst_dump tool Stack for reference : #01 0x00000000005ed944 in snappy::InternalUncompress<snappy::SnappyArrayWriter> () from /home/engshare/third-party2/snappy/1.0.3/src/snappy-1.0.3/snappy.cc:148 #02 0x00000000005edeee in snappy::RawUncompress () from /home/engshare/third-party2/snappy/1.0.3/src/snappy-1.0.3/snappy.cc:947 #03 0x00000000004e0b4d in rocksdb::UncompressBlockContents () from /data/users/paultuckfield/rocksdb/./util/compression.h:69 #04 0x00000000004e145c in rocksdb::ReadBlockContents () from /data/users/paultuckfield/rocksdb/table/format.cc:334 #05 0x00000000004ca424 in rocksdb::(anonymous namespace)::ReadBlockFromFile () from /data/users/paultuckfield/rocksdb/table/block_based_table_reader.cc:70 #06 0x00000000004cccad in rocksdb::BlockBasedTable::CreateIndexReader () from /data/users/paultuckfield/rocksdb/table/block_based_table_reader.cc:173 #07 0x00000000004d17e5 in rocksdb::BlockBasedTable::Open () from /data/users/paultuckfield/rocksdb/table/block_based_table_reader.cc:553 #08 0x00000000004c8184 in rocksdb::BlockBasedTableFactory::NewTableReader () from /data/users/paultuckfield/rocksdb/table/block_based_table_factory.cc:51 #09 0x0000000000598463 in rocksdb::SstFileReader::NewTableReader () from /data/users/paultuckfield/rocksdb/util/sst_dump_tool.cc:69 #10 0x00000000005986c2 in rocksdb::SstFileReader::SstFileReader () from /data/users/paultuckfield/rocksdb/util/sst_dump_tool.cc:26 #11 0x0000000000599047 in rocksdb::SSTDumpTool::Run () from /data/users/paultuckfield/rocksdb/util/sst_dump_tool.cc:332 #12 0x0000000000409b06 in main () from /data/users/paultuckfield/rocksdb/tools/sst_dump.cc:12 Test Plan: - Added a unit test to trigger the code. - Also did some manual verification. - Passed all unit tests task #6296048 Reviewers: igor, rven, sdong Reviewed By: sdong Subscribers: dhruba, leveldb Differential Revision: https://reviews.facebook.net/D34041		10 years ago
build_tools	build: do not relink every single binary just for a timestamp	10 years ago
coverage	Fix coverage script	10 years ago
db	Limit key range to number of keys, not number of writes	10 years ago
doc	Remove seek compaction	11 years ago
examples	Fix formatting	10 years ago
hdfs	Replace exception by abort() in dummy HdfsEnv implementation.	10 years ago
include	maint: remove extraneous "const" attribute from return type	10 years ago
java	[RocksJava] Updated TickerTypes and Histogram to 3.10	10 years ago
linters	Revert "Fbson to Json"	10 years ago
port	LevelDb include guard replaced with #pragma once	10 years ago
table	Disable pre-fetching of index and filter blocks for sst_dump_tool.	10 years ago
third-party/rapidjson	Revert "Fbson to Json"	10 years ago
tools	rocksdb: Fixed 'Dead assignment' and 'Dead initialization' scan-build warnings	10 years ago
util	Disable pre-fetching of index and filter blocks for sst_dump_tool.	10 years ago
utilities	Revert "Fbson to Json"	10 years ago
.arcconfig	build: abbreviate AR command, too	10 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	rocksdb: changes to support 'make analyze' in Jenkins	10 years ago
.travis.yml	Upgrade compiler in Travis	10 years ago
AUTHORS	Add AUTHORS file. Fix #203	10 years ago
CONTRIBUTING.md	facebook accounts are not required for CLA signers	11 years ago
HISTORY.md	Remember whole key/prefix filtering on/off in SST file	10 years ago
INSTALL.md	Optimize default compile to compilation platform by default	10 years ago
LICENSE	Fix copyright year	11 years ago
Makefile	Introduce DISABLE_WARNING_AS_ERROR in Makefile	10 years ago
PATENTS	Fix the patent format	11 years ago
README.md	Replaced "built on on earlier work" by "built on earlier work" in README.md	10 years ago
ROCKSDB_LITE.md	RocksDBLite	11 years ago
Vagrantfile	Package generation for Ubuntu and CentOS	10 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/