rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Feng Zhu c11d604ab3 store file_indexer info in sequential memory Summary: use arena to allocate space for next_level_index_ and level_rb_ Thus increasing data locality and make Version::Get faster. Benchmark detail Base version: commit `d2a727c182` command used: ./db_bench --db=/mnt/db/rocksdb --num_levels=6 --key_size=20 --prefix_size=20 --keys_per_prefix=0 --value_size=100 --block_size=4096 --cache_size=17179869184 --cache_numshardbits=6 --compression_type=none --compression_ratio=1 --min_level_to_compress=-1 --disable_seek_compaction=1 --hard_rate_limit=2 --write_buffer_size=134217728 --max_write_buffer_number=2 --level0_file_num_compaction_trigger=8 --target_file_size_base=2097152 --max_bytes_for_level_base=1073741824 --disable_wal=0 --sync=0 --disable_data_sync=1 --verify_checksum=1 --delete_obsolete_files_period_micros=314572800 --max_grandparent_overlap_factor=10 --max_background_compactions=4 --max_background_flushes=0 --level0_slowdown_writes_trigger=16 --level0_stop_writes_trigger=24 --statistics=0 --stats_per_interval=0 --stats_interval=1048576 --histogram=0 --use_plain_table=1 --open_files=-1 --mmap_read=1 --mmap_write=0 --memtablerep=prefix_hash --bloom_bits=10 --bloom_locality=1 --perf_level=0 --benchmarks=fillseq, readrandom,readrandom,readrandom --use_existing_db=0 --num=52428800 --threads=1 Result: cpu running percentage: Version::Get, improved from 7.98% to 7.42% FileIndexer::GetNextLevelIndex, improved from 1.18% to 0.68%. Test Plan: make all check Reviewers: ljin, haobo, yhchiang, sdong Reviewed By: sdong Subscribers: dhruba, igor Differential Revision: https://reviews.facebook.net/D19845		11 years ago
build_tools	Adding NUMA support to db_bench tests	11 years ago
coverage	Disable the html-based coverage report by default	11 years ago
db	store file_indexer info in sequential memory	11 years ago
doc	Remove seek compaction	11 years ago
examples	Make it easier to start using RocksDB	11 years ago
hdfs	hdfs cleanup and compile test against CDH 4.4.	11 years ago
helpers/memenv	Expose in memory Env to the world	11 years ago
include	Support multiple DB directories in universal compaction style	11 years ago
java	Caching methodId and fieldId is fine: v2	11 years ago
linters	allow lambda function syntax in cpplint	11 years ago
port	generic rate limiter	11 years ago
table	Fix compressed cache	11 years ago
third-party/rapidjson	Fix a rapidjson compile error in mac.	11 years ago
tools	[db stress] Don't drop column families if there's only 1	11 years ago
util	Support multiple DB directories in universal compaction style	11 years ago
utilities	Add missing DB functions to DocumentDB	11 years ago
.arcconfig	Improve/fix bugs for the cpp linter	11 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	Add .swp to gitignore	11 years ago
.travis.yml	Turn off travis notifications	11 years ago
CONTRIBUTING.md	facebook accounts are not required for CLA signers	11 years ago
HISTORY.md	Support multiple DB directories in universal compaction style	11 years ago
INSTALL.md	specify the command to install build_tools/mac-install-gflags.sh file in doc	11 years ago
LICENSE	Fix copyright year	11 years ago
Makefile	Update master to version 3.3	11 years ago
PATENTS	Fix the patent format	11 years ago
README.md	Update README.md	11 years ago
ROCKSDB_LITE.md	RocksDBLite	11 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/