rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

Igor Canadi 6059bdf86a Add experimental API MarkForCompaction() Summary: Some Mongo+Rocks datasets in Parse's environment are not doing compactions very frequently. During the quiet period (with no IO), we'd like to schedule compactions so that our reads become faster. Also, aggressively compacting during quiet periods helps when write bursts happen. In addition, we also want to compact files that are containing deleted key ranges (like old oplog keys). All of this is currently not possible with CompactRange() because it's single-threaded and blocks all other compactions from happening. Running CompactRange() risks an issue of blocking writes because we generate too much Level 0 files before the compaction is over. Stopping writes is very dangerous because they hold transaction locks. We tried running manual compaction once on Mongo+Rocks and everything fell apart. MarkForCompaction() solves all of those problems. This is very light-weight manual compaction. It is lower priority than automatic compactions, which means it shouldn't interfere with background process keeping the LSM tree clean. However, if no automatic compactions need to be run (or we have extra background threads available), we will start compacting files that are marked for compaction. Test Plan: added a new unit test Reviewers: yhchiang, rven, MarkCallaghan, sdong Reviewed By: sdong Subscribers: yoshinorim, dhruba, leveldb Differential Revision: https://reviews.facebook.net/D37083		10 years ago
arcanist_util	Integrate Jenkins with Phabricator	10 years ago
build_tools	Merge pull request #584 from pshareghi/rocksdb-3.10-falloch	10 years ago
coverage	Fix coverage script	10 years ago
db	Add experimental API MarkForCompaction()	10 years ago
doc	Remove seek compaction	11 years ago
examples	Fix formatting	10 years ago
hdfs	Remove unused parameter in CancelAllBackgroundWork	10 years ago
include	Add experimental API MarkForCompaction()	10 years ago
java	[RocksJava] Fix RateLimiter Tests in 3.10	10 years ago
port	stack_trace.cc: fix #elif check for OS_MACOSX	10 years ago
table	SyncPoint to allow a callback with an argument and use it to get DBTest.DynamicLevelCompressionPerLevel2 more straight-forward	10 years ago
third-party	Update COMMIT.md	10 years ago
tools	Get benchmark.sh loads to run faster	10 years ago
util	Speed up reduce_levels_test	10 years ago
utilities	maint: use ASSERT_TRUE, not ASSERT_EQ(true; same for false	10 years ago
.arcconfig	Integrate Jenkins with Phabricator	10 years ago
.clang-format	A script that automatically reformat affected lines	11 years ago
.gitignore	run 'make check's rules (and even subtests) in parallel	10 years ago
.travis.yml	Only run db_test in Travis	10 years ago
AUTHORS	Add AUTHORS file. Fix #203	10 years ago
CONTRIBUTING.md	facebook accounts are not required for CLA signers	11 years ago
HISTORY.md	A new call back to TablePropertiesCollector to allow users know the entry is add, delete or merge	10 years ago
INSTALL.md	Optimize default compile to compilation platform by default	10 years ago
LICENSE	Fix copyright year	11 years ago
Makefile	Add Xfunc to makefile	10 years ago
PATENTS	Update Patent Grant.	10 years ago
README.md	Replaced "built on on earlier work" by "built on earlier work" in README.md	10 years ago
ROCKSDB_LITE.md	RocksDBLite	11 years ago
USERS.md	Update USERS.md	10 years ago
Vagrantfile	RocksDB on FreeBSD support	10 years ago
src.mk	Add experimental API MarkForCompaction()	10 years ago

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/