fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Andrew Kryczka cc01985db0 Introduce bottom-pri thread pool for large universal compactions ... Summary: When we had a single thread pool for compactions, a thread could be busy for a long time (minutes) executing a compaction involving the bottom level. In multi-instance setups, the entire thread pool could be consumed by such bottom-level compactions. Then, top-level compactions (e.g., a few L0 files) would be blocked for a long time ("head-of-line blocking"). Such top-level compactions are critical to prevent compaction stalls as they can quickly reduce number of L0 files / sorted runs. This diff introduces a bottom-priority queue for universal compactions including the bottom level. This alleviates the head-of-line blocking situation for fast, top-level compactions. - Added `Env::Priority::BOTTOM` thread pool. This feature is only enabled if user explicitly configures it to have a positive number of threads. - Changed `ThreadPoolImpl`'s default thread limit from one to zero. This change is invisible to users as we call `IncBackgroundThreadsIfNeeded` on the low-pri/high-pri pools during `DB::Open` with values of at least one. It is necessary, though, for bottom-pri to start with zero threads so the feature is disabled by default. - Separated `ManualCompaction` into two parts in `PrepickedCompaction`. `PrepickedCompaction` is used for any compaction that's picked outside of its execution thread, either manual or automatic. - Forward universal compactions involving last level to the bottom pool (worker thread's entry point is `BGWorkBottomCompaction`). - Track `bg_bottom_compaction_scheduled_` so we can wait for bottom-level compactions to finish. We don't count them against the background jobs limits. So users of this feature will get an extra compaction for free. Closes https://github.com/facebook/rocksdb/pull/2580 Differential Revision: D5422916 Pulled By: ajkr fbshipit-source-id: a74bd11f1ea4933df3739b16808bb21fcd512333		7 years ago
..
dump	Change RocksDB License	7 years ago
rdb	fixed typo	7 years ago
CMakeLists.txt	cmake support for linux and osx (#1358)	8 years ago
Dockerfile	adding docker build script and dockerfile	9 years ago
auto_sanity_test.sh	AIX and Solaris Sparc Support	7 years ago
benchmark.sh	remove deleted option from benchmark.sh	7 years ago
benchmark_leveldb.sh	Add scripts to run leveldb benchmark	9 years ago
blob_dump.cc	Change RocksDB License	7 years ago
check_format_compatible.sh	checkout local branch in check_format_compatible.sh	7 years ago
db_bench.cc	Change RocksDB License	7 years ago
db_bench_tool.cc	Introduce bottom-pri thread pool for large universal compactions	7 years ago
db_bench_tool_test.cc	Change RocksDB License	7 years ago
db_crashtest.py	db_crashtest.py: remove need for shell	7 years ago
db_repl_stress.cc	Change RocksDB License	7 years ago
db_sanity_test.cc	Change RocksDB License	7 years ago
db_stress.cc	Revert "CRC32 Power Optimization Changes"	7 years ago
dbench_monitor	Added simple monitoring script to monitor overusage of memory in db_bench	10 years ago
generate_random_db.sh	Script to check whether RocksDB can read DB generated by previous releases and vice versa	9 years ago
ldb.cc	Change RocksDB License	7 years ago
ldb_cmd.cc	Replace dynamic_cast<>	7 years ago
ldb_cmd_impl.h	Change RocksDB License	7 years ago
ldb_cmd_test.cc	Change RocksDB License	7 years ago
ldb_test.py	Add GetAllKeyVersions API	7 years ago
ldb_tool.cc	Revert "comment out unused parameters"	7 years ago
pflag	Added simple monitoring script to monitor overusage of memory in db_bench	10 years ago
reduce_levels_test.cc	Change RocksDB License	7 years ago
regression_test.sh	fix regression test	7 years ago
rocksdb_dump_test.sh	AIX and Solaris Sparc Support	7 years ago
run_flash_bench.sh	AIX and Solaris Sparc Support	7 years ago
run_leveldb.sh	AIX and Solaris Sparc Support	7 years ago
sample-dump.dmp	First version of rocksdb_dump and rocksdb_undump.	9 years ago
sst_dump.cc	Change RocksDB License	7 years ago
sst_dump_test.cc	Change RocksDB License	7 years ago
sst_dump_tool.cc	Replace dynamic_cast<>	7 years ago
sst_dump_tool_imp.h	Change RocksDB License	7 years ago
verify_random_db.sh	tools/check_format_compatible.sh to cover option file loading too	7 years ago
write_stress.cc	tools/write_stress.cc: Correct "1204" typos.	7 years ago
write_stress_runner.py	Write stress test	9 years ago