fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Changyu Bi b3c43a5b99 Drain unnecessary levels when `level_compaction_dynamic_level_bytes=true` (#11340) ... Summary: When a user migrates to level compaction + `level_compaction_dynamic_level_bytes=true`, or when a DB shrinks, there can be unnecessary levels in the DB. Before this PR, this is no way to remove these levels except a manual compaction. These extra unnecessary levels make it harder to guarantee max_bytes_for_level_multiplier and can cause extra space amp. This PR boosts compaction score for these levels to allow RocksDB to automatically drain these levels. Together with https://github.com/facebook/rocksdb/issues/11321, this makes migration to `level_compaction_dynamic_level_bytes=true` automatic without needing user to do a one time full manual compaction. Credit: this PR is modified from https://github.com/facebook/rocksdb/issues/3921. Pull Request resolved: https://github.com/facebook/rocksdb/pull/11340 Test Plan: - New unit tests - `python3 tools/db_crashtest.py whitebox --simple` which randomly sets level_compaction_dynamic_level_bytes in each run. Reviewed By: ajkr Differential Revision: D44563884 Pulled By: cbi42 fbshipit-source-id: e20d3620bd73dff22be18c5a91a07f340740bcc8		2 years ago
..
clipping_iterator.h	Refactor AddRangeDels() + consider range tombstone during compaction file cutting (#11113)	2 years ago
clipping_iterator_test.cc	Print stack traces on frozen tests in CI (#10828)	2 years ago
compaction.cc	Revert #10802 Consider range tombstone in compaction output file cutting (#11089)	2 years ago
compaction.h	Drain unnecessary levels when `level_compaction_dynamic_level_bytes=true` (#11340)	2 years ago
compaction_iteration_stats.h	Support readahead during compaction for blob files (#9187)	3 years ago
compaction_iterator.cc	Drain unnecessary levels when `level_compaction_dynamic_level_bytes=true` (#11340)	2 years ago
compaction_iterator.h	Refactor AddRangeDels() + consider range tombstone during compaction file cutting (#11113)	2 years ago
compaction_iterator_test.cc	Basic Support for Merge with user-defined timestamp (#10819)	2 years ago
compaction_job.cc	Refactor AddRangeDels() + consider range tombstone during compaction file cutting (#11113)	2 years ago
compaction_job.h	Refactor AddRangeDels() + consider range tombstone during compaction file cutting (#11113)	2 years ago
compaction_job_stats_test.cc	Remove RocksDB LITE (#11147)	2 years ago
compaction_job_test.cc	Remove RocksDB LITE (#11147)	2 years ago
compaction_outputs.cc	Refactor AddRangeDels() + consider range tombstone during compaction file cutting (#11113)	2 years ago
compaction_outputs.h	Refactor AddRangeDels() + consider range tombstone during compaction file cutting (#11113)	2 years ago
compaction_picker.cc	Remove RocksDB LITE (#11147)	2 years ago
compaction_picker.h	Remove RocksDB LITE (#11147)	2 years ago
compaction_picker_fifo.cc	Remove RocksDB LITE (#11147)	2 years ago
compaction_picker_fifo.h	Remove RocksDB LITE (#11147)	2 years ago
compaction_picker_level.cc	Add missing range conflict check between file ingestion and RefitLevel() (#10988)	2 years ago
compaction_picker_level.h	Sort L0 files by newly introduced epoch_num (#10922)	2 years ago
compaction_picker_test.cc	Remove RocksDB LITE (#11147)	2 years ago
compaction_picker_universal.cc	Remove RocksDB LITE (#11147)	2 years ago
compaction_picker_universal.h	Remove RocksDB LITE (#11147)	2 years ago
compaction_service_job.cc	Remove RocksDB LITE (#11147)	2 years ago
compaction_service_test.cc	Remove RocksDB LITE (#11147)	2 years ago
compaction_state.cc	Tiered Compaction: per key placement support (#9964)	2 years ago
compaction_state.h	Tiered Compaction: per key placement support (#9964)	2 years ago
file_pri.h	Try to start TTL earlier with kMinOverlappingRatio is used (#8749)	3 years ago
sst_partitioner.cc	Remove FactoryFunc from LoadXXXObject (#11203)	2 years ago
subcompaction_state.cc	Refactor Compaction file cut `ShouldStopBefore()` (#10629)	2 years ago
subcompaction_state.h	Refactor AddRangeDels() + consider range tombstone during compaction file cutting (#11113)	2 years ago
tiered_compaction_test.cc	Drain unnecessary levels when `level_compaction_dynamic_level_bytes=true` (#11340)	2 years ago