fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

sdong a2b9be42b6 Try to start TTL earlier with kMinOverlappingRatio is used (#8749) ... Summary: Right now, when options.ttl is set, compactions are triggered around the time when TTL is reached. This might cause extra compactions which are often bursty. This commit tries to mitigate it by picking those files earlier in normal compaction picking process. This is only implemented using kMinOverlappingRatio with Leveled compaction as it is the default value and it is more complicated to change other styles. When a file is aged more than ttl/2, RocksDB starts to boost the compaction priority of files in normal compaction picking process, and hope by the time TTL is reached, very few extra compaction is needed. In order for this to work, another change is made: during a compaction, if an output level file is older than ttl/2, cut output files based on original boundary (if it is not in the last level). This is to make sure that after an old file is moved to the next level, and new data is merged from the upper level, the new data falling into this range isn't reset with old timestamp. Without this change, in many cases, most files from one level will keep having old timestamp, even if they have newer data and we stuck in it. Pull Request resolved: https://github.com/facebook/rocksdb/pull/8749 Test Plan: Add a unit test to test the boosting logic. Will add a unit test to test it end-to-end. Reviewed By: jay-zhuang Differential Revision: D30735261 fbshipit-source-id: 503c2d89250b22911eb99e72b379be154de3428e		3 years ago
..
clipping_iterator.h	Add a clipping internal iterator (#8327)	4 years ago
clipping_iterator_test.cc	Cleanup multiple implementations of VectorIterator (#8901)	3 years ago
compaction.cc	Try to start TTL earlier with kMinOverlappingRatio is used (#8749)	3 years ago
compaction.h	Try to start TTL earlier with kMinOverlappingRatio is used (#8749)	3 years ago
compaction_iteration_stats.h	Fix and detect headers with missing dependencies (#8893)	3 years ago
compaction_iterator.cc	Fix a compaction bug for write-prepared txn (#9061)	3 years ago
compaction_iterator.h	Fix a compaction bug for write-prepared txn (#9061)	3 years ago
compaction_iterator_test.cc	Cleanup multiple implementations of VectorIterator (#8901)	3 years ago
compaction_job.cc	Try to start TTL earlier with kMinOverlappingRatio is used (#8749)	3 years ago
compaction_job.h	Cleanup includes in dbformat.h (#8930)	3 years ago
compaction_job_stats_test.cc	Make MemTableRepFactory into a Customizable class (#8419)	3 years ago
compaction_job_test.cc	Support SingleDelete for user-defined timestamps (#8921)	3 years ago
compaction_picker.cc	Ignore non-overlapping levels when determinig grandparent files (#9051)	3 years ago
compaction_picker.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
compaction_picker_fifo.cc	Cleanup includes in dbformat.h (#8930)	3 years ago
compaction_picker_fifo.h	Move old files to warm tier in FIFO compactions (#8310)	3 years ago
compaction_picker_level.cc	Make it possible to force the garbage collection of the oldest blob files (#8994)	3 years ago
compaction_picker_level.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
compaction_picker_test.cc	Try to start TTL earlier with kMinOverlappingRatio is used (#8749)	3 years ago
compaction_picker_universal.cc	Incremental Space Amp Compactions in Universal Style (#8655)	3 years ago
compaction_picker_universal.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
compaction_service_test.cc	Add remote compaction read/write bytes statistics (#8939)	3 years ago
file_pri.h	Try to start TTL earlier with kMinOverlappingRatio is used (#8749)	3 years ago
sst_partitioner.cc	Make WalFilter, SstPartitionerFactory, FileChecksumGenFactory, and TableProperties Customizable (#8638)	3 years ago