fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

sdong a2b9be42b6 Try to start TTL earlier with kMinOverlappingRatio is used (#8749 An error occurred ) ... Summary: Right now, when options.ttl is set, compactions are triggered around the time when TTL is reached. This might cause extra compactions which are often bursty. This commit tries to mitigate it by picking those files earlier in normal compaction picking process. This is only implemented using kMinOverlappingRatio with Leveled compaction as it is the default value and it is more complicated to change other styles. When a file is aged more than ttl/2, RocksDB starts to boost the compaction priority of files in normal compaction picking process, and hope by the time TTL is reached, very few extra compaction is needed. In order for this to work, another change is made: during a compaction, if an output level file is older than ttl/2, cut output files based on original boundary (if it is not in the last level). This is to make sure that after an old file is moved to the next level, and new data is merged from the upper level, the new data falling into this range isn't reset with old timestamp. Without this change, in many cases, most files from one level will keep having old timestamp, even if they have newer data and we stuck in it. Pull Request resolved: https://github.com/facebook/rocksdb/pull/8749 Test Plan: Add a unit test to test the boosting logic. Will add a unit test to test it end-to-end. Reviewed By: jay-zhuang Differential Revision: D30735261 fbshipit-source-id: 503c2d89250b22911eb99e72b379be154de3428e		3 years ago
..
clipping_iterator.h	…
clipping_iterator_test.cc	Cleanup multiple implementations of VectorIterator (#8901 An error occurred )	3 years ago
compaction.cc	Try to start TTL earlier with kMinOverlappingRatio is used (#8749 An error occurred )	3 years ago
compaction.h	Try to start TTL earlier with kMinOverlappingRatio is used (#8749 An error occurred )	3 years ago
compaction_iteration_stats.h	Fix and detect headers with missing dependencies (#8893 An error occurred )	4 years ago
compaction_iterator.cc	Fix a compaction bug for write-prepared txn (#9061 An error occurred )	3 years ago
compaction_iterator.h	Fix a compaction bug for write-prepared txn (#9061 An error occurred )	3 years ago
compaction_iterator_test.cc	Cleanup multiple implementations of VectorIterator (#8901 An error occurred )	3 years ago
compaction_job.cc	Try to start TTL earlier with kMinOverlappingRatio is used (#8749 An error occurred )	3 years ago
compaction_job.h	Cleanup includes in dbformat.h (#8930 An error occurred )	3 years ago
compaction_job_stats_test.cc	…
compaction_job_test.cc	Support SingleDelete for user-defined timestamps (#8921 An error occurred )	3 years ago
compaction_picker.cc	Ignore non-overlapping levels when determinig grandparent files (#9051 An error occurred )	3 years ago
compaction_picker.h	…
compaction_picker_fifo.cc	Cleanup includes in dbformat.h (#8930 An error occurred )	3 years ago
compaction_picker_fifo.h	…
compaction_picker_level.cc	Make it possible to force the garbage collection of the oldest blob files (#8994 An error occurred )	3 years ago
compaction_picker_level.h	…
compaction_picker_test.cc	Try to start TTL earlier with kMinOverlappingRatio is used (#8749 An error occurred )	3 years ago
compaction_picker_universal.cc	Incremental Space Amp Compactions in Universal Style (#8655 An error occurred )	3 years ago
compaction_picker_universal.h	…
compaction_service_test.cc	Add remote compaction read/write bytes statistics (#8939 An error occurred )	3 years ago
file_pri.h	Try to start TTL earlier with kMinOverlappingRatio is used (#8749 An error occurred )	3 years ago
sst_partitioner.cc	Make WalFilter, SstPartitionerFactory, FileChecksumGenFactory, and TableProperties Customizable (#8638 An error occurred )	3 years ago