fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Sagar Vemuri d3d20dcdca Periodic Compactions (#5166) ... Summary: Introducing Periodic Compactions. This feature allows all the files in a CF to be periodically compacted. It could help in catching any corruptions that could creep into the DB proactively as every file is constantly getting re-compacted. And also, of course, it helps to cleanup data older than certain threshold. - Introduced a new option `periodic_compaction_time` to control how long a file can live without being compacted in a CF. - This works across all levels. - The files are put in the same level after going through the compaction. (Related files in the same level are picked up as `ExpandInputstoCleanCut` is used). - Compaction filters, if any, are invoked as usual. - A new table property, `file_creation_time`, is introduced to implement this feature. This property is set to the time at which the SST file was created (and that time is given by the underlying Env/OS). This feature can be enabled on its own, or in conjunction with `ttl`. It is possible to set a different time threshold for the bottom level when used in conjunction with ttl. Since `ttl` works only on 0 to last but one levels, you could set `ttl` to, say, 1 day, and `periodic_compaction_time` to, say, 7 days. Since `ttl < periodic_compaction_time` all files in last but one levels keep getting picked up based on ttl, and almost never based on periodic_compaction_time. The files in the bottom level get picked up for compaction based on `periodic_compaction_time`. Pull Request resolved: https://github.com/facebook/rocksdb/pull/5166 Differential Revision: D14884441 Pulled By: sagar0 fbshipit-source-id: 408426cbacb409c06386a98632dcf90bfa1bda47		5 years ago
..
adaptive_table_factory.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
adaptive_table_factory.h	Remove some "using std::..." from header files. (#5113)	5 years ago
block.cc	Apply automatic formatting to some files (#5114)	5 years ago
block.h	Apply automatic formatting to some files (#5114)	5 years ago
block_based_filter_block.cc	Apply automatic formatting to some files (#5114)	5 years ago
block_based_filter_block.h	Apply automatic formatting to some files (#5114)	5 years ago
block_based_filter_block_test.cc	Apply automatic formatting to some files (#5114)	5 years ago
block_based_table_builder.cc	Periodic Compactions (#5166)	5 years ago
block_based_table_builder.h	Periodic Compactions (#5166)	5 years ago
block_based_table_factory.cc	Periodic Compactions (#5166)	5 years ago
block_based_table_factory.h	Remove some "using std::..." from header files. (#5113)	5 years ago
block_based_table_reader.cc	Evict the uncompression dictionary from the block cache upon table close (#5150)	5 years ago
block_based_table_reader.h	Revert "Avoid per-key upper bound check in BlockBasedTableIterator (#5101)" (#5132)	5 years ago
block_builder.cc	Apply automatic formatting to some files (#5114)	5 years ago
block_builder.h	Apply automatic formatting to some files (#5114)	5 years ago
block_fetcher.cc	Apply automatic formatting to some files (#5114)	5 years ago
block_fetcher.h	Cache dictionary used for decompressing data blocks (#4881)	6 years ago
block_prefix_index.cc	Apply automatic formatting to some files (#5114)	5 years ago
block_prefix_index.h	Apply automatic formatting to some files (#5114)	5 years ago
block_test.cc	Apply automatic formatting to some files (#5114)	5 years ago
bloom_block.cc	Change RocksDB License	7 years ago
bloom_block.h	Disallow customized hash function in DynamicBloom (#4915)	6 years ago
cleanable_test.cc	Change RocksDB License	7 years ago
cuckoo_table_builder.cc	Promote rocksdb.{deleted.keys,merge.operands} to main table properties (#4594)	6 years ago
cuckoo_table_builder.h	Change RocksDB License	7 years ago
cuckoo_table_builder_test.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_factory.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_factory.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_reader.cc	Apply modernize-use-override (2nd iteration)	5 years ago
cuckoo_table_reader.h	Index value delta encoding (#3983)	6 years ago
cuckoo_table_reader_test.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
data_block_footer.cc	Add db_bench options of data block hash index (#4281)	6 years ago
data_block_footer.h	Add db_bench options of data block hash index (#4281)	6 years ago
data_block_hash_index.cc	DataBlockHashIndex: Remove the division from EstimateSize() (#4293)	6 years ago
data_block_hash_index.h	DataBlockHashIndex: Remove the division from EstimateSize() (#4293)	6 years ago
data_block_hash_index_test.cc	Feature for sampling and reporting compressibility (#4842)	5 years ago
filter_block.h	use user_key and iterate_upper_bound to determine compatibility of bloom filters (#3899)	6 years ago
flush_block_policy.cc	Apply modernize-use-override (2nd iteration)	5 years ago
format.cc	Apply automatic formatting to some files (#5114)	5 years ago
format.h	Apply automatic formatting to some files (#5114)	5 years ago
full_filter_bits_builder.h	Skip duplicate bloom keys when whole_key and prefix are mixed	6 years ago
full_filter_block.cc	Charging block cache more accurately (#4073)	6 years ago
full_filter_block.h	Charging block cache more accurately (#4073)	6 years ago
full_filter_block_test.cc	Apply modernize-use-override (2nd iteration)	5 years ago
get_context.cc	PlainTable should avoid copying Get() results from immortal source. (#4924)	6 years ago
get_context.h	Cache dictionary used for decompressing data blocks (#4881)	6 years ago
index_builder.cc	Add path to WritableFileWriter. (#4039)	6 years ago
index_builder.h	Add path to WritableFileWriter. (#4039)	6 years ago
internal_iterator.h	Index value delta encoding (#3983)	6 years ago
iter_heap.h	Make InternalKeyComparator final and directly use it in merging iterator	7 years ago
iterator.cc	Fix arena allocation size in NewEmptyInternalIterator (#4905)	5 years ago
iterator_wrapper.h	Index value delta encoding (#3983)	6 years ago
merger_test.cc	Apply modernize-use-override (2nd iteration)	5 years ago
merging_iterator.cc	Apply modernize-use-override (2nd iteration)	5 years ago
merging_iterator.h	Index value delta encoding (#3983)	6 years ago
meta_blocks.cc	Periodic Compactions (#5166)	5 years ago
meta_blocks.h	Feature for sampling and reporting compressibility (#4842)	5 years ago
mock_table.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
mock_table.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
partitioned_filter_block.cc	Fix bug in partition filters with format_version=4 (#4381)	6 years ago
partitioned_filter_block.h	Fix bug in partition filters with format_version=4 (#4381)	6 years ago
partitioned_filter_block_test.cc	Apply modernize-use-override (2nd iteration)	5 years ago
persistent_cache_helper.cc	Remove two variables from BlockContents class and don't use class Block for compressed block (#4650)	6 years ago
persistent_cache_helper.h	Change RocksDB License	7 years ago
persistent_cache_options.h	Change RocksDB License	7 years ago
plain_table_builder.cc	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	5 years ago
plain_table_builder.h	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	5 years ago
plain_table_factory.cc	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	5 years ago
plain_table_factory.h	Remove some "using std::..." from header files. (#5113)	5 years ago
plain_table_index.cc	Fix many bugs in log statement arguments (#5089)	5 years ago
plain_table_index.h	Move prefix_extractor to MutableCFOptions	6 years ago
plain_table_key_coding.cc	Comment out unused variables	6 years ago
plain_table_key_coding.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
plain_table_reader.cc	Remove some "using std::..." from header files. (#5113)	5 years ago
plain_table_reader.h	Remove some "using std::..." from header files. (#5113)	5 years ago
scoped_arena_iterator.h	Change RocksDB License	7 years ago
sst_file_reader.cc	Fix SstFileReader not able to open ingested file (#5097)	5 years ago
sst_file_reader_test.cc	Fix SstFileReader not able to open ingested file (#5097)	5 years ago
sst_file_writer.cc	Feature for sampling and reporting compressibility (#4842)	5 years ago
sst_file_writer_collectors.h	Fix SstFileReader not able to open ingested file (#5097)	5 years ago
table_builder.h	Periodic Compactions (#5166)	5 years ago
table_properties.cc	Periodic Compactions (#5166)	5 years ago
table_properties_internal.h	Index value delta encoding (#3983)	6 years ago
table_reader.h	Clean up FragmentedRangeTombstoneList (#4692)	6 years ago
table_reader_bench.cc	Feature for sampling and reporting compressibility (#4842)	5 years ago
table_test.cc	Evict the uncompression dictionary from the block cache upon table close (#5150)	5 years ago
two_level_iterator.cc	Apply modernize-use-override (2nd iteration)	5 years ago
two_level_iterator.h	Index value delta encoding (#3983)	6 years ago