fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Maysam Yabandeh 6a40ee5eb1 Refresh snapshot list during long compactions (2nd attempt) (#5278) ... Summary: Part of compaction cpu goes to processing snapshot list, the larger the list the bigger the overhead. Although the lifetime of most of the snapshots is much shorter than the lifetime of compactions, the compaction conservatively operates on the list of snapshots that it initially obtained. This patch allows the snapshot list to be updated via a callback if the compaction is taking long. This should let the compaction to continue more efficiently with much smaller snapshot list. For simplicity, to avoid the feature is disabled in two cases: i) When more than one sub-compaction are sharing the same snapshot list, ii) when Range Delete is used in which the range delete aggregator has its own copy of snapshot list. This fixes the reverted https://github.com/facebook/rocksdb/pull/5099 issue with range deletes. Pull Request resolved: https://github.com/facebook/rocksdb/pull/5278 Differential Revision: D15203291 Pulled By: maysamyabandeh fbshipit-source-id: fa645611e606aa222c7ce53176dc5bb6f259c258		6 years ago
..
adaptive_table_factory.cc	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
adaptive_table_factory.h	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
block.cc	Reduce binary search when reseek into the same data block (#5256)	6 years ago
block.h	Introduce InternalIteratorBase::NextAndGetResult() (#5197)	6 years ago
block_based_filter_block.cc	Apply automatic formatting to some files (#5114)	6 years ago
block_based_filter_block.h	Apply automatic formatting to some files (#5114)	6 years ago
block_based_filter_block_test.cc	Apply automatic formatting to some files (#5114)	6 years ago
block_based_table_builder.cc	Fix compilation errors for 32bits/LITE/ios build. (#5220)	6 years ago
block_based_table_builder.h	Periodic Compactions (#5166)	6 years ago
block_based_table_factory.cc	Add BlockBasedTableOptions::index_shortening (#5174)	6 years ago
block_based_table_factory.h	Add BlockBasedTableOptions::index_shortening (#5174)	6 years ago
block_based_table_reader.cc	Reduce binary search when reseek into the same data block (#5256)	6 years ago
block_based_table_reader.h	Improve explicit user readahead performance (#5246)	6 years ago
block_builder.cc	Apply automatic formatting to some files (#5114)	6 years ago
block_builder.h	Apply automatic formatting to some files (#5114)	6 years ago
block_fetcher.cc	Apply automatic formatting to some files (#5114)	6 years ago
block_fetcher.h	Cache dictionary used for decompressing data blocks (#4881)	6 years ago
block_prefix_index.cc	Apply automatic formatting to some files (#5114)	6 years ago
block_prefix_index.h	Apply automatic formatting to some files (#5114)	6 years ago
block_test.cc	Apply automatic formatting to some files (#5114)	6 years ago
bloom_block.cc	Change RocksDB License	8 years ago
bloom_block.h	Disallow customized hash function in DynamicBloom (#4915)	6 years ago
cleanable_test.cc	Change RocksDB License	8 years ago
cuckoo_table_builder.cc	Promote rocksdb.{deleted.keys,merge.operands} to main table properties (#4594)	6 years ago
cuckoo_table_builder.h	Change RocksDB License	8 years ago
cuckoo_table_builder_test.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_factory.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_factory.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_reader.cc	Apply modernize-use-override (2nd iteration)	6 years ago
cuckoo_table_reader.h	Index value delta encoding (#3983)	6 years ago
cuckoo_table_reader_test.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
data_block_footer.cc	Add db_bench options of data block hash index (#4281)	6 years ago
data_block_footer.h	Add db_bench options of data block hash index (#4281)	6 years ago
data_block_hash_index.cc	DataBlockHashIndex: Remove the division from EstimateSize() (#4293)	6 years ago
data_block_hash_index.h	DataBlockHashIndex: Remove the division from EstimateSize() (#4293)	6 years ago
data_block_hash_index_test.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
filter_block.h	Remove a couple of non-public includes from public header file (#5219)	6 years ago
flush_block_policy.cc	Apply modernize-use-override (2nd iteration)	6 years ago
flush_block_policy.h	Avoid per-key upper bound check in BlockBasedTableIterator (#5142)	6 years ago
format.cc	Apply automatic formatting to some files (#5114)	6 years ago
format.h	Apply automatic formatting to some files (#5114)	6 years ago
full_filter_bits_builder.h	Skip duplicate bloom keys when whole_key and prefix are mixed	7 years ago
full_filter_block.cc	Fix bugs detected by clang analyzer (#5185)	6 years ago
full_filter_block.h	Introduce a new MultiGet batching implementation (#5011)	6 years ago
full_filter_block_test.cc	Introduce a new MultiGet batching implementation (#5011)	6 years ago
get_context.cc	PlainTable should avoid copying Get() results from immortal source. (#4924)	6 years ago
get_context.h	Introduce a new MultiGet batching implementation (#5011)	6 years ago
index_builder.cc	Add BlockBasedTableOptions::index_shortening (#5174)	6 years ago
index_builder.h	Add BlockBasedTableOptions::index_shortening (#5174)	6 years ago
internal_iterator.h	Introduce InternalIteratorBase::NextAndGetResult() (#5197)	6 years ago
iter_heap.h	Make InternalKeyComparator final and directly use it in merging iterator	7 years ago
iterator.cc	Add back NewEmptyIterator (#5203)	6 years ago
iterator_wrapper.h	Introduce InternalIteratorBase::NextAndGetResult() (#5197)	6 years ago
merger_test.cc	Apply modernize-use-override (2nd iteration)	6 years ago
merging_iterator.cc	Apply modernize-use-override (2nd iteration)	6 years ago
merging_iterator.h	Index value delta encoding (#3983)	6 years ago
meta_blocks.cc	Fix compilation errors for 32bits/LITE/ios build. (#5220)	6 years ago
meta_blocks.h	Feature for sampling and reporting compressibility (#4842)	6 years ago
mock_table.cc	Refresh snapshot list during long compactions (2nd attempt) (#5278)	6 years ago
mock_table.h	Refresh snapshot list during long compactions (2nd attempt) (#5278)	6 years ago
multiget_context.h	multiget: fix memory issues due to vector auto resizing (#5279)	6 years ago
partitioned_filter_block.cc	Fix bug in partition filters with format_version=4 (#4381)	6 years ago
partitioned_filter_block.h	Fix bug in partition filters with format_version=4 (#4381)	6 years ago
partitioned_filter_block_test.cc	Apply modernize-use-override (2nd iteration)	6 years ago
persistent_cache_helper.cc	Remove two variables from BlockContents class and don't use class Block for compressed block (#4650)	6 years ago
persistent_cache_helper.h	Change RocksDB License	8 years ago
persistent_cache_options.h	Change RocksDB License	8 years ago
plain_table_builder.cc	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	6 years ago
plain_table_builder.h	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	6 years ago
plain_table_factory.cc	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
plain_table_factory.h	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
plain_table_index.cc	Fix many bugs in log statement arguments (#5089)	6 years ago
plain_table_index.h	Move prefix_extractor to MutableCFOptions	7 years ago
plain_table_key_coding.cc	Comment out unused variables	7 years ago
plain_table_key_coding.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
plain_table_reader.cc	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
plain_table_reader.h	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
scoped_arena_iterator.h	Change RocksDB License	8 years ago
sst_file_reader.cc	Fix SstFileReader not able to open ingested file (#5097)	6 years ago
sst_file_reader_test.cc	Fix SstFileReader not able to open ingested file (#5097)	6 years ago
sst_file_writer.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
sst_file_writer_collectors.h	Fix SstFileReader not able to open ingested file (#5097)	6 years ago
table_builder.h	Periodic Compactions (#5166)	6 years ago
table_properties.cc	Periodic Compactions (#5166)	6 years ago
table_properties_internal.h	Index value delta encoding (#3983)	6 years ago
table_reader.h	Introduce a new MultiGet batching implementation (#5011)	6 years ago
table_reader_bench.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
table_test.cc	Avoid per-key upper bound check in BlockBasedTableIterator (#5142)	6 years ago
two_level_iterator.cc	Apply modernize-use-override (2nd iteration)	6 years ago
two_level_iterator.h	Index value delta encoding (#3983)	6 years ago