fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Marton Trencseni 522de4f59e Adding pin_l0_filter_and_index_blocks_in_cache feature. ... Summary: When a block based table file is opened, if prefetch_index_and_filter is true, it will prefetch the index and filter blocks, putting them into the block cache. What this feature adds: when a L0 block based table file is opened, if pin_l0_filter_and_index_blocks_in_cache is true in the options (and prefetch_index_and_filter is true), then the filter and index blocks aren't released back to the block cache at the end of BlockBasedTableReader::Open(). Instead the table reader takes ownership of them, hence pinning them, ie. the LRU cache will never push them out. Meanwhile in the table reader, further accesses will not hit the block cache, thus avoiding lock contention. When the table reader is destroyed, it releases the pinned blocks (if there were any). This has to happen before the cache is destroyed, so I had to introduce a TableReader::Close(), to guarantee the order of destruction. Test Plan: Added two unit tests for this. Existing unit tests run fine (default is pin_l0_filter_and_index_blocks_in_cache=false). DISABLE_JEMALLOC=1 OPT=-g make all valgrind_check -j32 Mac: OK. Linux: with D55287 patched in it's OK. Reviewers: sdong Reviewed By: sdong Subscribers: andrewkr, leveldb, dhruba Differential Revision: https://reviews.facebook.net/D54801		10 years ago
..
adaptive_table_factory.cc	Pass column family ID to table property collector	10 years ago
adaptive_table_factory.h	Pass column family ID to table property collector	10 years ago
block.cc	Updated all copyright headers to the new format.	10 years ago
block.h	Updated all copyright headers to the new format.	10 years ago
block_based_filter_block.cc	Revert "Revert "Fixed the bug when both whole_key_filtering and prefix_extractor are set.""	10 years ago
block_based_filter_block.h	Revert "Revert "Fixed the bug when both whole_key_filtering and prefix_extractor are set.""	10 years ago
block_based_filter_block_test.cc	Updated all copyright headers to the new format.	10 years ago
block_based_table_builder.cc	Cache to have an option to fail Cache::Insert() when full	10 years ago
block_based_table_builder.h	Updated all copyright headers to the new format.	10 years ago
block_based_table_factory.cc	Adding pin_l0_filter_and_index_blocks_in_cache feature.	10 years ago
block_based_table_factory.h	Updated all copyright headers to the new format.	10 years ago
block_based_table_reader.cc	Adding pin_l0_filter_and_index_blocks_in_cache feature.	10 years ago
block_based_table_reader.h	Adding pin_l0_filter_and_index_blocks_in_cache feature.	10 years ago
block_builder.cc	Updated all copyright headers to the new format.	10 years ago
block_builder.h	Updated all copyright headers to the new format.	10 years ago
block_hash_index.cc	Updated all copyright headers to the new format.	10 years ago
block_hash_index.h	Updated all copyright headers to the new format.	10 years ago
block_hash_index_test.cc	Updated all copyright headers to the new format.	10 years ago
block_prefix_index.cc	Updated all copyright headers to the new format.	10 years ago
block_prefix_index.h	Updated all copyright headers to the new format.	10 years ago
block_test.cc	Updated all copyright headers to the new format.	10 years ago
bloom_block.cc	Updated all copyright headers to the new format.	10 years ago
bloom_block.h	Updated all copyright headers to the new format.	10 years ago
cuckoo_table_builder.cc	Updated all copyright headers to the new format.	10 years ago
cuckoo_table_builder.h	Updated all copyright headers to the new format.	10 years ago
cuckoo_table_builder_test.cc	Updated all copyright headers to the new format.	10 years ago
cuckoo_table_factory.cc	Updated all copyright headers to the new format.	10 years ago
cuckoo_table_factory.h	Updated all copyright headers to the new format.	10 years ago
cuckoo_table_reader.cc	Updated all copyright headers to the new format.	10 years ago
cuckoo_table_reader.h	Updated all copyright headers to the new format.	10 years ago
cuckoo_table_reader_test.cc	Updated all copyright headers to the new format.	10 years ago
filter_block.h	Updated all copyright headers to the new format.	10 years ago
flush_block_policy.cc	Updated all copyright headers to the new format.	10 years ago
format.cc	Updated all copyright headers to the new format.	10 years ago
format.h	Updated all copyright headers to the new format.	10 years ago
full_filter_block.cc	Updated all copyright headers to the new format.	10 years ago
full_filter_block.h	Updated all copyright headers to the new format.	10 years ago
full_filter_block_test.cc	Updated all copyright headers to the new format.	10 years ago
get_context.cc	Updated all copyright headers to the new format.	10 years ago
get_context.h	Updated all copyright headers to the new format.	10 years ago
internal_iterator.h	Add Iterator Property rocksdb.iterator.version_number	10 years ago
iter_heap.h	Updated all copyright headers to the new format.	10 years ago
iterator.cc	Rename iterator property "rocksdb.iterator.is.key.pinned" => "rocksdb.iterator.is-key-pinned"	10 years ago
iterator_wrapper.h	Updated all copyright headers to the new format.	10 years ago
merger.cc	Updated all copyright headers to the new format.	10 years ago
merger.h	Updated all copyright headers to the new format.	10 years ago
merger_test.cc	Updated all copyright headers to the new format.	10 years ago
meta_blocks.cc	Updated all copyright headers to the new format.	10 years ago
meta_blocks.h	Updated all copyright headers to the new format.	10 years ago
mock_table.cc	Updated all copyright headers to the new format.	10 years ago
mock_table.h	Updated all copyright headers to the new format.	10 years ago
plain_table_builder.cc	Updated all copyright headers to the new format.	10 years ago
plain_table_builder.h	Updated all copyright headers to the new format.	10 years ago
plain_table_factory.cc	Merge pull request #805 from SherlockNoMad/OptionHelperFix	10 years ago
plain_table_factory.h	Fix build broken by previous commit of "option helper refactor"	10 years ago
plain_table_index.cc	Updated all copyright headers to the new format.	10 years ago
plain_table_index.h	Updated all copyright headers to the new format.	10 years ago
plain_table_key_coding.cc	Updated all copyright headers to the new format.	10 years ago
plain_table_key_coding.h	Updated all copyright headers to the new format.	10 years ago
plain_table_reader.cc	Skip bottom-level filter block caching when hit-optimized	10 years ago
plain_table_reader.h	Skip bottom-level filter block caching when hit-optimized	10 years ago
scoped_arena_iterator.h	Updated all copyright headers to the new format.	10 years ago
sst_file_writer.cc	Updated all copyright headers to the new format.	10 years ago
table_builder.h	Adding pin_l0_filter_and_index_blocks_in_cache feature.	10 years ago
table_properties.cc	Updated all copyright headers to the new format.	10 years ago
table_properties_internal.h	Updated all copyright headers to the new format.	10 years ago
table_reader.h	Adding pin_l0_filter_and_index_blocks_in_cache feature.	10 years ago
table_reader_bench.cc	Updated all copyright headers to the new format.	10 years ago
table_test.cc	Adding pin_l0_filter_and_index_blocks_in_cache feature.	10 years ago
two_level_iterator.cc	Updated all copyright headers to the new format.	10 years ago
two_level_iterator.h	Updated all copyright headers to the new format.	10 years ago