fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Cheng Chang 91b7553293 Enable IO Uring in MultiGet in direct IO mode (#6815) ... Summary: Currently, in direct IO mode, `MultiGet` retrieves the data blocks one by one instead of in parallel, see `BlockBasedTable::RetrieveMultipleBlocks`. Since direct IO is supported in `RandomAccessFileReader::MultiRead` in https://github.com/facebook/rocksdb/pull/6446, this PR applies `MultiRead` to `MultiGet` so that the data blocks can be retrieved in parallel. Also, in direct IO mode and when data blocks are compressed and need to uncompressed, this PR only allocates one continuous aligned buffer to hold the data blocks, and then directly uncompress the blocks to insert into block cache, there is no longer intermediate copies to scratch buffers. Pull Request resolved: https://github.com/facebook/rocksdb/pull/6815 Test Plan: 1. added a new unit test `BlockBasedTableReaderTest::MultiGet`. 2. existing unit tests and stress tests contain tests against `MultiGet` in direct IO mode. Reviewed By: anand1976 Differential Revision: D21426347 Pulled By: cheng-chang fbshipit-source-id: b8446ae0e74152444ef9111e97f8e402ac31b24f		6 years ago
..
binary_search_index_reader.cc	Divide block_based_table_reader.cc (#6527)	6 years ago
binary_search_index_reader.h	Divide block_based_table_reader.cc (#6527)	6 years ago
block.cc	Fix some typos in code comments (#6733)	6 years ago
block.h	fix comparison count for format_version=3 indexes (#6650)	6 years ago
block_based_filter_block.cc	Silence false alarms in db_stress fault injection (#6741)	6 years ago
block_based_filter_block.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
block_based_filter_block_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
block_based_table_builder.cc	Add tests for compression failure in BlockBasedTableBuilder (#6709)	6 years ago
block_based_table_builder.h	Disallow BlockBasedTableBuilder to set status from non-OK (#6776)	6 years ago
block_based_table_factory.cc	sst_dump to reduce number of file reads (#6836)	6 years ago
block_based_table_factory.h	sst_dump to reduce number of file reads (#6836)	6 years ago
block_based_table_iterator.cc	Properly report IO errors when IndexType::kBinarySearchWithFirstKey is used (#6621)	6 years ago
block_based_table_iterator.h	Properly report IO errors when IndexType::kBinarySearchWithFirstKey is used (#6621)	6 years ago
block_based_table_reader.cc	Enable IO Uring in MultiGet in direct IO mode (#6815)	6 years ago
block_based_table_reader.h	sst_dump to reduce number of file reads (#6836)	6 years ago
block_based_table_reader_impl.h	Divide block_based_table_reader.cc (#6527)	6 years ago
block_based_table_reader_test.cc	Enable IO Uring in MultiGet in direct IO mode (#6815)	6 years ago
block_builder.cc	Add pipelined & parallel compression optimization (#6262)	6 years ago
block_builder.h	Add pipelined & parallel compression optimization (#6262)	6 years ago
block_prefetcher.cc	De-template block based table iterator (#6531)	6 years ago
block_prefetcher.h	De-template block based table iterator (#6531)	6 years ago
block_prefix_index.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
block_prefix_index.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
block_test.cc	Fix range deletion tombstone ingestion with global seqno (#6429)	6 years ago
block_type.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
cachable_entry.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
data_block_footer.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
data_block_footer.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
data_block_hash_index.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
data_block_hash_index.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
data_block_hash_index_test.cc	Fix range deletion tombstone ingestion with global seqno (#6429)	6 years ago
filter_block.h	Fix iterator reading filter block despite read_tier == kBlockCacheTier (#6562)	6 years ago
filter_block_reader_common.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
filter_block_reader_common.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
filter_policy.cc	Add Functions to OptionTypeInfo (#6422)	6 years ago
filter_policy_internal.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
flush_block_policy.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
flush_block_policy.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
full_filter_block.cc	Basic MultiGet support for partitioned filters (#6757)	6 years ago
full_filter_block.h	Fix iterator reading filter block despite read_tier == kBlockCacheTier (#6562)	6 years ago
full_filter_block_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
hash_index_reader.cc	Divide block_based_table_reader.cc (#6527)	6 years ago
hash_index_reader.h	Divide block_based_table_reader.cc (#6527)	6 years ago
index_builder.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
index_builder.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
index_reader_common.cc	Divide block_based_table_reader.cc (#6527)	6 years ago
index_reader_common.h	Divide block_based_table_reader.cc (#6527)	6 years ago
mock_block_based_table.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
parsed_full_filter_block.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
parsed_full_filter_block.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
partitioned_filter_block.cc	Basic MultiGet support for partitioned filters (#6757)	6 years ago
partitioned_filter_block.h	Basic MultiGet support for partitioned filters (#6757)	6 years ago
partitioned_filter_block_test.cc	Fix range deletion tombstone ingestion with global seqno (#6429)	6 years ago
partitioned_index_iterator.cc	Fix regression bug in partitioned index reseek caused by #6531 (#6551)	6 years ago
partitioned_index_iterator.h	Fix compiler warning treated as error (#6547)	6 years ago
partitioned_index_reader.cc	Silence false alarms in db_stress fault injection (#6741)	6 years ago
partitioned_index_reader.h	Divide block_based_table_reader.cc (#6527)	6 years ago
reader_common.cc	Divide block_based_table_reader.cc (#6527)	6 years ago
reader_common.h	Divide block_based_table_reader.cc (#6527)	6 years ago
uncompression_dict_reader.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago
uncompression_dict_reader.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	6 years ago