fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Akanksha Mahajan a0e0feca62 Improve BlockPrefetcher to prefetch only for sequential scans (#7394) ... Summary: BlockPrefetcher is used by iterators to prefetch data if they anticipate more data to be used in future and this is valid for forward sequential scans. But BlockPrefetcher tracks only num_file_reads_ and not if reads are sequential. This presents problem for MultiGet with large number of keys when it reseeks index iterator and data block. FilePrefetchBuffer can end up doing large readahead for reseeks as readahead size increases exponentially once readahead is enabled. Same issue is with BlockBasedTableIterator. Add previous length and offset read as well in BlockPrefetcher (creates FilePrefetchBuffer) and FilePrefetchBuffer (does prefetching of data) to determine if reads are sequential and then prefetch. Update the last block read after cache hit to take reads from cache also in account. Pull Request resolved: https://github.com/facebook/rocksdb/pull/7394 Test Plan: Add new unit test case Reviewed By: anand1976 Differential Revision: D23737617 Pulled By: akankshamahajan15 fbshipit-source-id: 8e6917c25ed87b285ee495d1b68dc623d71205a3		4 years ago
..
delete_scheduler.cc	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033)	4 years ago
delete_scheduler.h	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033)	4 years ago
delete_scheduler_test.cc	Use SST file manager to track blob files as well (#8037)	4 years ago
file_prefetch_buffer.cc	Improve BlockPrefetcher to prefetch only for sequential scans (#7394)	4 years ago
file_prefetch_buffer.h	Improve BlockPrefetcher to prefetch only for sequential scans (#7394)	4 years ago
file_util.cc	Fix typo: replace readadhead with readahead (#7953)	4 years ago
file_util.h	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033)	4 years ago
filename.cc	Handle rename() failure in non-local FS (#8192)	4 years ago
filename.h	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033)	4 years ago
line_file_reader.cc	Refactor: add LineFileReader and Status::MustCheck (#8026)	4 years ago
line_file_reader.h	Refactor: add LineFileReader and Status::MustCheck (#8026)	4 years ago
prefetch_test.cc	Improve BlockPrefetcher to prefetch only for sequential scans (#7394)	4 years ago
random_access_file_reader.cc	Replace Status with IOStatus for block fetcher IO function (#8130)	4 years ago
random_access_file_reader.h	Replace Status with IOStatus for block fetcher IO function (#8130)	4 years ago
random_access_file_reader_test.cc	use the pointer directly (#8095)	4 years ago
read_write_util.cc	Refactor: add LineFileReader and Status::MustCheck (#8026)	4 years ago
read_write_util.h	Refactor: add LineFileReader and Status::MustCheck (#8026)	4 years ago
readahead_raf.cc	Make StringEnv, StringSink, StringSource use FS classes (#7786)	4 years ago
readahead_raf.h	Make StringEnv, StringSink, StringSource use FS classes (#7786)	4 years ago
sequence_file_reader.cc	Remove Legacy and Custom FileWrapper classes from header files (#7851)	4 years ago
sequence_file_reader.h	Remove Legacy and Custom FileWrapper classes from header files (#7851)	4 years ago
sst_file_manager_impl.cc	Use SST file manager to track blob files as well (#8037)	4 years ago
sst_file_manager_impl.h	Use SST file manager to track blob files as well (#8037)	4 years ago
writable_file_writer.cc	Handoff checksum Implementation (#7523)	4 years ago
writable_file_writer.h	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033)	4 years ago