fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

anand76 35cdd3e71e MultiGet async IO across multiple levels (#10535) ... Summary: This PR exploits parallelism in MultiGet across levels. It applies only to the coroutine version of MultiGet. Previously, MultiGet file reads from SST files in the same level were parallelized. With this PR, MultiGet batches with keys distributed across multiple levels are read in parallel. This is accomplished by splitting the keys not present in a level (determined by bloom filtering) into a separate batch, and processing the new batch in parallel with the original batch. Pull Request resolved: https://github.com/facebook/rocksdb/pull/10535 Test Plan: 1. Ensure existing MultiGet unit tests pass, updating them as necessary 2. New unit tests - TODO 3. Run stress test - TODO No noticeable regression (<1%) without async IO - Without PR: `multireadrandom : 7.261 micros/op 1101724 ops/sec 60.007 seconds 66110936 operations; 571.6 MB/s (8168992 of 8168992 found)` With PR: `multireadrandom : 7.305 micros/op 1095167 ops/sec 60.007 seconds 65717936 operations; 568.2 MB/s (8271992 of 8271992 found)` For a fully cached DB, but with async IO option on, no regression observed (<1%) - Without PR: `multireadrandom : 5.201 micros/op 1538027 ops/sec 60.005 seconds 92288936 operations; 797.9 MB/s (11540992 of 11540992 found) ` With PR: `multireadrandom : 5.249 micros/op 1524097 ops/sec 60.005 seconds 91452936 operations; 790.7 MB/s (11649992 of 11649992 found) ` Reviewed By: akankshamahajan15 Differential Revision: D38774009 Pulled By: anand1976 fbshipit-source-id: c955e259749f1c091590ade73105b3ee46cd0007		2 years ago
..
cf_options.cc	Add memtable per key-value checksum (#10281)	2 years ago
cf_options.h	Add memtable per key-value checksum (#10281)	2 years ago
configurable.cc	Option type info functions (#9411)	3 years ago
configurable_helper.h	Fix some minor issues in the Customizable infrastructure (#8566)	3 years ago
configurable_test.cc	Remove own ToString() (#9955)	3 years ago
configurable_test.h	Move RegisterOptions into the Configurable API (#8223)	4 years ago
customizable.cc	Option type info functions (#9411)	3 years ago
customizable_test.cc	Make RateLimiter not Customizable (#10378)	2 years ago
db_options.cc	Make RateLimiter not Customizable (#10378)	2 years ago
db_options.h	Dynamically changeable `MemPurge` option (#10011)	3 years ago
options.cc	MultiGet async IO across multiple levels (#10535)	2 years ago
options_helper.cc	Add memtable per key-value checksum (#10281)	2 years ago
options_helper.h	Support prepopulating/warming the blob cache (#10298)	2 years ago
options_parser.cc	fix a false positive case of parsing table factory from options file (#10094)	3 years ago
options_parser.h	Bring the Configurable options together (#5753)	4 years ago
options_settable_test.cc	Add memtable per key-value checksum (#10281)	2 years ago
options_test.cc	Change `bottommost_temperture` to `last_level_temperture` (#10471)	2 years ago