rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

History

Yu Zhang d1ae7f6c41 Add support to strip / pad timestamp when writing / reading a block (#11472 ) Summary: This patch adds support in `BlockBuilder` to strip user-defined timestamp from the `key` added via `Add(key, value)` and its equivalent APIs. The stripping logic is different when the key is either a user key or an internal key, so the `BlockBuilder` is created with a flag to indicate that. This patch also add support on the read path to APIs `NewIndexIterator`, `NewDataIterator` to support pad a min timestamp. Pull Request resolved: https://github.com/facebook/rocksdb/pull/11472 Test Plan: Three test modes are added to parameterize existing tests: UserDefinedTimestampTestMode::kNone -> UDT feature is not enabled UserDefinedTimestampTestMode::kNormal -> UDT feature enabled, write / read with min timestamp UserDefinedTimestampTestMode::kStripUserDefinedTimestamps -> UDT feature enabled, write / read with min timestamp, set `persist_user_defined_timestamps` where it applies to false. The tests read/write with min timestamp so that point read and range scan can correctly read values in all three test modes. `block_test` are parameterized to run with above three test modes and some additional parameteriazation ``` make all check ./block_test --gtest_filter="P/BlockTest" ./block_test --gtest_filter="P/IndexBlockTest" ``` Reviewed By: ltamasi Differential Revision: D46200539 Pulled By: jowlyzhang fbshipit-source-id: 59f5d6b584639976b69c2943eba723bd47d9b3c0		1 year ago
..
binary_search_index_reader.cc	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
binary_search_index_reader.h	Extend Get/MultiGet deadline support to table open (#6982 )	4 years ago
block.cc	Add support to strip / pad timestamp when writing / reading a block (#11472 )	1 year ago
block.h	Add support to strip / pad timestamp when writing / reading a block (#11472 )	1 year ago
block_based_table_builder.cc	Change internal headers with duplicate names (#11408 )	2 years ago
block_based_table_builder.h	Record and use the tail size to prefetch table tail (#11406 )	2 years ago
block_based_table_factory.cc	Record and use the tail size to prefetch table tail (#11406 )	2 years ago
block_based_table_factory.h	Record and use the tail size to prefetch table tail (#11406 )	2 years ago
block_based_table_iterator.cc	Much better stats for seeks and prefix filtering (#11460 )	2 years ago
block_based_table_iterator.h	Much better stats for seeks and prefix filtering (#11460 )	2 years ago
block_based_table_reader.cc	Much better stats for seeks and prefix filtering (#11460 )	2 years ago
block_based_table_reader.h	Much better stats for seeks and prefix filtering (#11460 )	2 years ago
block_based_table_reader_impl.h	Group rocksdb.sst.read.micros stat by IOActivity flush and compaction (#11288 )	2 years ago
block_based_table_reader_sync_and_async.h	Much better stats for seeks and prefix filtering (#11460 )	2 years ago
block_based_table_reader_test.cc	Add block checksum mismatch ticker stat (#11438 )	2 years ago
block_builder.cc	Add support to strip / pad timestamp when writing / reading a block (#11472 )	1 year ago
block_builder.h	Add support to strip / pad timestamp when writing / reading a block (#11472 )	1 year ago
block_cache.cc	Block per key-value checksum (#11287 )	2 years ago
block_cache.h	Block per key-value checksum (#11287 )	2 years ago
block_prefetcher.cc	Fix stress test failure for async_io (#10660 )	2 years ago
block_prefetcher.h	Provide support for direct_reads with async_io (#10197 )	2 years ago
block_prefix_index.cc	Fix bug with kHashSearch and changing prefix_extractor with SetOptions (#10128 )	2 years ago
block_prefix_index.h	Fix bug with kHashSearch and changing prefix_extractor with SetOptions (#10128 )	2 years ago
block_test.cc	Add support to strip / pad timestamp when writing / reading a block (#11472 )	1 year ago
block_type.h	Remove deprecated block-based filter (#10184 )	2 years ago
cachable_entry.h	HyperClockCache support for SecondaryCache, with refactoring (#11301 )	2 years ago
data_block_footer.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
data_block_footer.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
data_block_hash_index.cc	Format files under table/ by clang-format (#10852 )	2 years ago
data_block_hash_index.h	Fix build with gcc 13 by including <cstdint> (#11118 )	2 years ago
data_block_hash_index_test.cc	Block per key-value checksum (#11287 )	2 years ago
filter_block.h	Record and use the tail size to prefetch table tail (#11406 )	2 years ago
filter_block_reader_common.cc	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
filter_block_reader_common.h	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
filter_policy.cc	Remove RocksDB LITE (#11147 )	2 years ago
filter_policy_internal.h	Remove deprecated block-based filter (#10184 )	2 years ago
flush_block_policy.cc	Change internal headers with duplicate names (#11408 )	2 years ago
flush_block_policy_impl.h	Change internal headers with duplicate names (#11408 )	2 years ago
full_filter_block.cc	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
full_filter_block.h	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
full_filter_block_test.cc	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
hash_index_reader.cc	Add support to strip / pad timestamp when writing / reading a block (#11472 )	1 year ago
hash_index_reader.h	Extend Get/MultiGet deadline support to table open (#6982 )	4 years ago
index_builder.cc	Make InternalKeyComparator not configurable (#10342 )	2 years ago
index_builder.h	Format files under table/ by clang-format (#10852 )	2 years ago
index_reader_common.cc	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
index_reader_common.h	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
mock_block_based_table.h	Remove deprecated block-based filter (#10184 )	2 years ago
parsed_full_filter_block.cc	Hide FilterBits{Builder,Reader} from public API (#9592 )	3 years ago
parsed_full_filter_block.h	Major Cache refactoring, CPU efficiency improvement (#10975 )	2 years ago
partitioned_filter_block.cc	Record and use the tail size to prefetch table tail (#11406 )	2 years ago
partitioned_filter_block.h	Record and use the tail size to prefetch table tail (#11406 )	2 years ago
partitioned_filter_block_test.cc	Use user-provided ReadOptions for metadata block reads more often (#11208 )	2 years ago
partitioned_index_iterator.cc	Provide support for direct_reads with async_io (#10197 )	2 years ago
partitioned_index_iterator.h	Format files under table/ by clang-format (#10852 )	2 years ago
partitioned_index_reader.cc	Record and use the tail size to prefetch table tail (#11406 )	2 years ago
partitioned_index_reader.h	Record and use the tail size to prefetch table tail (#11406 )	2 years ago
reader_common.cc	Remove own ToString() (#9955 )	3 years ago
reader_common.h	Add block checksum mismatch ticker stat (#11438 )	2 years ago
uncompression_dict_reader.cc	Group rocksdb.sst.read.micros stat by IOActivity flush and compaction (#11288 )	2 years ago
uncompression_dict_reader.h	Group rocksdb.sst.read.micros stat by IOActivity flush and compaction (#11288 )	2 years ago