fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Yu Zhang c24ef26ca7 Support switching on / off UDT together with in-Memtable-only feature (#11623) ... Summary: Add support to allow enabling / disabling user-defined timestamps feature for an existing column family in combination with the in-Memtable only feature. To do this, this PR includes: 1) Log the `persist_user_defined_timestamps` option per column family in Manifest to facilitate detecting an attempt to enable / disable UDT. This entry is enforced to be logged in the same VersionEdit as the user comparator name entry. 2) User-defined timestamps related options are validated when re-opening a column family, including user comparator name and the `persist_user_defined_timestamps` flag. These type of settings and settings change are considered valid: a) no user comparator change and no effective `persist_user_defined_timestamp` flag change. b) switch user comparator to enable UDT provided the immediately effective `persist_user_defined_timestamps` flag is false. c) switch user comparator to disable UDT provided that the before-change `persist_user_defined_timestamps` is already false. 3) when an attempt to enable UDT is detected, we mark all its existing SST files as "having no UDT" by marking its `FileMetaData.user_defined_timestamps_persisted` flag to false and handle their file boundaries `FileMetaData.smallest`, `FileMetaData.largest` by padding a min timestamp. 4) while enabling / disabling UDT feature, timestamp size inconsistency in existing WAL logs are handled to make it compatible with the running user comparator. Pull Request resolved: https://github.com/facebook/rocksdb/pull/11623 Test Plan: ``` make all check ./db_with_timestamp_basic_test --gtest-filter="*EnableDisableUDT*" ./db_wal_test --gtest_filter="*EnableDisableUDT*" ``` Reviewed By: ltamasi Differential Revision: D47636862 Pulled By: jowlyzhang fbshipit-source-id: dcd19f67292da3c3cc9584c09ad00331c9ab9322		1 year ago
..
compacted_db_impl.cc	Group rocksdb.sst.read.micros stat by IOActivity flush and compaction (#11288)	2 years ago
compacted_db_impl.h	Support to create a CF by importing multiple non-overlapping CFs (#11378)	1 year ago
db_impl.cc	Support switching on / off UDT together with in-Memtable-only feature (#11623)	1 year ago
db_impl.h	Respect cutoff timestamp during flush (#11599)	1 year ago
db_impl_compaction_flush.cc	Respect cutoff timestamp during flush (#11599)	1 year ago
db_impl_debug.cc	Add WaitForCompact with WaitForCompactOptions to public API (#11436)	2 years ago
db_impl_experimental.cc	Record the `persist_user_defined_timestamps` flag in manifest (#11515)	1 year ago
db_impl_files.cc	add property "rocksdb.obsolete-sst-files-size" (#11533)	1 year ago
db_impl_open.cc	Support switching on / off UDT together with in-Memtable-only feature (#11623)	1 year ago
db_impl_readonly.cc	Add missing stopwatch and perf timer to DBImplReadOnly (#11521)	1 year ago
db_impl_readonly.h	Add CreateColumnFamilyWithImport to `StackableDB` and `DBImplReadOnly` (#11556)	1 year ago
db_impl_secondary.cc	switch to use RocksDB UnorderedMap (#11507)	1 year ago
db_impl_secondary.h	Add utils to use for handling user defined timestamp size record in WAL (#11451)	2 years ago
db_impl_write.cc	Logging timestamp size record in WAL and use it during recovery (#11471)	1 year ago