fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Changyu Bi 9f2363f4c4 User-defined timestamp support for `DeleteRange()` (#10661) ... Summary: Add user-defined timestamp support for range deletion. The new API is `DeleteRange(opt, cf, begin_key, end_key, ts)`. Most of the change is to update the comparator to compare without timestamp. Other than that, major changes are - internal range tombstone data structures (`FragmentedRangeTombstoneList`, `RangeTombstone`, etc.) to store timestamps. - Garbage collection of range tombstones and range tombstone covered keys during compaction. - Get()/MultiGet() to return the timestamp of a range tombstone when needed. - Get/Iterator with range tombstones bounded by readoptions.timestamp. - timestamp crash test now issues DeleteRange by default. Pull Request resolved: https://github.com/facebook/rocksdb/pull/10661 Test Plan: - Added unit test: `make check` - Stress test: `python3 tools/db_crashtest.py --enable_ts whitebox --readpercent=57 --prefixpercent=4 --writepercent=25 -delpercent=5 --iterpercent=5 --delrangepercent=4` - Ran `db_bench` to measure regression when timestamp is not enabled. The tests are for write (with some range deletion) and iterate with DB fitting in memory: `./db_bench--benchmarks=fillrandom,seekrandom --writes_per_range_tombstone=200 --max_write_buffer_number=100 --min_write_buffer_number_to_merge=100 --writes=500000 --reads=500000 --seek_nexts=10 --disable_auto_compactions -disable_wal=true --max_num_range_tombstones=1000`. Did not see consistent regression in no timestamp case. | micros/op | fillrandom | seekrandom | | --- | --- | --- | |main| 2.58 |10.96| |PR 10661| 2.68 |10.63| Reviewed By: riversand963 Differential Revision: D39441192 Pulled By: cbi42 fbshipit-source-id: f05aca3c41605caf110daf0ff405919f300ddec2		2 years ago
..
clipping_iterator.h	Make InternalKeyComparator not configurable (#10342)	2 years ago
clipping_iterator_test.cc	Cleanup multiple implementations of VectorIterator (#8901)	3 years ago
compaction.cc	Align compaction output file boundaries to the next level ones (#10655)	2 years ago
compaction.h	Align compaction output file boundaries to the next level ones (#10655)	2 years ago
compaction_iteration_stats.h	Support readahead during compaction for blob files (#9187)	3 years ago
compaction_iterator.cc	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
compaction_iterator.h	Include minimal contextual information in `CompactionIterator` (#10505)	2 years ago
compaction_iterator_test.cc	Tiered Compaction: per key placement support (#9964)	2 years ago
compaction_job.cc	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
compaction_job.h	Support subcmpct using reserved resources for round-robin priority (#10341)	2 years ago
compaction_job_stats_test.cc	Remove own ToString() (#9955)	3 years ago
compaction_job_test.cc	Align compaction output file boundaries to the next level ones (#10655)	2 years ago
compaction_outputs.cc	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
compaction_outputs.h	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
compaction_picker.cc	Use actual file size when checking max_compaction_size (#10728)	2 years ago
compaction_picker.h	Support subcmpct using reserved resources for round-robin priority (#10341)	2 years ago
compaction_picker_fifo.cc	Fix underflow in FIFOCompactionPicker (#10386)	2 years ago
compaction_picker_fifo.h	Add OpenAndTrimHistory API to support trimming data with specified timestamp (#9410)	3 years ago
compaction_picker_level.cc	Use actual file size when checking max_compaction_size (#10728)	2 years ago
compaction_picker_level.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
compaction_picker_test.cc	Fix overlapping check by excluding timestamp (#10615)	2 years ago
compaction_picker_universal.cc	Fix overlapping check by excluding timestamp (#10615)	2 years ago
compaction_picker_universal.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
compaction_service_job.cc	Improve SubCompaction Partitioning (#10393)	2 years ago
compaction_service_test.cc	Deflake CompactionServiceTest.BasicCompactions (#10697)	2 years ago
compaction_state.cc	Tiered Compaction: per key placement support (#9964)	2 years ago
compaction_state.h	Tiered Compaction: per key placement support (#9964)	2 years ago
file_pri.h	Try to start TTL earlier with kMinOverlappingRatio is used (#8749)	3 years ago
sst_partitioner.cc	Restore Regex support for ObjectLibrary::Register, rename new APIs to allow old one to be deprecated in the future (#9362)	3 years ago
subcompaction_state.cc	Refactor Compaction file cut `ShouldStopBefore()` (#10629)	2 years ago
subcompaction_state.h	Refactor Compaction file cut `ShouldStopBefore()` (#10629)	2 years ago
tiered_compaction_test.cc	Change `bottommost_temperture` to `last_level_temperture` (#10471)	2 years ago