fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Changyu Bi 9f2363f4c4 User-defined timestamp support for `DeleteRange()` (#10661) ... Summary: Add user-defined timestamp support for range deletion. The new API is `DeleteRange(opt, cf, begin_key, end_key, ts)`. Most of the change is to update the comparator to compare without timestamp. Other than that, major changes are - internal range tombstone data structures (`FragmentedRangeTombstoneList`, `RangeTombstone`, etc.) to store timestamps. - Garbage collection of range tombstones and range tombstone covered keys during compaction. - Get()/MultiGet() to return the timestamp of a range tombstone when needed. - Get/Iterator with range tombstones bounded by readoptions.timestamp. - timestamp crash test now issues DeleteRange by default. Pull Request resolved: https://github.com/facebook/rocksdb/pull/10661 Test Plan: - Added unit test: `make check` - Stress test: `python3 tools/db_crashtest.py --enable_ts whitebox --readpercent=57 --prefixpercent=4 --writepercent=25 -delpercent=5 --iterpercent=5 --delrangepercent=4` - Ran `db_bench` to measure regression when timestamp is not enabled. The tests are for write (with some range deletion) and iterate with DB fitting in memory: `./db_bench--benchmarks=fillrandom,seekrandom --writes_per_range_tombstone=200 --max_write_buffer_number=100 --min_write_buffer_number_to_merge=100 --writes=500000 --reads=500000 --seek_nexts=10 --disable_auto_compactions -disable_wal=true --max_num_range_tombstones=1000`. Did not see consistent regression in no timestamp case. | micros/op | fillrandom | seekrandom | | --- | --- | --- | |main| 2.58 |10.96| |PR 10661| 2.68 |10.63| Reviewed By: riversand963 Differential Revision: D39441192 Pulled By: cbi42 fbshipit-source-id: f05aca3c41605caf110daf0ff405919f300ddec2		2 years ago
..
adaptive	…
block_based	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
cuckoo	…
plain	Fix platform 10 build with folly (#10708)	2 years ago
block_fetcher.cc	Refactor to avoid confusing "raw block" (#10408)	2 years ago
block_fetcher.h	Refactor to avoid confusing "raw block" (#10408)	2 years ago
block_fetcher_test.cc	…
cleanable_test.cc	…
format.cc	Refactor to avoid confusing "raw block" (#10408)	2 years ago
format.h	Refactor to avoid confusing "raw block" (#10408)	2 years ago
get_context.cc	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
get_context.h	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
internal_iterator.h	Skip swaths of range tombstone covered keys in merging iterator (2022 edition) (#10449)	2 years ago
iter_heap.h	…
iterator.cc	…
iterator_wrapper.h	Skip swaths of range tombstone covered keys in merging iterator (2022 edition) (#10449)	2 years ago
merger_test.cc	…
merging_iterator.cc	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
merging_iterator.h	Fix memtable-only iterator regression (#10705)	2 years ago
meta_blocks.cc	Refactor to avoid confusing "raw block" (#10408)	2 years ago
meta_blocks.h	Refactor to avoid confusing "raw block" (#10408)	2 years ago
mock_table.cc	Align compaction output file boundaries to the next level ones (#10655)	2 years ago
mock_table.h	Align compaction output file boundaries to the next level ones (#10655)	2 years ago
multiget_context.h	MultiGet async IO across multiple levels (#10535)	2 years ago
persistent_cache_helper.cc	Refactor to avoid confusing "raw block" (#10408)	2 years ago
persistent_cache_helper.h	Refactor to avoid confusing "raw block" (#10408)	2 years ago
persistent_cache_options.h	…
scoped_arena_iterator.h	…
sst_file_dumper.cc	…
sst_file_dumper.h	…
sst_file_reader.cc	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
sst_file_reader_test.cc	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
sst_file_writer.cc	User-defined timestamp support for `DeleteRange()` (#10661)	2 years ago
sst_file_writer_collectors.h	Refactor to avoid confusing "raw block" (#10408)	2 years ago
table_builder.h	Always verify SST unique IDs on SST file open (#10532)	2 years ago
table_factory.cc	…
table_properties.cc	…
table_properties_internal.h	…
table_reader.h	…
table_reader_bench.cc	…
table_reader_caller.h	…
table_test.cc	Always verify SST unique IDs on SST file open (#10532)	2 years ago
two_level_iterator.cc	…
two_level_iterator.h	…
unique_id.cc	…
unique_id_impl.h	…