fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Baptiste Lemaire e3a96c4823 Memtable sampling for mempurge heuristic. (#8628) ... Summary: Changes the API of the MemPurge process: the `bool experimental_allow_mempurge` and `experimental_mempurge_policy` flags have been replaced by a `double experimental_mempurge_threshold` option. This change of API reflects another major change introduced in this PR: the MemPurgeDecider() function now works by sampling the memtables being flushed to estimate the overall amount of useful payload (payload minus the garbage), and then compare this useful payload estimate with the `double experimental_mempurge_threshold` value. Therefore, when the value of this flag is `0.0` (default value), mempurge is simply deactivated. On the other hand, a value of `DBL_MAX` would be equivalent to always going through a mempurge regardless of the garbage ratio estimate. At the moment, a `double experimental_mempurge_threshold` value else than 0.0 or `DBL_MAX` is opnly supported`with the `SkipList` memtable representation. Regarding the sampling, this PR includes the introduction of a `MemTable::UniqueRandomSample` function that collects (approximately) random entries from the memtable by using the new `SkipList::Iterator::RandomSeek()` under the hood, or by iterating through each memtable entry, depending on the target sample size and the total number of entries. The unit tests have been readapted to support this new API. Pull Request resolved: https://github.com/facebook/rocksdb/pull/8628 Reviewed By: pdillinger Differential Revision: D30149315 Pulled By: bjlemaire fbshipit-source-id: 1feef5390c95db6f4480ab4434716533d3947f27		3 years ago
..
CMakeLists.txt	Mark dependencies as PRIVATE and fix missing dependencies in tools. (#6790)	5 years ago
batched_ops_stress.cc	Integrity protection for live updates to WriteBatch (#7748)	4 years ago
cf_consistency_stress.cc	Fix cf_consistency_stress for backup/restore, harmonize (#7373)	4 years ago
db_stress.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
db_stress_common.cc	Add user-defined timestamps to db_stress (#8061)	4 years ago
db_stress_common.h	Memtable sampling for mempurge heuristic. (#8628)	3 years ago
db_stress_compaction_filter.h	Fix unused variable failure (#7004)	4 years ago
db_stress_driver.cc	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033)	4 years ago
db_stress_driver.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
db_stress_env_wrapper.h	db_stress to add --open_metadata_write_fault_one_in (#8235)	4 years ago
db_stress_gflags.cc	Memtable sampling for mempurge heuristic. (#8628)	3 years ago
db_stress_listener.h	Make EventListener into a Customizable Class (#8473)	3 years ago
db_stress_shared_state.cc	Silence false alarms in db_stress fault injection (#6741)	5 years ago
db_stress_shared_state.h	Stress test to inject read failures in DB reopen (#8476)	3 years ago
db_stress_stat.h	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033)	4 years ago
db_stress_table_properties_collector.h	Mark files for compaction in stress/crash tests (#7231)	4 years ago
db_stress_test_base.cc	Memtable sampling for mempurge heuristic. (#8628)	3 years ago
db_stress_test_base.h	Inject fatal write failures to db_stress when DB is running (#8479)	3 years ago
db_stress_tool.cc	Stress test to inject read failures in DB reopen (#8476)	3 years ago
no_batched_ops_stress.cc	Inject fatal write failures to db_stress when DB is running (#8479)	3 years ago