fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Gang Liao e6432dfd4c Make it possible to enable blob files starting from a certain LSM tree level (#10077) ... Summary: Currently, if blob files are enabled (i.e. `enable_blob_files` is true), large values are extracted both during flush/recovery (when SST files are written into level 0 of the LSM tree) and during compaction into any LSM tree level. For certain use cases that have a mix of short-lived and long-lived values, it might make sense to support extracting large values only during compactions whose output level is greater than or equal to a specified LSM tree level (e.g. compactions into L1/L2/... or above). This could reduce the space amplification caused by large values that are turned into garbage shortly after being written at the price of some write amplification incurred by long-lived values whose extraction to blob files is delayed. In order to achieve this, we would like to do the following: - Add a new configuration option `blob_file_starting_level` (default: 0) to `AdvancedColumnFamilyOptions` (and `MutableCFOptions` and extend the related logic) - Instantiate `BlobFileBuilder` in `BuildTable` (used during flush and recovery, where the LSM tree level is L0) and `CompactionJob` iff `enable_blob_files` is set and the LSM tree level is `>= blob_file_starting_level` - Add unit tests for the new functionality, and add the new option to our stress tests (`db_stress` and `db_crashtest.py` ) - Add the new option to our benchmarking tool `db_bench` and the BlobDB benchmark script `run_blob_bench.sh` - Add the new option to the `ldb` tool (see https://github.com/facebook/rocksdb/wiki/Administration-and-Data-Access-Tool) - Ideally extend the C and Java bindings with the new option - Update the BlobDB wiki to document the new option. Pull Request resolved: https://github.com/facebook/rocksdb/pull/10077 Reviewed By: ltamasi Differential Revision: D36884156 Pulled By: gangliao fbshipit-source-id: 942bab025f04633edca8564ed64791cb5e31627d		2 years ago
..
CMakeLists.txt	Stress test for RocksDB transactions (#8936)	3 years ago
batched_ops_stress.cc	Revise APIs related to user-defined timestamp (#8946)	3 years ago
cf_consistency_stress.cc	Add rate limiter priority to ReadOptions (#9424)	3 years ago
db_stress.cc	Add (& fix) some simple source code checks (#8821)	3 years ago
db_stress_common.cc	db_stress fault injection in release mode (#9957)	3 years ago
db_stress_common.h	Make it possible to enable blob files starting from a certain LSM tree level (#10077)	2 years ago
db_stress_compaction_filter.h	Rename kRemoveWithSingleDelete to kPurge (#9951)	3 years ago
db_stress_driver.cc	db_stress fault injection in release mode (#9957)	3 years ago
db_stress_driver.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
db_stress_env_wrapper.h	Make the Env class Customizable (#9293)	3 years ago
db_stress_gflags.cc	Make it possible to enable blob files starting from a certain LSM tree level (#10077)	2 years ago
db_stress_listener.cc	Adjust public APIs to prefer 128-bit SST unique ID (#10009)	3 years ago
db_stress_listener.h	Avoid usage of ReopenWritableFile in db_stress (#9649)	3 years ago
db_stress_shared_state.cc	Remove ROCKSDB_SUPPORT_THREAD_LOCAL define because it's a part of C++11 (#10015)	3 years ago
db_stress_shared_state.h	Remove ROCKSDB_SUPPORT_THREAD_LOCAL define because it's a part of C++11 (#10015)	3 years ago
db_stress_stat.cc	Fix Statistics in db_stress (#9260)	3 years ago
db_stress_stat.h	Fix Statistics in db_stress (#9260)	3 years ago
db_stress_table_properties_collector.h	Fix and detect headers with missing dependencies (#8893)	3 years ago
db_stress_test_base.cc	Make it possible to enable blob files starting from a certain LSM tree level (#10077)	2 years ago
db_stress_test_base.h	Avoid overwriting options loaded from OPTIONS (#9943)	3 years ago
db_stress_tool.cc	Enable IngestExternalFile() in crash test (#9357)	3 years ago
expected_state.cc	Remove own ToString() (#9955)	3 years ago
expected_state.h	db_stress verify with lost unsynced operations (#8966)	3 years ago
multi_ops_txns_stress.cc	db_stress fault injection in release mode (#9957)	3 years ago
multi_ops_txns_stress.h	Fix a bug of CompactionIterator/CompactionFilter using `Delete` (#9929)	3 years ago
no_batched_ops_stress.cc	Enable IngestExternalFile() in crash test (#9357)	3 years ago