rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

History

Hui Xiao d6bd1a0291 Support "level_at_creation" in TablePropertiesCollectorFactory::Context (#8919 ) Summary: Context: Exposing the level of the sst file (i.e, table) where it is created in `TablePropertiesCollectorFactory::Context` allows users of `TablePropertiesCollectorFactory` to customize some implementation details of `TablePropertiesCollectorFactory` and `TablePropertiesCollector` based on the level of creation. For example, `TablePropertiesCollector::NeedCompact()` can return different values based on level of creation. - Declared an extra field `level_at_creation` in `TablePropertiesCollectorFactory::Context` - Allowed `level_at_creation` to be passed in as an argument in `IntTblPropCollectorFactory::CreateIntTblPropCollector()` and `UserKeyTablePropertiesCollectorFactory::CreateIntTblPropCollector()`, the latter of which is an internal wrapper of user's passed-in `TablePropertiesCollectorFactory::CreateTablePropertiesCollector()` used in table-building process - Called `IntTblPropCollectorFactory::CreateIntTblPropCollector()` with `level_at_creation` passed into both `BlockBasedTableBuilder` and `PlainTableBuilder` - `PlainTableBuilder` previously did not capture `level_at_creation` from `TableBuilderOptions` in `PlainTableFactory`. In order for it to call the method with this parameter, this PR also made `PlainTableBuilder` capture `level_at_creation` as a required parameter - Called `IntTblPropCollectorFactory::CreateIntTblPropCollector()` with `level_at_creation` its overridden functions in its derived classes, including `RegularKeysStartWithAFactory::CreateIntTblPropCollector()` in `table_properties_collector_test.cc`, `SstFileWriterPropertiesCollectorFactory::CreateIntTblPropCollector()` in `sst_file_writer_collectors.h` Pull Request resolved: https://github.com/facebook/rocksdb/pull/8919 Test Plan: - Passed the added assertion for `context.level_at_creation` - Passed existing tests - Run `Make` to make sure adding a required parameter to `PlainTableBuilder`'s constructor does not break anything Reviewed By: anand1976 Differential Revision: D30951729 Pulled By: hx235 fbshipit-source-id: c4a0173b0d9344a4cf47e1b987d759c1c73cb474		3 years ago
..
blob	Sort per-file blob read requests by offset (#8953 )	3 years ago
compaction	Make WalFilter, SstPartitionerFactory, FileChecksumGenFactory, and TableProperties Customizable (#8638 )	3 years ago
db_impl	Support SingleDelete for user-defined timestamps (#8921 )	3 years ago
arena_wrapped_db_iter.cc	Rename ImmutableOptions variables (#8409 )	3 years ago
arena_wrapped_db_iter.h	Fix some lint warnings reported on 6.25 (#8945 )	3 years ago
builder.cc	Expose blob file information through the EventListener interface (#8675 )	3 years ago
builder.h	Expose blob file information through the EventListener interface (#8675 )	3 years ago
c.cc	Add Bloom/Ribbon hybrid API support (#8679 )	3 years ago
c_test.c	Add Bloom/Ribbon hybrid API support (#8679 )	3 years ago
column_family.cc	Add DB properties for BlobDB (#8734 )	3 years ago
column_family.h	Add DB properties for BlobDB (#8734 )	3 years ago
column_family_test.cc	Make MemTableRepFactory into a Customizable class (#8419 )	3 years ago
compact_files_test.cc	Compaction should not move data to up level (#8116 )	4 years ago
comparator_db_test.cc	Remove unused includes (#7604 )	4 years ago
convenience.cc	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262 )	4 years ago
corruption_test.cc	Add CreateFrom methods to Env/FileSystem (#8174 )	3 years ago
cuckoo_table_db_test.cc	Remove some unneeded code (#8736 )	3 years ago
db_basic_test.cc	Change the File System File Wrappers to std::unique_ptr (#8618 )	3 years ago
db_block_cache_test.cc	Fix PrepopulateBlockCache::kFlushOnly (#8750 )	3 years ago
db_bloom_filter_test.cc	Make SliceTransform into a Customizable class (#8641 )	3 years ago
db_compaction_filter_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_compaction_test.cc	Make SystemClock into a Customizable Class (#8636 )	3 years ago
db_dynamic_level_test.cc	Make SystemClock into a Customizable Class (#8636 )	3 years ago
db_encryption_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_filesnapshot.cc	DB::GetSortedWalFiles() to ensure file deletion is disabled (#8591 )	3 years ago
db_flush_test.cc	Make SystemClock into a Customizable Class (#8636 )	3 years ago
db_info_dumper.cc	Allow WAL dir to change with db dir (#8582 )	3 years ago
db_info_dumper.h	Add a DB Session ID (#6959 )	4 years ago
db_inplace_update_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_io_failure_test.cc	Make MemTableRepFactory into a Customizable class (#8419 )	3 years ago
db_iter.cc	Rename ImmutableOptions variables (#8409 )	3 years ago
db_iter.h	Rename ImmutableOptions variables (#8409 )	3 years ago
db_iter_stress_test.cc	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262 )	4 years ago
db_iter_test.cc	Remove some unneeded code (#8736 )	3 years ago
db_iterator_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_kv_checksum_test.cc	Allow WriteBatch to have keys with different timestamp sizes (#8725 )	3 years ago
db_log_iter_test.cc	Attempt to deflake DBTestXactLogIterator.TransactionLogIteratorCorruptedLog (#8627 )	3 years ago
db_logical_block_size_cache_test.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
db_memtable_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_merge_operand_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_merge_operator_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_options_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_properties_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_range_del_test.cc	Make MemTableRepFactory into a Customizable class (#8419 )	3 years ago
db_secondary_test.cc	Make MemTableRepFactory into a Customizable class (#8419 )	3 years ago
db_sst_test.cc	Fix flaky WALTrashCleanupOnOpen (#8917 )	3 years ago
db_statistics_test.cc	Bytes read stat for `VerifyChecksum()` and `VerifyFileChecksums()` APIs (#8741 )	3 years ago
db_table_properties_test.cc	Make WalFilter, SstPartitionerFactory, FileChecksumGenFactory, and TableProperties Customizable (#8638 )	3 years ago
db_tailing_iter_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_test.cc	Make RateLimiter::GetTotalPendingRequest() non pure virtual for backward compability (#8938 )	3 years ago
db_test2.cc	Make Statistics a Customizable Class (#8637 )	3 years ago
db_test_util.cc	Make SystemClock into a Customizable Class (#8636 )	3 years ago
db_test_util.h	Make MemTableRepFactory into a Customizable class (#8419 )	3 years ago
db_universal_compaction_test.cc	Make SystemClock into a Customizable Class (#8636 )	3 years ago
db_wal_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_with_timestamp_basic_test.cc	Support SingleDelete for user-defined timestamps (#8921 )	3 years ago
db_with_timestamp_compaction_test.cc	Make MemTableRepFactory into a Customizable class (#8419 )	3 years ago
db_write_buffer_manager_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
db_write_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
dbformat.cc	Remove some unneeded code (#8736 )	3 years ago
dbformat.h	Fix some typos in comments (#8066 )	4 years ago
dbformat_test.cc	Remove unused includes (#7604 )	4 years ago
deletefile_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
error_handler.cc	DB::GetSortedWalFiles() to ensure file deletion is disabled (#8591 )	3 years ago
error_handler.h	Fix some typos in comments (#8066 )	4 years ago
error_handler_fs_test.cc	Remove some unneeded code (#8736 )	3 years ago
event_helpers.cc	Expose blob file information through the EventListener interface (#8675 )	3 years ago
event_helpers.h	Expose blob file information through the EventListener interface (#8675 )	3 years ago
experimental.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
external_sst_file_basic_test.cc	Bypass unused parameterization in ExternalSSTFileBasicTest.IngestExte… (#8910 )	3 years ago
external_sst_file_ingestion_job.cc	Support custom Env in db_sst_test and external_sst_file_basic_test (#8888 )	3 years ago
external_sst_file_ingestion_job.h	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033 )	4 years ago
external_sst_file_test.cc	Make SystemClock into a Customizable Class (#8636 )	3 years ago
fault_injection_test.cc	Make SystemClock into a Customizable Class (#8636 )	3 years ago
file_indexer.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
file_indexer.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
file_indexer_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
filename_test.cc	Remove unused includes (#7604 )	4 years ago
flush_job.cc	Expose blob file information through the EventListener interface (#8675 )	3 years ago
flush_job.h	Add condition on NotifyOnFlushComplete that FlushJob was not mempurge. Add event listeners to mempurge tests. (#8672 )	3 years ago
flush_job_test.cc	Fix NotifyOnFlushCompleted() for atomic flush (#8585 )	3 years ago
flush_scheduler.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
flush_scheduler.h	Include C++ standard library headers instead of C compatibility headers (#8068 )	4 years ago
forward_iterator.cc	Fix some typos in comments (#8066 )	4 years ago
forward_iterator.h	Replace most typedef with using= (#8751 )	3 years ago
forward_iterator_bench.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
import_column_family_job.cc	Add a SystemClock class to capture the time functions of an Env (#7858 )	4 years ago
import_column_family_job.h	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033 )	4 years ago
import_column_family_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
internal_stats.cc	Use GetBlobFileSize instead of GetTotalBlobBytes in DB properties (#8902 )	3 years ago
internal_stats.h	Add DB properties for BlobDB (#8734 )	3 years ago
job_context.h	Fix and detect headers with missing dependencies (#8893 )	3 years ago
kv_checksum.h	Fix some lint warnings reported on 6.25 (#8945 )	3 years ago
listener_test.cc	Fix some lint warnings reported on 6.25 (#8945 )	3 years ago
log_format.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
log_reader.cc	Fix kPointInTimeRecovery handling of truncated WAL (#7701 )	4 years ago
log_reader.h	Real fix for race in backup custom checksum checking (#7309 )	4 years ago
log_test.cc	Make StringEnv, StringSink, StringSource use FS classes (#7786 )	4 years ago
log_writer.cc	Using existing crc32c checksum in checksum handoff for Manifest and WAL (#8412 )	3 years ago
log_writer.h	Include C++ standard library headers instead of C compatibility headers (#8068 )	4 years ago
logs_with_prep_tracker.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
logs_with_prep_tracker.h	Include C++ standard library headers instead of C compatibility headers (#8068 )	4 years ago
lookup_key.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
malloc_stats.cc	Replace most typedef with using= (#8751 )	3 years ago
malloc_stats.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
manual_compaction_test.cc	Add more tests for assert status checked (#7524 )	4 years ago
memtable.cc	Adapt key-value checksum for timestamp-suffixed keys (#8914 )	3 years ago
memtable.h	Adapt key-value checksum for timestamp-suffixed keys (#8914 )	3 years ago
memtable_list.cc	Improve MemPurge sampling (#8656 )	3 years ago
memtable_list.h	Improve MemPurge sampling (#8656 )	3 years ago
memtable_list_test.cc	Fix NotifyOnFlushCompleted() for atomic flush (#8585 )	3 years ago
merge_context.h	Add Merge Operator support to WriteBatchWithIndex (#8135 )	4 years ago
merge_helper.cc	Add support for Merge with base value during Compaction in IntegratedBlobDB (#8445 )	3 years ago
merge_helper.h	Add support for Merge with base value during Compaction in IntegratedBlobDB (#8445 )	3 years ago
merge_helper_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
merge_operator.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
merge_test.cc	Built-in support for generating unique IDs, bug fix (#8708 )	3 years ago
obsolete_files_test.cc	Attempt to deflake ObsoleteFilesTest.DeleteObsoleteOptionsFile (#8624 )	3 years ago
options_file_test.cc	No elide constructors (#7798 )	4 years ago
output_validator.cc	Use NPHash64 in more places (#7632 )	4 years ago
output_validator.h	Add remote compaction public API (#8300 )	4 years ago
perf_context_test.cc	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033 )	4 years ago
periodic_work_scheduler.cc	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033 )	4 years ago
periodic_work_scheduler.h	Add a SystemClock class to capture the time functions of an Env (#7858 )	4 years ago
periodic_work_scheduler_test.cc	Fix a minor issue with initializing the test path (#8555 )	3 years ago
pinned_iterators_manager.h	Replace most typedef with using= (#8751 )	3 years ago
plain_table_db_test.cc	Remove some unneeded code (#8736 )	3 years ago
pre_release_callback.h	Fix and detect headers with missing dependencies (#8893 )	3 years ago
prefix_test.cc	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033 )	4 years ago
range_del_aggregator.cc	In ParseInternalKey(), include corrupt key info in Status (#7515 )	4 years ago
range_del_aggregator.h	Fix some typos in comments (#8066 )	4 years ago
range_del_aggregator_bench.cc	Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033 )	4 years ago
range_del_aggregator_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
range_tombstone_fragmenter.cc	Added memtable garbage statistics (#8411 )	3 years ago
range_tombstone_fragmenter.h	Added memtable garbage statistics (#8411 )	3 years ago
range_tombstone_fragmenter_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
read_callback.h	Fix and detect headers with missing dependencies (#8893 )	3 years ago
repair.cc	Expose blob file information through the EventListener interface (#8675 )	3 years ago
repair_test.cc	Some fixes and enhancements to `ldb repair` (#8544 )	3 years ago
snapshot_checker.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
snapshot_impl.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
snapshot_impl.h	Fix and detect headers with missing dependencies (#8893 )	3 years ago
table_cache.cc	Fix use-after-free on implicit temporary FileOptions (#8571 )	3 years ago
table_cache.h	Fix use-after-free on implicit temporary FileOptions (#8571 )	3 years ago
table_properties_collector.cc	Apply `sample_for_compression` to all block-based tables (#8105 )	4 years ago
table_properties_collector.h	Support "level_at_creation" in TablePropertiesCollectorFactory::Context (#8919 )	3 years ago
table_properties_collector_test.cc	Support "level_at_creation" in TablePropertiesCollectorFactory::Context (#8919 )	3 years ago
transaction_log_impl.cc	Add more tests for assert status checked (#7524 )	4 years ago
transaction_log_impl.h	Store FileSystemPtr object that contains FileSystem ptr (#7180 )	4 years ago
trim_history_scheduler.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
trim_history_scheduler.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
version_builder.cc	Remove some unneeded code (#8736 )	3 years ago
version_builder.h	Handle blob files when options.best_efforts_recovery is true (#8180 )	4 years ago
version_builder_test.cc	Print blob file checksums as hex (#8437 )	3 years ago
version_edit.cc	Write file temperature information to manifest (#8284 )	4 years ago
version_edit.h	Write file temperature information to manifest (#8284 )	4 years ago
version_edit_handler.cc	Fix a bug of secondary instance sequence going backward (#8653 )	3 years ago
version_edit_handler.h	Fixed manifest_dump issues when printing keys and values containing null characters (#8378 )	3 years ago
version_edit_test.cc	Make it able to ignore WAL related VersionEdits in older versions (#7873 )	4 years ago
version_set.cc	Sort per-file blob read requests by offset (#8953 )	3 years ago
version_set.h	Sort per-file blob read requests by offset (#8953 )	3 years ago
version_set_test.cc	Print blob file checksums as hex (#8437 )	3 years ago
wal_edit.cc	Always track WAL obsoletion (#7759 )	4 years ago
wal_edit.h	Always track WAL obsoletion (#7759 )	4 years ago
wal_edit_test.cc	Always track WAL obsoletion (#7759 )	4 years ago
wal_manager.cc	Allow WAL dir to change with db dir (#8582 )	3 years ago
wal_manager.h	Allow WAL dir to change with db dir (#8582 )	3 years ago
wal_manager_test.cc	Make SystemClock into a Customizable Class (#8636 )	3 years ago
write_batch.cc	Adapt key-value checksum for timestamp-suffixed keys (#8914 )	3 years ago
write_batch_base.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
write_batch_internal.h	Adapt key-value checksum for timestamp-suffixed keys (#8914 )	3 years ago
write_batch_test.cc	Remove some unneeded code (#8736 )	3 years ago
write_callback.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
write_callback_test.cc	Move slow valgrind tests behind -DROCKSDB_FULL_VALGRIND_RUN (#8475 )	3 years ago
write_controller.cc	Revamp WriteController (#8064 )	4 years ago
write_controller.h	Revamp WriteController (#8064 )	4 years ago
write_controller_test.cc	Revamp WriteController (#8064 )	4 years ago
write_thread.cc	Stall writes in WriteBufferManager when memory_usage exceeds buffer_size (#7898 )	4 years ago
write_thread.h	typo: fix typo in db/write_thread's state (#8423 )	3 years ago