rocksdb

fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

History

Peter Dillinger 4d1ac19e3d aggregated-table-properties with GetMapProperty (#7779 ) Summary: So that we can more easily get aggregate live table data such as total filter, index, and data sizes. Also adds ldb support for getting properties Also fixed some missing/inaccurate related comments in db.h For example: $ ./ldb --db=testdb get_property rocksdb.aggregated-table-properties rocksdb.aggregated-table-properties.data_size: 102871 rocksdb.aggregated-table-properties.filter_size: 0 rocksdb.aggregated-table-properties.index_partitions: 0 rocksdb.aggregated-table-properties.index_size: 2232 rocksdb.aggregated-table-properties.num_data_blocks: 100 rocksdb.aggregated-table-properties.num_deletions: 0 rocksdb.aggregated-table-properties.num_entries: 15000 rocksdb.aggregated-table-properties.num_merge_operands: 0 rocksdb.aggregated-table-properties.num_range_deletions: 0 rocksdb.aggregated-table-properties.raw_key_size: 288890 rocksdb.aggregated-table-properties.raw_value_size: 198890 rocksdb.aggregated-table-properties.top_level_index_size: 0 $ ./ldb --db=testdb get_property rocksdb.aggregated-table-properties-at-level1 rocksdb.aggregated-table-properties-at-level1.data_size: 80909 rocksdb.aggregated-table-properties-at-level1.filter_size: 0 rocksdb.aggregated-table-properties-at-level1.index_partitions: 0 rocksdb.aggregated-table-properties-at-level1.index_size: 1787 rocksdb.aggregated-table-properties-at-level1.num_data_blocks: 81 rocksdb.aggregated-table-properties-at-level1.num_deletions: 0 rocksdb.aggregated-table-properties-at-level1.num_entries: 12466 rocksdb.aggregated-table-properties-at-level1.num_merge_operands: 0 rocksdb.aggregated-table-properties-at-level1.num_range_deletions: 0 rocksdb.aggregated-table-properties-at-level1.raw_key_size: 238210 rocksdb.aggregated-table-properties-at-level1.raw_value_size: 163414 rocksdb.aggregated-table-properties-at-level1.top_level_index_size: 0 $ Pull Request resolved: https://github.com/facebook/rocksdb/pull/7779 Test Plan: Added a test to ldb_test.py Reviewed By: jay-zhuang Differential Revision: D25653103 Pulled By: pdillinger fbshipit-source-id: 2905469a08a64dd6b5510cbd7be2e64d3234d6d3		4 years ago
..
blob	Add initial blob support to batched MultiGet (#7766 )	4 years ago
compaction	Change ErrorHandler methods to return const Status& (#7539 )	4 years ago
db_impl	Track WAL obsoletion when updating empty CF's log number (#7781 )	4 years ago
arena_wrapped_db_iter.cc	Add blob support to DBIter (#7731 )	4 years ago
arena_wrapped_db_iter.h	Add blob support to DBIter (#7731 )	4 years ago
builder.cc	Add full_history_ts_low_ to FlushJob (#7655 )	4 years ago
builder.h	Add full_history_ts_low_ to FlushJob (#7655 )	4 years ago
c.cc	Remove unused includes (#7604 )	4 years ago
c_test.c	Add getters to the C API for env, universal compaction options and fifo compaction options (#7501 )	4 years ago
column_family.cc	Fix memory leak for ColumnFamily drop with live iterator (#7749 )	4 years ago
column_family.h	Track WAL obsoletion when updating empty CF's log number (#7781 )	4 years ago
column_family_test.cc	Integrated blob garbage collection: relocate blobs (#7694 )	4 years ago
compact_files_test.cc	Replace reinterpret_cast with static_cast_with_check (#7067 )	5 years ago
compacted_db_impl.cc	Periodically flush info log out of application buffer (#7488 )	4 years ago
compacted_db_impl.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
comparator_db_test.cc	Remove unused includes (#7604 )	4 years ago
convenience.cc	sst_dump to reduce number of file reads (#6836 )	5 years ago
corruption_test.cc	Port corruption test to use custom env (#7699 )	4 years ago
cuckoo_table_db_test.cc	Fix a recovery corner case (#7621 )	4 years ago
db_basic_test.cc	Ensure that MultiGet works properly with compressed cache (#7756 )	4 years ago
db_block_cache_test.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
db_bloom_filter_test.cc	Experimental (production candidate) SST schema for Ribbon filter (#7658 )	4 years ago
db_compaction_filter_test.cc	In ParseInternalKey(), include corrupt key info in Status (#7515 )	4 years ago
db_compaction_test.cc	Integrated blob garbage collection: relocate blobs (#7694 )	4 years ago
db_dynamic_level_test.cc	Add a host location property to TableProperties (#7479 )	4 years ago
db_encryption_test.cc	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
db_filesnapshot.cc	Fix checkpoint file deletion race with avoid_unnecessary_blocking_io (#7369 )	4 years ago
db_flush_test.cc	Write min_log_number_to_keep to MANIFEST during atomic flush under 2 phase commit (#7570 )	4 years ago
db_info_dumper.cc	Make FileType Public and Replace kLogFile with kWalFile (#7580 )	4 years ago
db_info_dumper.h	Add a DB Session ID (#6959 )	5 years ago
db_inplace_update_test.cc	Whole DBTest to skip fsync (#7274 )	4 years ago
db_io_failure_test.cc	Whole DBTest to skip fsync (#7274 )	4 years ago
db_iter.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
db_iter.h	Add blob support to DBIter (#7731 )	4 years ago
db_iter_stress_test.cc	Add blob support to DBIter (#7731 )	4 years ago
db_iter_test.cc	Add blob support to DBIter (#7731 )	4 years ago
db_iterator_test.cc	Add further tests to ASSERT_STATUS_CHECKED (1) (#7679 )	4 years ago
db_log_iter_test.cc	Whole DBTest to skip fsync (#7274 )	4 years ago
db_logical_block_size_cache_test.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
db_memtable_test.cc	Add further tests to ASSERT_STATUS_CHECKED (1) (#7679 )	4 years ago
db_merge_operand_test.cc	Add further tests to ASSERT_STATUS_CHECKED (1) (#7679 )	4 years ago
db_merge_operator_test.cc	Add further tests to ASSERT_STATUS_CHECKED (1) (#7679 )	4 years ago
db_options_test.cc	Always apply bottommost_compression_opts when enabled (#7633 )	4 years ago
db_properties_test.cc	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
db_range_del_test.cc	Fix a recovery corner case (#7621 )	4 years ago
db_sst_test.cc	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
db_statistics_test.cc	Add a new stats level to exclude tickers (#7329 )	4 years ago
db_table_properties_test.cc	DBTablePropertiesTest often times out in internal test infra (#7639 )	4 years ago
db_tailing_iter_test.cc	Whole DBTest to skip fsync (#7274 )	4 years ago
db_test.cc	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
db_test2.cc	Fix unit test failure ppc64le in travis (#7752 )	4 years ago
db_test_util.cc	Add further tests to ASSERT_STATUS_CHECKED (1) (#7679 )	4 years ago
db_test_util.h	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
db_universal_compaction_test.cc	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
db_wal_test.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
db_with_timestamp_basic_test.cc	Make CompactRange and GetApproximateSizes work with timestamp (#7684 )	4 years ago
db_with_timestamp_compaction_test.cc	Whole DBTest to skip fsync (#7274 )	4 years ago
db_write_test.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
dbformat.cc	Make CompactRange and GetApproximateSizes work with timestamp (#7684 )	4 years ago
dbformat.h	Make CompactRange and GetApproximateSizes work with timestamp (#7684 )	4 years ago
dbformat_test.cc	Remove unused includes (#7604 )	4 years ago
deletefile_test.cc	Make FileType Public and Replace kLogFile with kWalFile (#7580 )	4 years ago
error_handler.cc	Change ErrorHandler methods to return const Status& (#7539 )	4 years ago
error_handler.h	Change ErrorHandler methods to return const Status& (#7539 )	4 years ago
error_handler_fs_test.cc	Add kManifestWriteNoWAL to BackgroundErrorReason to handle Flush IO Error when WAL is disabled (#7693 )	4 years ago
event_helpers.cc	Status check enforcement for error_handler_fs_test (#7342 )	4 years ago
event_helpers.h	Pass SST file checksum information through OnTableFileCreated (#7108 )	4 years ago
experimental.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
external_sst_file_basic_test.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
external_sst_file_ingestion_job.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
external_sst_file_ingestion_job.h	Store FSSequentialFilePtr object in SequenceFileReader (#7190 )	4 years ago
external_sst_file_test.cc	Do not use ASSERT_OK in child threads in ExternalSstFileTest.PickedLevelBug (#7754 )	4 years ago
fault_injection_test.cc	Remove unused includes (#7604 )	4 years ago
file_indexer.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
file_indexer.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
file_indexer_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
filename_test.cc	Remove unused includes (#7604 )	4 years ago
flush_job.cc	Fix assertion failure in bg flush (#7362 )	4 years ago
flush_job.h	Fix assertion failure in bg flush (#7362 )	4 years ago
flush_job_test.cc	Write min_log_number_to_keep to MANIFEST during atomic flush under 2 phase commit (#7570 )	4 years ago
flush_scheduler.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
flush_scheduler.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
forward_iterator.cc	Add further tests to ASSERT_STATUS_CHECKED (1) (#7679 )	4 years ago
forward_iterator.h	Properly report IO errors when IndexType::kBinarySearchWithFirstKey is used (#6621 )	5 years ago
forward_iterator_bench.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
import_column_family_job.cc	In ParseInternalKey(), include corrupt key info in Status (#7515 )	4 years ago
import_column_family_job.h	Store FSSequentialFilePtr object in SequenceFileReader (#7190 )	4 years ago
import_column_family_test.cc	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
internal_stats.cc	aggregated-table-properties with GetMapProperty (#7779 )	4 years ago
internal_stats.h	aggregated-table-properties with GetMapProperty (#7779 )	4 years ago
job_context.h	Expose the set of live blob files from Version/VersionSet (#6785 )	5 years ago
listener_test.cc	Remove unused includes (#7604 )	4 years ago
log_format.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
log_reader.cc	Fix kPointInTimeRecovery handling of truncated WAL (#7701 )	4 years ago
log_reader.h	Real fix for race in backup custom checksum checking (#7309 )	4 years ago
log_test.cc	Fix kPointInTimeRecovery handling of truncated WAL (#7701 )	4 years ago
log_writer.cc	Fail recovery when MANIFEST record checksum mismatch (#6996 )	5 years ago
log_writer.h	Pass IOStatus to write path and set retryable IO Error as hard error in BG jobs (#6487 )	5 years ago
logs_with_prep_tracker.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
logs_with_prep_tracker.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
lookup_key.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
malloc_stats.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
malloc_stats.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
manual_compaction_test.cc	Skip high levels with no key falling in the range in CompactRange (#6482 )	5 years ago
memtable.cc	Add initial blob support to batched MultiGet (#7766 )	4 years ago
memtable.h	Add initial blob support to batched MultiGet (#7766 )	4 years ago
memtable_list.cc	Add initial blob support to batched MultiGet (#7766 )	4 years ago
memtable_list.h	Add initial blob support to batched MultiGet (#7766 )	4 years ago
memtable_list_test.cc	Write min_log_number_to_keep to MANIFEST during atomic flush under 2 phase commit (#7570 )	4 years ago
merge_context.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
merge_helper.cc	In ParseInternalKey(), include corrupt key info in Status (#7515 )	4 years ago
merge_helper.h	In ParseInternalKey(), include corrupt key info in Status (#7515 )	4 years ago
merge_helper_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
merge_operator.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
merge_test.cc	Perform post-flush updates of memtable list in a callback (#6069 )	4 years ago
obsolete_files_test.cc	Remove unused includes (#7604 )	4 years ago
options_file_test.cc	Add more tests to ASSERT_STATUS_CHECKED (#7367 )	4 years ago
output_validator.cc	Use NPHash64 in more places (#7632 )	4 years ago
output_validator.h	Use NPHash64 in more places (#7632 )	4 years ago
perf_context_test.cc	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
periodic_work_scheduler.cc	Remove unused includes (#7604 )	4 years ago
periodic_work_scheduler.h	Periodically flush info log out of application buffer (#7488 )	4 years ago
periodic_work_scheduler_test.cc	Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566 )	4 years ago
pinned_iterators_manager.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
plain_table_db_test.cc	Remove unused includes (#7604 )	4 years ago
pre_release_callback.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
prefix_test.cc	Fix prefix_test for status check (#7495 )	4 years ago
range_del_aggregator.cc	In ParseInternalKey(), include corrupt key info in Status (#7515 )	4 years ago
range_del_aggregator.h	In ParseInternalKey(), include corrupt key info in Status (#7515 )	4 years ago
range_del_aggregator_bench.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
range_del_aggregator_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
range_tombstone_fragmenter.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
range_tombstone_fragmenter.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
range_tombstone_fragmenter_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
read_callback.h	Get() with timestamp should respect snapshot (#7227 )	4 years ago
repair.cc	Add full_history_ts_low_ to FlushJob (#7655 )	4 years ago
repair_test.cc	add Status check assertions for repair_test (#7455 )	4 years ago
snapshot_checker.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
snapshot_impl.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
snapshot_impl.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
table_cache.cc	Fix MultiGet unable to query timestamp data issue (#7589 )	4 years ago
table_cache.h	Store FSRandomAccessPtr object in RandomAccessFileReader (#7192 )	4 years ago
table_properties_collector.cc	In ParseInternalKey(), include corrupt key info in Status (#7515 )	4 years ago
table_properties_collector.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
table_properties_collector_test.cc	Bring the Configurable options together (#5753 )	4 years ago
transaction_log_impl.cc	Store FSSequentialFilePtr object in SequenceFileReader (#7190 )	4 years ago
transaction_log_impl.h	Store FileSystemPtr object that contains FileSystem ptr (#7180 )	4 years ago
trim_history_scheduler.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
trim_history_scheduler.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
version_builder.cc	Log sst number in Corruption status (#7767 )	4 years ago
version_builder.h	make L0 index/filter pinned memory usage predictable (#6911 )	5 years ago
version_builder_test.cc	Remove unused includes (#7604 )	4 years ago
version_edit.cc	Add full_history_ts_low to column family (#7740 )	4 years ago
version_edit.h	Add full_history_ts_low to column family (#7740 )	4 years ago
version_edit_handler.cc	Add full_history_ts_low to column family (#7740 )	4 years ago
version_edit_handler.h	Refactor with VersionEditHandler (#6581 )	4 years ago
version_edit_test.cc	Add full_history_ts_low to column family (#7740 )	4 years ago
version_set.cc	Add initial blob support to batched MultiGet (#7766 )	4 years ago
version_set.h	Track WAL obsoletion when updating empty CF's log number (#7781 )	4 years ago
version_set_test.cc	Fix memory leak for ColumnFamily drop with live iterator (#7749 )	4 years ago
wal_edit.cc	Always track WAL obsoletion (#7759 )	4 years ago
wal_edit.h	Always track WAL obsoletion (#7759 )	4 years ago
wal_edit_test.cc	Always track WAL obsoletion (#7759 )	4 years ago
wal_manager.cc	Make FileType Public and Replace kLogFile with kWalFile (#7580 )	4 years ago
wal_manager.h	Store FileSystemPtr object that contains FileSystem ptr (#7180 )	4 years ago
wal_manager_test.cc	Make FileType Public and Replace kLogFile with kWalFile (#7580 )	4 years ago
write_batch.cc	Return `Status` from `MemTable` mutation functions (#7656 )	4 years ago
write_batch_base.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
write_batch_internal.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
write_batch_test.cc	Add further tests to ASSERT_STATUS_CHECKED (1) (#7679 )	4 years ago
write_callback.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
write_callback_test.cc	Divide WriteCallbackTest.WriteWithCallbackTest (#7037 )	5 years ago
write_controller.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
write_controller.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
write_controller_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433 )	5 years ago
write_thread.cc	Add further tests to ASSERT_STATUS_CHECKED (2) (#7698 )	4 years ago
write_thread.h	Remove the status.PermitUncheckedError() from WriteGroup Destructor (#7555 )	4 years ago