fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Shobhit Dayal b45b1cde3e Feature for sampling and reporting compressibility (#4842) ... Summary: This is a feature to sample data-block compressibility and and report them as stats. 1 in N (tunable) blocks is sampled for compressibility using two algorithms: 1. lz4 or snappy for fast compression 2. zstd or zlib for slow but higher compression. The stats are reported to the caller as raw-bytes and compressed-bytes. The block continues to be compressed for storage using the specified CompressionType. The db_bench_tool how has a command line option for specifying the sampling rate. It's default value is 0 (no sampling). To test the overhead for a certain value, users can compare the performance of db_bench_tool, varying the sampling rate. It is unlikely to have a noticeable impact for high values like 20. Pull Request resolved: https://github.com/facebook/rocksdb/pull/4842 Differential Revision: D13629011 Pulled By: shobhitdayal fbshipit-source-id: 14ca668bcab6499b2a1734edf848eb62a4f4fafa		6 years ago
..
adaptive_table_factory.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
adaptive_table_factory.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
block.cc	Checksum properties block for block-based table (#4956)	6 years ago
block.h	Checksum properties block for block-based table (#4956)	6 years ago
block_based_filter_block.cc	PrefixMayMatch: remove unnecessary check for prefix_extractor_ (#4067)	6 years ago
block_based_filter_block.h	Move prefix_extractor to MutableCFOptions	7 years ago
block_based_filter_block_test.cc	Apply modernize-use-override (2nd iteration)	6 years ago
block_based_table_builder.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
block_based_table_builder.h	Feature for sampling and reporting compressibility (#4842)	6 years ago
block_based_table_factory.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
block_based_table_factory.h	Revert "Move MemoryAllocator option from Cache to BlockBasedTableOpti… (#4697)	6 years ago
block_based_table_reader.cc	Apply modernize-use-override (2nd iteration)	6 years ago
block_based_table_reader.h	Cache dictionary used for decompressing data blocks (#4881)	6 years ago
block_builder.cc	DataBlockHashIndex: Remove the division from EstimateSize() (#4293)	6 years ago
block_builder.h	Add path to WritableFileWriter. (#4039)	6 years ago
block_fetcher.cc	Cache dictionary used for decompressing data blocks (#4881)	6 years ago
block_fetcher.h	Cache dictionary used for decompressing data blocks (#4881)	6 years ago
block_prefix_index.cc	Change RocksDB License	7 years ago
block_prefix_index.h	Change RocksDB License	7 years ago
block_test.cc	Remove two variables from BlockContents class and don't use class Block for compressed block (#4650)	6 years ago
bloom_block.cc	Change RocksDB License	7 years ago
bloom_block.h	Disallow customized hash function in DynamicBloom (#4915)	6 years ago
cleanable_test.cc	Change RocksDB License	7 years ago
cuckoo_table_builder.cc	Promote rocksdb.{deleted.keys,merge.operands} to main table properties (#4594)	6 years ago
cuckoo_table_builder.h	Change RocksDB License	7 years ago
cuckoo_table_builder_test.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_factory.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_factory.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
cuckoo_table_reader.cc	Apply modernize-use-override (2nd iteration)	6 years ago
cuckoo_table_reader.h	Index value delta encoding (#3983)	6 years ago
cuckoo_table_reader_test.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
data_block_footer.cc	Add db_bench options of data block hash index (#4281)	6 years ago
data_block_footer.h	Add db_bench options of data block hash index (#4281)	6 years ago
data_block_hash_index.cc	DataBlockHashIndex: Remove the division from EstimateSize() (#4293)	6 years ago
data_block_hash_index.h	DataBlockHashIndex: Remove the division from EstimateSize() (#4293)	6 years ago
data_block_hash_index_test.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
filter_block.h	use user_key and iterate_upper_bound to determine compatibility of bloom filters (#3899)	6 years ago
flush_block_policy.cc	Apply modernize-use-override (2nd iteration)	6 years ago
format.cc	Make statistics's stats_level change thread-safe (#5030)	6 years ago
format.h	Digest ZSTD compression dictionary once when writing SST file (#4849)	6 years ago
full_filter_bits_builder.h	Skip duplicate bloom keys when whole_key and prefix are mixed	7 years ago
full_filter_block.cc	Charging block cache more accurately (#4073)	6 years ago
full_filter_block.h	Charging block cache more accurately (#4073)	6 years ago
full_filter_block_test.cc	Apply modernize-use-override (2nd iteration)	6 years ago
get_context.cc	PlainTable should avoid copying Get() results from immortal source. (#4924)	6 years ago
get_context.h	Cache dictionary used for decompressing data blocks (#4881)	6 years ago
index_builder.cc	Add path to WritableFileWriter. (#4039)	6 years ago
index_builder.h	Add path to WritableFileWriter. (#4039)	6 years ago
internal_iterator.h	Index value delta encoding (#3983)	6 years ago
iter_heap.h	Make InternalKeyComparator final and directly use it in merging iterator	7 years ago
iterator.cc	Apply modernize-use-override (2nd iteration)	6 years ago
iterator_wrapper.h	Index value delta encoding (#3983)	6 years ago
merger_test.cc	Apply modernize-use-override (2nd iteration)	6 years ago
merging_iterator.cc	Apply modernize-use-override (2nd iteration)	6 years ago
merging_iterator.h	Index value delta encoding (#3983)	6 years ago
meta_blocks.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
meta_blocks.h	Feature for sampling and reporting compressibility (#4842)	6 years ago
mock_table.cc	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
mock_table.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
partitioned_filter_block.cc	Fix bug in partition filters with format_version=4 (#4381)	6 years ago
partitioned_filter_block.h	Fix bug in partition filters with format_version=4 (#4381)	6 years ago
partitioned_filter_block_test.cc	Apply modernize-use-override (2nd iteration)	6 years ago
persistent_cache_helper.cc	Remove two variables from BlockContents class and don't use class Block for compressed block (#4650)	6 years ago
persistent_cache_helper.h	Change RocksDB License	7 years ago
persistent_cache_options.h	Change RocksDB License	7 years ago
plain_table_builder.cc	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	6 years ago
plain_table_builder.h	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	6 years ago
plain_table_factory.cc	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	6 years ago
plain_table_factory.h	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	6 years ago
plain_table_index.cc	Change RocksDB License	7 years ago
plain_table_index.h	Move prefix_extractor to MutableCFOptions	7 years ago
plain_table_key_coding.cc	Comment out unused variables	7 years ago
plain_table_key_coding.h	Update all unique/shared_ptr instances to be qualified with namespace std (#4638)	6 years ago
plain_table_reader.cc	Revert "Remove PlainTable's feature store_index_in_file (#4914)" (#5034)	6 years ago
plain_table_reader.h	PlainTable should avoid copying Get() results from immortal source. (#4924)	6 years ago
scoped_arena_iterator.h	Change RocksDB License	7 years ago
sst_file_reader.cc	Get `CompactionJobInfo` from CompactFiles	6 years ago
sst_file_reader_test.cc	Get `CompactionJobInfo` from CompactFiles	6 years ago
sst_file_writer.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
sst_file_writer_collectors.h	Feature for sampling and reporting compressibility (#4842)	6 years ago
table_builder.h	Feature for sampling and reporting compressibility (#4842)	6 years ago
table_properties.cc	Promote rocksdb.{deleted.keys,merge.operands} to main table properties (#4594)	6 years ago
table_properties_internal.h	Index value delta encoding (#3983)	6 years ago
table_reader.h	Clean up FragmentedRangeTombstoneList (#4692)	6 years ago
table_reader_bench.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
table_test.cc	Feature for sampling and reporting compressibility (#4842)	6 years ago
two_level_iterator.cc	Apply modernize-use-override (2nd iteration)	6 years ago
two_level_iterator.h	Index value delta encoding (#3983)	6 years ago