fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Andrew Kryczka 843d2e3137 Shared dictionary compression using reference block ... Summary: This adds a new metablock containing a shared dictionary that is used to compress all data blocks in the SST file. The size of the shared dictionary is configurable in CompressionOptions and defaults to 0. It's currently only used for zlib/lz4/lz4hc, but the block will be stored in the SST regardless of the compression type if the user chooses a nonzero dictionary size. During compaction, computes the dictionary by randomly sampling the first output file in each subcompaction. It pre-computes the intervals to sample by assuming the output file will have the maximum allowable length. In case the file is smaller, some of the pre-computed sampling intervals can be beyond end-of-file, in which case we skip over those samples and the dictionary will be a bit smaller. After the dictionary is generated using the first file in a subcompaction, it is loaded into the compression library before writing each block in each subsequent file of that subcompaction. On the read path, gets the dictionary from the metablock, if it exists. Then, loads that dictionary into the compression library before reading each block. Test Plan: new unit test Reviewers: yhchiang, IslamAbdelRahman, cyan, sdong Reviewed By: sdong Subscribers: andrewkr, yoshinorim, kradhakrishnan, dhruba, leveldb Differential Revision: https://reviews.facebook.net/D52287		9 years ago
..
utilities	Delete deprecated *BackupableDB interface for backups	9 years ago
c.h	Shared dictionary compression using reference block	9 years ago
cache.h	Adding pin_l0_filter_and_index_blocks_in_cache feature and related fixes.	9 years ago
compaction_filter.h	Updated all copyright headers to the new format.	9 years ago
compaction_job_stats.h	Rename options.compaction_measure_io_stats to options.report_bg_io_stats and include flush too.	9 years ago
comparator.h	Updated all copyright headers to the new format.	9 years ago
convenience.h	Updated all copyright headers to the new format.	9 years ago
db.h	Add per-level compression ratio property	9 years ago
db_bench_tool.h	Separeate main from bench functionality to allow cusomizations	9 years ago
db_dump_tool.h	Updated all copyright headers to the new format.	9 years ago
env.h	Make WritableFileWrapper not screw up preallocation	9 years ago
experimental.h	Updated all copyright headers to the new format.	9 years ago
filter_policy.h	Updated all copyright headers to the new format.	9 years ago
flush_block_policy.h	Updated all copyright headers to the new format.	9 years ago
immutable_options.h	Updated all copyright headers to the new format.	9 years ago
iostats_context.h	IOStatsContext::ToString() add option to exclude zero counters	9 years ago
iterator.h	Introduce PinnedIteratorsManager (Reduce PinData() overhead / Refactor PinData)	9 years ago
ldb_tool.h	Updated all copyright headers to the new format.	9 years ago
listener.h	Fix lite_build	9 years ago
memtablerep.h	Updated all copyright headers to the new format.	9 years ago
merge_operator.h	Updated all copyright headers to the new format.	9 years ago
metadata.h	Updated all copyright headers to the new format.	9 years ago
options.h	Shared dictionary compression using reference block	9 years ago
perf_context.h	Update comments on include/rocksdb/perf_context.h	9 years ago
perf_level.h	Updated all copyright headers to the new format.	9 years ago
rate_limiter.h	Updated all copyright headers to the new format.	9 years ago
slice.h	to/from hex refactor	9 years ago
slice_transform.h	Updated all copyright headers to the new format.	9 years ago
snapshot.h	Updated all copyright headers to the new format.	9 years ago
sst_dump_tool.h	Updated all copyright headers to the new format.	9 years ago
sst_file_manager.h	Introduce SstFileManager::SetMaxAllowedSpaceUsage() to cap disk space usage	9 years ago
sst_file_writer.h	Updated all copyright headers to the new format.	9 years ago
statistics.h	Cache to have an option to fail Cache::Insert() when full	9 years ago
status.h	Updated all copyright headers to the new format.	9 years ago
table.h	Introduce PinnedIteratorsManager (Reduce PinData() overhead / Refactor PinData)	9 years ago
table_properties.h	Shared dictionary compression using reference block	9 years ago
thread_status.h	Updated all copyright headers to the new format.	9 years ago
transaction_log.h	Updated all copyright headers to the new format.	9 years ago
types.h	Updated all copyright headers to the new format.	9 years ago
universal_compaction.h	Updated all copyright headers to the new format.	9 years ago
version.h	Release RocksDB 4.7	9 years ago
wal_filter.h	Avoid overloaded virtual function	9 years ago
write_batch.h	Updated all copyright headers to the new format.	9 years ago
write_batch_base.h	Updated all copyright headers to the new format.	9 years ago