fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Zhongyi Xie 80bc35927c Should only decode restart points for uncompressed blocks (#3996) ... Summary: The Block object assumes contents are uncompressed. Block's constructor tries to read the number of restarts, but does not get an accurate number when its contents are compressed, which is causing issues like https://github.com/facebook/rocksdb/issues/3843. This PR address this issue by skipping reconstruction of restart points when blocks are known to be compressed. Somehow the restart points can be read directly when Snappy is used and some tests (for example https://github.com/facebook/rocksdb/blob/master/db/db_block_cache_test.cc#L196) expects blocks to be fully constructed even when Snappy compression is used, so here we keep the restart point logic for Snappy. Closes https://github.com/facebook/rocksdb/pull/3996 Differential Revision: D8416186 Pulled By: miasantreble fbshipit-source-id: 002c0b62b9e5d89fb7736563d354ce0023c8cb28		6 years ago
..
builder.cc	Don't generate a notification for a 0 size SST (#4003)	6 years ago
builder.h	Move prefix_extractor to MutableCFOptions	7 years ago
c.cc	add c api rocksdb_sstfilewriter_file_size	7 years ago
c_test.c	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
column_family.cc	Skip deleted WALs during recovery	7 years ago
column_family.h	Add max_subcompactions as a compaction option	7 years ago
column_family_test.cc	Extend some tests to format_version=3 (#3942)	7 years ago
compact_files_test.cc	fix memory leak in two_level_iterator	7 years ago
compacted_db_impl.cc	Move prefix_extractor to MutableCFOptions	7 years ago
compacted_db_impl.h	Comment out unused variables	7 years ago
compaction.cc	MaxFileSizeForLevel: adjust max_file_size for dynamic level compaction	7 years ago
compaction.h	MaxFileSizeForLevel: adjust max_file_size for dynamic level compaction	7 years ago
compaction_iteration_stats.h	add counter for deletion dropping optimization	7 years ago
compaction_iterator.cc	Blob DB: Improve FIFO eviction	7 years ago
compaction_iterator.h	Comment out unused variables	7 years ago
compaction_iterator_test.cc	Comment out unused variables	7 years ago
compaction_job.cc	Delay verify compaction output table (#3979)	6 years ago
compaction_job.h	MaxFileSizeForLevel: adjust max_file_size for dynamic level compaction	7 years ago
compaction_job_stats_test.cc	fix memory leak in two_level_iterator	7 years ago
compaction_job_test.cc	Add max_subcompactions as a compaction option	7 years ago
compaction_picker.cc	Check conflict at output level in CompactFiles (#3926)	7 years ago
compaction_picker.h	Delete triggered compaction for universal style	7 years ago
compaction_picker_test.cc	Delete triggered compaction for universal style	7 years ago
compaction_picker_universal.cc	Delete triggered compaction for universal style	7 years ago
compaction_picker_universal.h	Delete triggered compaction for universal style	7 years ago
comparator_db_test.cc	run make format for PR 3838 (#3954)	7 years ago
convenience.cc	Move prefix_extractor to MutableCFOptions	7 years ago
corruption_test.cc	Change and clarify the relationship between Valid(), status() and Seek*() for all iterators. Also fix some bugs	7 years ago
cuckoo_table_db_test.cc	fix memory leak in two_level_iterator	7 years ago
db_basic_test.cc	Disallow compactions if there isn't enough free space	7 years ago
db_blob_index_test.cc	fix lite build	7 years ago
db_block_cache_test.cc	LRUCache midpoint insertion	7 years ago
db_bloom_filter_test.cc	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
db_compaction_filter_test.cc	Remove tests from ROCKSDB_VALGRIND_RUN	7 years ago
db_compaction_test.cc	Check conflict at output level in CompactFiles (#3926)	7 years ago
db_dynamic_level_test.cc	fix memory leak in two_level_iterator	7 years ago
db_encryption_test.cc	Change RocksDB License	7 years ago
db_filesnapshot.cc	fix behavior does not match name for "IsFileDeletionsEnabled"	7 years ago
db_flush_test.cc	Skip deleted WALs during recovery	7 years ago
db_impl.cc	Add kOptionsStatistics to GetProperty() (#3966)	6 years ago
db_impl.h	Add kOptionsStatistics to GetProperty() (#3966)	6 years ago
db_impl_compaction_flush.cc	Bottommost level-based compactions in bottom-pri pool	7 years ago
db_impl_debug.cc	Pass manual_wal_flush also to the first wal file	7 years ago
db_impl_experimental.cc	Inform caller when rocksdb is stalling writes	7 years ago
db_impl_files.cc	DBImpl::FindObsoleteFiles() not to call GetChildren() on the same path	7 years ago
db_impl_open.cc	Pass manual_wal_flush also to the first wal file	7 years ago
db_impl_readonly.cc	Move prefix_extractor to MutableCFOptions	7 years ago
db_impl_readonly.h	allowing CompactFiles to return new file names	7 years ago
db_impl_write.cc	fix deadlock with enable_pipelined_write=true and max_successive_merges > 0	7 years ago
db_info_dumper.cc	Change RocksDB License	7 years ago
db_info_dumper.h	Change RocksDB License	7 years ago
db_inplace_update_test.cc	Change RocksDB License	7 years ago
db_io_failure_test.cc	Fix LITE unit tests	7 years ago
db_iter.cc	Move prefix_extractor to MutableCFOptions	7 years ago
db_iter.h	Move prefix_extractor to MutableCFOptions	7 years ago
db_iter_stress_test.cc	Move prefix_extractor to MutableCFOptions	7 years ago
db_iter_test.cc	Fix regression bug of Prev() with upper bound (#3989)	6 years ago
db_iterator_test.cc	Fix regression bug of Prev() with upper bound (#3989)	6 years ago
db_log_iter_test.cc	fix memory leak in two_level_iterator	7 years ago
db_memtable_test.cc	Comment out unused variables	7 years ago
db_merge_operator_test.cc	Fix TSAN timeout in MergeOperatorPinningTest.Randomized/x test	7 years ago
db_options_test.cc	PersistRocksDBOptions() to use WritableFileWriter	7 years ago
db_properties_test.cc	Add kOptionsStatistics to GetProperty() (#3966)	6 years ago
db_range_del_test.cc	Add max_subcompactions as a compaction option	7 years ago
db_sst_test.cc	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
db_statistics_test.cc	Change RocksDB License	7 years ago
db_table_properties_test.cc	fix deletion-triggered compaction in table builder	7 years ago
db_tailing_iter_test.cc	fix memory leak in two_level_iterator	7 years ago
db_test.cc	Remove tests from ROCKSDB_VALGRIND_RUN	7 years ago
db_test2.cc	Copy Get() result when file reads use mmap	7 years ago
db_test_util.cc	Extend format 3 to partitioned index/filters (#3958)	7 years ago
db_test_util.h	Extend some tests to format_version=3 (#3942)	7 years ago
db_universal_compaction_test.cc	Udpate db_universal_compaction_test according to PR #3970 (#3995)	6 years ago
db_wal_test.cc	Skip deleted WALs during recovery	7 years ago
db_write_test.cc	Suppress tsan lock-order-inversion on FlushWAL	7 years ago
dbformat.cc	add kEntryRangeDeletion	7 years ago
dbformat.h	Imporve perf of random read and insert compare by suggesting inlining to the compiler	7 years ago
dbformat_test.cc	Change RocksDB License	7 years ago
deletefile_test.cc	fix memory leak in two_level_iterator	7 years ago
event_helpers.cc	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
event_helpers.h	Change RocksDB License	7 years ago
experimental.cc	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
external_sst_file_basic_test.cc	optimize file ingestion checks for range deletion overlap	7 years ago
external_sst_file_ingestion_job.cc	Move prefix_extractor to MutableCFOptions	7 years ago
external_sst_file_ingestion_job.h	Move prefix_extractor to MutableCFOptions	7 years ago
external_sst_file_test.cc	Skip deleted WALs during recovery	7 years ago
fault_injection_test.cc	Split FaultInjectionTest.FaultTest to avoid timeout	7 years ago
file_indexer.cc	Change RocksDB License	7 years ago
file_indexer.h	Change RocksDB License	7 years ago
file_indexer_test.cc	Comment out unused variables	7 years ago
filename_test.cc	Change RocksDB License	7 years ago
flush_job.cc	Skip deleted WALs during recovery	7 years ago
flush_job.h	Skip deleted WALs during recovery	7 years ago
flush_job_test.cc	Skip deleted WALs during recovery	7 years ago
flush_scheduler.cc	Change RocksDB License	7 years ago
flush_scheduler.h	Change RocksDB License	7 years ago
forward_iterator.cc	Move prefix_extractor to MutableCFOptions	7 years ago
forward_iterator.h	Comment out unused variables	7 years ago
forward_iterator_bench.cc	fix gflags namespace	7 years ago
internal_stats.cc	Add kOptionsStatistics to GetProperty() (#3966)	6 years ago
internal_stats.h	Add kOptionsStatistics to GetProperty() (#3966)	6 years ago
job_context.h	Introduce and use the option to disable stall notifications structures	7 years ago
listener_test.cc	fix some text in comments.	7 years ago
log_format.h	Change RocksDB License	7 years ago
log_reader.cc	Change RocksDB License	7 years ago
log_reader.h	Suppress lint in old files	7 years ago
log_test.cc	Use nullptr instead of NULL / 0 more consistently.	7 years ago
log_writer.cc	Pass manual_wal_flush also to the first wal file	7 years ago
log_writer.h	Pass manual_wal_flush also to the first wal file	7 years ago
logs_with_prep_tracker.cc	Skip deleted WALs during recovery	7 years ago
logs_with_prep_tracker.h	Skip deleted WALs during recovery	7 years ago
malloc_stats.cc	Disallow compactions if there isn't enough free space	7 years ago
malloc_stats.h	Change RocksDB License	7 years ago
managed_iterator.cc	Change and clarify the relationship between Valid(), status() and Seek*() for all iterators. Also fix some bugs	7 years ago
managed_iterator.h	Change and clarify the relationship between Valid(), status() and Seek*() for all iterators. Also fix some bugs	7 years ago
manual_compaction_test.cc	Speedup ManualCompactionTest.Test	7 years ago
memtable.cc	Move prefix_extractor to MutableCFOptions	7 years ago
memtable.h	InlineSkiplist: don't decode keys unnecessarily during comparisons	7 years ago
memtable_list.cc	Skip deleted WALs during recovery	7 years ago
memtable_list.h	Skip deleted WALs during recovery	7 years ago
memtable_list_test.cc	Skip deleted WALs during recovery	7 years ago
merge_context.h	Change RocksDB License	7 years ago
merge_helper.cc	WritePrepared Txn: Support merge operator	7 years ago
merge_helper.h	WritePrepared Txn: Support merge operator	7 years ago
merge_helper_test.cc	Change RocksDB License	7 years ago
merge_operator.cc	Change RocksDB License	7 years ago
merge_test.cc	Comment out unused variables	7 years ago
obsolete_files_test.cc	fix memory leak in two_level_iterator	7 years ago
options_file_test.cc	fix memory leak in two_level_iterator	7 years ago
perf_context_test.cc	Improve write time breakdown stats	7 years ago
pinned_iterators_manager.h	Change RocksDB License	7 years ago
plain_table_db_test.cc	Should only decode restart points for uncompressed blocks (#3996)	6 years ago
pre_release_callback.h	Fix pre_release callback argument list.	7 years ago
prefix_test.cc	fix memory leak in two_level_iterator	7 years ago
range_del_aggregator.cc	Assert keys/values pinned by range deletion meta-block iterators	7 years ago
range_del_aggregator.h	Recommit "Avoid adding tombstones of the same file to RangeDelAggregator multiple times"	7 years ago
range_del_aggregator_test.cc	optimize file ingestion checks for range deletion overlap	7 years ago
read_callback.h	write-prepared txn: call IsInSnapshot	7 years ago
repair.cc	Move prefix_extractor to MutableCFOptions	7 years ago
repair_test.cc	fix memory leak in two_level_iterator	7 years ago
snapshot_checker.h	Comment out unused variables	7 years ago
snapshot_impl.cc	Change RocksDB License	7 years ago
snapshot_impl.h	WritePrepared Txn: smallest_prepare optimization	7 years ago
table_cache.cc	Move prefix_extractor to MutableCFOptions	7 years ago
table_cache.h	Move prefix_extractor to MutableCFOptions	7 years ago
table_properties_collector.cc	Comment out unused variables	7 years ago
table_properties_collector.h	Comment out unused variables	7 years ago
table_properties_collector_test.cc	Should only decode restart points for uncompressed blocks (#3996)	6 years ago
transaction_log_impl.cc	Comment out unused variables	7 years ago
transaction_log_impl.h	WritePrepared Txn: Refactor conf params	7 years ago
version_builder.cc	Delay verify compaction output table (#3979)	6 years ago
version_builder.h	Move prefix_extractor to MutableCFOptions	7 years ago
version_builder_test.cc	Change RocksDB License	7 years ago
version_edit.cc	Specify the underlying type of enums.	7 years ago
version_edit.h	Skip deleted WALs during recovery	7 years ago
version_edit_test.cc	Skip deleted WALs during recovery	7 years ago
version_set.cc	Should only decode restart points for uncompressed blocks (#3996)	6 years ago
version_set.h	Move prefix_extractor to MutableCFOptions	7 years ago
version_set_test.cc	Comment out unused variables	7 years ago
wal_manager.cc	Fix memleak when DB::DeleteFile()	7 years ago
wal_manager.h	Fix memleak when DB::DeleteFile()	7 years ago
wal_manager_test.cc	fix memory leak in two_level_iterator	7 years ago
write_batch.cc	WritePrepared Txn: enable TryAgain for duplicates at the end of the batch	7 years ago
write_batch_base.cc	Change RocksDB License	7 years ago
write_batch_internal.h	Fix some typos in comments and docs.	7 years ago
write_batch_test.cc	Comment out unused variables	7 years ago
write_callback.h	Change RocksDB License	7 years ago
write_callback_test.cc	fix memory leak in two_level_iterator	7 years ago
write_controller.cc	Change RocksDB License	7 years ago
write_controller.h	Change RocksDB License	7 years ago
write_controller_test.cc	Change RocksDB License	7 years ago
write_thread.cc	Avoid sleep in DBTest.GroupCommitTest to fix flakiness	7 years ago
write_thread.h	WritePrepared Txn: Duplicate Keys, Txn Part	7 years ago