fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Zhichao Cao 4369f2c7bb Checksum for each SST file and stores in MANIFEST (#6216) ... Summary: In the current code base, RocksDB generate the checksum for each block and verify the checksum at usage. Current PR enable SST file checksum. After a SST file is generated by Flush or Compaction, RocksDB generate the SST file checksum and store the checksum value and checksum method name in the vs_info and MANIFEST as part for the FileMetadata. Added the enable_sst_file_checksum to Options to enable or disable file checksum. Added sst_file_checksum to Options such that user can plugin their own SST file checksum calculate method via overriding the SstFileChecksum class. The checksum information inlcuding uint32_t checksum value and a checksum name (string). A new tool is added to LDB such that user can dump out a list of file checksum information from MANIFEST. If user enables the file checksum but does not provide the sst_file_checksum instance, RocksDB will use the default crc32checksum implemented in table/sst_file_checksum_crc32c.h Pull Request resolved: https://github.com/facebook/rocksdb/pull/6216 Test Plan: Added the testing case in table_test and ldb_cmd_test to verify checksum is correct in different level. Pass make asan_check. Differential Revision: D19171461 Pulled By: zhichao-cao fbshipit-source-id: b2e53479eefc5bb0437189eaa1941670e5ba8b87		4 years ago
..
adaptive	Organizing rocksdb/table directory by format	5 years ago
block_based	Checksum for each SST file and stores in MANIFEST (#6216)	4 years ago
cuckoo	Checksum for each SST file and stores in MANIFEST (#6216)	4 years ago
plain	Checksum for each SST file and stores in MANIFEST (#6216)	4 years ago
block_fetcher.cc	Divide file_reader_writer.h and .cc (#5803)	5 years ago
block_fetcher.h	Combine the read-ahead logic for user reads and compaction reads (#5431)	5 years ago
cleanable_test.cc	Move test related files under util/ to test_util/ (#5377)	5 years ago
format.cc	Add new persistent 64-bit hash (#5984)	5 years ago
format.h	New Bloom filter implementation for full and partitioned filters (#6007)	5 years ago
get_context.cc	New API to get all merge operands for a Key (#5604)	5 years ago
get_context.h	Fix local includes	5 years ago
internal_iterator.h	Revert "Merging iterator to avoid child iterator reseek for some cases (#5286)" (#5871)	5 years ago
iter_heap.h	Make InternalKeyComparator final and directly use it in merging iterator	7 years ago
iterator.cc	Add an option to put first key of each sst block in the index (#5289)	5 years ago
iterator_wrapper.h	Revert "Merging iterator to avoid child iterator reseek for some cases (#5286)" (#5871)	5 years ago
merger_test.cc	Move test related files under util/ to test_util/ (#5377)	5 years ago
merging_iterator.cc	Fix a timer bug in MergingIterator::Seek() caused by #5871 (#5874)	5 years ago
merging_iterator.h	Index value delta encoding (#3983)	6 years ago
meta_blocks.cc	Divide file_reader_writer.h and .cc (#5803)	5 years ago
meta_blocks.h	Fix comment of function NotifyCollectTableCollectorsOnFinish (#5738)	5 years ago
mock_table.cc	Introduce a new storage specific Env API (#5761)	5 years ago
mock_table.h	Checksum for each SST file and stores in MANIFEST (#6216)	4 years ago
multiget_context.h	Batched MultiGet API for multiple column families (#5816)	5 years ago
persistent_cache_helper.cc	Organizing rocksdb/table directory by format	5 years ago
persistent_cache_helper.h	Change RocksDB License	7 years ago
persistent_cache_options.h	Change RocksDB License	7 years ago
scoped_arena_iterator.h	Change RocksDB License	7 years ago
sst_file_reader.cc	Introduce a new storage specific Env API (#5761)	5 years ago
sst_file_reader_test.cc	simplify include directive involving inttypes (#5402)	5 years ago
sst_file_writer.cc	Improve error msg for SstFileWriter Merge (#6261)	5 years ago
sst_file_writer_collectors.h	Fix SstFileReader not able to open ingested file (#5097)	5 years ago
table_builder.h	Checksum for each SST file and stores in MANIFEST (#6216)	4 years ago
table_properties.cc	Organizing rocksdb/table directory by format	5 years ago
table_properties_internal.h	Index value delta encoding (#3983)	6 years ago
table_reader.h	Apply formatter to recent 200+ commits. (#5830)	5 years ago
table_reader_bench.cc	Introduce a new storage specific Env API (#5761)	5 years ago
table_reader_caller.h	Add more callers for table reader. (#5454)	5 years ago
table_test.cc	Checksum for each SST file and stores in MANIFEST (#6216)	4 years ago
two_level_iterator.cc	Add an option to put first key of each sst block in the index (#5289)	5 years ago
two_level_iterator.h	Add an option to put first key of each sst block in the index (#5289)	5 years ago