fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Peter Dillinger 04db764831 Embed original file number in SST table properties (#8686) ... Summary: I very recently realized that with https://github.com/facebook/rocksdb/issues/8669 we cannot later add file numbers to external SST files (so that more can share db session ids for better uniqueness properties), because of forward compatibility. We would have a version of RocksDB that assumes session IDs are unique on external SST files and therefore can't really break that invariant in future files. This change adds a table property for "orig_file_number" which is populated by normal SST files and also external SST files generated by SstFileWriter. SstFileWriter now keeps a db_session_id for life of the object and increments its own file numbers for embedding in table properties. (They are arguably "fake" file numbers because these numbers and not embedded in the file name.) While updating block_based_table_builder, I removed several unnecessary fields from Rep, because following the pattern would have created another unnecessary field. This change also updates block_based_table_reader to use this new property when available, which means that for newer SST files, we can determine the stable/original <db_session_id,file_number> unique identifier using just the file contents, not the file name. (It's a bit complicated; detailed comments in block_based_table_reader.) Also added DB host id to properties listing by sst_dump, which could be useful in debugging. Pull Request resolved: https://github.com/facebook/rocksdb/pull/8686 Test Plan: majorly overhauled StableCacheKeys test for this change Reviewed By: zhichao-cao Differential Revision: D30457742 Pulled By: pdillinger fbshipit-source-id: 2e5ae7dddeb94fb9d8eac8a928486aed8b8cd445		3 years ago
..
plain_table_bloom.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	4 years ago
plain_table_bloom.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	4 years ago
plain_table_builder.cc	Embed original file number in SST table properties (#8686)	3 years ago
plain_table_builder.h	Embed original file number in SST table properties (#8686)	3 years ago
plain_table_factory.cc	Embed original file number in SST table properties (#8686)	3 years ago
plain_table_factory.h	Refactor: use TableBuilderOptions to reduce parameter lists (#8240)	3 years ago
plain_table_index.cc	Rename variables in ImmutableCFOptions to avoid conflicts with ImmutableDBOptions (#8227)	3 years ago
plain_table_index.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	3 years ago
plain_table_key_coding.cc	In ParseInternalKey(), include corrupt key info in Status (#7515)	4 years ago
plain_table_key_coding.h	Make db_basic_test pass assert status checked (#7452)	4 years ago
plain_table_reader.cc	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	3 years ago
plain_table_reader.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	3 years ago