fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Andrew Kryczka a4fb1f8c04 Add crash-recovery correctness check to db_stress ... Summary: Previously, our `db_stress` tool held the expected state of the DB in-memory, so after crash-recovery, there was no way to verify data correctness. This PR adds an option, `--expected_values_file`, which specifies a file holding the expected values. In black-box testing, the `db_stress` process can be killed arbitrarily, so updates to the `--expected_values_file` must be atomic. We achieve this by `mmap`ing the file and relying on `std::atomic<uint32_t>` for atomicity. Actually this doesn't provide a total guarantee on what we want as `std::atomic<uint32_t>` could, in theory, be translated into multiple stores surrounded by a mutex. We can verify our assumption by looking at `std::atomic::is_always_lock_free`. For the `mmap`'d file, we didn't have an existing way to expose its contents as a raw memory buffer. This PR adds it in the `Env::NewMemoryMappedFileBuffer` function, and `MemoryMappedFileBuffer` class. `db_crashtest.py` is updated to use an expected values file for black-box testing. On the first iteration (when the DB is created), an empty file is provided as `db_stress` will populate it when it runs. On subsequent iterations, that same filename is provided so `db_stress` can check the data is as expected on startup. Closes https://github.com/facebook/rocksdb/pull/3629 Differential Revision: D7463144 Pulled By: ajkr fbshipit-source-id: c8f3e82c93e045a90055e2468316be155633bd8b		7 years ago
..
utilities	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
advanced_options.h	Level Compaction with TTL	7 years ago
c.h	C API for PerfContext	7 years ago
cache.h	Comment out unused variables	7 years ago
cleanable.h	Fix some typos in comments and docs.	7 years ago
compaction_filter.h	Comment out unused variables	7 years ago
compaction_job_stats.h	Fix some typos in comments and docs.	7 years ago
comparator.h	Move ~Comparator define to comparator.h	7 years ago
convenience.h	Delete files in multiple ranges at once	7 years ago
db.h	Add block cache related DB properties	7 years ago
db_bench_tool.h	Change RocksDB License	8 years ago
db_dump_tool.h	Fix some typos in comments and docs.	7 years ago
env.h	Add crash-recovery correctness check to db_stress	7 years ago
env_encryption.h	Fix some typos in comments and docs.	7 years ago
experimental.h	Change RocksDB License	8 years ago
filter_policy.h	Comment out unused variables	7 years ago
flush_block_policy.h	Change RocksDB License	8 years ago
iostats_context.h	Change RocksDB License	8 years ago
iterator.h	fix-typo: add missing periods	7 years ago
ldb_tool.h	Change RocksDB License	8 years ago
listener.h	Improve visibility into the reasons for compaction.	7 years ago
memtablerep.h	InlineSkiplist: don't decode keys unnecessarily during comparisons	7 years ago
merge_operator.h	Update comments about MergeOperator::AllowSingleOperand	7 years ago
metadata.h	Fix coverity issues in include/rocksdb	7 years ago
options.h	Propagate fill_cache config to partitioned index iterator	7 years ago
perf_context.h	Improve write time breakdown stats	7 years ago
perf_level.h	Change RocksDB License	8 years ago
persistent_cache.h	Change RocksDB License	8 years ago
rate_limiter.h	Comment out unused variables	7 years ago
slice.h	Fix some typos in comments and docs.	7 years ago
slice_transform.h	Fix some typos in comments and docs.	7 years ago
snapshot.h	Change RocksDB License	8 years ago
sst_dump_tool.h	Change RocksDB License	8 years ago
sst_file_manager.h	Fixed small typos	7 years ago
sst_file_writer.h	Fix some typos in comments and docs.	7 years ago
statistics.h	Add a stat for MultiGet keys found, update memtable hit/miss stats	7 years ago
status.h	Disallow compactions if there isn't enough free space	7 years ago
table.h	Improve the comment on TableFactory::NewTableReader()	7 years ago
table_properties.h	Fix some typos in comments and docs.	7 years ago
thread_status.h	fix ThreadStatus for bottom-pri compaction threads	7 years ago
threadpool.h	Change RocksDB License	8 years ago
transaction_log.h	Change RocksDB License	8 years ago
types.h	add kEntryRangeDeletion	7 years ago
universal_compaction.h	Change RocksDB License	8 years ago
version.h	Update history for future 5.13 release	7 years ago
wal_filter.h	Comment out unused variables	7 years ago
write_batch.h	Fix some typos in comments and docs.	7 years ago
write_batch_base.h	Fix some typos in comments and docs.	7 years ago
write_buffer_manager.h	Change RocksDB License	8 years ago