fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Zhongyi Xie 1cbc96d236 FlushReason improvement ... Summary: Right now flush reason "SuperVersion Change" covers a few different scenarios which is a bit vague. For example, the following db_bench job should trigger "Write Buffer Full" > $ TEST_TMPDIR=/dev/shm ./db_bench -benchmarks=fillrandom -write_buffer_size=1048576 -target_file_size_base=1048576 -max_bytes_for_level_base=4194304 $ grep 'flush_reason' /dev/shm/dbbench/LOG ... 2018/03/06-17:30:42.543638 7f2773b99700 EVENT_LOG_v1 {"time_micros": 1520386242543634, "job": 192, "event": "flush_started", "num_memtables": 1, "num_entries": 7006, "num_deletes": 0, "memory_usage": 1018024, "flush_reason": "SuperVersion Change"} 2018/03/06-17:30:42.569541 7f2773b99700 EVENT_LOG_v1 {"time_micros": 1520386242569536, "job": 193, "event": "flush_started", "num_memtables": 1, "num_entries": 7006, "num_deletes": 0, "memory_usage": 1018104, "flush_reason": "SuperVersion Change"} 2018/03/06-17:30:42.596396 7f2773b99700 EVENT_LOG_v1 {"time_micros": 1520386242596392, "job": 194, "event": "flush_started", "num_memtables": 1, "num_entries": 7008, "num_deletes": 0, "memory_usage": 1018048, "flush_reason": "SuperVersion Change"} 2018/03/06-17:30:42.622444 7f2773b99700 EVENT_LOG_v1 {"time_micros": 1520386242622440, "job": 195, "event": "flush_started", "num_memtables": 1, "num_entries": 7006, "num_deletes": 0, "memory_usage": 1018104, "flush_reason": "SuperVersion Change"} With the fix: > 2018/03/19-14:40:02.341451 7f11dc257700 EVENT_LOG_v1 {"time_micros": 1521495602341444, "job": 98, "event": "flush_started", "num_memtables": 1, "num_entries": 7009, "num_deletes": 0, "memory_usage": 1018008, "flush_reason": "Write Buffer Full"} 2018/03/19-14:40:02.379655 7f11dc257700 EVENT_LOG_v1 {"time_micros": 1521495602379642, "job": 100, "event": "flush_started", "num_memtables": 1, "num_entries": 7006, "num_deletes": 0, "memory_usage": 1018016, "flush_reason": "Write Buffer Full"} 2018/03/19-14:40:02.418479 7f11dc257700 EVENT_LOG_v1 {"time_micros": 1521495602418474, "job": 101, "event": "flush_started", "num_memtables": 1, "num_entries": 7009, "num_deletes": 0, "memory_usage": 1018104, "flush_reason": "Write Buffer Full"} 2018/03/19-14:40:02.455084 7f11dc257700 EVENT_LOG_v1 {"time_micros": 1521495602455079, "job": 102, "event": "flush_started", "num_memtables": 1, "num_entries": 7009, "num_deletes": 0, "memory_usage": 1018048, "flush_reason": "Write Buffer Full"} 2018/03/19-14:40:02.492293 7f11dc257700 EVENT_LOG_v1 {"time_micros": 1521495602492288, "job": 104, "event": "flush_started", "num_memtables": 1, "num_entries": 7007, "num_deletes": 0, "memory_usage": 1018056, "flush_reason": "Write Buffer Full"} 2018/03/19-14:40:02.528720 7f11dc257700 EVENT_LOG_v1 {"time_micros": 1521495602528715, "job": 105, "event": "flush_started", "num_memtables": 1, "num_entries": 7006, "num_deletes": 0, "memory_usage": 1018104, "flush_reason": "Write Buffer Full"} 2018/03/19-14:40:02.566255 7f11dc257700 EVENT_LOG_v1 {"time_micros": 1521495602566238, "job": 107, "event": "flush_started", "num_memtables": 1, "num_entries": 7009, "num_deletes": 0, "memory_usage": 1018112, "flush_reason": "Write Buffer Full"} Closes https://github.com/facebook/rocksdb/pull/3627 Differential Revision: D7328772 Pulled By: miasantreble fbshipit-source-id: 67c94065fbdd36930f09930aad0aaa6d2c152bb8		7 years ago
..
utilities	allowing CompactFiles to return new file names	7 years ago
advanced_options.h	Fix some typos in comments and docs.	7 years ago
c.h	C API for PerfContext	7 years ago
cache.h	Comment out unused variables	7 years ago
cleanable.h	Fix some typos in comments and docs.	7 years ago
compaction_filter.h	Comment out unused variables	7 years ago
compaction_job_stats.h	Fix some typos in comments and docs.	7 years ago
comparator.h	Move ~Comparator define to comparator.h	7 years ago
convenience.h	Delete files in multiple ranges at once	7 years ago
db.h	allowing CompactFiles to return new file names	7 years ago
db_bench_tool.h	Change RocksDB License	7 years ago
db_dump_tool.h	Fix some typos in comments and docs.	7 years ago
env.h	Fix some typos in comments and docs.	7 years ago
env_encryption.h	Fix some typos in comments and docs.	7 years ago
experimental.h	Change RocksDB License	7 years ago
filter_policy.h	Comment out unused variables	7 years ago
flush_block_policy.h	Change RocksDB License	7 years ago
iostats_context.h	Change RocksDB License	7 years ago
iterator.h	Add rocksdb.iterator.internal-key property	7 years ago
ldb_tool.h	Change RocksDB License	7 years ago
listener.h	FlushReason improvement	7 years ago
memtablerep.h	Fix some typos in comments and docs.	7 years ago
merge_operator.h	Fix some typos in comments and docs.	7 years ago
metadata.h	Fix coverity issues in include/rocksdb	7 years ago
options.h	Add delay before flush in CompactRange to avoid write stalling	7 years ago
perf_context.h	Add lock wait time as a perf context counter	7 years ago
perf_level.h	Change RocksDB License	7 years ago
persistent_cache.h	Change RocksDB License	7 years ago
rate_limiter.h	Comment out unused variables	7 years ago
slice.h	Fix some typos in comments and docs.	7 years ago
slice_transform.h	Fix some typos in comments and docs.	7 years ago
snapshot.h	Change RocksDB License	7 years ago
sst_dump_tool.h	Change RocksDB License	7 years ago
sst_file_manager.h	SstFileManager: add bytes_max_delete_chunk	7 years ago
sst_file_writer.h	Fix some typos in comments and docs.	7 years ago
statistics.h	Adding stat to count cancelled compactions	7 years ago
status.h	Disallow compactions if there isn't enough free space	7 years ago
table.h	Fix some typos in comments and docs.	7 years ago
table_properties.h	Fix some typos in comments and docs.	7 years ago
thread_status.h	fix ThreadStatus for bottom-pri compaction threads	7 years ago
threadpool.h	Change RocksDB License	7 years ago
transaction_log.h	Change RocksDB License	7 years ago
types.h	Fix WriteBatch rep_ format for RangeDeletion records	7 years ago
universal_compaction.h	Change RocksDB License	7 years ago
version.h	Update history for future 5.13 release	7 years ago
wal_filter.h	Comment out unused variables	7 years ago
write_batch.h	Fix some typos in comments and docs.	7 years ago
write_batch_base.h	Fix some typos in comments and docs.	7 years ago
write_buffer_manager.h	Change RocksDB License	7 years ago