fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Levi Tamasi 8df334342e Use the write amplification value calculated by RocksDB in benchmark.sh (#8915) ... Summary: Currently, `benchmark.sh` computes write amplification itself; the patch changes the script to use the value calculated by RocksDB (which is printed as part of the periodic statistics). This also has the benefit of being correct for BlobDB as well, since it also considers the amount of data written to blob files. Pull Request resolved: https://github.com/facebook/rocksdb/pull/8915 Test Plan: ``` DB_DIR=/tmp/rocksdbtest/dbbench/ WAL_DIR=/tmp/rocksdbtest/dbbench/ NUM_KEYS=20000000 NUM_THREADS=32 tools/benchmark.sh overwrite --enable_blob_files=1 --enable_blob_garbage_collection=1 ... ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 43.93 MB 0.5 0.3 0.0 0.3 0.5 0.3 0.0 1.0 1.3 59.9 201.35 101.88 109 1.847 22M 499K 0.0 11.2 L4 4/4 244.03 MB 0.0 11.4 0.3 1.6 1.6 0.0 0.0 1.1 50.6 49.3 231.10 288.84 7 33.014 156M 26M 9.5 9.5 L5 36/0 3.28 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 47/9 3.56 GB 0.0 11.7 0.3 1.8 2.2 0.3 0.0 2.0 27.6 54.3 432.45 390.72 116 3.728 179M 26M 9.5 20.8 Int 0/0 0.00 KB 0.0 3.5 0.1 0.5 0.6 0.1 0.0 2.2 31.2 55.6 115.01 109.53 29 3.966 51M 7353K 2.9 5.6 ... Completed overwrite (ID: ) in 289 seconds ops/sec mb/sec Size-GB L0_GB Sum_GB W-Amp W-MB/s usec/op p50 p75 p99 p99.9 p99.99 Uptime Stall-time Stall% Test Date Version Job-ID 111784 44.8 0.0 0.5 2.2 2.0 9.2 285.9 215.3 264.4 1232 13299 23310 243 00:00:0.000 0.0 overwrite.t32.s0 2021-09-14T11:58:26.000-07:00 6.24 ``` Reviewed By: zhichao-cao Differential Revision: D30940352 Pulled By: ltamasi fbshipit-source-id: ae7f5cd5440c8529788dda043266121fc2be0853		3 years ago
..
advisor	Update branch as "main" in tools/advisor/README.md (#8744)	3 years ago
block_cache_analyzer	Make TraceRecord and Replayer public (#8611)	3 years ago
dump	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
rdb	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
CMakeLists.txt	Mark dependencies as PRIVATE and fix missing dependencies in tools. (#6790)	5 years ago
Dockerfile	adding docker build script and dockerfile	10 years ago
analyze_txn_stress_test.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
auto_sanity_test.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
backup_db.sh	Revamp check_format_compatible.sh (#8012)	4 years ago
benchmark.sh	Use the write amplification value calculated by RocksDB in benchmark.sh (#8915)	3 years ago
benchmark_leveldb.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
blob_dump.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
check_all_python.py	Allow missing "unversioned" python, as in CentOS 8 (#6883)	5 years ago
check_format_compatible.sh	Add 6.24 to the format compatibility checker (#8716)	3 years ago
db_bench.cc	Add (& fix) some simple source code checks (#8821)	3 years ago
db_bench_tool.cc	Make Statistics a Customizable Class (#8637)	3 years ago
db_bench_tool_test.cc	Add support for the integrated BlobDB to db_bench (#7956)	4 years ago
db_crashtest.py	Temporarily disable block-based filter when stress testing timestamp (#8703)	3 years ago
db_repl_stress.cc	Migrate away from Travis+Linux+amd64 (#7791)	4 years ago
db_sanity_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
dbench_monitor	Fix /bin/bash shebangs	7 years ago
generate_random_db.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
ingest_external_sst.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
io_tracer_parser.cc	Add IO Tracer Parser (#7333)	4 years ago
io_tracer_parser_test.cc	Fix cmake build failure with gflags (#8324)	4 years ago
io_tracer_parser_tool.cc	Add request_id in IODebugContext. (#8045)	4 years ago
io_tracer_parser_tool.h	Add IO Tracer Parser (#7333)	4 years ago
ldb.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
ldb_cmd.cc	Fix flaky, dubious LdbCmdTest::*DumpFileChecksum* (#8898)	3 years ago
ldb_cmd_impl.h	Some fixes and enhancements to `ldb repair` (#8544)	3 years ago
ldb_cmd_test.cc	Fix flaky, dubious LdbCmdTest::*DumpFileChecksum* (#8898)	3 years ago
ldb_test.py	Add list live files metadata (#8446)	3 years ago
ldb_tool.cc	Add list live files metadata (#8446)	3 years ago
pflag	Fix /bin/bash shebangs	7 years ago
reduce_levels_test.cc	Remove some unneeded code (#8736)	3 years ago
regression_test.sh	Fix regression test script (#8753)	3 years ago
restore_db.sh	Revamp check_format_compatible.sh (#8012)	4 years ago
rocksdb_dump_test.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
run_flash_bench.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
run_leveldb.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
sample-dump.dmp	First version of rocksdb_dump and rocksdb_undump.	10 years ago
simulated_hybrid_file_system.cc	Change the File System File Wrappers to std::unique_ptr (#8618)	3 years ago
simulated_hybrid_file_system.h	Change the File System File Wrappers to std::unique_ptr (#8618)	3 years ago
sst_dump.cc	Implement a new subcommand "identify" for sst_dump (#6943)	4 years ago
sst_dump_test.cc	Add CreateFrom methods to Env/FileSystem (#8174)	3 years ago
sst_dump_tool.cc	Add CreateFrom methods to Env/FileSystem (#8174)	3 years ago
trace_analyzer.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
trace_analyzer_test.cc	Simplify `TraceAnalyzer` (#8697)	3 years ago
trace_analyzer_tool.cc	Simplify `TraceAnalyzer` (#8697)	3 years ago
trace_analyzer_tool.h	Simplify `TraceAnalyzer` (#8697)	3 years ago
verify_random_db.sh	Add copyright headers per FB open-source checkup tool. (#5199)	6 years ago
write_external_sst.sh	Revamp check_format_compatible.sh (#8012)	4 years ago
write_stress.cc	Add a SystemClock class to capture the time functions of an Env (#7858)	4 years ago
write_stress_runner.py	Allow missing "unversioned" python, as in CentOS 8 (#6883)	5 years ago