2.8 KiB
BSBM
The Berlin SPARQL Benchmark (BSBM) is a simple SPARQL benchmark.
It provides a dataset generator and multiple set of queries grouped by "use cases".
Results
We compare here Oxigraph with some existing SPARQL implementations (Blazegraph, Virtuoso and GraphDB).
The dataset used in the following charts is generated with 10k "products" (see its spec). It leads to the creation of 3.5M triples. It has been executed on a PrevailPro P3000 with 32GB of RAM. The tests have been executed with a concurrency factor of 5 (i.e. at most 5 queries are send at the same time to the server).
Explore
The explore use case is composed of 11 queries that do simple data retrieval.
Query 6 existed in previous versions of the benchmark but is now removed.
Explore and update
The explore and update use case is composed of the 2 operations of the update use case (INSERT DATA
and DELETE WHERE
) and the 11 queries of the explore use case and the .
The first two char elements (1 and 2) are the 2 updates and the other (3 to 14) are the 11 queries.
How to reproduce the benchmark
The code of the benchmark is in the bsbm-tools
submodule. You should pull it with a git submodule update
before running the benchmark.
To run the benchmark for Oxigraph run bash bsbm_oxigraph.sh
. It will compile the current Oxigraph code and run the benchmark against it.
You could tweak the number of products in the dataset using the environment variables at the beginning of bsbm_oxigraph.sh
.
To generate the plots run python3 bsbsm-plot.py
.
Scripts are also provided for the other benchmarks (bsbm_blazegraph.sh
, bsbm_graphdb.sh
and bsbm_virtuoso.sh
).