Fork of https://github.com/oxigraph/oxigraph.git for the purpose of NextGraph project
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
oxigraph/bench
Yaroslav Halchenko a3294a8abd Remove unused JAVA_HOME. If to be used by child processes -- should have been exported 1 year ago
..
bsbm-tools@59d0a8a605 Makes easier to run benchmarks by adding BSBM as a submodule 5 years ago
README.md Releases v0.3.0-beta.1 2 years ago
bsbm-plot.py Adds Oxigraph 0.2 to BSBM benchmark 2 years ago
bsbm.explore.svg Adds Oxigraph 0.2 to BSBM benchmark 2 years ago
bsbm.exploreAndUpdate.svg Adds Oxigraph 0.2 to BSBM benchmark 2 years ago
bsbm_blazegraph.sh Run bench/bsbm_ with set -eu to exit right away if something abnormal happens 1 year ago
bsbm_graphdb.sh Remove unused JAVA_HOME. If to be used by child processes -- should have been exported 1 year ago
bsbm_jena.sh Run bench/bsbm_ with set -eu to exit right away if something abnormal happens 1 year ago
bsbm_oxigraph.sh Run bench/bsbm_ with set -eu to exit right away if something abnormal happens 1 year ago
bsbm_rdf4j.sh Run bench/bsbm_ with set -eu to exit right away if something abnormal happens 1 year ago
bsbm_virtuoso.sh Run bench/bsbm_ with set -eu to exit right away if something abnormal happens 1 year ago
explanation_to_flamegraph.py Flamegraph: allows to use the inferno generator tool 1 year ago
explanation_to_trace.py Exposes the query profiler to the CLI app 1 year ago

README.md

BSBM

The Berlin SPARQL Benchmark (BSBM) is a simple SPARQL benchmark.

It provides a dataset generator and multiple sets of queries grouped by "use cases".

Results

We compare here Oxigraph 0.2 and 0.3 with some existing SPARQL implementations (Blazegraph, GraphDB, Jena, and Virtuoso).

The dataset used in the following charts is generated with 100k "products" (see its spec). It leads to the creation of 35M triples. It has been executed on a PrevailPro P3000 with 32GB of RAM. The tests have been executed with a concurrency factor of 16 (i.e. at most 16 queries are sent at the same time to the server).

Beware, the graph y axis is in log scale to properly display on the same graph systems with very different speed behaviors.

Explore

The explore use case is composed of 11 queries that do simple data retrieval.

Query 6 existed in previous versions of the benchmark but is now removed.

explore use case results

Explore and update

The explore and update use case is composed of the 2 operations of the update use case (INSERT DATA and DELETE WHERE) and the 11 queries of the explore use case.

The first two elements (1 and 2) are the 2 updates and the others (3 to 14) are the 11 queries.

explore use case results

How to reproduce the benchmark

The code of the benchmark is in the bsbm-tools submodule. You should pull it with a git submodule update before running the benchmark.

To run the benchmark for Oxigraph run bash bsbm_oxigraph.sh. It will compile the current Oxigraph code and run the benchmark against it. You can tweak the number of products in the dataset and the number of concurrent requests using the environment variables at the beginning of bsbm_oxigraph.sh.

To generate the plots run python3 bsbsm-plot.py.

Scripts are also provided for the other systems (bsbm_blazegraph.sh, bsbm_graphdb.sh, bsbm_jena.sh and bsbm_virtuoso.sh).