oxigraph/CHANGELOG.md

[0.3.1] - 2022-04-02

Changed

• The default git branch is now main and not master (thanks to @nyurik).
• Upgrades RocksDB to v7.0.4.
• Limits the number of bulk loader threads to at most 4 (allows bigger BTree chunks and a better data layout).
• Limits the number of files opened by RocksDB to the soft file descriptor limit minus 48.

[0.3.0] - 2022-03-19

Changed

• Fixes compilation on ARM.
• Moves some lints from errors to warnings in order to avoid compilation failures on different Rust versions.

[0.3.0-rc.1] - 2022-03-14

Added

• The bulk loader now checks available memory and tries to increase its batch size to make use of it.
• The Bulk loader provides now a --lenient option to keep loading a file even if invalid data is found (works only with N-Triples and N-Quads). This behavior can be customised in the Rust API using the BulkLoader::on_parse_error method.

Changed

• Rocksdb has been upgrade to 7.0.2. It now requires a C++17 compatible compiler. This required dropping support of macOS 10.9 to 10.13.

[0.3.0-beta.4] - 2022-02-27

Added

• JS: Oxigraph NPM package is now also supporting web browsers and WebPack.
• JS: RDF term related classes now overrides the toString method.
• Python: It is now possible to directly give a file path to the parse, serialize, Store.load, Store.bulk_load and Store.dump functions.
• Python: New Store.clear_graph, Store.clear, Store.optimize and Store.flush methods.

Removed

• sophia_api traits implementation following a request of Sophia maintainer.

Changed

• SPARQL: fixes evaluation of SPARQL queries with no results but an ORDER BY clause. There should be no group in the output instead of one empty group. This behavior has been changed following this discussion.
• SPARQL: fixes SPARQL-star evaluation of nested triples with both variables and constants.
• SPARQL: if results are sorted, literals are now ordered by value, then datatype, then language tag. This ordering is considered as "implementation defined" by the SPARQL specification and is very likely to change in the future.
• Python: all costly methods now release the python GIL allowing multithreaded usages of pyoxigraph.
• Rust: SPARQL results writer now flushes the buffer at the end of the results writes. This makes their API less error-prone.
• Rust: the bulk loader API has been rewritten to allow hooking a progress indicator and set parallelism limit.
• Server: it is now possible to bulk load gzipped files.

[0.3.0-beta.3] - 2022-02-02

Changed

• Fixes a bug in the bulk_load_dataset method that was creating an invalid database.
• Server: Takes into account also URL query parameters if the send SPARQL request body is using form-urlencoded.
• Upgrades RocksDB to v0.28.2.
• Generate clean python sdist files compiling Oxigraph from scratch with the proper Cargo.lock.
• Do not push beta releases to homebrew and python stable documentation.
• Moves RocksDB binding directory to oxrocksdb-sys.

[0.3.0-beta.2] - 2022-01-29

Changed

• Fixes release on crates.io of the RocksDB bindings.

[0.3.0-beta.1] - 2022-01-29

Added

• RDF-star support. Triple is now a possible Term. Serialization formats and SPARQL support have been updated to match the latest version of the specification draft.
• Fast data bulk load with the Store bulk_load_dataset and bulk_load_graph methods and a special command line option of the server.
• It is now possible to quickly backup the database using the backup method.
• Rust: *Syntax::from_extension to easy guess a graph/dataset/sparql result format from a file extension.
• Rust: Custom SPARQL functions are now supported using QueryOptions::with_custom_function.
• Rust: Simple in-memory graph (Graph) and dataset (Dataset) data structures with canonicalization.
• Nightly build of the server binary and docker image, and of pyoxigraph wheels.
• Store operations are now transactional using the "repeatable read" isolation level: the store only exposes changes that have been "committed" (i.e. no partial writes) and the exposed state does not change for the complete duration of a read operation (e.g. a SPARQL query) or a read/write operation (e.g. a SPARQL update). the Store transaction method now allows to do read/write transactions. -RDF-star <https://w3c.github.io/rdf-star/cg-spec>_ is now supported (including serialization formats and SPARQL-star). :py:class:.Triple can now be used in :py:attr:.Triple.object, :py:attr:.Triple.object, :py:attr:.Quad.subject and :py:attr:.Quad.object.

Changed

• SPARQL: It is now possible to compare rdf:langString literals with the same language tag.
• SPARQL: The parser now validates more carefully the inputs following the SPARQL specification and test suite.
• SPARQL: Variable scoping was buggy with "FILTER EXISTS". It is now fixed.
• Rust: RDF model, SPARQL parser and SPARQL result parsers have been moved to stand-alone reusable libraries.
• Rust: HTTPS is not supported by default with the http_client option. You need to enable the native-tls or the rustls feature of the oxhttp crate to enable a TSL layer.
• Rust: The error types have been cleaned. Most of the Store methods now return a StorageError that is more descriptive than the previous std::io::Error. The new error type all implements Into<std::io::Error> for easy conversion.
• Rust: There is now a Subject struct that is the union of NamedNode, BlankNode and Triple. It is The used type of the subject field of the Triple and Quad structs.
• Rust: The SPARQL algebra is not anymore publicly exposed in the oxigraph crate. The new oxalgebra crate exposes it.
• Rust: UpdateOptions API have been rewritten. It can now be built using From<QueryOptions> or Default.
• Server: The command line API has been redesign. See the server README for more information.
• Server: The HTTP implementation is now provided by oxhttp.
• Server: The HTTP response bodies are now generated on the fly instead of being buffered.
• Python: The SledStore and MemoryStore classes have been removed in favor of the Store class.
• JS: The MemoryStore class has been renamed to Store.
• JS: The RDF/JS DataFactory interface is now implemented by the oxigraph module itself and the MemoryStore.dataFactory propery has been removed.
• The implementation of SPARQL evaluation has been improved for better performances (especially joins).
• The TLS implementation used in SPARQL HTTP calls is now rustls and not native-tls. The host system certificate registry is still used.
• Spargebra: The basic RDF terms are now the ones of the oxrdf crate.

Removed

• SledStore and MemoryStore. There is only the RocksDbStore anymore that is renamed to Store.
• oxigraph_wikibase is now stored in its own repository.
• Rust: From implementations between oxigraph terms and rio_api terms.

Many thanks to Thad Guidry, James Overton and Jeremiah who sponsored the project during the development of this version.

[0.2.5] - 2021-07-11

Added

• SPARQL 1.1 Query Results JSON Format parser.
• Python wheels for macOS are now universal2 binaries.

Changed

• The Cargo.lock file is now provided with releases to avoid compilation failures because of changes in dependencies.
• Uses clap instead of argh for the server arguments parsing.
• Upgrades PyO3 to v0.14.

[0.2.4] - 2021-04-28

Changed

• The HTTP server allows to query the union of all graphs using the union-default-graph query parameter and to use the union graph for update WHERE clauses using the using-union-graph parameter.
• Exposes Sled flush operation (useful for platforms without auto-flush like Windows or Android).
• Fixes a possible out of bound panic in SPARQL query evaluation.
• Upgrades RocksDB to 6.17.3.

[0.2.3] - 2021-04-11

Changed

• Server: Fixes HTTP content negotiation (charset constraints, failure to properly handle */*...).
• Makes Clippy 1.51 happy.

[0.2.2] - 2021-03-18

Added

• Support of XML entities to the RDF/XML parser

Changed

• Serve: Allows unsupported query parameters in HTTP SPARQL requests.
• Fixes WASM compilation bug and optimises WASM release packages.
• Fixes named graph creation inside of a SledStore transaction.

[0.2.1] - 2021-01-16

Changed

• Fixes pyoxigraph build by enforcing a given maturin version.
• Adds code to build Python wheels for MacOS and Windows.

[0.2.0] - 2021-01-07

Added

• SPARQL 1.1 Update support for Rust, Python and JavaScript. All store-like classes now provide an update method.
• SPARQL 1.1 Query Results CSV and TSV Formats serializers and TSV format parser.
• SPARQL 1.1 Graph Store HTTP Protocol partial support in oxigraph_server. This protocol is accessible under the /store path.
• The SPARQL Query and Update algebra is now public.
• The stores are now "graph aware" i.e. it is possible to create and keep empty named graphs.
• A simple built-in HTTP client. In the Rust library, is disabled by default behind the http_client feature. It powers SPARQL federation and SPARQL UPDATE LOAD operations.
• std::str::FromStr implementations to NamedNode, BlankNode, Literal, Term and Variable allowing to easily parse Turtle/SPARQL serialization of these terms.
• Optional Sled storage for oxigraph_server.

Removed

• The default_graph_uris and named_graph_uris parameters from pyoxigraph query methods.
• Python 3.5 support.
• (Memory|RocksDB|Sled)Store::prepare_query methods. It is possible to cache SPARQL query parsing using the Query::parse function and give the parsed query to the query method.

Changed

• Loading data into oxigraph_server is now possible using /store and not anymore using /. For example, you should use now curl -f -X POST -H 'Content-Type:application/n-quads' --data-binary "@MY_FILE.nq" http://localhost:7878/store to add the N-Quads file MY_FILE.nt to the server dataset.
• Fixes evaluation of MONTH() and DAY() functions on the xsd:date values.
• Variable::new now validates the variable name.
• (Memory|RocksDB|Sled)Store::query does not have an option parameter anymore. There is now a new query_opt method that allows giving options.
• xsd:boolean SPARQL function now properly follows XPath specification.
• Fixes SPARQL DESCRIBE evaluation.

Disk data format

The disk data format has been changed between Oxigraph 0.1 (version 0) and Oxigraph 0.2 (version 1). Data is automatically migrated from the version 0 format to the version 1 format when opened with Oxigraph 0.2.

[0.1.1] - 2020-08-14

Added

• The "sophia" feature implementing the sophia_api traits on Oxigraph terms and stores.
• Explicit types for quads iterators returned by stores.

Changed

• QueryOptions::with_default_graph now takes an impl Into<GraphName> instead of an impl Into<NamedNode>.
• QueryOptions::with_named_graph now takes an impl Into<NamedOrBlankNode> instead of an impl Into<NamedNode>.
• pyoxigraph query methods now takes two new parameters, default_graph and named_graphs. default_graph_uris and named_graph_uris parameters are deprecated.
• Fixes a bug in xsd:gYear parsing.

[0.1.0] - 2020-08-09

Added

• QueryOptions now allows settings the query dataset graph URIs (the SPARQL protocol default-graph-uri and named-graph-uri parameters).
• pyoxigraph store query methods allows to provide the dataset graph URIs. It also provides an option to use all graph names as the default graph.
• "default graph as union option" now works with FROM NAMED.
• pyoxigraph now exposes and documents Variable, QuerySolution, QuerySolutions and QueryTriples

[0.1.0-rc.1] - 2020-08-08

Added

• oxigraph Rust library with SPARQL 1.1 query support and memory, Sled and RocksDB stores.
• oxigraph_server standalone SPARQL server.
• oxigraph_wikibase standalone SPARQL server loading data from a Wikibase instance.
• pyoxigraph Python library based on Oxigraph.
• oxigraph NodeJS library based on Oxigraph.