60ffd99ad8
Exposes the query profiler to the CLI app
2 years ago
13976014e7
Bulk loader: reduces default system parameters
...
Uses by default targets of 1GB of RAM and 2 threads.
Data parsing is in most of the case slower than ingestion so no more than 2 threads are used anyway.
2 years ago
fbcbd60c0e
Python: adds Store.bulk_extend
2 years ago
26f4e2dc98
Allows to have secondary instances in memory
2 years ago
855c39146d
Replaces Store::open_with_options with explicit variants
...
Trades enums and structs for methods
2 years ago
f7637ee5a5
Add option to open database in read-only mode
...
With read-only it's not possible to modify the data. Updates to the data
are possible via a primary instance of oxigraph, but will not be
reflected. The data is frozen at the time the read-only server is
started.
2 years ago
aa9476b9cc
Add option to open rocksdb in secondary mode
...
The database can be opened once in primary mode, but may be opened
multiple times in secondary mode. It's not possible to write data to the
database in secondary mode.
Secondary mode does not support checkpoints so there might be data
inconsistencies when data is changed while said data is queried. It
might happen that the result data mixes both elements before and after
the change that can not happen in primary mode.
2 years ago
1fa0633db3
Library: adds basic WASI support
...
Adds tests for WASM+JS and WASI to the CI
2 years ago
eedc4b3a71
Removes unnecessary qualified paths
2 years ago
839375c2a4
Adds an option to avoid aborting bulk loading on syntax error
3 years ago
54c6f2c19f
Bulk load: use megabytes as unit
3 years ago
9e969cd8eb
Adds methods to configure bulk loader system consumption
3 years ago
adea1899e5
Bulk loader: rewrite API and add hook to display progress indicators
3 years ago
ac64b58825
Fixes wasm build
3 years ago
822dd60596
Fixes invalid database generated from bulk load
...
Adds an invariant validation test
3 years ago
ad4bfe35c2
Fixes typos in the documentation
3 years ago
4efd193708
Improves documentation
3 years ago
0d14159b6e
Adds the Store.backup function to pyoxigraph
3 years ago
203bd4c080
Adds a backup system
...
RocksDB provides a great cheap backup feature thanks to the immutable SST storage.
Sadly it is not compatible with in-memory databases which do not rely on the SST files.
3 years ago
045fb8cbf6
Adds a public API for transaction
...
Very similar to the one of the previous SledStore
3 years ago
34a944036f
Simplifies UpdateOptions API
...
Keeps only useful methods
3 years ago
ec5c7c86be
Improves RDF I/O ParseError
3 years ago
a33dbb6d06
Avoids abusing std::io::Error
...
Introduces new specific errors and make them implement Into<io::Error> for compatibility
3 years ago
44d1a5f04c
Makes bulk load partial insertions atomic
...
Ensures that the stores does not end up in an inconsistent state.
3 years ago
f64001906c
Minor documentation improvements
3 years ago
d6d88b074c
Improves pyoxigraph documentation
3 years ago
8d20f65890
Adds back in memory WASM support
3 years ago
a3e40556da
Automatically retries transactions on failure
3 years ago
e99d6f4ad0
Makes bulk loader multithreaded
3 years ago
6f44a5956b
Simplifies bulk load API
3 years ago
607aa0b0dd
WIP: Transactions
3 years ago
196d6d6576
Adds bulk load by directly write RocksDB SSTs
3 years ago
569000b5ea
Storage: adds write batch
...
Atomic insertions and huge performance improvements for RocksDB
3 years ago
986d3e60bb
RocksDB: bulk load
...
TODO: we do a lot of lookups during load for GC, so the option is not very useful
3 years ago
98f9a307b8
Exposes a function to compact the database
...
Use it after load
3 years ago
bf0f178c41
Adds a ColumnFamilyDefinition struct to store column family options
3 years ago
3119e7748e
Small RocksDB optimizations
...
Use native iterator bound
3 years ago
e297de73d1
Refactors backend code
...
Makes it easier to implement transactions
3 years ago
063683088d
Moves back from Sled to RocksDB
...
Simple implementation without transactions
3 years ago
97bb227042
Migrates to Rust 2021
3 years ago
e9608fb2eb
Adds wasm32 support to lib crate
...
The storage layer is in memory and not optimized yet
3 years ago
f084cfe332
Enables more Clippy lints and enforces them
3 years ago
8a1683eba2
Fixes named graphs insertion
3 years ago
fa7ae0353f
Makes Storage edit method take the explicit term
...
Allows to abstract away the insertion process from SPARQL
Adds also some optimized methods for SPARQL UPDATE operations
3 years ago
c18281183a
Uses std::io::Result where relevant
3 years ago
b5cb0cce19
Makes Clippy happy
4 years ago
4302316a41
Fixes the input type of graph manipulation methods
...
Nested triples are not allowed there
4 years ago
0071f82662
Uses From for term encoding without insertion
...
Makes code simpler
4 years ago
a97250dcce
Basic RDF-star support
...
No parsing and SPARQL support yet
4 years ago
8004fc28c0
Renames NamedOrBlankNode to Subject
...
Preparatory work for RDF-star addition
4 years ago
Tpt