54c6f2c19f
Bulk load: use megabytes as unit
3 years ago
9e969cd8eb
Adds methods to configure bulk loader system consumption
3 years ago
adea1899e5
Bulk loader: rewrite API and add hook to display progress indicators
3 years ago
ac64b58825
Fixes wasm build
3 years ago
822dd60596
Fixes invalid database generated from bulk load
...
Adds an invariant validation test
3 years ago
ad4bfe35c2
Fixes typos in the documentation
3 years ago
4efd193708
Improves documentation
3 years ago
0d14159b6e
Adds the Store.backup function to pyoxigraph
3 years ago
203bd4c080
Adds a backup system
...
RocksDB provides a great cheap backup feature thanks to the immutable SST storage.
Sadly it is not compatible with in-memory databases which do not rely on the SST files.
3 years ago
045fb8cbf6
Adds a public API for transaction
...
Very similar to the one of the previous SledStore
3 years ago
34a944036f
Simplifies UpdateOptions API
...
Keeps only useful methods
3 years ago
ec5c7c86be
Improves RDF I/O ParseError
3 years ago
a33dbb6d06
Avoids abusing std::io::Error
...
Introduces new specific errors and make them implement Into<io::Error> for compatibility
3 years ago
44d1a5f04c
Makes bulk load partial insertions atomic
...
Ensures that the stores does not end up in an inconsistent state.
3 years ago
f64001906c
Minor documentation improvements
3 years ago
d6d88b074c
Improves pyoxigraph documentation
3 years ago
8d20f65890
Adds back in memory WASM support
3 years ago
a3e40556da
Automatically retries transactions on failure
3 years ago
e99d6f4ad0
Makes bulk loader multithreaded
3 years ago
6f44a5956b
Simplifies bulk load API
3 years ago
607aa0b0dd
WIP: Transactions
3 years ago
196d6d6576
Adds bulk load by directly write RocksDB SSTs
3 years ago
569000b5ea
Storage: adds write batch
...
Atomic insertions and huge performance improvements for RocksDB
3 years ago
986d3e60bb
RocksDB: bulk load
...
TODO: we do a lot of lookups during load for GC, so the option is not very useful
3 years ago
98f9a307b8
Exposes a function to compact the database
...
Use it after load
3 years ago
bf0f178c41
Adds a ColumnFamilyDefinition struct to store column family options
3 years ago
3119e7748e
Small RocksDB optimizations
...
Use native iterator bound
3 years ago
e297de73d1
Refactors backend code
...
Makes it easier to implement transactions
3 years ago
063683088d
Moves back from Sled to RocksDB
...
Simple implementation without transactions
3 years ago
97bb227042
Migrates to Rust 2021
3 years ago
e9608fb2eb
Adds wasm32 support to lib crate
...
The storage layer is in memory and not optimized yet
3 years ago
f084cfe332
Enables more Clippy lints and enforces them
3 years ago
8a1683eba2
Fixes named graphs insertion
3 years ago
fa7ae0353f
Makes Storage edit method take the explicit term
...
Allows to abstract away the insertion process from SPARQL
Adds also some optimized methods for SPARQL UPDATE operations
3 years ago
c18281183a
Uses std::io::Result where relevant
3 years ago
b5cb0cce19
Makes Clippy happy
4 years ago
4302316a41
Fixes the input type of graph manipulation methods
...
Nested triples are not allowed there
4 years ago
0071f82662
Uses From for term encoding without insertion
...
Makes code simpler
4 years ago
a97250dcce
Basic RDF-star support
...
No parsing and SPARQL support yet
4 years ago
8004fc28c0
Renames NamedOrBlankNode to Subject
...
Preparatory work for RDF-star addition
4 years ago
e2bbc29198
Makes encoded term not copy
4 years ago
e6e83ff369
Makes SPARQL algebra more strict
...
Removes some invalid but encodable states
4 years ago
aa7a23b94d
Makes term encoding not fail if the string is not stored
4 years ago
68aab2563c
Simplifies string storage traits
4 years ago
0efc5b4654
Renames SledStore to Store and cleans up files hierarchy
4 years ago
a5c49a73b1
Drops old Stotrage traits
4 years ago
17a3ae728d
Removes generics from SPARQL implementation
4 years ago
5ea4f2f95a
StrContainer does not need to be mutable
4 years ago
4b9b4a01b8
Moves storage related code to a specific file
4 years ago
fe5bab8eb9
Drops generics on string ids
4 years ago
Tpt