fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Dmitri Smirnov f4b72d7056 Provide a way to override windows memory allocator with jemalloc for ZSTD ... Summary: Windows does not have LD_PRELOAD mechanism to override all memory allocation functions and ZSTD makes use of C-tuntime calloc. During flushes and compactions default system allocator fragments and the system slows down considerably. For builds with jemalloc we employ an advanced ZSTD context creation API that re-directs memory allocation to jemalloc. To reduce the cost of context creation on each block we cache ZSTD context within the block based table builder while a new SST file is being built, this will help all platform builds including those w/o jemalloc. This avoids system allocator fragmentation and improves the performance. The change does not address random reads and currently on Windows reads with ZSTD regress as compared with SNAPPY compression. Closes https://github.com/facebook/rocksdb/pull/3838 Differential Revision: D8229794 Pulled By: miasantreble fbshipit-source-id: 719b622ab7bf4109819bc44f45ec66f0dd3ee80d		7 years ago
..
adaptive_table_factory.cc	Comment out unused variables	7 years ago
adaptive_table_factory.h	Comment out unused variables	7 years ago
block.cc	Copy Get() result when file reads use mmap	7 years ago
block.h	Copy Get() result when file reads use mmap	7 years ago
block_based_filter_block.cc	Move prefix_extractor to MutableCFOptions	7 years ago
block_based_filter_block.h	Move prefix_extractor to MutableCFOptions	7 years ago
block_based_filter_block_test.cc	Move prefix_extractor to MutableCFOptions	7 years ago
block_based_table_builder.cc	Provide a way to override windows memory allocator with jemalloc for ZSTD	7 years ago
block_based_table_builder.h	Provide a way to override windows memory allocator with jemalloc for ZSTD	7 years ago
block_based_table_factory.cc	Move prefix_extractor to MutableCFOptions	7 years ago
block_based_table_factory.h	Align SST file data blocks to avoid spanning multiple pages	7 years ago
block_based_table_reader.cc	Provide a way to override windows memory allocator with jemalloc for ZSTD	7 years ago
block_based_table_reader.h	Exclude seq from index keys	7 years ago
block_builder.cc	Change RocksDB License	7 years ago
block_builder.h	Change RocksDB License	7 years ago
block_fetcher.cc	Provide a way to override windows memory allocator with jemalloc for ZSTD	7 years ago
block_fetcher.h	Fix BlockFetcher ASAN error	7 years ago
block_prefix_index.cc	Change RocksDB License	7 years ago
block_prefix_index.h	Change RocksDB License	7 years ago
block_test.cc	Exclude seq from index keys	7 years ago
bloom_block.cc	Change RocksDB License	7 years ago
bloom_block.h	Change RocksDB License	7 years ago
cleanable_test.cc	Change RocksDB License	7 years ago
cuckoo_table_builder.cc	Enable MSVC W4 with a few exceptions. Fix warnings and bugs	7 years ago
cuckoo_table_builder.h	Change RocksDB License	7 years ago
cuckoo_table_builder_test.cc	fix memory leak in two_level_iterator	7 years ago
cuckoo_table_factory.cc	Comment out unused variables	7 years ago
cuckoo_table_factory.h	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
cuckoo_table_reader.cc	Move prefix_extractor to MutableCFOptions	7 years ago
cuckoo_table_reader.h	Move prefix_extractor to MutableCFOptions	7 years ago
cuckoo_table_reader_test.cc	Move prefix_extractor to MutableCFOptions	7 years ago
filter_block.h	Move prefix_extractor to MutableCFOptions	7 years ago
flush_block_policy.cc	Align SST file data blocks to avoid spanning multiple pages	7 years ago
format.cc	Provide a way to override windows memory allocator with jemalloc for ZSTD	7 years ago
format.h	Provide a way to override windows memory allocator with jemalloc for ZSTD	7 years ago
full_filter_bits_builder.h	Skip duplicate bloom keys when whole_key and prefix are mixed	7 years ago
full_filter_block.cc	Move prefix_extractor to MutableCFOptions	7 years ago
full_filter_block.h	Move prefix_extractor to MutableCFOptions	7 years ago
full_filter_block_test.cc	Move prefix_extractor to MutableCFOptions	7 years ago
get_context.cc	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
get_context.h	Stats for false positive rate of full filtesr	7 years ago
index_builder.cc	Exclude seq from index keys	7 years ago
index_builder.h	Exclude seq from index keys	7 years ago
internal_iterator.h	Change and clarify the relationship between Valid(), status() and Seek*() for all iterators. Also fix some bugs	7 years ago
iter_heap.h	Make InternalKeyComparator final and directly use it in merging iterator	7 years ago
iterator.cc	Comment out unused variables	7 years ago
iterator_wrapper.h	Change and clarify the relationship between Valid(), status() and Seek*() for all iterators. Also fix some bugs	7 years ago
merger_test.cc	Make InternalKeyComparator final and directly use it in merging iterator	7 years ago
merging_iterator.cc	Change and clarify the relationship between Valid(), status() and Seek*() for all iterators. Also fix some bugs	7 years ago
merging_iterator.h	fix DBImpl::NewInternalIterator super-version leak on failure	7 years ago
meta_blocks.cc	Exclude seq from index keys	7 years ago
meta_blocks.h	Support prefetch last 512KB with direct I/O in block based file reader	7 years ago
mock_table.cc	Move prefix_extractor to MutableCFOptions	7 years ago
mock_table.h	Move prefix_extractor to MutableCFOptions	7 years ago
partitioned_filter_block.cc	Exclude seq from index keys	7 years ago
partitioned_filter_block.h	Move prefix_extractor to MutableCFOptions	7 years ago
partitioned_filter_block_test.cc	Move prefix_extractor to MutableCFOptions	7 years ago
persistent_cache_helper.cc	comment unused parameters to turn on -Wunused-parameter flag	7 years ago
persistent_cache_helper.h	Change RocksDB License	7 years ago
persistent_cache_options.h	Change RocksDB License	7 years ago
plain_table_builder.cc	Move prefix_extractor to MutableCFOptions	7 years ago
plain_table_builder.h	Move prefix_extractor to MutableCFOptions	7 years ago
plain_table_factory.cc	Move prefix_extractor to MutableCFOptions	7 years ago
plain_table_factory.h	Comment out unused variables	7 years ago
plain_table_index.cc	Change RocksDB License	7 years ago
plain_table_index.h	Move prefix_extractor to MutableCFOptions	7 years ago
plain_table_key_coding.cc	Comment out unused variables	7 years ago
plain_table_key_coding.h	Change RocksDB License	7 years ago
plain_table_reader.cc	Move prefix_extractor to MutableCFOptions	7 years ago
plain_table_reader.h	Move prefix_extractor to MutableCFOptions	7 years ago
scoped_arena_iterator.h	Change RocksDB License	7 years ago
sst_file_writer.cc	Move prefix_extractor to MutableCFOptions	7 years ago
sst_file_writer_collectors.h	Comment out unused variables	7 years ago
table_builder.h	Move prefix_extractor to MutableCFOptions	7 years ago
table_properties.cc	Exclude seq from index keys	7 years ago
table_properties_internal.h	Eliminate some redundant block reads.	7 years ago
table_reader.h	Move prefix_extractor to MutableCFOptions	7 years ago
table_reader_bench.cc	Move prefix_extractor to MutableCFOptions	7 years ago
table_test.cc	Exclude seq from index keys	7 years ago
two_level_iterator.cc	Change and clarify the relationship between Valid(), status() and Seek*() for all iterators. Also fix some bugs	7 years ago
two_level_iterator.h	fix memory leak in two_level_iterator	7 years ago