fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Hui Xiao 91b95cadee Account for dictionary-building buffer in global memory limit (#8428) ... Summary: Context: Some data blocks are temporarily buffered in memory in BlockBasedTableBuilder for building compression dictionary used in data block compression. Currently this memory usage is not counted toward our global memory usage utilizing block cache capacity. To improve that, this PR charges that memory usage into the block cache to achieve better memory tracking and limiting. - Reserve memory in block cache for buffered data blocks that are used to build a compression dictionary - Release all the memory associated with buffering the data blocks mentioned above in EnterUnbuffered(), which is called when (a) buffer limit is exceeded after buffering OR (b) the block cache becomes full after reservation OR (c) BlockBasedTableBuilder calls Finish() Pull Request resolved: https://github.com/facebook/rocksdb/pull/8428 Test Plan: - Passing existing unit tests - Passing new unit tests Reviewed By: ajkr Differential Revision: D30755305 Pulled By: hx235 fbshipit-source-id: 6e66665020b775154a94c4c5e0f2adaeaff13981		3 years ago
..
adaptive	Refactor: use TableBuilderOptions to reduce parameter lists (#8240)	4 years ago
block_based	Account for dictionary-building buffer in global memory limit (#8428)	3 years ago
cuckoo	Embed original file number in SST table properties (#8686)	3 years ago
plain	Make MemTableRepFactory into a Customizable class (#8419)	3 years ago
block_fetcher.cc	Rename variables in ImmutableCFOptions to avoid conflicts with ImmutableDBOptions (#8227)	4 years ago
block_fetcher.h	Add db_test2 to to ASSERT_STATUS_CHECKED (#8640)	3 years ago
block_fetcher_test.cc	Make it possible to apply only a subrange of table property collectors (#8298)	4 years ago
cleanable_test.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
format.cc	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
format.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
get_context.cc	Support for Merge in Integrated BlobDB with base values (#8292)	4 years ago
get_context.h	Support for Merge in Integrated BlobDB with base values (#8292)	4 years ago
internal_iterator.h	Clean up InternalIterator upper bound logic a little bit (#7200)	4 years ago
iter_heap.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
iterator.cc	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
iterator_wrapper.h	Redesign block cache pinning API (#7520)	4 years ago
merger_test.cc	More Makefile Cleanup (#7097)	5 years ago
merging_iterator.cc	Replace most typedef with using= (#8751)	3 years ago
merging_iterator.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
meta_blocks.cc	Embed original file number in SST table properties (#8686)	3 years ago
meta_blocks.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
mock_table.cc	Refactor: use TableBuilderOptions to reduce parameter lists (#8240)	4 years ago
mock_table.h	Fix some minor issues in the Customizable infrastructure (#8566)	3 years ago
multiget_context.h	Replace most typedef with using= (#8751)	3 years ago
persistent_cache_helper.cc	Add more tests to ASSERT_STATUS_CHECKED (#7367)	4 years ago
persistent_cache_helper.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
persistent_cache_options.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
scoped_arena_iterator.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
sst_file_dumper.cc	Make it possible to apply only a subrange of table property collectors (#8298)	4 years ago
sst_file_dumper.h	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
sst_file_reader.cc	Make ImmutableOptions struct that inherits from ImmutableCFOptions and ImmutableDBOptions (#8262)	4 years ago
sst_file_reader_test.cc	Add CreateFrom methods to Env/FileSystem (#8174)	4 years ago
sst_file_writer.cc	Embed original file number in SST table properties (#8686)	3 years ago
sst_file_writer_collectors.h	Apply `sample_for_compression` to all block-based tables (#8105)	4 years ago
table_builder.h	Partially revert the "apply subrange of table property collectors" change (#8465)	4 years ago
table_factory.cc	Add customizable_util.h to the public API (#8301)	4 years ago
table_properties.cc	Embed original file number in SST table properties (#8686)	3 years ago
table_properties_internal.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
table_reader.h	dedup ReadOptions in iterator hierarchy (#7210)	4 years ago
table_reader_bench.cc	Make it possible to apply only a subrange of table property collectors (#8298)	4 years ago
table_reader_caller.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago
table_test.cc	Account for dictionary-building buffer in global memory limit (#8428)	3 years ago
two_level_iterator.cc	Redesign block cache pinning API (#7520)	4 years ago
two_level_iterator.h	Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)	5 years ago