fork of https://github.com/oxigraph/rocksdb and https://github.com/facebook/rocksdb for nextgraph and oxigraph

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Zhichao Cao 699f45049d Introduce a mechanism to dump out blocks from block cache and re-insert to secondary cache (#8912) ... Summary: Background: Cache warming up will cause potential read performance degradation due to reading blocks from storage to the block cache. Since in production, the workload and access pattern to a certain DB is stable, it is a potential solution to dump out the blocks belonging to a certain DB to persist storage (e.g., to a file) and bulk-load the blocks to Secondary cache before the DB is relaunched. For example, when migrating a DB form host A to host B, it will take a short period of time, the access pattern to blocks in the block cache will not change much. It is efficient to dump out the blocks of certain DB, migrate to the destination host and insert them to the Secondary cache before we relaunch the DB. Design: we introduce the interface of CacheDumpWriter and CacheDumpRead for user to store the blocks dumped out from block cache. RocksDB will encode all the information and send the string to the writer. User can implement their own writer it they want. CacheDumper and CacheLoad are introduced to save the blocks and load the blocks respectively. Pull Request resolved: https://github.com/facebook/rocksdb/pull/8912 Test Plan: add new tests to lru_cache_test and pass make check. Reviewed By: pdillinger Differential Revision: D31452871 Pulled By: zhichao-cao fbshipit-source-id: 11ab4f5d03e383f476947116361d54188d36ec48		3 years ago
..
cache.cc	Make SecondaryCache Customizable (#8480)	4 years ago
cache_bench.cc	Add (& fix) some simple source code checks (#8821)	3 years ago
cache_bench_tool.cc	Make SecondaryCache Customizable (#8480)	4 years ago
cache_entry_roles.cc	Account for dictionary-building buffer in global memory limit (#8428)	3 years ago
cache_entry_roles.h	Account for dictionary-building buffer in global memory limit (#8428)	3 years ago
cache_entry_stats.h	Fix and detect headers with missing dependencies (#8893)	3 years ago
cache_helpers.h	Use deleters to label cache entries and collect stats (#8297)	4 years ago
cache_reservation_manager.cc	Account for dictionary-building buffer in global memory limit (#8428)	3 years ago
cache_reservation_manager.h	Add comment for new_memory_used parameter in CacheReservationManager::UpdateCacheReservation (#8895)	3 years ago
cache_reservation_manager_test.cc	Refactor WriteBufferManager::CacheRep into CacheReservationManager (#8506)	3 years ago
cache_test.cc	Use deleters to label cache entries and collect stats (#8297)	4 years ago
clock_cache.cc	Replace most typedef with using= (#8751)	3 years ago
clock_cache.h	Change RocksDB License	8 years ago
lru_cache.cc	Fix a race in LRUCacheShard::Promote (#8717)	3 years ago
lru_cache.h	Add a stat to count secondary cache hits (#8666)	3 years ago
lru_cache_test.cc	Introduce a mechanism to dump out blocks from block cache and re-insert to secondary cache (#8912)	3 years ago
sharded_cache.cc	Add a stat to count secondary cache hits (#8666)	3 years ago
sharded_cache.h	Add a stat to count secondary cache hits (#8666)	3 years ago