Jeff Washington (jwash)
8cdf5cdb50
get_storage_to_move_to_ancient_append_vec returns a single append vec ( #29482 )
...
get_storages_to_move_to_ancient_append_vec returns a single append vec
2023-01-05 07:31:26 -08:00
Jeff Washington (jwash)
221f547ba9
remove store_ids from a few shrink data structures ( #29360 )
2023-01-05 07:30:43 -08:00
Jeff Washington (jwash)
fc8cd82309
migrate tests to get_slot_storage_entry ( #29515 )
2023-01-04 13:12:48 -08:00
Jeff Washington (jwash)
4e636ab153
cleanup ancient append vec tests ( #29514 )
2023-01-04 12:39:42 -08:00
Jeff Washington (jwash)
ef72140173
remove unnecessary to_vec() ( #29516 )
2023-01-04 12:38:16 -08:00
Jeff Washington (jwash)
093b1a5e10
get_storages_for_slot uses get_slot_storage_entry ( #29498 )
2023-01-04 10:15:56 -08:00
Jeff Washington (jwash)
10135dbd10
should_move_to_ancient_append_vec works with a single storage ( #29484 )
2023-01-04 07:03:46 -08:00
Jeff Washington (jwash)
89deecb979
add AccountStorage.is_empty_entry for tests ( #29489 )
2023-01-03 12:36:31 -08:00
Jeff Washington (jwash)
0f2bfa2b02
cleanup get_snapshot_storages ( #29488 )
...
* cleanup get_snapshot_storages
* pr feedback
2023-01-03 12:22:28 -08:00
Jeff Washington (jwash)
95d2f002bd
add AccountStorage.get_slot_storage_entry ( #29480 )
2023-01-03 12:10:34 -08:00
Jeff Washington (jwash)
9ee4555f53
remove should_retain from mark_dirty_dead_stores ( #29358 )
2023-01-03 09:53:43 -08:00
Jeff Washington (jwash)
102dc08378
get_snapshot_storages removes call to AccountStorage.get ( #29466 )
2023-01-03 09:15:07 -08:00
Jeff Washington (jwash)
9d15ead873
remove single use AccountStorage.slot_store_count ( #29479 )
2023-01-03 09:12:27 -08:00
Jeff Washington (jwash)
10eadb6dd9
add test method assert_no_storages_at_slot() ( #29483 )
2023-01-03 08:59:21 -08:00
Jeff Washington (jwash)
ca9166201c
add test method get_and_assert_single_storage ( #29481 )
2023-01-03 08:38:15 -08:00
Jeff Washington (jwash)
04508ccfa7
add AccountStorage.is_empty ( #29478 )
2023-01-03 08:35:10 -08:00
Jeff Washington (jwash)
8c878daada
refactor RecycleStores::add_entries ( #29475 )
...
* refactor RecycleStores::add_entries
* pr feedback
2023-01-03 07:56:30 -08:00
Jeff Washington (jwash)
89e733c2b3
remove unnecessary type ( #29473 )
2023-01-03 06:34:05 -08:00
Jeff Washington (jwash)
1fd1e57f50
add test ( #29471 )
2023-01-02 20:53:43 -08:00
Jeff Washington (jwash)
e86628a823
filter get_snapshot_storages for requested_slots earlier ( #29465 )
...
* filter get_snapshot_storages for requested_slots earlier
* Update runtime/src/accounts_db.rs
Co-authored-by: apfitzge <apfitzge@gmail.com>
Co-authored-by: apfitzge <apfitzge@gmail.com>
2023-01-02 20:53:30 -08:00
Jeff Washington (jwash)
4cc1890f00
skip_rewrites will only be feature driven ( #29468 )
2023-01-02 20:15:42 -08:00
Jeff Washington (jwash)
9615965219
decrease frequency of random shrink of ancient append vec ( #29462 )
2023-01-02 13:29:04 -08:00
Jeff Washington (jwash)
bf93a1e13f
migrate tests to not use AccountStorage::get ( #29464 )
2023-01-02 13:02:09 -08:00
Jeff Washington (jwash)
e99afb4e85
handle ancient overflow case correctly ( #29458 )
2023-01-02 12:39:59 -08:00
Jeff Washington (jwash)
8397f295c0
simplify get_storages_for_slot ( #29463 )
2023-01-02 12:38:48 -08:00
Jeff Washington (jwash)
38d771a823
add test and comments ( #29459 )
2023-01-02 12:38:21 -08:00
Jeff Washington (jwash)
6edbb61fa0
add test_shrink_ancient_overflow ( #29363 )
2023-01-02 07:09:53 -08:00
Jeff Washington (jwash)
0f7ef085a0
introduce ShrinkInProgress ( #29329 )
...
* introduce ShrinkInProgress
* remove redundant check
* add comments
2022-12-21 09:03:29 -08:00
Jeff Washington (jwash)
4a64f6d421
test_utils::create_test_accounts pre-allocates an append vec first ( #29336 )
...
* test_utils::create_test_accounts pre-allocates an append vec first
* remove comment
2022-12-21 09:02:42 -08:00
Jeff Washington (jwash)
c3ca5b78b2
remove acctdb.min_num_stores ( #29335 )
2022-12-20 10:39:20 -08:00
Jeff Washington (jwash)
098b86b883
test_minimize_accounts_db uses write cache correctly ( #29333 )
2022-12-20 09:50:56 -08:00
Brooks
053775ad77
Elides unnecessary lifetimes ( #29299 )
2022-12-20 12:44:17 -05:00
Jeff Washington (jwash)
c816157979
shrink avoids reshaping data by using StorableAccounts trait ( #29307 )
2022-12-19 12:29:21 -08:00
Jeff Washington (jwash)
19f13a0bea
refactor get_store_for_shrink ( #29284 )
2022-12-15 22:10:39 -08:00
Brooks Prumo
1e0a0e0ced
Cleans up CacheHashData ( #29267 )
2022-12-15 14:16:27 -05:00
Jeff Washington (jwash)
5a687fa818
make AccountStorage::map private ( #29268 )
2022-12-14 20:03:25 -08:00
Jeff Washington (jwash)
3a7b67ea55
refactor unwrap_or_default for type that will soon not have a default ( #29257 )
2022-12-14 15:11:36 -08:00
Jeff Washington (jwash)
49a136a374
move AccountStorage out of accounts_db.rs ( #29261 )
2022-12-14 15:08:39 -08:00
Jeff Washington (jwash)
f9db75768c
Vec<Arc<AccountStorageEntry>> becomes SnapshotStorage ( #29253 )
2022-12-14 12:18:43 -08:00
Jeff Washington (jwash)
fab0ce21a2
remove shrink_candidate_slots_v1 ( #29252 )
2022-12-14 08:57:16 -08:00
Jeff Washington (jwash)
b77bef4ee3
write_version -> write_version_obsolete ( #29176 )
2022-12-14 07:43:40 -08:00
Jeff Washington (jwash)
62be54a75e
remove process_stale_slot_v1 and other fns ( #29244 )
2022-12-13 16:32:24 -08:00
Jeff Washington (jwash)
4ae12bf5fa
fix tests broken by add_root change ( #29248 )
2022-12-13 14:43:52 -08:00
Jeff Washington (jwash)
3e649d2aa0
remove add_root(caching_enabled) ( #29245 )
2022-12-13 11:26:28 -08:00
Jeff Washington (jwash)
1a0a465416
handle unclean roots explicitly during index generation ( #29230 )
2022-12-13 07:51:33 -08:00
Brooks Prumo
bcbf3374fd
Avoids copying hashes when computing merkle root ( #29225 )
2022-12-13 10:20:14 -05:00
Jeff Washington (jwash)
a57247a78e
handle write_version correctly in geyser api ( #29224 )
2022-12-13 06:42:28 -08:00
Jeff Washington (jwash)
c3001abef7
don't rely on write_version increasing - just assert that it is for now ( #29180 )
2022-12-12 19:24:45 -08:00
Jeff Washington (jwash)
5e799ad563
remove AccountsDb::new_with_config.caching_enabled ( #29167 )
2022-12-12 08:50:00 -08:00
Jeff Washington (jwash)
db2cc53967
remove skip rewrites from bank ( #29182 )
2022-12-10 09:27:15 -08:00
Jeff Washington (jwash)
f9c4170d34
remove caching_enabled ( #29117 )
...
* warp_from_parents works with write_cache enabled
* remove caching_enabled
2022-12-09 14:31:54 -08:00
Jeff Washington (jwash)
7f1b71a2b0
remove AccountsDb::new_with_config_for_tests.caching_enabled ( #29181 )
2022-12-09 13:54:37 -08:00
Jeff Washington (jwash)
06a806bb9d
introduce aligned_stored_size to flush write cache ( #29147 )
2022-12-08 19:44:23 -08:00
Jeff Washington (jwash)
072070ba80
test_shrink_candidate_slots uses write cache ( #29145 )
2022-12-08 15:13:05 -08:00
Brooks Prumo
2d4f17e1c9
Removes AccountsDb::hash_account_with_rent_epoch() ( #29138 )
2022-12-08 13:08:36 -05:00
Brooks Prumo
9eedc189fd
Uses `storages` for instance of SortedStorages ( #29133 )
2022-12-07 19:27:46 -05:00
Jeff Washington (jwash)
1d95720e5e
migrate some tests to work with write cache ( #29124 )
...
* make specific tests use write cache
* fix a few more tests
2022-12-07 13:46:06 -08:00
Jeff Washington (jwash)
284c41a6db
test_get_snapshot_storages_only_non_empty uses write cache ( #29111 )
2022-12-07 09:19:17 -08:00
Jeff Washington (jwash)
59359c3ab4
test_shrink_collect_simple uses write cache ( #29115 )
2022-12-07 09:18:45 -08:00
Jeff Washington (jwash)
00f5a176a0
test_clean_zero_lamport_and_old_roots uses write cache ( #29113 )
2022-12-07 07:30:58 -08:00
Jeff Washington (jwash)
18a85edf8c
migrate tests to use write cache ( #29108 )
...
* test_store_overhead works with write cache
* test_storage_remove_account_double_remove works with write cache
* test_set_storage_count_and_alive_bytes works with write cache
* test_reuse_append_vec_id works with write cache
2022-12-07 07:03:57 -08:00
Jeff Washington (jwash)
8ce6081744
test_accounts_db_purge1 uses write cache ( #29100 )
2022-12-06 14:34:40 -08:00
Jeff Washington (jwash)
e5e64c8d6e
test_remove_unrooted_slot_snapshot uses write cache ( #29110 )
...
* test_remove_unrooted_slot_snapshot uses write cache
* test_purge_alive_unrooted_slots_after_clean uses with write cache
* test_get_snapshot_storages_with_base_slot uses write cache
* test_get_snapshot_storages_only_roots uses write cache
* test_get_snapshot_storages_only_older_than_or_equal_to_snapshot_slot uses write cache
* test_get_snapshot_storages_exclude_empty uses write cache
* test_clean_old_with_zero_lamport_account uses write cache
* test_clean_old_with_normal_account uses write cache
* test_clean_old_with_both_normal_and_zero_lamport_accounts uses write cache
* test_clean_max_slot_zero_lamport_account uses write cache
* test_calculate_storage_count_and_alive_bytes_2_accounts uses write cache
* test_calculate_storage_count_and_alive_bytes uses write cache
2022-12-06 14:34:18 -08:00
Jeff Washington (jwash)
46e13423fd
migrate tests to work with write cache ( #29106 )
...
* test_accounts_purge_long_chained_after_snapshot_restore
* test_accountsdb_calculate_accounts_hash_from_storages works with write cache
* test_zero_lamport_new_root_not_cleaned works with write cache
* test_wrapping_append_vec_id works with write cache
* test_verify_bank_hash works with write cache
* change tests to use write cache
* use shared db to pass to tests
2022-12-06 14:33:52 -08:00
Jeff Washington (jwash)
c668a58b8e
do_full_clean_refcount uses write cache ( #29112 )
2022-12-06 14:33:28 -08:00
Jeff Washington (jwash)
d3fa93907b
test_clean_zero_lamport_and_dead_slot uses write cache ( #29114 )
2022-12-06 14:33:07 -08:00
behzad nouri
9524c9dbff
patches errors from clippy::uninlined_format_args
...
https://rust-lang.github.io/rust-clippy/master/index.html#uninlined_format_args
2022-12-06 19:32:15 +00:00
behzad nouri
9433c06745
patches errors from clippy::unchecked_duration_subtraction
...
https://rust-lang.github.io/rust-clippy/master/index.html#unchecked_duration_subtraction
2022-12-06 19:32:15 +00:00
Jeff Washington (jwash)
ca8372efc1
with_chained_zero_lamport_accounts works with write cache ( #29104 )
2022-12-06 10:56:37 -08:00
Jeff Washington (jwash)
26472a13ea
migrating tests to use write cache ( #29101 )
...
* test_account_update uses write cache
* test_accounts_db_purge_keep_live works with write cache
* enable caching for test_accounts_db_purge_keep_live
2022-12-06 10:25:37 -08:00
Jeff Washington (jwash)
5d0d4a6b95
test_accounts_db_serialize_zero_and_free uses write cache ( #29102 )
2022-12-06 10:25:07 -08:00
Jeff Washington (jwash)
7180345ee1
test_verify_bank_capitalization works with write cache ( #29107 )
2022-12-06 10:24:43 -08:00
Jeff Washington (jwash)
5833e2f85e
test_account_grow uses write cache ( #29099 )
2022-12-06 09:28:24 -08:00
Jeff Washington (jwash)
94a6665995
test_clean_multiple_zero_lamport_decrements_index_ref_count uses write cache ( #29088 )
2022-12-06 08:56:37 -08:00
Jeff Washington (jwash)
fe8b15b43a
test_accountsdb_count_stores uses write cache ( #29086 )
2022-12-06 07:40:51 -08:00
Jeff Washington (jwash)
93cc3b1d3d
test_shrink_stale_slots_skipped only uses non-write cache ( #29081 )
2022-12-06 07:03:30 -08:00
Jeff Washington (jwash)
4de13be926
test_accounts_db_serialize1 uses write cache ( #29085 )
2022-12-06 06:36:28 -08:00
Jeff Washington (jwash)
f88398cbcf
test_shrink_stale_slots_processed uses write cache ( #29082 )
2022-12-06 06:35:49 -08:00
Jeff Washington (jwash)
ed0c9e285b
test_partial_clean supports write cache ( #29091 )
2022-12-06 06:35:02 -08:00
Jeff Washington (jwash)
c106c7e349
test_clean_accounts_with_last_full_snapshot_slot uses write cache ( #29087 )
2022-12-05 20:41:11 -08:00
Jeff Washington (jwash)
6935ff74ce
test_uncleaned_roots_with_account uses write cache ( #29084 )
2022-12-05 20:37:42 -08:00
Jeff Washington (jwash)
1b49c52d98
store_uncached -> store_for_tests ( #29083 )
2022-12-05 14:42:16 -08:00
Jeff Washington (jwash)
9746eb2c8d
test_lazy_gc_slot can use write cache ( #29080 )
2022-12-05 12:48:15 -08:00
Jeff Washington (jwash)
8c47e2168e
test_accounts_clean_after_snapshot_restore_then_old_revives can use write cache ( #29050 )
...
* test_accounts_clean_after_snapshot_restore_then_old_revives can use write cache
* combine flush and set root
2022-12-05 12:39:26 -08:00
Brooks Prumo
c65a8ce6c3
AccountsDb::get_snapshot_storages() takes a Range for slots ( #29054 )
2022-12-05 11:21:21 -05:00
Jeff Washington (jwash)
e6cc5052c3
pass alive bytes to AccountsToStore::new ( #28994 )
2022-11-30 15:46:52 -08:00
Jeff Washington (jwash)
2c912c9049
use files for merkle tree inputs on accounts hash ( #28965 )
...
* use files for merkle tree inputs on accounts hash
* remove multi-pass scan, simplify
* cleanup and comments
* rework writing into the hash file for clarity
* add test, cleanup
* rename
* move count into option
2022-11-30 12:27:27 -08:00
Jeff Washington (jwash)
58e12cf963
avoid copies when writing to an ancient append vec ( #28981 )
...
* avoid copies when writing to an ancient append vec
* update comments
2022-11-30 10:09:23 -08:00
Jeff Washington (jwash)
2427004dba
add 'bytes' to aligned/alive_total for clarity ( #28982 )
2022-11-30 07:38:57 -08:00
Jeff Washington (jwash)
c8cc1270f1
log # append vecs open ( #28958 )
2022-11-29 16:48:02 -08:00
Jeff Washington (jwash)
e42649a8ba
remove cli arg to specify # accounts hash scan passes ( #28976 )
2022-11-29 16:47:51 -08:00
Brooks Prumo
9327658007
Promotes accounts hash to a strong type ( #28930 )
2022-11-28 10:09:47 -05:00
Jeff Washington (jwash)
9a24743d2a
expect only 1 store per slot ( #28844 )
...
expect only 1 store per slot in shrink
2022-11-23 06:20:36 -08:00
Brooks Prumo
40a7c6d46a
Renames fn to insert_default_bank_hash() ( #28929 )
2022-11-22 19:31:59 -05:00
Jeff Washington (jwash)
5d88a9b32b
improve perf of storing accounts for shrink/ancient ( #28880 )
...
* improve perf of storing accounts for shrink/ancient
* rename
* phantom data
* update comment
* make impl Borrow<Hash> consistent
* remove unused static
2022-11-22 15:36:57 -08:00
Jeff Washington (jwash)
8addf93de7
test_store_reuse uses write cache ( #28901 )
2022-11-21 11:17:33 -08:00
Brooks Prumo
d698f982ee
Renames to AccountsHasher ( #28883 )
2022-11-18 18:25:44 -05:00
Jeff Washington (jwash)
8cbe83c725
cleanup CalcAccountsHashDataSource ( #28882 )
2022-11-18 14:49:22 -08:00
Jeff Washington (jwash)
aa1d319d48
add shrink ancient test ( #28858 )
...
* add shrink ancient test
* improvements
2022-11-18 13:11:57 -08:00
Brooks Prumo
7787cb2ab2
Renames BankHashInfo field to accounts_delta_hash ( #28878 )
2022-11-18 15:35:03 -05:00
Jeff Washington (jwash)
dcfb73f664
extract test append_account function ( #28875 )
2022-11-18 10:57:02 -08:00
Jeff Washington (jwash)
9acfa08838
remove per-account slot in ancient append vecs ( #28851 )
...
* remove per-account slot in ancient append vecs
* review fixes
2022-11-18 10:15:41 -08:00
Jeff Washington (jwash)
e269fe3383
refactor into combine_one_store_into_ancient ( #28845 )
2022-11-17 08:42:42 -08:00
Jeff Washington (jwash)
83a7b2ca6c
only log ancient append vec stats when they are useful ( #28843 )
2022-11-16 17:15:43 -08:00
Jeff Washington (jwash)
c17d594684
collect storage_read_elapsed for shrink and ancient ( #28833 )
2022-11-16 11:14:07 -08:00
Jeff Washington (jwash)
4837dc071f
cleanup return value from append_accounts ( #28836 )
2022-11-16 10:59:11 -08:00
Jeff Washington (jwash)
f7139532a6
acct hash: don't init accum or create hash file if no storages ( #28839 )
2022-11-16 10:58:39 -08:00
Jeff Washington (jwash)
2b1db39faa
refactor test ancient population code ( #28823 )
2022-11-16 08:31:39 -08:00
Jeff Washington (jwash)
b572422d24
test ancient append vecs with dead slots ( #28800 )
2022-11-15 10:21:38 -08:00
Jeff Washington (jwash)
a21f536b3a
add scan statistics in hash calc for ancient append vecs ( #28816 )
2022-11-15 09:31:24 -08:00
Jeff Washington (jwash)
84cfdf23fc
remove LoadedAccount::stored_size ( #28802 )
2022-11-15 05:47:12 -08:00
Jeff Washington (jwash)
ec58cda2e7
improve ancient append vec test ( #28799 )
2022-11-15 05:46:09 -08:00
Jeff Washington (jwash)
f69e847137
allow ancient append vec threshold to be set on cli ( #28707 )
...
* allow ancient append vec threshold to be set on cli
* pr responses
2022-11-11 11:30:05 -08:00
Jeff Washington (jwash)
b2ece6368f
shrink ancient append vecs at 90% ( #28736 )
2022-11-10 20:05:34 -08:00
Jeff Washington (jwash)
552248906e
report ancient stats correctly in drop_or_recycle_stores ( #28747 )
2022-11-10 07:27:38 -08:00
Brooks Prumo
d1ba42180d
clippy for rust 1.65.0 ( #28765 )
2022-11-09 19:39:38 +00:00
Jeff Washington (jwash)
0bc66c82aa
remove unused stat ancient.skipped_shrink ( #28749 )
2022-11-05 08:09:19 -07:00
Jeff Washington (jwash)
99565570b8
add ancient append vec stats ( #28737 )
2022-11-05 08:08:52 -07:00
Jeff Washington (jwash)
5937a10810
ancient append vec stat fixes ( #28731 )
2022-11-04 04:48:19 -07:00
Jeff Washington (jwash)
88d7f6cc9d
add ability to flush read only accounts cache ( #28726 )
2022-11-02 12:03:32 -07:00
Jeff Washington (jwash)
faf32e2a94
add ancient append vec tests ( #28712 )
...
add test test_combine_ancient_slots_simple
2022-11-02 11:24:08 -07:00
Jeff Washington (jwash)
ee0320c9f3
fix ancient append vec throwing away stores bug ( #28710 )
2022-11-02 08:21:03 -07:00
Jeff Washington (jwash)
7885fdca37
ancient append vecs: pass through can_randomly_shrink ( #28706 )
2022-11-01 11:55:28 -07:00
Jeff Washington (jwash)
daf71003d3
add tests for handle_dropped_roots_for_ancient ( #28703 )
2022-11-01 09:03:54 -07:00
Jeff Washington (jwash)
0b51b15af2
remove duplicate pubkey during shrink ( #28689 )
2022-11-01 07:45:52 -07:00
Jeff Washington (jwash)
cb4c3668c7
.pubkey() instead of meta.pubkey for stored account ( #28682 )
2022-10-31 13:58:42 -07:00
Jeff Washington (jwash)
c47515d055
remove duplicate pubkey when shrinking or combining ancient ( #28678 )
2022-10-31 12:00:55 -07:00
Jeff Washington (jwash)
fad6c99e9f
add test variations for shrink_collect ( #28640 )
...
add test variations
2022-10-29 14:24:08 -07:00
Jeff Washington (jwash)
5889ee30b0
add test_get_keys_to_unref_ancient ( #28664 )
2022-10-29 14:23:41 -07:00
Brooks Prumo
bfa62da29e
Renames variant to CalcAccountsHashDataSource::IndexForTests ( #28623 )
2022-10-29 08:55:33 -04:00
Brooks Prumo
f98e4d9198
Renames BankHashInfo field to accounts_hash ( #28665 )
2022-10-28 15:18:25 -04:00
Jeff Washington (jwash)
8924829e7b
extract 'unref_pubkeys' for shared code ( #28653 )
2022-10-28 10:12:29 -07:00
Jeff Washington (jwash)
0b2bc987ca
tests for maybe_unref_accounts_already_in_ancient ( #28652 )
2022-10-28 08:24:10 -07:00
Jeff Washington (jwash)
0c1df82d48
add current_ancient tests ( #28651 )
2022-10-28 07:32:23 -07:00
Jeff Washington (jwash)
8ae5af2822
ancient append vec tests ( #28635 )
2022-10-27 15:10:22 -07:00
Jeff Washington (jwash)
3d7cca6296
cleanup drop in ancient append vecs ( #28617 )
2022-10-27 11:16:46 -07:00
Jeff Washington (jwash)
646514e4d5
give metric around 'remove_old_stores_shrink" better name ( #28613 )
2022-10-27 07:33:01 -07:00
Jeff Washington (jwash)
4ac52c2a9d
ancient append vec comments and cleanup ( #28616 )
2022-10-27 07:32:42 -07:00
Jeff Washington (jwash)
251cab4c8b
extract handle_dropped_roots_for_ancient from ancient append vec code ( #28611 )
2022-10-27 07:32:04 -07:00
Jeff Washington (jwash)
decf3de453
extract ancient maybe_unref_accounts_already_in_ancient ( #28610 )
2022-10-26 14:20:32 -07:00
Jeff Washington (jwash)
d4db649e7c
extract common code remove_old_stores_shrink from shrink and ancient append vecs ( #28588 )
2022-10-26 11:49:10 -07:00
Brooks Prumo
27269d833c
Uses enum for data source with calc_accounts_hash() ( #28584 )
2022-10-26 13:04:01 -04:00
Jeff Washington (jwash)
252d7f68da
combine all_are_zero_lamports ( #28567 )
2022-10-26 08:55:20 -07:00
Brooks Prumo
1dbcb78de7
Renames fn to update_accounts_hash() ( #28574 )
2022-10-25 16:43:19 -04:00
Jeff Washington (jwash)
51e1a7f2af
simplify mark_dirty_dead_stores ( #28565 )
2022-10-25 11:34:58 -07:00
Jeff Washington (jwash)
470ed4f06e
update stats in shrink_collect ( #28563 )
2022-10-25 11:27:33 -07:00
Brooks Prumo
e79c1cba03
Renames fn to update_accounts_hash_for_tests() ( #28571 )
2022-10-25 14:03:19 -04:00
Jeff Washington (jwash)
8c57efb828
ancient append vecs: get rid of some locals in shared code ( #28559 )
2022-10-25 09:32:14 -07:00
Jeff Washington (jwash)
2c837ba4e3
reorder code to prepare for sharing ( #28564 )
2022-10-25 09:15:26 -07:00
Brooks Prumo
bf214d36e3
Renames fn to calculate_accounts_hash_with_verify() ( #28573 )
2022-10-25 11:55:26 -04:00
Brooks Prumo
e2438cf3e2
Renames fn to calculate_accounts_hash() ( #28572 )
2022-10-25 11:53:41 -04:00
Jeff Washington (jwash)
1ca7c8244f
rename merge() -> accumulate() ( #28561 )
2022-10-25 08:52:02 -07:00
Brooks Prumo
bc02789c43
Renames fn to calculate_accounts_hash_from_storages() ( #28566 )
2022-10-24 21:07:00 -04:00
Brooks Prumo
2354a0a343
Renames fn to calculate_accounts_hash_from_index() ( #28568 )
2022-10-24 19:20:08 -04:00
Jeff Washington (jwash)
dde8f0dfad
CurrentAncientAppendVec for clarity ( #28528 )
2022-10-24 15:28:52 -07:00
Jeff Washington (jwash)
8acd6bb34a
share index_read_elapsed code ( #28557 )
2022-10-24 15:19:40 -07:00
Jeff Washington (jwash)
a422387ca8
cleanup ancient append vec merge stats ( #28556 )
2022-10-24 13:11:12 -07:00
Trent Nelson
1fbd818647
runtime: remove `Default` req on account scan interfaces ( #28533 )
2022-10-21 17:53:06 -06:00
Jeff Washington (jwash)
993583d9b3
simplify get_store_for_shrink ( #28524 )
2022-10-21 14:49:34 -07:00
Jeff Washington (jwash)
fb94e50678
remove single use function for clarity ( #28523 )
2022-10-21 11:42:27 -07:00
Jeff Washington (jwash)
09ede8b85c
reuse update_shrink_stats for combine_ancient_slots ( #28466 )
2022-10-19 14:17:34 -07:00
Jeff Washington (jwash)
2b11926c9e
simplify combine_ancient_slots ( #28464 )
2022-10-19 09:35:21 -07:00
Jeff Washington (jwash)
8b115ff489
factor out update_shrink_stats ( #28465 )
...
* use local for shrink_stats
* renames and remove .as_us()
* factor out update_shrink_stats
* use integer to report us in metrics
2022-10-19 08:08:04 -07:00
Jeff Washington (jwash)
040035063f
share shrink_collect code ( #28454 )
...
* share shrink_collect code
* use correct stats
2022-10-19 08:07:05 -07:00
Jeff Washington (jwash)
ca115594ff
remove concept of 'full' ancient append vec ( #28449 )
2022-10-18 15:08:04 -07:00
Jeff Washington (jwash)
c89bd0d6a4
make ancient shrink consistent with shrink ( #28457 )
2022-10-18 15:05:32 -07:00
Jeff Washington (jwash)
825b83c95c
simple minor refactoring ( #28456 )
2022-10-18 15:05:06 -07:00
Jeff Washington (jwash)
3835ac166e
refactor load_accounts_index_for_shrink for easier sharing ( #28455 )
2022-10-18 14:55:10 -07:00
Jeff Washington (jwash)
d52e28ac22
combine sort into get_unique_accounts_from_storages ( #28450 )
2022-10-18 11:52:48 -07:00
Jeff Washington (jwash)
b583ec79e1
add tests for should_move_to_ancient_append_vec ( #28438 )
...
add tests for should_moev_to_ancient_append_vec
2022-10-18 11:41:35 -07:00
Jeff Washington (jwash)
fd2e671861
remove slot# from account hash ( #28405 )
...
* remove slot# from account hash
* add feature
* fix tests
* constants to help clarify 'irrelevant' changes
* move to enum for enforcing irrelevancy
* ignore unsupported tests
2022-10-18 08:03:37 -07:00
Jeff Washington (jwash)
682999a423
accounts hash calculation uses files instead of memory ( #28065 )
2022-10-18 07:51:38 -07:00
Jeff Washington (jwash)
b669b827fb
refactor and test get_sorted_potential_ancient_slots ( #28436 )
2022-10-18 07:45:43 -07:00
Jeff Washington (jwash)
28a89a1d99
remove expected rent collection and rehashing completely ( #28422 )
2022-10-17 07:24:42 -07:00
Jeff Washington (jwash)
0807105c5a
refactoring of accounts hash to prepare for using files always ( #28379 )
2022-10-14 12:29:43 -07:00
Jeff Washington (jwash)
72d6927fa1
factor out hashing of storages for caching ( #28261 )
2022-10-13 08:53:54 -07:00
Jeff Washington (jwash)
53a1a14868
eliminate worthless work in store_accounts_to ( #28365 )
2022-10-12 13:30:20 -07:00
steviez
db9e32d71d
Revert "log adding root every 10s ( #28280 )" ( #28334 )
...
This reverts commit 16853acf35
.
We get similar coverage from the slot field of bank-forks_set_root;
additionally, we can see banks with bank-new_from_parent-heights.
2022-10-11 12:49:49 -05:00
Jeff Washington (jwash)
7a120b8b62
accounts_db::load returns None for zero lamport accounts ( #28311 )
2022-10-11 07:43:03 -07:00
Jeff Washington (jwash)
16853acf35
log adding root every 10s ( #28280 )
2022-10-07 09:19:34 -07:00
Jeff Washington (jwash)
a1fe8dd444
add info for load race condition asserts ( #28277 )
2022-10-07 08:55:01 -07:00
Jeff Washington (jwash)
a400178744
hash calc chunking cleanup ( #28274 )
2022-10-06 23:23:26 -07:00
Jeff Washington (jwash)
76c30e7bd0
move accounts_db::load_without_fixed_root to test mod ( #28271 )
2022-10-06 17:11:08 -07:00
Jeff Washington (jwash)
66cd290d04
add chunk tracking in SplitAncientStorages ( #28202 )
2022-10-06 11:19:53 -07:00
Jeff Washington (jwash)
bb9a19ac86
minor refactoring of accounts hash cache ( #28260 )
2022-10-06 10:50:16 -07:00
Jeff Washington (jwash)
435d4aded9
run initial hash calc in background, using background threads ( #28239 )
2022-10-05 19:42:06 -07:00
Jeff Washington (jwash)
456d4ae93a
accounts hash calc, add get_ancient_slots ( #28240 )
2022-10-05 15:32:39 -07:00
Jeff Washington (jwash)
ad0742c7cf
exit early deep in bank freeze, avoiding some unnecessary work ( #28238 )
...
exit early on bank freeze
2022-10-05 14:49:33 -07:00
Brooks Prumo
a8c6a9e5fc
Bank::freeze() waits for EAH calculation to complete ( #28170 )
2022-10-05 17:44:35 -04:00
Jeff Washington (jwash)
3f5eec32cd
refactor SplitAncientStorages::new for testing ( #28235 )
2022-10-05 12:56:29 -07:00
Jeff Washington (jwash)
f464c69764
refactor into SplitAncientStorages::new ( #28228 )
2022-10-05 08:46:53 -07:00
Jeff Washington (jwash)
3339570a70
accounts hash scan refactoring ( #28220 )
2022-10-04 10:19:50 -07:00
Jeff Washington (jwash)
fd11e261dd
use ref for snapshot_storages.iter_range ( #28205 )
2022-10-04 09:11:44 -07:00
Jeff Washington (jwash)
39b37e2c6f
remove LoadZeroLamports enum ( #28204 )
...
remove feature return_none_for_zero_lamport_accounts
2022-10-04 08:06:56 -07:00
Jeff Washington (jwash)
e2c0999568
rename fields in SplitAncientStorages ( #28200 )
2022-10-03 17:18:08 -07:00
Jeff Washington (jwash)
df76cb5ad9
refactor into split_storages_ancient ( #28194 )
2022-10-03 14:25:33 -07:00
Jeff Washington (jwash)
adc4e633a2
accounts hash calc refactoring ( #28164 )
2022-10-01 17:09:50 -07:00
Jeff Washington (jwash)
929a311155
refactor accts hash tests ( #28165 )
2022-10-01 17:09:29 -07:00
Jeff Washington (jwash)
cfc124c825
acct idx can no longer use write cache ( #28150 )
2022-09-30 10:55:27 -07:00
Jeff Washington (jwash)
80c0173452
width of hash calc bins was off by 1 ( #28124 )
2022-09-29 11:45:53 -07:00