acd846b90e
when storing detailed debug info on accounts hash, we're ok with > 1 storage ( #27617 )
2022-09-07 06:38:57 -07:00
72a2c02ee7
add --accounts-db-verify-refcounts for debugging ( #27504 )
2022-09-06 09:39:39 -07:00
ed132e75a9
rename get_account_maps_read_lock to get_bin since we don't use a loc… ( #27543 )
...
rename get_account_maps_read_lock to get_bin since we don't ues a lock anymore
2022-09-06 07:22:55 -07:00
f90e70ff5a
fix some comments ( #27547 )
...
remove stray comment
2022-09-06 07:21:19 -07:00
a6d737d773
Add EpochAccountsHash to AccountsDb ( #27538 )
2022-09-01 12:11:07 -04:00
0df0b94a72
randomly shrink ancient append vecs ( #27523 )
2022-09-01 08:32:43 -07:00
28c3552756
remove counter stat for clean which is already captured in clean_accounts_stats
2022-09-01 10:11:08 -05:00
43e3545c26
add stats of dirty_slots for cleaning during hash calc
2022-09-01 10:11:08 -05:00
407717eb2a
add timing stat for account hash calc with cache
2022-09-01 10:11:08 -05:00
874085aadc
improve performance of unrefing ancient pubkeys ( #27485 )
2022-09-01 07:34:52 -07:00
b5cca0bfa3
add tests to AccountsDb::unref_accounts ( #27474 )
2022-08-30 18:51:20 -05:00
2e4a52d010
remove storages that only contain empty ( #27452 )
2022-08-30 14:04:17 -05:00
1154bc8636
get rid of acquisition of read lock while unrefing accounts in scan ( #27388 )
2022-08-30 14:04:02 -05:00
9bde3261fd
cleanup ( #27453 )
...
* cleanup
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks Prumo <brooks@prumo.org>
Co-authored-by: Brooks Prumo <brooks@prumo.org>
2022-08-30 10:58:35 -05:00
e35cd7a34a
comment loop in function ( #27454 )
2022-08-30 10:58:02 -05:00
3d692ba046
refactor clean_dead_slots_from_accounts_index ( #27451 )
2022-08-30 10:06:52 -05:00
73ee94d674
remove old bank hashes with ancient shrink ( #27450 )
2022-08-30 09:31:20 -05:00
a4b8ab2f59
clean_dead_slots_from_accounts_index unrefs correctly ( #27461 )
2022-08-30 08:40:21 -05:00
49411aaae0
Feature: Interleaved Snapshot Untar and Indexing - Stage 1 ( #26590 )
...
* Add snapshot_storage_lengths_from_fields
* Add SnapshotUnpacker
* Add SnapshotStorageRebuilder
* Rebuild snapshot storage during unpack
* move snapshot unpacker back into snapshot_utils
* use SerializedAppendVecId in storage rebuilder
* create AccountStorageMap type alias
* Wrap storage and next_append_vec_id in a type
* fixed typo
* move use StorageAndNextAppendVecId
* calculate num_rebuilder_threads more concisely
2022-08-29 13:17:27 -05:00
cdb699d812
ancient append vecs and cleaning dead slots ( #27353 )
...
cleanup old code
2022-08-26 10:13:41 -07:00
841ed68088
clean_accounts add _inclusive ( #27282 )
2022-08-24 08:56:53 -05:00
66e2df8ddc
failed_store_id should be searched per pubkey ( #27342 )
2022-08-23 19:12:50 -05:00
1c4f7bcd37
clean optimization for store count ( #27277 )
2022-08-23 14:56:44 -05:00
326f43d644
don't mark ancient append vecs as dirty wrt clean ( #27312 )
2022-08-23 09:18:48 -05:00
e4a7d01e10
Rust v1.63 ( #27303 )
...
* Upgrade to Rust v1.63.0
* Add nightly_clippy_allows
* Resolve some new clippy nightly lints
* Increase QUIC packets completion timeout
* Update quinn-udp crate
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-08-22 18:01:03 -07:00
748c6ea609
in ancient shrink, unref accounts that were already ancient shrunk ( #27294 )
2022-08-22 18:37:46 -05:00
0ac114fc5d
add _inclusive ( #27308 )
2022-08-22 18:03:32 -05:00
0e45e17aca
log reason why oldest store_id isn't being cleaned ( #27298 )
2022-08-22 17:11:38 -05:00
9703855a80
add _inclusive ( #27300 )
2022-08-22 14:55:58 -05:00
ae02d955b4
add _inclusive ( #27301 )
2022-08-22 14:33:17 -05:00
97036b1c75
refactor/document calc_delete_dependencies ( #27272 )
2022-08-22 13:28:18 -05:00
5272a2852d
account_iter instead of accounts() ( #27252 )
2022-08-22 11:35:43 -05:00
fc1a4dd11a
run hash calc with index on failure ( #27279 )
2022-08-22 10:58:04 -05:00
ab826b71a9
rename unused parameter for clarity ( #27271 )
2022-08-22 10:27:24 -05:00
9d5029da15
slots_per_epoch shouldn't be optional ( #27256 )
2022-08-22 10:15:48 -05:00
8f98333395
remove inaccurate log ( #27255 )
2022-08-20 10:15:10 -05:00
58ebae5b9c
cleanup comment on filter_zero_lamport_clean_for_incremental_snapshots ( #27273 )
2022-08-20 10:14:49 -05:00
3f4731b37f
Standardize thread names
...
Tenets:
1. Limit thread names to 15 characters
2. Prefix all Solana-controlled threads with "sol"
3. Use Camel case. It's more character dense than Snake or Kebab case
2022-08-20 07:49:39 -07:00
3c786bab65
Parallel insertion of dirty store keys during clean ( #27058 )
...
parallelize dirty store key insertion
2022-08-20 06:52:32 -07:00
1b441f7a2d
make test code more clear ( #27260 )
2022-08-19 14:39:20 -05:00
42e227778b
eliminate unnecessary ZERO_RAW_LAMPORTS_SENTINEL ( #27218 )
2022-08-19 14:18:00 -05:00
e132583a24
add _inclusive for clarity ( #27239 )
2022-08-19 14:17:32 -05:00
7573000d87
Revert "Rust v1.63.0 ( #27148 )" ( #27245 )
...
This reverts commit a2e7bdf50a
2022-08-19 09:19:44 +01:00
f115e4d0ed
reorder slot # in debug hash data path ( #27217 )
2022-08-18 11:30:11 -05:00
7720b48aa6
add an assert for a debug feature to avoid wasted time ( #27210 )
2022-08-18 10:35:22 -05:00
a2e7bdf50a
Rust v1.63.0 ( #27148 )
...
* Upgrade to Rust v1.63.0
* Add nightly_clippy_allows
* Resolve some new clippy nightly lints
* Increase QUIC packets completion timeout
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-08-17 15:48:33 -07:00
2fd9a4f373
Add clean_accounts_for_tests() ( #27200 )
2022-08-17 18:45:59 -04:00
8c791f871e
store hash calc failures in a separate folder by slot ( #27146 )
...
* store hash calc failures in a separate folder by slot
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks Prumo <brooks@prumo.org>
Co-authored-by: Brooks Prumo <brooks@prumo.org>
2022-08-16 09:35:56 -05:00
1a90cffabe
Add stats for readonly cache evicts ( #26938 )
...
* add stats for readonly cache evicts
* bump up account cache to 400M
* aggregate num_evicts in the loop
2022-08-15 16:23:37 -05:00
0ca8239ef7
don't log when there is no work to do for combining ancient slots ( #26925 )
2022-08-13 14:38:41 -06:00
Jeff Washington (jwash)
Jeff Washington (jwash)
Brooks Prumo
Haoran Yi
apfitzge
Brennan Watt
Michael Vines