f4287d70bb
Move accounts-db code to its own crate ( #32766 )
2023-08-09 13:03:36 -07:00
fa8cbae8df
Only hold storages meant for snapshots ( #32590 )
2023-07-25 18:58:06 -04:00
aba637d5d9
Split snapshot_utils.rs into snapshot_bank_utils.rs ( #32612 )
2023-07-24 16:31:03 -07:00
282e043177
`cargo fmt` using 1.6.0-nightly ( #32390 )
...
Seems like rustfmt 1.6.0 can now format `let/else` statements.
1.5.2 we use in our `solana-nightly` does not mind the reformatting.
```
$ cargo +nightly fmt --version
rustfmt 1.6.0-nightly (f20afcc 2023-07-04)
$ cargo +nightly fmt
$ git add -u
$ git commit
$ ./cargo nightly fmt --version
+ exec cargo +nightly-2023-04-19 fmt --version
rustfmt 1.5.2-nightly (c609da5 2023-04-18)
$ ./cargo nightly fmt
$ git diff
[empty output]
```
2023-07-06 20:45:29 -07:00
77b587aa4d
Add constant for disabled snapshot interval ( #32236 )
...
Slot::MAX was used to specify that a type of snapshots should not be
created; define a constant to be that value and reference the constant
to have a single point of edit.
2023-06-26 12:26:56 -05:00
a4ff9be5fb
Handle errors when sending a snapshot package during shutdown ( #31873 )
2023-05-30 16:06:10 -04:00
0e93090520
Updates priority for which snapshot request to handle next ( #31798 )
2023-05-24 16:21:06 -04:00
ad67fd5be5
validator: remove optional remote accounts hash consistency check ( #31279 )
2023-05-16 14:23:13 -06:00
dd4cfe9924
Do not purge bank snapshots in AccountsBackgroundService ( #31647 )
2023-05-15 13:53:48 -04:00
bac4d50761
Uses `_` instead of `-` for datapoint field names ( #31648 )
2023-05-15 12:02:43 -04:00
962650e88e
AccountsHashVerifier purges old bank snapshots ( #31519 )
2023-05-12 17:02:43 -04:00
3e543665c7
remove unused functions connecting hash calc and ancient append vec boundary ( #31575 )
...
remove coupling between hash calc and ancient append vec boundary
2023-05-11 13:30:44 -07:00
122b05b9f5
pass include_slot_in_hash through hash calcs to allow rehashing if hash is not stored ( #31579 )
...
* pass include_slot_in_hash through hash calcs to allow rehashing
* tests use each include_slot_in_hash value
* move include_slot_in_hash
* typo
* reorder struct init
* spelling is hard
2023-05-11 13:23:29 -07:00
0a2e897f16
Clean up the outdated SnapshotPackage snapshot_links field ( #31360 )
...
* Remove snapshot_links
* Change the function name from snapshot_dir to bank_snapshot_dir
* Format fix
* Fix test_concurrent_snapshot_packaging
* Fix clippy error
* Fix nits
* Fix nits 2nd try
* Use get_bank_snapshots_dir
* Use slot_dir
* Revert "Use get_bank_snapshots_dir" because get_bank_snapshots_dir is private to crate
This reverts commit 1ed9b3b2c8e84689a918beee7159f63c56500a96.
2023-05-01 11:24:59 -07:00
427ad7b5bd
Combine AccountsHashVerifier metrics ( #31420 )
...
It is more efficient to submit the metrics together, and there is no
reason for them to be separate.
2023-04-30 21:39:44 -04:00
f3e94ca73c
AHV processes the snapshot dirs in place ( #30978 )
...
* AHV processes the snapshot dirs in place
Let account pacakge use the snapshot dir, so AHV computes the accounts hash and turns the pre snapshot dir into a post snapshot dir
* fix status cache path to maintain the archive layout for the in-place snapshot dir archiving
* fix test_package_snapshots
* Fix test_concurrent_snapshot_packaging
* Remove debug change.
* Fix snapshot_links path
* change to borrow for bank_snapshots_dir
* Reverted changes in create_and_verify_snapshot
* Fix param errors
* Fix rebase errors
* Remove NOTE 1
* Remove unwrap
* Remove the variables to make it apparent taht snapshot_links is the bank_snapshots_dir
* Use soft link instead of hard link for snapshot and status cache
* After switching to soft symlinking, the src path should be absolute
2023-04-26 11:48:48 -07:00
80b27f3cd9
Use Arc instead of &Arc in AccountsHashVerifier::new ( #31269 )
2023-04-19 11:10:08 -04:00
2164a50d00
Move BankIncrementalSnapshotPersistence ( #31236 )
...
* Move BankIncrementalSnapshotPersistence
* Update bank serialize ABI digest
2023-04-18 11:18:17 -07:00
5747290d51
Move reference-holding last_snapshot_storages from ABS to AHV ( #31175 )
...
* Let AHV hold and update last_snapshot_storages
* Clean up comment
* Move cloning after enqueued_time
* Minor positon change
* Remove type last_snapshot_storages annotation
2023-04-14 14:38:44 -07:00
f9276d1748
Uses MAX_ACCOUNTS_HASHES instead of MAX_SNAPSHOT_HASHES in accounts_hash_verifier.rs ( #31114 )
2023-04-10 10:44:40 -04:00
fcd1fe0959
Refactor fault hash injection into lambda ( #31093 )
...
* refactor out fault hash inject output AccountsHashVerifier
* refactor faught injector out of AccountHashVerifier
* use type alias
* Apply suggestions from code review
Co-authored-by: Brooks <brooks@prumo.org>
* move type alias
* rename
---------
Co-authored-by: Brooks <brooks@prumo.org>
2023-04-07 17:50:21 -05:00
d7ae05c3fd
Unifies logging of start/stop for background services ( #30916 )
2023-03-28 08:32:18 -04:00
bf7fa02214
Add units to incremental accounts hash datapoint ( #30894 )
2023-03-24 21:39:20 +00:00
35437b8dad
Makes AccountsHashVerifier aware of Incremental Accounts Hash ( #30820 )
2023-03-22 10:20:16 -04:00
cd7fe76744
Removes writing BankIncrementalSnapshotPersistence in AccountsHashVerifier ( #30792 )
2023-03-19 21:45:13 -04:00
93c43610ac
AccountsHashVerifier stores IncrementalAccountsHash in AccountsDb ( #30696 )
2023-03-14 12:41:44 -04:00
560ec08d5e
AccountsHashVerifier writes BankIncrementalSnapshotPersistence ( #30587 )
2023-03-13 17:44:34 -04:00
346021a48c
Refactors common accounts hash calculation config in AccountsHashVerifier ( #30677 )
...
* Refactors common accounts hash calculation config in AccountsHashVerifier
* pr: config var
2023-03-13 19:39:28 +00:00
6e5615e32d
Revert "AccountsHashVerifier remembers last full snapshot info ( #30582 )" ( #30660 )
2023-03-13 14:48:16 -04:00
505e3ff5c7
AccountsHashVerifier updates AccountsDb after calculating accounts hash ( #30658 )
2023-03-13 16:41:24 +00:00
a43f803604
AccountsHashVerifier purges old accounts hashes ( #30644 )
2023-03-13 11:12:11 -04:00
120b0c92d1
AccountsHashVerifier remembers last full snapshot info ( #30582 )
...
AHV remembers last full snapshot info
2023-03-06 16:40:46 +00:00
6972f92c29
AHV loop uses let-else ( #30583 )
2023-03-04 01:59:29 +00:00
1cf0ce1215
AHV logs when stopped ( #30585 )
2023-03-03 23:44:30 +00:00
cd652a7e20
AHV uses metrics names like SPS's ( #30584 )
2023-03-03 23:38:35 +00:00
89c07d259a
AccountsHashVerifier uses AccountsHashEnum ( #30514 )
2023-02-24 17:17:54 -05:00
1689586213
Uses a channel for AHV -> SPS ( #30406 )
2023-02-22 03:36:29 +00:00
35328ca63d
Makes AccountsHash an enum ( #30416 )
2023-02-21 15:20:51 -05:00
ded457cd73
embeds the new gossip ContactInfo in ClusterInfo ( #30022 )
...
Working towards replacing the legacy gossip contact-info with the new
one, the commit updates the respective field in gossip cluster-info.
2023-02-10 20:07:45 +00:00
1c7662a37f
asserts that cluster-info keypair is consistent with contact-info id ( #29818 )
2023-01-24 16:57:55 +00:00
0db14ad39c
Removes full_snapshot from CalcAccountsHashConfig ( #29722 )
2023-01-16 16:22:46 -05:00
8c212f59ad
renames ContactInfo to LegacyContactInfo ( #29566 )
...
Working towards adding a new ContactInfo where new sockets can be
added in a backward compatible way.
2023-01-08 16:00:55 +00:00
86b2e545e1
Prune redundant const SLOT_MS ( #29278 )
...
* Alias redundant const SLOT_MS to DEFAULT_MS_PER_SLOT
* Slate SLOT_MS for deprecation
* Add doc comments
Co-authored-by: Brooks Prumo <brooks@prumo.org>
2022-12-16 08:05:09 -08:00
aeb6b53502
Remove unused Option<> around ValidatorConfig's SnapshotConfig ( #29090 )
...
Remove Option<> around ValidatorConfig's SnapshotConfig
The SnapshotConfig is required and is currently hard-coded to be a
Some().
2022-12-06 22:47:55 +00:00
9327658007
Promotes accounts hash to a strong type ( #28930 )
2022-11-28 10:09:47 -05:00
9e1cdc7e60
Enables not taking a bank snapshot ( #28756 )
2022-11-09 12:43:33 -05:00
0b9426e734
Simplifies AHV's `test_max_hashes()` ( #28754 )
2022-11-07 02:32:33 +00:00
064cfc70d2
Removes cluster_type from AccountsPackage ( #28725 )
2022-11-02 18:21:13 -04:00
d0f639745a
Uses AccountsPackage::default_for_tests() in AHV tests ( #28723 )
2022-11-02 14:13:35 -04:00
37507a2de6
Removes EAH parameter from serde_snapshot::reserialize_bank() ( #28669 )
2022-10-31 09:43:17 -04:00
Pankaj Garg
Brooks
Illia Bobyr
steviez
Trent Nelson
Jeff Washington (jwash)
Xiang Zhu
Brennan
HaoranYi
behzad nouri