9d2c71b9a3
remove type SnapshotStoragesOne ( #29750 )
2023-01-18 11:51:08 -08:00
aef8692c8f
remove SnapshotStorageOne ( #29747 )
2023-01-18 07:10:56 -08:00
f24e30e4fe
remove test method get_storages_for_slot ( #29739 )
2023-01-17 12:28:53 -08:00
8c62927d59
Adds calculate_incremental_accounts_hash() ( #29734 )
...
**Node operators,** please delete your `<ledger>/calculate_accounts_hash_cache` directory (if you have one). It has been moved/renamed to `<ledger>/accounts_hash_cache/full`.
2023-01-17 15:04:29 -05:00
e1d38c8315
remove test method slot_stores ( #29736 )
2023-01-17 10:15:25 -08:00
71a746f10e
remove some write_version checking ( #29733 )
2023-01-17 10:14:31 -08:00
4bfe4091b4
make storages not plural ( #29732 )
2023-01-17 09:50:35 -08:00
5188da0492
remove get_slot_stores from AccountStorage ( #29726 )
2023-01-17 09:26:46 -08:00
1d88654116
Revert "Cap accounts data a transaction can load by its requested limit" ( #29373 )
...
Revert "Cap accounts data a transaction can load by its requested limit (#27840 )"
This reverts commit 81dc2e56ac
2023-01-17 11:34:18 +01:00
c5380d4699
Adds symmetric tests for all cases of un-/re-/deployment inside the same transaction ( #29725 )
...
Unifies test_program_sbf_upgrade_and_invoke_in_same_tx() and test_program_sbf_upgrade_self_via_cpi() into test_program_sbf_invoke_in_same_tx_as_redeployment().
Adds test_program_sbf_invoke_in_same_tx_as_deployment() and test_program_sbf_invoke_in_same_tx_as_undeployment().
2023-01-17 09:44:27 +01:00
461dafb887
AccountStorage only holds a single append vec ( #29723 )
...
* AccountStorageReference
* tests build
* pr feedback
2023-01-16 16:22:30 -08:00
0db14ad39c
Removes full_snapshot from CalcAccountsHashConfig ( #29722 )
2023-01-16 16:22:46 -05:00
ef30083319
iterate contents of AccountStorage without exposing internals ( #29719 )
...
* iterate contents of AccountStorage without exposing internals
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks <brooks@prumo.org>
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks <brooks@prumo.org>
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks <brooks@prumo.org>
* compile errors
Co-authored-by: Brooks <brooks@prumo.org>
2023-01-16 12:01:25 -08:00
8a28877910
Use Hash::new_from_array() instead of TryFrom ( #29720 )
2023-01-16 10:53:38 -05:00
977d3453a3
storage.remove does not leak SlotStores ( #29664 )
2023-01-15 11:06:24 -08:00
9d1a0c52f8
Cleanup - `disable_deprecated_loader` ( #29653 )
...
* Removes the gating of disable_deprecated_loader.
* Adds create_program().
Renames create_deprecated_program() -> load_program().
Renames load_and_finalize_deprecated_program() -> load_and_finalize_program().
* Fixes test_sol_alloc_free_no_longer_deployable().
2023-01-14 13:02:10 +01:00
064f163b70
get_account_storage_entry handles missing shrink in progress entry correctly ( #29682 )
2023-01-13 13:11:25 -08:00
a2933f7fa6
remove some uses of write_version ( #29680 )
2023-01-13 12:05:15 -08:00
ab97d37e3d
Refactor - Simplify loader utils ( #29699 )
...
* Moves all the common code of tests and benches into loader utils.
* Removes write_sbf_program().
* Removes ignored test: test_program_sbf_test_use_latest_executor2().
2023-01-13 20:38:36 +01:00
10f8b5faa3
Bump memmap2 from 0.5.3 to 0.5.8 ( #29674 )
...
* Bump memmap2 from 0.5.3 to 0.5.8
Bumps [memmap2](https://github.com/RazrFalcon/memmap2-rs ) from 0.5.3 to 0.5.8.
- [Release notes](https://github.com/RazrFalcon/memmap2-rs/releases )
- [Changelog](https://github.com/RazrFalcon/memmap2-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/RazrFalcon/memmap2-rs/compare/v0.5.3...v0.5.8 )
---
updated-dependencies:
- dependency-name: memmap2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-01-12 19:38:38 -07:00
6359d68f9f
get_slot_stores -> get_slot_storage_entry ( #29677 )
2023-01-12 09:44:53 -08:00
d0aa93de21
Refactors accounts hash cache ( #29625 )
2023-01-12 10:43:50 -05:00
3412928cad
get_slot_stores -> get_slot_storage_entry ( #29678 )
2023-01-12 07:17:18 -08:00
b64f58614d
get_slot_stores -> get_slot_storage_entry ( #29665 )
2023-01-12 07:09:56 -08:00
9d1c0c5a3c
get_slot_stores -> get_slot_storage_entry ( #29663 )
2023-01-12 04:08:08 -08:00
56f8c16497
remove remaining uses of SnapshotStorages ( #29660 )
2023-01-11 17:58:14 -08:00
14055fc3e2
remove type SnapshotStorage and uses ( #29661 )
2023-01-11 17:57:44 -08:00
69c4db27c5
Configurable hashes per tick ( #29659 )
2023-01-11 16:56:11 -08:00
3e6ba72da1
remove scan_multiple_account_storages_one_slot ( #29658 )
2023-01-11 16:26:49 -08:00
0e19b9c849
SortedStorages holds HashMap instead of Vec ( #29632 )
...
* SortedStorages holds HashMap instead of Vec
* add comment
2023-01-11 14:20:43 -08:00
4b93fa85c2
renaming/refactoring for append vecs ( #29655 )
2023-01-11 14:20:14 -08:00
544b9745c2
snapshot storage path uses 1 append vec per slot ( #29627 )
2023-01-11 12:05:15 -08:00
28071d5bf4
chore: Move new bank metric into metric submodule ( #29628 )
...
More cleanup in moving non-essential items out of bank.rs
2023-01-11 13:14:46 -06:00
0ee9993632
decouple geyser's write_version from append vec on snapshot load ( #29623 )
2023-01-11 10:59:57 -08:00
1d6999914a
factor out scan_single_account_storage ( #29633 )
2023-01-11 10:59:46 -08:00
d693167dfb
Feature: filter stake by min delegation for rewards ( #29618 )
...
filter stake by min delegation for rewards
2023-01-11 08:55:18 -06:00
864a7d8d6f
Bump bzip2 from 0.4.3 to 0.4.4 ( #29630 )
...
* Bump bzip2 from 0.4.3 to 0.4.4
Bumps [bzip2](https://github.com/alexcrichton/bzip2-rs ) from 0.4.3 to 0.4.4.
- [Release notes](https://github.com/alexcrichton/bzip2-rs/releases )
- [Commits](https://github.com/alexcrichton/bzip2-rs/commits/0.4.4 )
---
updated-dependencies:
- dependency-name: bzip2
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-01-10 23:08:22 -07:00
0f16120b03
remove FoundStoredAccount ( #29591 )
2023-01-10 13:57:34 -08:00
ad400419b5
assert write version is increasing per slot as we read from a slot ( #29624 )
2023-01-10 13:34:30 -08:00
c3353c27c2
verify acct size in index can easily be recalculated ( #29601 )
2023-01-10 13:33:36 -08:00
9cd3bb0c4d
never try to shrink a slot that is in the write cache ( #29615 )
2023-01-10 12:01:37 -08:00
1faf7d516b
while shrinking, old append vec is held outside of storage.map ( #29323 )
...
* while shrinking, old append vec is held outside of storage.map
* update comment
* rework ShrinkInProgress for clarity
* add tests and comment
2023-01-10 11:52:01 -08:00
1c1c8fb008
chore: Move bank new epoch metrics into separate file ( #29599 )
...
chore: Move bank new epoch metric into separate file
bank.rs is very large, so move the metrics reporting code into a
separate file. This reduces line count and also makes the actual logic
in bank.rs more readable by removing a big block of boilerplate code.
There are more metrics that we can do this for, but doing them one at a
time to avoid large diffs.
2023-01-10 13:15:50 -06:00
a5106e110a
just use slot to determine alive while shrinking ( #29613 )
2023-01-10 09:00:18 -08:00
1c862f0b66
remove unused ret val from do_shrink_slot_store ( #29616 )
2023-01-10 08:12:24 -08:00
6441ed121e
get_unique_accounts_from_storages drops plural ( #29600 )
2023-01-10 07:49:38 -08:00
d3daea65b9
use atomicu64 for bucket maxsize instead of lock ( #29569 )
2023-01-10 09:15:27 -06:00
71467808d2
convert some get_slot_stores -> get_slot_storage_entry ( #29549 )
2023-01-10 05:34:08 -08:00
c9fe21e3c3
ancient append vecs enabled at -10k by default ( #29565 )
2023-01-10 05:33:43 -08:00
1d675c6205
FoundStoredAccount removes store_id ( #29590 )
2023-01-10 05:28:41 -08:00
db277d320b
Adds TX signature to `TransactionContext` in debug mode ( #29597 )
...
Adds TX signature to TransactionContext in debug mode.
2023-01-10 00:54:26 +01:00
dda34b208c
get_unique_accounts_from_storages takes 1 append vec ( #29588 )
2023-01-09 14:53:50 -08:00
3234af41a7
shrink_collect takes a single append vec ( #29523 )
2023-01-09 13:33:21 -08:00
a703019caa
feature: don't do rewrites in rent collection ( #26491 )
...
* feature: don't do rewrites in rent collection
* modify test to specifically test this feature
2023-01-09 08:14:17 -08:00
d41da2178c
test_bad_bank_hash uses write cache ( #29559 )
2023-01-09 08:10:28 -08:00
a171402e5c
combine_one_store_into_ancient takes 1 append vec ( #29560 )
2023-01-09 08:09:38 -08:00
9692cfef98
accounts tests use store_for_tests ( #29555 )
2023-01-06 15:30:42 -08:00
2f0d849c84
set rent epoch to max on new account creation ( #29528 )
...
* set rent epoch to max on new account creation
* add comment
2023-01-06 14:21:10 -08:00
2a0a185846
accounts tests use store_for_tests ( #29554 )
2023-01-06 12:07:36 -08:00
33119f8a87
convert some get_slot_stores -> get_slot_storage_entry ( #29557 )
2023-01-06 12:06:59 -08:00
453b61676e
filler accounts only work gradually ( #29553 )
2023-01-06 12:05:32 -08:00
3fc4015a4d
do_shrink_slot_stores -> do_shrink_slot_store ( #29552 )
2023-01-06 09:23:32 -08:00
39dc034c05
ShrinkCandidates only hold 1 append vec per slot ( #29525 )
...
* ShrinkCandidates only hold 1 append vec per slot
* Fixed select_candidates_by_total_usage unit tests, use distinct slots for stores
as each slot has one store now.
* rename
Co-authored-by: Lijun Wang <83639177+lijunwangs@users.noreply.github.com>
2023-01-06 06:54:34 -08:00
272e5a05f2
remove AccountStorage::is_empty() ( #29548 )
2023-01-06 06:51:25 -08:00
8e19909c7d
stop returning remaining # stores from mark_dirty_dead_stores ( #29545 )
2023-01-05 19:21:01 -08:00
a0f045d2c3
storage rebuilder regex cleanup ( #29408 )
...
* storage rebuilder regex cleanup
* Update runtime/src/snapshot_utils/snapshot_storage_rebuilder.rs
Co-authored-by: apfitzge <apfitzge@gmail.com>
Co-authored-by: apfitzge <apfitzge@gmail.com>
2023-01-05 16:16:24 -08:00
a6b492b2c1
Removed assert on write_version ordering ( #29530 )
...
Removed assert on write_version ordering as snapshot created by earlier version
is not honoring that.
2023-01-05 15:14:55 -08:00
a6bf68cec8
Refine appendvec sanitize error message to include path ( #29541 )
2023-01-05 14:43:10 -08:00
72a7cbd6a2
shrink fns take a single append vec ( #29522 )
2023-01-05 13:17:04 -08:00
12da2da389
fixes errors from clippy::redundant_clone ( #29536 )
...
https://rust-lang.github.io/rust-clippy/master/index.html#redundant_clone
2023-01-05 18:42:19 +00:00
3b7ebfe50e
migrate tests to use get_storage_for_slot ( #29518 )
2023-01-05 10:38:58 -08:00
d3f45c6901
shrink_slot_forced uses a single append vec ( #29521 )
2023-01-05 10:38:05 -08:00
d87128e02c
fixes errors from clippy::needless_borrow ( #29535 )
...
https://rust-lang.github.io/rust-clippy/master/index.html#needless_borrow
2023-01-05 18:21:56 +00:00
d611cc2e75
Fixes format string ( #29533 )
2023-01-05 13:06:00 -05:00
5c9beef498
fixes errors from clippy::useless_conversion ( #29534 )
...
https://rust-lang.github.io/rust-clippy/master/index.html#useless_conversion
2023-01-05 18:05:32 +00:00
1e8a8e07b6
Stream the executed transaction count in the block notification ( #29272 )
...
Problem
The plugins need to know when all transactions for a block have been all notified to serve getBlock request correctly. As block and transaction notifications are sent asynchronously to each other it will be difficult.
Summary of Changes
Include the executed transaction count in block notification which can be used to check if all transactions have been notified.
2023-01-05 09:36:19 -08:00
dbac798ef6
process_storage_slot takes a single append vec ( #29519 )
2023-01-05 07:33:47 -08:00
a140f06a67
use get_storage_for_slot() in tests ( #29517 )
2023-01-05 07:32:00 -08:00
8cdf5cdb50
get_storage_to_move_to_ancient_append_vec returns a single append vec ( #29482 )
...
get_storages_to_move_to_ancient_append_vec returns a single append vec
2023-01-05 07:31:26 -08:00
221f547ba9
remove store_ids from a few shrink data structures ( #29360 )
2023-01-05 07:30:43 -08:00
05d5aed4d8
Adds SnapshotError::IoWithSourceAndFile ( #29527 )
2023-01-05 09:08:15 -05:00
fc8cd82309
migrate tests to get_slot_storage_entry ( #29515 )
2023-01-04 13:12:48 -08:00
4e636ab153
cleanup ancient append vec tests ( #29514 )
2023-01-04 12:39:42 -08:00
150ac80cfa
filter_storages ignores reclaims ( #29512 )
2023-01-04 12:38:30 -08:00
ef72140173
remove unnecessary to_vec() ( #29516 )
2023-01-04 12:38:16 -08:00
093b1a5e10
get_storages_for_slot uses get_slot_storage_entry ( #29498 )
2023-01-04 10:15:56 -08:00
10135dbd10
should_move_to_ancient_append_vec works with a single storage ( #29484 )
2023-01-04 07:03:46 -08:00
d7bd1bf970
bank: Record non-vote transaction count ( #29383 )
...
A subsequent change to `SamplePerformanceService` introduces non-vote transaction counts, which `bank`s need to store.
Part of work on https://github.com/solana-labs/solana/issues/29159
2023-01-03 14:46:20 -08:00
89deecb979
add AccountStorage.is_empty_entry for tests ( #29489 )
2023-01-03 12:36:31 -08:00
0f2bfa2b02
cleanup get_snapshot_storages ( #29488 )
...
* cleanup get_snapshot_storages
* pr feedback
2023-01-03 12:22:28 -08:00
95d2f002bd
add AccountStorage.get_slot_storage_entry ( #29480 )
2023-01-03 12:10:34 -08:00
9ee4555f53
remove should_retain from mark_dirty_dead_stores ( #29358 )
2023-01-03 09:53:43 -08:00
102dc08378
get_snapshot_storages removes call to AccountStorage.get ( #29466 )
2023-01-03 09:15:07 -08:00
9d15ead873
remove single use AccountStorage.slot_store_count ( #29479 )
2023-01-03 09:12:27 -08:00
10eadb6dd9
add test method assert_no_storages_at_slot() ( #29483 )
2023-01-03 08:59:21 -08:00
ca9166201c
add test method get_and_assert_single_storage ( #29481 )
2023-01-03 08:38:15 -08:00
04508ccfa7
add AccountStorage.is_empty ( #29478 )
2023-01-03 08:35:10 -08:00
8c878daada
refactor RecycleStores::add_entries ( #29475 )
...
* refactor RecycleStores::add_entries
* pr feedback
2023-01-03 07:56:30 -08:00
89e733c2b3
remove unnecessary type ( #29473 )
2023-01-03 06:34:05 -08:00
3363c08ac0
Move async remove to snapshot_utils.rs ( #29406 )
2023-01-03 06:15:32 -08:00
Jeff Washington (jwash)
Brooks
Tao Zhu
Alexander Meißner
dependabot[bot]
Brennan Watt
steviez
HaoranYi
Xiang Zhu
Lijun Wang
behzad nouri
Illia Bobyr