94a6665995
test_clean_multiple_zero_lamport_decrements_index_ref_count uses write cache ( #29088 )
2022-12-06 08:56:37 -08:00
fe8b15b43a
test_accountsdb_count_stores uses write cache ( #29086 )
2022-12-06 07:40:51 -08:00
93cc3b1d3d
test_shrink_stale_slots_skipped only uses non-write cache ( #29081 )
2022-12-06 07:03:30 -08:00
4de13be926
test_accounts_db_serialize1 uses write cache ( #29085 )
2022-12-06 06:36:28 -08:00
f88398cbcf
test_shrink_stale_slots_processed uses write cache ( #29082 )
2022-12-06 06:35:49 -08:00
ed0c9e285b
test_partial_clean supports write cache ( #29091 )
2022-12-06 06:35:02 -08:00
c106c7e349
test_clean_accounts_with_last_full_snapshot_slot uses write cache ( #29087 )
2022-12-05 20:41:11 -08:00
6935ff74ce
test_uncleaned_roots_with_account uses write cache ( #29084 )
2022-12-05 20:37:42 -08:00
1b49c52d98
store_uncached -> store_for_tests ( #29083 )
2022-12-05 14:42:16 -08:00
b4075a0e29
bank tests use write cache ( #28885 )
2022-12-05 14:08:28 -08:00
9746eb2c8d
test_lazy_gc_slot can use write cache ( #29080 )
2022-12-05 12:48:15 -08:00
8c47e2168e
test_accounts_clean_after_snapshot_restore_then_old_revives can use write cache ( #29050 )
...
* test_accounts_clean_after_snapshot_restore_then_old_revives can use write cache
* combine flush and set root
2022-12-05 12:39:26 -08:00
293a5860b8
test_process_stale_slot_with_budget never uses write cache ( #29076 )
2022-12-05 11:40:14 -08:00
1036d4409b
test_verify_snapshot_bank works without write cache ( #29075 )
2022-12-05 11:00:01 -08:00
c65a8ce6c3
AccountsDb::get_snapshot_storages() takes a Range for slots ( #29054 )
2022-12-05 11:21:21 -05:00
544e430a0d
Use AccountsHash instead of bare Hash ( #29052 )
2022-12-05 11:19:29 -05:00
7f268e0f6d
rebuild_bank_from_snapshots uses write cache ( #29047 )
2022-12-02 13:28:21 -08:00
babc241345
tests use write cache ( #29027 )
...
* test_add_precompiled_account uses write cache
* test_add_precompiled_account_squatted_while_not_replacing uses write cache
2022-12-02 10:26:51 -08:00
5104f4ef0d
test_bank_update_vote_stake_rewards works with write cache ( #29044 )
2022-12-02 10:19:43 -08:00
00ba78bd2d
test_bank_update_rewards_determinism works with write cache ( #29043 )
2022-12-02 09:56:58 -08:00
6852d5768a
test_add_builtin_account* works with write cache ( #29030 )
2022-12-02 09:48:21 -08:00
87a3130226
test_bank_hash_internal_state works with write cache ( #29042 )
2022-12-02 09:37:22 -08:00
d17a740a99
test_bank_hash_internal_state_verify works with write cache ( #29041 )
2022-12-02 09:22:42 -08:00
0809a4df78
remove redundant internal functions ( #29035 )
...
remove redundant _internal functions
2022-12-02 10:21:25 -06:00
63e19c0068
do_test_clean_dropped_unrooted_banks uses write cache ( #29029 )
2022-12-02 08:04:57 -08:00
911a8d2a4a
test_add_instruction_processor_for_existing_unrelated_accounts works with write cache ( #29031 )
2022-12-02 08:04:34 -08:00
5850af5316
Refactor to remove requested_cu from cost_trarcker ( #29015 )
...
* refactor cost tracker by removing requested_cu from it, call sites to use cost_model forr consistency
* review fix
2022-12-02 00:25:09 +00:00
20aeff3632
test_purge_empty_accounts uses write cache ( #29018 )
2022-12-01 15:22:26 -08:00
dbd6ce8f21
test_bank_update_sysvar_account uses write cache ( #29022 )
...
* test_add_precompiled_account_inherited_cap_while_replacing uses write cache
* test_bank_update_sysvar_account uses write cache
2022-12-01 15:21:05 -08:00
a9c8f26a66
test_add_precompiled_account_inherited_cap_while_replacing uses write cache ( #29019 )
2022-12-01 14:07:39 -08:00
631d93dd2d
tests use write cache ( #29012 )
2022-12-01 12:17:13 -08:00
e6cc5052c3
pass alive bytes to AccountsToStore::new ( #28994 )
2022-11-30 15:46:52 -08:00
2c912c9049
use files for merkle tree inputs on accounts hash ( #28965 )
...
* use files for merkle tree inputs on accounts hash
* remove multi-pass scan, simplify
* cleanup and comments
* rework writing into the hash file for clarity
* add test, cleanup
* rename
* move count into option
2022-11-30 12:27:27 -08:00
58e12cf963
avoid copies when writing to an ancient append vec ( #28981 )
...
* avoid copies when writing to an ancient append vec
* update comments
2022-11-30 10:09:23 -08:00
2427004dba
add 'bytes' to aligned/alive_total for clarity ( #28982 )
2022-11-30 07:38:57 -08:00
c8cc1270f1
log # append vecs open ( #28958 )
2022-11-29 16:48:02 -08:00
e42649a8ba
remove cli arg to specify # accounts hash scan passes ( #28976 )
2022-11-29 16:47:51 -08:00
19d86bd2b1
add balance to cap overflow message ( #28975 )
2022-11-29 13:55:07 -08:00
9327658007
Promotes accounts hash to a strong type ( #28930 )
2022-11-28 10:09:47 -05:00
267bbcadcf
Cleans up accounts hash testing in ABS ( #28931 )
2022-11-23 10:07:22 -05:00
9a24743d2a
expect only 1 store per slot ( #28844 )
...
expect only 1 store per slot in shrink
2022-11-23 06:20:36 -08:00
04016e3bcf
Don't wait for EAH unless feature is enabled ( #28938 )
2022-11-23 09:11:28 -05:00
40a7c6d46a
Renames fn to insert_default_bank_hash() ( #28929 )
2022-11-22 19:31:59 -05:00
5d88a9b32b
improve perf of storing accounts for shrink/ancient ( #28880 )
...
* improve perf of storing accounts for shrink/ancient
* rename
* phantom data
* update comment
* make impl Borrow<Hash> consistent
* remove unused static
2022-11-22 15:36:57 -08:00
c8b0c3ede9
Update cost model to use requested_cu instead of estimated cu #27608 ( #28281 )
...
* Update cost model to use requested_cu instead of estimated cu #27608
* remove CostUpdate and CostModel from replay/tvu
* revive cost update service to send cost tracker stats
* CostModel is now static
* remove unused package
Co-authored-by: Tao Zhu <tao@solana.com>
2022-11-22 11:55:56 -06:00
efc681b348
rename test var for clarity ( #28914 )
2022-11-21 13:22:16 -08:00
d449b9ea26
test_new_from_file_crafted_zero_lamport_account uses static append vec file ( #28911 )
2022-11-21 12:43:03 -08:00
8addf93de7
test_store_reuse uses write cache ( #28901 )
2022-11-21 11:17:33 -08:00
ff7e82b5ff
Removes Accounts::bank_hash_at() ( #28879 )
2022-11-21 13:25:48 -05:00
b29dea7a56
comment function ( #28906 )
2022-11-21 09:56:07 -08:00
d698f982ee
Renames to AccountsHasher ( #28883 )
2022-11-18 18:25:44 -05:00
8cbe83c725
cleanup CalcAccountsHashDataSource ( #28882 )
2022-11-18 14:49:22 -08:00
f22104d46b
use write cache by default in some tests ( #28876 )
2022-11-18 14:35:52 -08:00
aa1d319d48
add shrink ancient test ( #28858 )
...
* add shrink ancient test
* improvements
2022-11-18 13:11:57 -08:00
7787cb2ab2
Renames BankHashInfo field to accounts_delta_hash ( #28878 )
2022-11-18 15:35:03 -05:00
dcfb73f664
extract test append_account function ( #28875 )
2022-11-18 10:57:02 -08:00
9acfa08838
remove per-account slot in ancient append vecs ( #28851 )
...
* remove per-account slot in ancient append vecs
* review fixes
2022-11-18 10:15:41 -08:00
4c85850a73
Refactor: Rename `load_transaction` to `load_transaction_accounts` ( #28746 )
...
* Refactor: Rename load_transaction to load_transaction_accounts
* Refactor: map over account keys to load transaction accounts
2022-11-18 23:44:09 +08:00
7371608722
Support versioned transactions in program test framework ( #28739 )
...
* Support versioned transactions in program test framework
* use working bank
* Update to process_transaction_with_metadata
* Migrate client apis from Transaction to Into<VersionedTransaction>
* feedback
2022-11-18 23:43:52 +08:00
813f1f993a
remove test only append_account ( #28850 )
2022-11-17 12:26:51 -08:00
53a579bed1
ledger-tool: stream output of `accounts` subcommand
2022-11-17 12:45:26 -07:00
e269fe3383
refactor into combine_one_store_into_ancient ( #28845 )
2022-11-17 08:42:42 -08:00
2bafb0cb12
Requires EAH state cannot be Invalid ( #28817 )
2022-11-17 11:01:01 -05:00
e8c8235474
Get Index Key Size RPC Support ( #28383 )
...
Co-authored-by: K-anon <IntokuSatori@users.noreply.github.com>
2022-11-16 20:39:11 -07:00
83a7b2ca6c
only log ancient append vec stats when they are useful ( #28843 )
2022-11-16 17:15:43 -08:00
ae48ac97dd
fix account resize test by requesting max tx data size ( #28826 )
...
* fix account resize test by requesting max tx data size
* define data size limit in incremental of 1024
2022-11-16 17:52:15 -06:00
c17d594684
collect storage_read_elapsed for shrink and ancient ( #28833 )
2022-11-16 11:14:07 -08:00
4837dc071f
cleanup return value from append_accounts ( #28836 )
2022-11-16 10:59:11 -08:00
f7139532a6
acct hash: don't init accum or create hash file if no storages ( #28839 )
2022-11-16 10:58:39 -08:00
2b1db39faa
refactor test ancient population code ( #28823 )
2022-11-16 08:31:39 -08:00
c1e440acb6
Warping calculates and sets new EAH ( #28809 )
2022-11-15 23:16:38 -05:00
28956d7653
removes feature gate code preventing crediting accounts that end rent paying ( #28818 )
2022-11-15 19:55:34 +00:00
d798e751a0
Disables EAH with short epochs ( #28803 )
2022-11-15 13:26:19 -05:00
b572422d24
test ancient append vecs with dead slots ( #28800 )
2022-11-15 10:21:38 -08:00
a21f536b3a
add scan statistics in hash calc for ancient append vecs ( #28816 )
2022-11-15 09:31:24 -08:00
ac9b11762a
Lowers test's account data size to avoid hitting MaxLoadedAccountsDataSizeExceed ( #28814 )
2022-11-15 16:52:35 +00:00
84cfdf23fc
remove LoadedAccount::stored_size ( #28802 )
2022-11-15 05:47:12 -08:00
ec58cda2e7
improve ancient append vec test ( #28799 )
2022-11-15 05:46:09 -08:00
d4cf18421d
Use 400 slots-per-epoch in EAH tests ( #28801 )
2022-11-14 17:49:20 -05:00
c882d165e2
Fix typo in cost_tracker.rs ( #28781 )
...
Substract -> Subtract
2022-11-14 14:36:59 -07:00
503da50f2c
Verifies EAH in SnapshotHash ( #28775 )
2022-11-14 16:02:08 -05:00
0bfea02056
Snapshots wait for EAH calculations to complete ( #28777 )
2022-11-14 11:34:44 -06:00
81dc2e56ac
Cap accounts data a transaction can load by its requested limit ( #27840 )
...
- Add new compute-budget instruction to set transaction-wide accounts data size limit
- Set default accounts data limit to 10MB, and max to 100MB, per transaction;
- Add getters to make changing default and/or max values easier in the future with feature gates;
- added error counter for transactions exceed data size limit
2022-11-14 10:29:35 -06:00
f69e847137
allow ancient append vec threshold to be set on cli ( #28707 )
...
* allow ancient append vec threshold to be set on cli
* pr responses
2022-11-11 11:30:05 -08:00
b2ece6368f
shrink ancient append vecs at 90% ( #28736 )
2022-11-10 20:05:34 -08:00
4142f42319
Refactor - Move `Executor` in program-runtime crate ( #28782 )
...
* Moves CreateMetrics into the program-runtime crate.
* Moves the Executor trait into executor.rs
* Removes the first_instruction_account parameter from Executor::execute().
2022-11-10 21:11:00 +01:00
628ac0d4ea
Refactors SnapshotPackage::new() to use let-else statements ( #28779 )
2022-11-10 11:29:51 -05:00
552248906e
report ancient stats correctly in drop_or_recycle_stores ( #28747 )
2022-11-10 07:27:38 -08:00
8eeabf9042
Skips taking a bank snapshot for EAH requests ( #28757 )
2022-11-10 15:14:26 +00:00
4d6653598b
Upgrades to Rust 1.65.0 ( #28741 )
2022-11-09 17:15:03 -05:00
d1ba42180d
clippy for rust 1.65.0 ( #28765 )
2022-11-09 19:39:38 +00:00
df81cd11ba
Refactors snapshot_archive_info in bank_from_snapshot_archives() ( #28776 )
2022-11-09 18:41:27 +00:00
9e1cdc7e60
Enables not taking a bank snapshot ( #28756 )
2022-11-09 12:43:33 -05:00
d4c2900590
Removes `snapshot_bank()` wrapper fn ( #28753 )
2022-11-07 15:09:31 +00:00
0873b90d5f
Treats all bank snapshot errors as fatal ( #28752 )
2022-11-07 11:03:11 +00:00
0bc66c82aa
remove unused stat ancient.skipped_shrink ( #28749 )
2022-11-05 08:09:19 -07:00
99565570b8
add ancient append vec stats ( #28737 )
2022-11-05 08:08:52 -07:00
5937a10810
ancient append vec stat fixes ( #28731 )
2022-11-04 04:48:19 -07:00
064cfc70d2
Removes cluster_type from AccountsPackage ( #28725 )
2022-11-02 18:21:13 -04:00
88d7f6cc9d
add ability to flush read only accounts cache ( #28726 )
2022-11-02 12:03:32 -07:00
faf32e2a94
add ancient append vec tests ( #28712 )
...
add test test_combine_ancient_slots_simple
2022-11-02 11:24:08 -07:00
0a62f01cab
Removes EAH string from datapoint metric ( #28724 )
2022-11-02 14:14:08 -04:00
ee0320c9f3
fix ancient append vec throwing away stores bug ( #28710 )
2022-11-02 08:21:03 -07:00
7885fdca37
ancient append vecs: pass through can_randomly_shrink ( #28706 )
2022-11-01 11:55:28 -07:00
9ff9051d87
move test function to test mod ( #28704 )
2022-11-01 11:18:02 -07:00
daf71003d3
add tests for handle_dropped_roots_for_ancient ( #28703 )
2022-11-01 09:03:54 -07:00
0b51b15af2
remove duplicate pubkey during shrink ( #28689 )
2022-11-01 07:45:52 -07:00
17680fe837
removes feature gate code preserving rent_epoch for rent exempt accounts ( #28507 )
...
* removes feature gate code preserving rent_epoch for rent exempt accounts
* update test expected hashes
Co-authored-by: jeff washington <jeff.washington@solana.com>
2022-11-01 13:36:59 +00:00
f0f108905e
Always verifies deserialized bank's slot and snapshot hash ( #28688 )
2022-10-31 17:48:18 -04:00
cb4c3668c7
.pubkey() instead of meta.pubkey for stored account ( #28682 )
2022-10-31 13:58:42 -07:00
1ba81acf9a
remove public from rent code ( #28687 )
2022-10-31 13:37:36 -07:00
c47515d055
remove duplicate pubkey when shrinking or combining ancient ( #28678 )
2022-10-31 12:00:55 -07:00
59bf1809fe
Uses SnapshotHash type in snapshot archive fields ( #28681 )
2022-10-31 14:28:35 -04:00
34865d032c
chore: update Solana docs and code comments that specify "BPF" to "SBF"
2022-10-31 14:14:25 -04:00
37507a2de6
Removes EAH parameter from serde_snapshot::reserialize_bank() ( #28669 )
2022-10-31 09:43:17 -04:00
fad6c99e9f
add test variations for shrink_collect ( #28640 )
...
add test variations
2022-10-29 14:24:08 -07:00
5889ee30b0
add test_get_keys_to_unref_ancient ( #28664 )
2022-10-29 14:23:41 -07:00
bfa62da29e
Renames variant to CalcAccountsHashDataSource::IndexForTests ( #28623 )
2022-10-29 08:55:33 -04:00
2ebf248f47
Renames fn to Bank::update_accounts_hash() ( #28619 )
2022-10-28 17:31:16 -04:00
f98e4d9198
Renames BankHashInfo field to accounts_hash ( #28665 )
2022-10-28 15:18:25 -04:00
5a3d252899
Renames fn to Bank::update_accounts_hash_for_tests() ( #28620 )
2022-10-28 14:33:05 -04:00
8924829e7b
extract 'unref_pubkeys' for shared code ( #28653 )
2022-10-28 10:12:29 -07:00
0232944c95
Uses Storages to update accounts hash in bank_to_snapshot_archive() ( #28618 )
2022-10-28 12:22:58 -04:00
0b2bc987ca
tests for maybe_unref_accounts_already_in_ancient ( #28652 )
2022-10-28 08:24:10 -07:00
0c1df82d48
add current_ancient tests ( #28651 )
2022-10-28 07:32:23 -07:00
8ae5af2822
ancient append vec tests ( #28635 )
2022-10-27 15:10:22 -07:00
3d7cca6296
cleanup drop in ancient append vecs ( #28617 )
2022-10-27 11:16:46 -07:00
7b70aef33c
Add help text to genesis creation time assert ( #28629 )
...
If a validator starts with a snapshot from the wrong cluster, an assert
will trigger complaining about the genesis_creation_time encoded in the
snapshot differing from the genesis_creation_time embedded in
genesis.bin.
This could be a fairly easy mistake to make so add a help string to the
assertion to point operators in the right direction.
2022-10-27 18:02:36 +02:00
646514e4d5
give metric around 'remove_old_stores_shrink" better name ( #28613 )
2022-10-27 07:33:01 -07:00
4ac52c2a9d
ancient append vec comments and cleanup ( #28616 )
2022-10-27 07:32:42 -07:00
251cab4c8b
extract handle_dropped_roots_for_ancient from ancient append vec code ( #28611 )
2022-10-27 07:32:04 -07:00
a2b0d0e6f0
runtime: use correct module doc comments ( #27889 )
2022-10-27 14:39:44 +02:00
decf3de453
extract ancient maybe_unref_accounts_already_in_ancient ( #28610 )
2022-10-26 14:20:32 -07:00
d4db649e7c
extract common code remove_old_stores_shrink from shrink and ancient append vecs ( #28588 )
2022-10-26 11:49:10 -07:00
27269d833c
Uses enum for data source with calc_accounts_hash() ( #28584 )
2022-10-26 13:04:01 -04:00
252d7f68da
combine all_are_zero_lamports ( #28567 )
2022-10-26 08:55:20 -07:00
2d8665d307
Record inner instruction stack height ( #28430 )
...
* Record inner instruction stack height
* fix sbf tests
* feedback
2022-10-26 10:37:44 +08:00
1dbcb78de7
Renames fn to update_accounts_hash() ( #28574 )
2022-10-25 16:43:19 -04:00
51e1a7f2af
simplify mark_dirty_dead_stores ( #28565 )
2022-10-25 11:34:58 -07:00
470ed4f06e
update stats in shrink_collect ( #28563 )
2022-10-25 11:27:33 -07:00
e79c1cba03
Renames fn to update_accounts_hash_for_tests() ( #28571 )
2022-10-25 14:03:19 -04:00
8c57efb828
ancient append vecs: get rid of some locals in shared code ( #28559 )
2022-10-25 09:32:14 -07:00
2c837ba4e3
reorder code to prepare for sharing ( #28564 )
2022-10-25 09:15:26 -07:00
f158bab0ef
Tracks how long background requests wait before processing ( #28581 )
2022-10-25 12:10:53 -04:00
bf214d36e3
Renames fn to calculate_accounts_hash_with_verify() ( #28573 )
2022-10-25 11:55:26 -04:00
e2438cf3e2
Renames fn to calculate_accounts_hash() ( #28572 )
2022-10-25 11:53:41 -04:00
1ca7c8244f
rename merge() -> accumulate() ( #28561 )
2022-10-25 08:52:02 -07:00
bc02789c43
Renames fn to calculate_accounts_hash_from_storages() ( #28566 )
2022-10-24 21:07:00 -04:00
2354a0a343
Renames fn to calculate_accounts_hash_from_index() ( #28568 )
2022-10-24 19:20:08 -04:00
dde8f0dfad
CurrentAncientAppendVec for clarity ( #28528 )
2022-10-24 15:28:52 -07:00
Jeff Washington (jwash)
Brooks Prumo
Tao Zhu
Maximilian Schneider
Justin Starry
Trent Nelson
K-anon
behzad nouri
Ikko Ashimine
Alexander Meißner
Dmitri Makarov
steviez
Ian Macalinao