510d195620
Simplify `Bank::clean_accounts()` by removing params ( #27254 )
2022-08-19 18:15:04 -04:00
a54ea4d62d
Refactor epoch reward 1 ( #27253 )
...
* refactor: extract store_stake_accounts fn
* clippy: slice
Co-authored-by: haoran <haoran@mbook>
2022-08-19 21:04:24 +00:00
1b441f7a2d
make test code more clear ( #27260 )
2022-08-19 14:39:20 -05:00
42e227778b
eliminate unnecessary ZERO_RAW_LAMPORTS_SENTINEL ( #27218 )
2022-08-19 14:18:00 -05:00
e132583a24
add _inclusive for clarity ( #27239 )
2022-08-19 14:17:32 -05:00
2031e0afaf
simple refactorings to disk idx ( #27238 )
2022-08-19 12:40:42 -05:00
6f045d6080
add ed25519_program to built-in instruction cost list ( #27199 )
...
* add ed25519_program to built-in instruction cost list
* Remove unnecessary and stale comment
2022-08-19 12:14:37 -05:00
b3c72bc8a2
Call `AccountsDb::shrink_all_slots()` directly ( #27235 )
2022-08-19 12:09:47 -04:00
2184d0ff26
Add Bank::clean_accounts_for_tests() ( #27209 )
2022-08-19 12:09:35 -04:00
7573000d87
Revert "Rust v1.63.0 ( #27148 )" ( #27245 )
...
This reverts commit a2e7bdf50a
2022-08-19 09:19:44 +01:00
0b54b22f58
Remove `Bank::ensure_no_storage_rewards_pool()` ( #26468 )
2022-08-18 16:24:36 -04:00
fa4122f9a8
Verifying snapshot bank must always specify the snapshot slot ( #27234 )
2022-08-18 17:24:23 +00:00
e0472050c0
create helper fn for clarity ( #27216 )
2022-08-18 11:30:35 -05:00
f115e4d0ed
reorder slot # in debug hash data path ( #27217 )
2022-08-18 11:30:11 -05:00
4634fb944c
Use from_secs api to create duration ( #27222 )
...
use from_secs api to create duration
2022-08-18 11:06:52 -05:00
77563bc1c9
remove redundant call that bumps age to future ( #27215 )
2022-08-18 11:01:05 -05:00
7720b48aa6
add an assert for a debug feature to avoid wasted time ( #27210 )
2022-08-18 10:35:22 -05:00
7569f8eded
store-tool: log lamports for each account ( #27168 )
...
log lamports for each account
2022-08-18 10:00:04 -05:00
d2868f439d
Verify snapshot slot deltas ( #26666 )
2022-08-18 09:48:58 -04:00
7d765e3d67
clean feature: `prevent_calling_precompiles_as_programs` ( #27100 )
...
* clean feature: prevent_calling_precompiles_as_programs
* fix tests
* fix test
* remove comment
* fix test
* feedback
2022-08-18 05:21:16 +00:00
a2e7bdf50a
Rust v1.63.0 ( #27148 )
...
* Upgrade to Rust v1.63.0
* Add nightly_clippy_allows
* Resolve some new clippy nightly lints
* Increase QUIC packets completion timeout
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-08-17 15:48:33 -07:00
2fd9a4f373
Add clean_accounts_for_tests() ( #27200 )
2022-08-17 18:45:59 -04:00
225cddcffb
serialize incremental_snapshot_hash ( #26839 )
...
* serialize incremental_snapshot_hash
* pr feedback
2022-08-17 15:14:31 -05:00
c1111fa069
snapshots: serialize version file first ( #27192 )
...
serialize version file first
2022-08-17 12:57:52 -05:00
3fc4ba7c9a
Rename to `MAX_BLOCK_ACCOUNTS_DATA_SIZE_DELTA` ( #27175 )
2022-08-16 13:57:24 -04:00
dbd2423e9f
Share Ancestors API get with contains_key ( #27161 )
...
consolidate similar fns
2022-08-16 12:06:52 -05:00
8c791f871e
store hash calc failures in a separate folder by slot ( #27146 )
...
* store hash calc failures in a separate folder by slot
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks Prumo <brooks@prumo.org>
Co-authored-by: Brooks Prumo <brooks@prumo.org>
2022-08-16 09:35:56 -05:00
bc0d01110c
Remove `fn slot_deltas()` from StatusCache ( #26931 )
2022-08-16 06:08:29 -04:00
1a90cffabe
Add stats for readonly cache evicts ( #26938 )
...
* add stats for readonly cache evicts
* bump up account cache to 400M
* aggregate num_evicts in the loop
2022-08-15 16:23:37 -05:00
3ad93c84b6
wait for bg hash calc to complete before 'calculate_capitalization' ( #27145 )
2022-08-15 11:47:54 -05:00
0ca8239ef7
don't log when there is no work to do for combining ancient slots ( #26925 )
2022-08-13 14:38:41 -06:00
bdce208fe5
clean feature: `request_units_deprecated` ( #27102 )
...
clean feature: request_units_deprecated
2022-08-13 13:12:35 +01:00
6c796727df
clean-feature: `default_units_per_instruction` ( #27101 )
...
clean-feature: default_units_per_instruction
2022-08-13 09:04:40 +01:00
35c87c3888
Fix test_accounts_data_size_and_resize_transactions ( #27105 )
2022-08-12 17:06:54 +00:00
5618e9fd07
Allow overriding the runtime transaction account lock limit ( #26948 )
...
* Add --transaction-account-lock-limit cli arg to test-validator
* Allow overriding the tx account lock limit in ProgramTest
2022-08-12 15:07:48 +01:00
a00c045d7c
chore: bump once_cell from 1.12.0 to 1.13.0 ( #27049 )
...
* chore: bump once_cell from 1.12.0 to 1.13.0
Bumps [once_cell](https://github.com/matklad/once_cell ) from 1.12.0 to 1.13.0.
- [Release notes](https://github.com/matklad/once_cell/releases )
- [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md )
- [Commits](https://github.com/matklad/once_cell/compare/v1.12.0...v1.13.0 )
---
updated-dependencies:
- dependency-name: once_cell
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <you@example.com>
2022-08-10 12:19:10 -06:00
ae5b680c6f
chore: bump serde from 1.0.138 to 1.0.143 ( #27015 )
...
* chore: bump serde from 1.0.138 to 1.0.143
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.138 to 1.0.143.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.138...v1.0.143 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-08-10 05:08:43 +00:00
ccfbc54195
Move vote program state and instructions to solana-program
2022-08-09 20:52:47 -07:00
6e57a8f8a1
A more convenient store-tool ( #26796 )
...
* Use new_from_file_unchecked - don't sanitize input length for appendvec file
* Exit-early on completely zeroed accounts
2022-08-08 06:55:00 -07:00
ed8c224374
Bump version to v1.12 ( #26967 )
2022-08-06 13:20:30 -05:00
cf58640937
Keypair: implement clone() ( #26248 )
...
* Keypair: implement clone()
This was not implemented upstream in ed25519-dalek to force everyone to
think twice before creating another copy of a potentially sensitive
private key in memory.
See https://github.com/dalek-cryptography/ed25519-dalek/issues/76
However, there are now 9 instances of
Keypair::from_bytes(&keypair.to_bytes())
in the solana codebase and it would be preferable to have a function.
In particular since this also comes up when writing programs and can
cause users to either start messing with lifetimes or discover the
from_bytes() workaround themselves.
This patch opts to not implement the Clone trait. This avoids automatic
use in order to preserve some of the original "let developers think
twice about this" intention.
* Use Keypair::clone
2022-08-06 11:54:38 -06:00
69598ed4c0
Refactor: Add `RuntimeConfig` field to Bank ( #26946 )
...
* Refactor: Simplify arguments for bank constructor methods
* Refactor: Add RuntimeConfig to Bank fields
* Arc wrap runtime_config
* Arc wrap all runtime config usages
* Remove Copy trait derivation from RuntimeConfig
* Remove some arc wrapping
2022-08-05 20:49:00 +01:00
06a610130e
Remove bank test_max_accounts_data_size_exceeded() ( #26772 )
...
bank: remove test_max_accounts_data_size_exceeded()
2022-08-05 09:55:29 -04:00
73fe400407
protect access to rent paying account vec ( #26919 )
2022-08-05 08:19:46 -05:00
2dca239480
Remove runtime dependency from solana-transaction-status ( #26930 )
...
* Move RewardType out of runtime
* Move collect_token_balances to solana-ledger
* Remove solana-runtime dependency
2022-08-05 00:20:27 -06:00
300666dce7
Make `solana-ledger-tool` run AccountsBackgroundService ( #26914 )
...
Prior to this change, long running commands like `solana-ledger-tool
verify` would OOM due to AccountsDb cleanup not happening.
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-08-04 15:44:31 -05:00
4b8f881af3
in mem acct idx scan multiple ages simultaneously ( #26853 )
2022-08-03 13:44:01 -05:00
fbf1bf6d86
Bump Version to 1.11.6 ( #26906 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-08-03 12:48:43 -05:00
0732a6c45f
add 'oldest_root' stat in hash calc ( #26896 )
2022-08-03 10:02:08 -05:00
6706be0f56
log oldest dirty slot on clean ( #26897 )
2022-08-03 10:01:29 -05:00
f24de9d254
Make tx error accounting more granular ( #26718 )
2022-08-02 16:43:03 -07:00
224550d65f
allow caching on ancient append vecs for accounts hash calc ( #26885 )
2022-08-02 14:40:29 -05:00
acc1112e9c
calculate cache hash path for store_detailed_debug_info_on_failure ( #26874 )
2022-08-02 11:19:00 -05:00
e5c5055869
Revert "allow caching on ancient append vecs for accounts hash calc" ( #26882 )
...
Revert "allow caching on ancient append vecs for accounts hash calc (#26770 )"
This reverts commit 30b408ed0c
2022-08-02 10:23:11 -05:00
f210182851
accounts: Don't collect rent on newly created accounts ( #26851 )
2022-08-02 16:34:34 +02:00
050c66f197
enable accounts hash caching if store_detailed_debug_info_on_failure ( #26864 )
2022-08-01 14:27:20 -05:00
d159682a6d
add comment ( #26875 )
2022-08-01 14:25:19 -05:00
ebabc53cee
use Vec::drain instead of option/take ( #26852 )
2022-07-31 21:04:15 -05:00
c7462b7a52
ledger tool verify can store debug info on hash calc ( #26837 )
2022-07-29 15:54:56 -05:00
38cd29810f
Fix ordering for AccountEntry ref_count ( #26842 )
...
fix ordering for ref_count
2022-07-29 15:47:03 -05:00
69b5dd9b07
cleanup ignore_eof_error ( #26838 )
2022-07-29 12:10:22 -05:00
c1f7d1a367
Add AppendVec::new_from_file_unchecked ( #26795 )
...
new_from_file_unchecked
2022-07-28 14:57:26 -05:00
467cb5def5
Concurrent slot replay ( #26465 )
...
* Concurrent replay slots
* Split out concurrent and single bank replay paths
* Sub function processing of replay results for readability
* Add feature switch for concurrent replay
2022-07-28 11:33:19 -07:00
817f65bb50
add full_snapshot to hash config ( #26811 )
2022-07-28 09:46:34 -05:00
8d69e8d447
Compact vote state updates to reduce block size ( #26616 )
...
* Compact vote state updates to reduce block size
* Add rpc transaction tests
2022-07-27 13:23:44 -06:00
1a5b830294
CalcAccountsHashConfig default for tests ( #26810 )
2022-07-27 13:21:38 -05:00
1421833c5e
log when shrink still contains extra stores ( #26794 )
2022-07-27 09:14:16 -05:00
30b408ed0c
allow caching on ancient append vecs for accounts hash calc ( #26770 )
2022-07-27 09:13:32 -05:00
cd4340ed06
chore: bump bytemuck from 1.10.0 to 1.11.0 ( #26792 )
...
* chore: bump bytemuck from 1.10.0 to 1.11.0
Bumps [bytemuck](https://github.com/Lokathor/bytemuck ) from 1.10.0 to 1.11.0.
- [Release notes](https://github.com/Lokathor/bytemuck/releases )
- [Changelog](https://github.com/Lokathor/bytemuck/blob/main/changelog.md )
- [Commits](https://github.com/Lokathor/bytemuck/compare/v1.10.0...v1.11.0 )
---
updated-dependencies:
- dependency-name: bytemuck
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-07-26 20:50:30 -06:00
293d651ca8
store-tool use accounts_iter ( #26793 )
2022-07-26 17:29:53 -05:00
5e622f82ac
Add feature gate to use default units per instruction for fee calculation ( #26786 )
...
* Add feature gate to use default units per instruction for fee calculation
* fix bpf tests
2022-07-26 19:39:24 +00:00
5de1a7accf
Add streaming_unpack_snapshot to send entry files during unpack ( #26781 )
...
* Add streaming_unpack_snapshot to send entry files during unpack
* Update unpack tests to call internal function
2022-07-26 14:09:28 -05:00
a7e4df5d6e
Separate remapping append_vecs into functions ( #26696 )
...
Separate remapping append_vecs into remap_and_reconstruct_storages and helpers
2022-07-25 14:55:30 -05:00
6f5995c841
add stats for disk_index_find_entry_mut_us ( #26753 )
2022-07-25 14:47:17 -05:00
5d038b9d2a
Bump Version to 1.11.5 ( #26758 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-07-25 13:05:14 -06:00
01e367f19b
Add Bank::update_accounts_data_size_delta_off_chain_for_tests() ( #26771 )
2022-07-25 18:58:04 +00:00
d9c7bc7e78
Revert "cleanup feature: default units per instruction ( #26684 )" ( #26750 )
...
This reverts commit 39a34db52a
2022-07-23 11:03:46 -05:00
f2b81fe665
Separate field_from_stream to get bank/account fields from individual snapshot stream ( #26679 )
2022-07-21 12:27:31 -05:00
075a5ac44e
Removes `AccountSharedData` from `SysvarCache`. ( #26712 )
...
* Removes AccountSharedData from SysvarCache.
* Fixes incorrect transaction account index in stake_instruction::test_set_lockup().
2022-07-21 18:32:28 +02:00
cbb74a190f
Cleanup: `record_instruction_in_transaction_context_push` ( #26658 )
...
Cleanup feature gate of record_instruction_in_transaction_context_push.
2022-07-21 12:49:34 +02:00
6ec89ee861
log error for cache_hash_data save failure ( #26676 )
...
log error for cach_hash_data save
2022-07-20 16:19:35 -05:00
39a34db52a
cleanup feature: default units per instruction ( #26684 )
2022-07-20 19:13:34 +00:00
b20edd232b
Remove useless enumerate from test_hold_range_in_memory2 ( #26683 )
2022-07-20 10:06:08 -05:00
9f2f2a45cd
AcctIdx: ref_count_from_storage remove Arc::clone ( #26678 )
2022-07-20 10:05:13 -05:00
f8e9af5f1e
Cap the number of accounts passed to a bpf program ix ( #26630 )
...
* Cap the number of accounts passed to a bpf program ix
* update bank abi hash
* fix ci failures
2022-07-20 14:12:43 +02:00
07f41628db
untar_snapshot_create_shared_buffer doesn't need to return a result ( #26686 )
2022-07-19 23:15:41 +00:00
2d689ac53a
get rid of rwlock per bin in accounts index ( #26675 )
2022-07-19 17:48:40 -05:00
e7cd6daebe
Add helper fn to create shared buffer - simplify archive format matching ( #26674 )
2022-07-19 20:30:30 +00:00
84c8cfe901
Refactor/hardened unpack more generic unpack archive ( #26677 )
...
* Add entry_processor fn to unpack_archive - not used yet
* Add generic unpack_snapshot_with_processors to separate account paths handling from entry checking
2022-07-19 14:48:57 -05:00
7efe72a74f
eliminate write lock usage in acct idx ( #26673 )
2022-07-19 13:24:03 -05:00
77843306c7
rename parallel_archivers -> parallel_divisions for consistency ( #26672 )
...
parallel_archivers -> parallel_divisions for consistency
2022-07-19 13:15:33 -05:00
263911e7fd
save off what we find when calculating hash ( #26663 )
2022-07-19 09:55:52 -05:00
738c4a79b7
metric for 'ancient_account_cleans' ( #26664 )
2022-07-19 09:16:23 -05:00
6efe7e095b
temporarily make ancient append vecs 10x smaller to find intermittent bugs ( #26574 )
2022-07-19 08:51:36 -05:00
c4d2c95540
move hash stat to correct level for ahv to work ( #26649 )
2022-07-18 12:44:33 -05:00
1c08f83c7e
eliminate flatten().collect() of reclaims in clean ( #26647 )
2022-07-18 12:37:17 -05:00
fd6038884b
Clean up forgotten error log
2022-07-17 12:21:52 +02:00
be8813e588
shrink stops using HandleReclaims ( #26594 )
2022-07-15 17:54:48 -05:00
83c614da3c
change type to be more clear ( #26646 )
2022-07-15 17:17:17 -05:00
47716a5e01
async hash verify on load ( #26208 )
...
* verify accounts hash in bg on startup
* fix some tests and loading from genesis
* add extra state for when background thread has completed
2022-07-15 14:29:56 -05:00
Brooks Prumo
HaoranYi
Jeff Washington (jwash)
Tao Zhu
Brennan Watt
apfitzge
Justin Starry
Jeff Washington (jwash)
dependabot[bot]
Michael Vines
Will Hickey
Christian Kamm
Tyera Eulberg
steviez
github-actions[bot]
Jon Cinque
Ashwin Sekar
Alexander Meißner
Jack May