7d06f7a174
runtime: fix typo in expected_rent_collection.rs ( #27890 )
2022-09-17 21:58:33 -06:00
0e19b22e08
runtime: fix typo occured -> occurred ( #27891 )
2022-09-17 21:58:09 -06:00
c1c93adf67
runtime: fix typo recalcluate -> recalculate ( #27892 )
2022-09-17 21:57:38 -06:00
9cec2ef577
runtime: fix typo situtation -> situation ( #27893 )
2022-09-17 21:57:13 -06:00
543897a439
runtime: fix typo idnex -> index ( #27895 )
2022-09-17 21:56:25 -06:00
36fe33a1f3
runtime: ifno -> info ( #27897 )
2022-09-17 21:55:53 -06:00
c237f15295
runtime: ParitalEq -> PartialEq ( #27900 )
2022-09-17 21:55:29 -06:00
8c24840247
runtime: compleleted -> completed ( #27901 )
2022-09-17 21:53:57 -06:00
1db7da5c32
pass enable_rehashing to verify_bank_hash_and_lamports ( #27827 )
2022-09-17 06:09:06 -07:00
1d701aa4f9
ancient append vec stats: ancient_append_vecs_shrunk ( #27824 )
2022-09-16 12:58:48 -07:00
1a4b8b5b79
recycle_store_count is moved to try_recycle_store ( #27797 )
2022-09-15 21:27:09 +02:00
b9700244b5
Increase transaction account lock limit from 64 to 128 ( #27242 )
...
* Increase transaction account lock limit from 64 to 256
* fix bpf test
* Reduce lock limit from 256 to 128
2022-09-15 13:50:14 -04:00
138d5ed5b0
don't return zero lamport accounts from 'load' with feature ( #27793 )
...
* don't return zero lamport accounts from 'load'
* add feature
* rename
2022-09-15 08:46:32 -07:00
6a7fbf7aba
move create_store counting to create_store ( #27781 )
2022-09-14 22:02:29 +02:00
2a875a894b
Fix and expand EAH calculation info ( #27779 )
2022-09-14 15:23:43 -04:00
3a47dfb8e6
add bank.bank_enable_rehashing_on_accounts_hash ( #27768 )
2022-09-14 11:29:23 -07:00
4f232250e5
add `dirty_ancient_stores` to clean metrics ( #27774 )
2022-09-14 06:52:51 -07:00
416b45ac0f
calculate_capitalization gets 'enable_rehashing' ( #27767 )
2022-09-14 06:52:18 -07:00
cd44a0ab7b
acctidx: unref returns whether refcount went negative ( #27773 )
2022-09-14 06:51:50 -07:00
17007fdda8
remove ancient append vec stores from shrink_candidate_slots ( #27763 )
2022-09-14 06:50:34 -07:00
c0e4379f43
Whickey/version v1.15 ( #27739 )
...
* Bump version to v1.13.0
* Bump version to v1.14.0
* Bump version to v1.15.0
2022-09-13 09:06:15 -05:00
0c185d1983
Fix a constant that was missed ( #27731 )
...
Missed constant
2022-09-12 16:23:55 -05:00
0bcd9134bc
Rework 'remove_dead_slots_metadata: slots' info log message
2022-09-12 13:36:05 -07:00
d242c0fc97
pass 'enable_rehashing' through all accounts hash functions ( #27701 )
2022-09-12 12:18:09 -07:00
ac74fc16b6
cleanup test constants ( #27704 )
2022-09-12 12:00:52 -07:00
765c628546
use exit signal for acct idx bg threads ( #27483 )
2022-09-12 11:51:12 -07:00
4f22ee8f9b
uses varint encoding for vote-state lockout offsets
...
The commit removes CompactVoteStateUpdate and instead reduces serialized
size of VoteStateUpdate using varint encoding for vote-state lockout
offsets.
2022-09-12 16:31:20 +00:00
90b8a3a44d
Remove KeypairInsecureClone trait and add insecure_clone() instead ( #27396 )
...
See discussion in #26248
2022-09-12 14:59:41 +00:00
d36c5774a1
Use `.find()` instead of loop+filter+break for sending snapshot request ( #27674 )
2022-09-10 19:11:37 -04:00
bd6177d5f2
move fn only used by tests to tests ( #27699 )
2022-09-10 13:57:52 -07:00
92a5d27cb8
remove unused 'unref' fn ( #27698 )
2022-09-10 13:57:31 -07:00
1811d684b5
clean race condition with extra unref ( #27682 )
...
* clean race condition with extra unref
* clarify comment
* fix test
* cleanup test
* clippy
2022-09-10 13:57:17 -07:00
abd01553d5
tests: Keypair::new().pubkey() -> pubkey::new_rand ( #27705 )
2022-09-10 13:56:45 -07:00
1d9d5bef04
remove outdated comment ( #27703 )
2022-09-10 13:56:08 -07:00
ced8f6a512
Add feature gate to remove support for RequestUnitsDeprecated instruction ( #27503 )
...
* feature gate: remove support for RequestUnitsDeprecated instruction #27500
* review update: stop support deprecated ix for prioritization
* Apply suggestions from code review
Co-authored-by: Justin Starry <justin.m.starry@gmail.com>
Co-authored-by: Justin Starry <justin.m.starry@gmail.com>
2022-09-09 22:24:21 +00:00
2b554560fd
Send snapshot request for correct bank in set_root() ( #27673 )
2022-09-09 17:30:37 -04:00
6561428278
Separate add_un_ref for easier tracing ( #27652 )
2022-09-09 16:14:55 -05:00
fc396f965c
Fixup log of Epoch Accounts Hash when freezing bank ( #27688 )
2022-09-09 16:33:12 -04:00
1f00b468e5
add enable_rehashing to AccountsPackage ( #27644 )
2022-09-08 09:25:25 -07:00
82d12c4dda
suppress large debug message on test ( #27646 )
2022-09-08 07:01:01 -07:00
f338aa62ba
chore: bump serde from 1.0.143 to 1.0.144 ( #27511 )
...
* chore: bump serde from 1.0.143 to 1.0.144
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.143 to 1.0.144.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.143...v1.0.144 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-09-07 16:54:44 -06:00
6a322de845
Make Accounts Background Services aware of Epoch Accounts Hash ( #27626 )
2022-09-07 20:41:40 +00:00
d3ca364e9e
reuse shared function ( #27642 )
2022-09-07 13:11:00 -07:00
22007a3c96
allow accounts hash calc to specify enable_rehashing ( #27615 )
2022-09-07 10:16:52 -07:00
a31d4a597d
serialize epoch_accounts_hash ( #27516 )
2022-09-07 10:07:00 -07:00
1cf9077d06
Include the Epoch Accounts Hash in the Bank hash ( #27541 )
2022-09-07 10:10:49 -04:00
93a4f80a2c
Handling snapshot requests is now required ( #27537 )
2022-09-07 10:08:42 -04:00
acd846b90e
when storing detailed debug info on accounts hash, we're ok with > 1 storage ( #27617 )
2022-09-07 06:38:57 -07:00
ecbd5bb807
acctidx: avoid extra addref in combine ancient slots ( #27545 )
...
* acctidx: avoid extra addref in combine ancient slots
* make code common
2022-09-06 13:57:34 -07:00
a2df1e95dc
Hold `PendingAccountsPackage` lock for both checking and submitting ( #27613 )
...
Hold package lock for both checking and submitting
2022-09-06 20:11:13 +00:00
0d01494cf8
acctidx renames for clarity ( #27606 )
2022-09-06 12:29:45 -07:00
f1297850b8
acctidx: use slot list len to determine if upsert remains in cache ( #27550 )
2022-09-06 10:59:54 -07:00
72a2c02ee7
add --accounts-db-verify-refcounts for debugging ( #27504 )
2022-09-06 09:39:39 -07:00
7bdbb18741
acctidx: factor out update_slot_list_entry ( #27546 )
2022-09-06 07:39:31 -07:00
7b579771b0
log on acct idx derefs below 0 ( #27544 )
2022-09-06 07:34:05 -07:00
ed132e75a9
rename get_account_maps_read_lock to get_bin since we don't use a loc… ( #27543 )
...
rename get_account_maps_read_lock to get_bin since we don't ues a lock anymore
2022-09-06 07:22:55 -07:00
f90e70ff5a
fix some comments ( #27547 )
...
remove stray comment
2022-09-06 07:21:19 -07:00
12d2147efa
Adds `IndexOfAccount` type ( #27599 )
...
Adds the type `IndexOfAccount`.
2022-09-06 11:31:40 +02:00
6f2e556b16
Cleanup: `TransactionContext` ( #27595 )
...
* Lets instruction_accounts_lamport_sum() have the &InstructionContext as parameter directly.
* Updates docu comments.
* Uses accessors methods instead of accessing private properties of other structs.
* Adds #![deny(clippy::indexing_slicing)].
* Has get_signers() return a Result instead of using unwrap().
* Removes InvokeContext::get_key_of_account_at_index().
2022-09-05 16:29:02 +02:00
0b94d5af18
Refactor: `InstructionContext::configure()` ( #27400 )
...
* Replaces InstructionContext::new() by InstructionContext::configure().
Adds TransactionContext::get_next_instruction_context().
* Switch back to using references as parameters.
* Hoists InstructionContext::configure() from TransactionContext::push() into InvokeContext::push().
* Moves InstructionContext::config() to the beginning of InvokeContext::push().
* Hoists InstructionContext::configure() from InvokeContext::push() into InvokeContext::process_instruction().
* Review feedback: Updates docu comments.
2022-09-03 10:34:57 +02:00
c0f41fe6d0
fix a flacky test ( #27572 )
2022-09-02 15:02:22 +00:00
6684c62280
Add SnapshotUsage to SnapshotConfig ( #27508 )
2022-09-02 08:56:23 -04:00
9b8bed86f9
Add getRecentPrioritizationFees RPC endpoint ( #27278 )
...
* Plumb priority_fee_cache into rpc
* Add PrioritizationFeeCache api
* Add getRecentPrioritizationFees rpc endpoint
* Use MAX_TX_ACCOUNT_LOCKS to limit input keys
* Remove unused cache apis
* Map fee data by slot, and make rpc account inputs optional
* Add priority_fee_cache to rpc test framework, and add test
* Add endpoint to jsonrpc docs
* Update docs/src/developing/clients/jsonrpc-api.md
* Update docs/src/developing/clients/jsonrpc-api.md
2022-09-01 23:12:12 +00:00
a6d737d773
Add EpochAccountsHash to AccountsDb ( #27538 )
2022-09-01 12:11:07 -04:00
3e40fad46b
deserialize(or eof) snapshot epoch_accounts_hash ( #27513 )
...
deserialize(or eof) snapshot prior_epoch_accounts_hash
2022-09-01 08:35:52 -07:00
0df0b94a72
randomly shrink ancient append vecs ( #27523 )
2022-09-01 08:32:43 -07:00
28c3552756
remove counter stat for clean which is already captured in clean_accounts_stats
2022-09-01 10:11:08 -05:00
a28f336eb3
add timing unit scale in field name
2022-09-01 10:11:08 -05:00
43e3545c26
add stats of dirty_slots for cleaning during hash calc
2022-09-01 10:11:08 -05:00
407717eb2a
add timing stat for account hash calc with cache
2022-09-01 10:11:08 -05:00
874085aadc
improve performance of unrefing ancient pubkeys ( #27485 )
2022-09-01 07:34:52 -07:00
af971e63ab
Create all shared buffer readers before spawning threads ( #27512 )
...
* Create all shared buffer readers before spawning threads
* Allow 'needless' collect - clippy is wrong
* move clippy allow, spacing
2022-08-31 22:49:02 -05:00
84b5a2bcf4
Refactor: `TransactionContext` ABIv2 adjustments ( #27476 )
...
* Marks methods and structs which are only to be used by the program runtime.
* Removes TransactionContext::get_keys_of_accounts().
* Adds InstructionContext::get_instruction_accounts_lamport_sum().
2022-08-31 17:47:47 +02:00
8c1e193d5d
delay trying to flush cached upserts until far future ( #26908 )
2022-08-31 08:56:26 -05:00
8bb039d08d
collect min prioritization fees when replaying sanitized transactions ( #26709 )
...
* Collect blocks' minimum prioritization fees when replaying sanitized transactions
* Limits block min-fee metrics reporting to top 10 writable accounts
* Add service thread to asynchronously update and finalize prioritization fee cache
* Add bench test for prioritization_fee_cache
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2022-08-31 08:00:55 -05:00
b5cca0bfa3
add tests to AccountsDb::unref_accounts ( #27474 )
2022-08-30 18:51:20 -05:00
3d03f7b47e
remove unused acct idx::upsert_on_disk ( #27479 )
2022-08-30 15:42:46 -05:00
2e4a52d010
remove storages that only contain empty ( #27452 )
2022-08-30 14:04:17 -05:00
1154bc8636
get rid of acquisition of read lock while unrefing accounts in scan ( #27388 )
2022-08-30 14:04:02 -05:00
9bde3261fd
cleanup ( #27453 )
...
* cleanup
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks Prumo <brooks@prumo.org>
Co-authored-by: Brooks Prumo <brooks@prumo.org>
2022-08-30 10:58:35 -05:00
e35cd7a34a
comment loop in function ( #27454 )
2022-08-30 10:58:02 -05:00
3d692ba046
refactor clean_dead_slots_from_accounts_index ( #27451 )
2022-08-30 10:06:52 -05:00
73ee94d674
remove old bank hashes with ancient shrink ( #27450 )
2022-08-30 09:31:20 -05:00
a4b8ab2f59
clean_dead_slots_from_accounts_index unrefs correctly ( #27461 )
2022-08-30 08:40:21 -05:00
8f3c1e3ebb
report a datapoint
2022-08-29 19:06:30 -05:00
7e722f15f2
reduce log frequence to 1m when qlen is above the threshold
2022-08-29 19:06:30 -05:00
37bba64613
remove bank drop queue stat
...
remove try_send
add warn! for excessively long bank drop queue
2022-08-29 19:06:30 -05:00
5b64107626
make pruned_bank channel unbonded.
...
In kin-sim, we found that bounded channel causes halt for account
background services. As the number of accounts grows, the time for
pruning and cleaning increases, which would leads to longer intervals
between the pruning of deaded bank slots. With 1.7B accounts, we will
exceed the 10K bounded channel threshold that causes halt of account
back ground services. Without pruning, the node will eventually run out
of memory.
2022-08-29 19:06:30 -05:00
757e46c3c7
Set cap for new allocations per transaction ( #27385 )
2022-08-29 14:30:48 -04:00
49411aaae0
Feature: Interleaved Snapshot Untar and Indexing - Stage 1 ( #26590 )
...
* Add snapshot_storage_lengths_from_fields
* Add SnapshotUnpacker
* Add SnapshotStorageRebuilder
* Rebuild snapshot storage during unpack
* move snapshot unpacker back into snapshot_utils
* use SerializedAppendVecId in storage rebuilder
* create AccountStorageMap type alias
* Wrap storage and next_append_vec_id in a type
* fixed typo
* move use StorageAndNextAppendVecId
* calculate num_rebuilder_threads more concisely
2022-08-29 13:17:27 -05:00
3c7cd62030
Move pruned_banks_receiver into PrunedBanksRequestHandler ( #27445 )
2022-08-29 13:30:06 -04:00
d0983c3cf7
Update runtime background hash verifier thread name
2022-08-26 13:44:11 -07:00
05fe061a7c
Address RUSTSEC-2022-0051
...
`lz4` to 1.24.0
`lz4-sys` to 1.9.4
2022-08-26 14:30:47 -06:00
46a48760db
Switch concurrent replay from feature to param ( #27401 )
...
* Switch concurrent replay from feature to param
2022-08-26 12:36:02 -07:00
cdb699d812
ancient append vecs and cleaning dead slots ( #27353 )
...
cleanup old code
2022-08-26 10:13:41 -07:00
5e71f339c9
Add a SanitizedMessage type that caches writable accounts indexes ( #27317 )
...
* Add a SanitizedMessage type that caches writable accounts indexes
* Add is_writable_account_cache to both SanitizedMessage variants, cache is initialized in constructors
2022-08-25 16:33:41 -05:00
9866510ef2
get rid of extra comment ( #27378 )
2022-08-24 14:10:33 -05:00
841ed68088
clean_accounts add _inclusive ( #27282 )
2022-08-24 08:56:53 -05:00
efa6201eda
Check overflow on vote tx compaction boundary ( #27185 )
...
* Check overflow on vote tx compaction boundary
Check for overflow during the conversion between VoteStateUpdate and
CompactVoteStateUpdate.
* Try removing clippy supress
2022-08-23 22:29:03 -07:00
66e2df8ddc
failed_store_id should be searched per pubkey ( #27342 )
2022-08-23 19:12:50 -05:00
Ian Macalinao
Jeff Washington (jwash)
kirill lykov
Justin Starry
Brooks Prumo
Will Hickey
apfitzge
Michael Vines
behzad nouri
Christian Kamm
Tao Zhu
dependabot[bot]
Jeff Washington (jwash)
Alexander Meißner
Tyera Eulberg
Haoran Yi
apfitzge
Trent Nelson
Brennan Watt
Ashwin Sekar