cfc124c825
acct idx can no longer use write cache ( #28150 )
2022-09-30 10:55:27 -07:00
82558226f7
ImmutableDeserializedPacket rc to arc ( #28145 )
2022-09-30 12:07:48 -05:00
82e65593ee
Batch filtering invalid transactions before forwarding ( #26798 )
...
- Batch filtering invalid transactions (fail to sanitize, too old or already processed) before forwarding
- Combine packet filtering and forwarding to share sanitized transactions
- `iter_desc` is no longer needed, remove it;
- Add a method to share the logic of removing packets from buffer after they were removed from MinMaxHeap
- Add test coverage for forward_packet_batches_by_accounts
- rebase, resolve conflicts
2022-09-29 16:33:40 -05:00
8b0f9b4917
make ping cache rate limit delay configurable ( #27955 )
2022-09-26 14:16:56 -07:00
f49beb0cbc
caches reed-solomon encoder/decoder instance ( #27510 )
...
ReedSolomon::new(...) initializes a matrix and a data-decode-matrix cache:
https://github.com/rust-rse/reed-solomon-erasure/blob/273ebbced/src/core.rs#L460-L466
In order to cache this computation, this commit caches the reed-solomon
encoder/decoder instance for each (data_shards, parity_shards) pair.
2022-09-25 18:09:47 +00:00
9816c94d7e
metrics to distinguish why repair packets are dropped ( #27960 )
2022-09-24 23:20:05 -07:00
8b43215ddd
count unsigned repair requests ( #27953 )
2022-09-24 12:56:02 -07:00
e51cf46d6b
Remove priority from vote transactions ( #28030 )
...
vote transactions have same priority fee
2022-09-24 00:31:50 +00:00
9ee53e594d
patches clippy errors from new rust nightly release ( #28028 )
2022-09-23 20:57:27 +00:00
d9b31fd6b0
ahv: Add debug logging for EAH ( #27998 )
2022-09-23 14:04:48 -04:00
206cc9407b
allow unsigned repair requests ( #27910 )
2022-09-23 10:11:08 -07:00
97c9af4c6b
plumbs through flag to generate merkle variant of shreds
2022-09-23 16:45:18 +00:00
e4affb9fea
Add Blockstore::highest_slot() method ( #27981 )
2022-09-23 04:53:43 -05:00
9a57c64f21
patches clippy errors from new rust nightly release ( #27996 )
2022-09-22 22:23:03 +00:00
abfb996135
tracks number of staked/stale/dead nodes in turbine cluster-nodes ( #27915 )
2022-09-19 18:16:04 +00:00
9119dc13ec
Add structure to house unprocessed transactions in banking_stage ( #27777 )
...
Separate storage for voting and transaction threads:
- Voting threads utilize a shared reference in order to dedup extraneous
votes
- Transactions have thread local storage like before
2022-09-14 10:40:44 -07:00
c74df830b1
Add structure to collect and coalesce vote packets ( #27558 )
...
* Add structure to collect and coalesce vote packets
Will be used in banking stage to throw out extraneous vote packets
before processing
* pr comments
* Update inner lock to arc to improve performance
2022-09-14 00:44:26 -07:00
079bf561b0
Clean_up/upb_push_comment ( #27707 )
2022-09-12 18:59:41 -05:00
765c628546
use exit signal for acct idx bg threads ( #27483 )
2022-09-12 11:51:12 -07:00
4f22ee8f9b
uses varint encoding for vote-state lockout offsets
...
The commit removes CompactVoteStateUpdate and instead reduces serialized
size of VoteStateUpdate using varint encoding for vote-state lockout
offsets.
2022-09-12 16:31:20 +00:00
90b8a3a44d
Remove KeypairInsecureClone trait and add insecure_clone() instead ( #27396 )
...
See discussion in #26248
2022-09-12 14:59:41 +00:00
83d4d128c2
Add --process-ledger-before-service flag to solana-validator
2022-09-11 07:58:42 -07:00
1f00b468e5
add enable_rehashing to AccountsPackage ( #27644 )
2022-09-08 09:25:25 -07:00
a9c5adbf88
UnprocessedPacketBatches pop_max fn are only used in tests ( #27645 )
2022-09-08 11:01:14 -05:00
cc58968b76
add new leader slot metric to track account contention throttling ( #27654 )
2022-09-08 09:22:58 -05:00
4308c300b4
In ledger-tool delete the account files in the async way ( #27622 )
...
* In ledger-tool delete the account files in the async way
* format changes by ./cargo nightly fmt --all
2022-09-07 14:35:06 -07:00
6a322de845
Make Accounts Background Services aware of Epoch Accounts Hash ( #27626 )
2022-09-07 20:41:40 +00:00
7f223dc582
Added option to turn on UDP for TPU transaction and make UDP based TPU off by default ( #27462 )
...
--tpu-enable-udp is introduced. And when this is on, the transaction receive and transaction forward is enabled using udp.
Except for a few tests which was hard-coded sending transactions using udp, most tests are being done with udp based tpu disabled.
2022-09-07 13:19:14 -07:00
c04747dd66
cluster_slot_state_verifier: clippy nightly fixes ( #27521 )
...
clippy nightly fixes
2022-09-07 15:04:56 -05:00
1465ec947d
replay_stage: clippy nightly fixes ( #27520 )
...
clippy nightly fixes
2022-09-07 15:04:46 -05:00
d6a1e7498f
Add tests for deserialize_and_collect_packets ( #27623 )
2022-09-07 12:52:18 -05:00
22007a3c96
allow accounts hash calc to specify enable_rehashing ( #27615 )
2022-09-07 10:16:52 -07:00
a31d4a597d
serialize epoch_accounts_hash ( #27516 )
2022-09-07 10:07:00 -07:00
93a4f80a2c
Handling snapshot requests is now required ( #27537 )
2022-09-07 10:08:42 -04:00
269eb519dd
track time to coalesce entries in recv_slot_entries ( #27525 )
2022-09-06 16:07:17 -07:00
a67d56f462
refactor: add function for deserializing and collecting packets - separate from channel receive ( #27548 )
2022-09-06 15:54:31 -05:00
6684c62280
Add SnapshotUsage to SnapshotConfig ( #27508 )
2022-09-02 08:56:23 -04:00
242c9cb442
RPC Notifier Signal when Setup Complete ( #27481 )
...
* RPC notifier signal when ready
2022-09-01 16:39:55 -07:00
9b8bed86f9
Add getRecentPrioritizationFees RPC endpoint ( #27278 )
...
* Plumb priority_fee_cache into rpc
* Add PrioritizationFeeCache api
* Add getRecentPrioritizationFees rpc endpoint
* Use MAX_TX_ACCOUNT_LOCKS to limit input keys
* Remove unused cache apis
* Map fee data by slot, and make rpc account inputs optional
* Add priority_fee_cache to rpc test framework, and add test
* Add endpoint to jsonrpc docs
* Update docs/src/developing/clients/jsonrpc-api.md
* Update docs/src/developing/clients/jsonrpc-api.md
2022-09-01 23:12:12 +00:00
3bdc5b3f2b
separate packet_deserializer inside banking_stage ( #27120 )
...
* separate packet_deserializer inside banking_stage
* Make ReceivePacketResults into a struct with named fields
2022-09-01 10:00:48 -05:00
8bb039d08d
collect min prioritization fees when replaying sanitized transactions ( #26709 )
...
* Collect blocks' minimum prioritization fees when replaying sanitized transactions
* Limits block min-fee metrics reporting to top 10 writable accounts
* Add service thread to asynchronously update and finalize prioritization fee cache
* Add bench test for prioritization_fee_cache
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2022-08-31 08:00:55 -05:00
5b64107626
make pruned_bank channel unbonded.
...
In kin-sim, we found that bounded channel causes halt for account
background services. As the number of accounts grows, the time for
pruning and cleaning increases, which would leads to longer intervals
between the pruning of deaded bank slots. With 1.7B accounts, we will
exceed the 10K bounded channel threshold that causes halt of account
back ground services. Without pruning, the node will eventually run out
of memory.
2022-08-29 19:06:30 -05:00
3c7cd62030
Move pruned_banks_receiver into PrunedBanksRequestHandler ( #27445 )
2022-08-29 13:30:06 -04:00
46a48760db
Switch concurrent replay from feature to param ( #27401 )
...
* Switch concurrent replay from feature to param
2022-08-26 12:36:02 -07:00
5eefc256d6
Fix startup panic if removing accounts directory fails ( #27386 )
...
* Remove contents of accounts directory if deleting the directory fails.
2022-08-25 20:35:12 -05:00
b1cff5d740
make fatal log message sound fatal
2022-08-25 21:49:12 +00:00
d1522fc790
coalesce entries in recv_slot_entries to target byte count ( #27321 )
2022-08-25 13:51:55 -07:00
2da93bd45a
add text to assert ( #27377 )
2022-08-24 14:11:53 -05:00
b8b3d723da
Use new client crates ( #27360 )
...
* Update ancillary cli crates
* Update cli
* Update command-line tools
* Update rpc, etc
* Update client-test
* Update core, validator
* Update local-cluster
2022-08-24 10:47:02 -06:00
efa6201eda
Check overflow on vote tx compaction boundary ( #27185 )
...
* Check overflow on vote tx compaction boundary
Check for overflow during the conversion between VoteStateUpdate and
CompactVoteStateUpdate.
* Try removing clippy supress
2022-08-23 22:29:03 -07:00
Jeff Washington (jwash)
apfitzge
Tao Zhu
Jeff Biseda
behzad nouri
Brooks Prumo
steviez
Ashwin Sekar
Christian Kamm
Michael Vines
apfitzge
Maximilian Schneider
Xiang Zhu
Lijun Wang
Brennan Watt
Tyera Eulberg
Haoran Yi
Will Hickey
Trent Nelson
Jeff Washington (jwash)
Tyera Eulberg