245530b28e
Uses purge_all_bank_snapshots() ( #35380 )
2024-03-01 07:11:38 -05:00
e3b9d7fbb3
SDK: refactor `Signer` and `Signers` traits ( #34984 )
...
* read_keypair_file\((.+?)\)[\n\r\s]+.unwrap\(\)[\n\r\s]+.into\(\) -> Box::new(read_keypair_file().unwrap()), Presigner::new\((.*?)\).into\(\) -> Box::new(Presigner::new())
* compiles
* moar general
* doc
* Result impls FromIterator
* doc
2024-03-01 12:34:32 +01:00
9bb59aa30f
ledger-tool: verify: add --record-slots and --verify-slots ( #34246 )
...
ledger-tool: verify: add --verify-slots and --verify-slots-details
This adds:
--record-slots <FILENAME>
Write the slot hashes to this file.
--record-slots-config hash-only|accounts
Store the bank (=accounts) json file, or not.
--verify-slots <FILENAME>
Verify slot hashes against this file.
The first case can be used to dump a list of (slot, hash) to a json file
during a replay. The second case can be used to check slot hashes against
previously recorded values.
This is useful for debugging consensus failures, eg:
# on good commit/branch
ledger-tool verify --record-slots good.json --record-slots-config=accounts
# on bad commit or potentially consensus breaking branch
ledger-tool verify --verify-slots good.json
On a hash mismatch an error will be logged with the expected hash vs the
computed hash.
2024-03-01 08:39:30 +00:00
e8c87e86ef
local-cluster: fix flaky optimistic_confirmation tests ( #35356 )
...
* local-cluster: fix flaky optimistic_confirmation tests
* pr feedback: latest_vote -> newest_vote, reword some comments
2024-02-29 12:05:20 -08:00
bdc5cceb18
Purges all bank snapshots after fastboot ( #35350 )
2024-02-29 14:31:13 -05:00
5f54f6a7d9
build(deps): bump log from 0.4.20 to 0.4.21 ( #35370 )
...
* build(deps): bump log from 0.4.20 to 0.4.21
Bumps [log](https://github.com/rust-lang/log ) from 0.4.20 to 0.4.21.
- [Release notes](https://github.com/rust-lang/log/releases )
- [Changelog](https://github.com/rust-lang/log/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/log/compare/0.4.20...0.4.21 )
---
updated-dependencies:
- dependency-name: log
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-03-01 00:51:44 +08:00
eef4afa782
build(deps): bump crossbeam-channel from 0.5.11 to 0.5.12 ( #35372 )
...
* build(deps): bump crossbeam-channel from 0.5.11 to 0.5.12
Bumps [crossbeam-channel](https://github.com/crossbeam-rs/crossbeam ) from 0.5.11 to 0.5.12.
- [Release notes](https://github.com/crossbeam-rs/crossbeam/releases )
- [Changelog](https://github.com/crossbeam-rs/crossbeam/blob/master/CHANGELOG.md )
- [Commits](https://github.com/crossbeam-rs/crossbeam/compare/crossbeam-channel-0.5.11...crossbeam-channel-0.5.12 )
---
updated-dependencies:
- dependency-name: crossbeam-channel
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-03-01 00:51:01 +08:00
996de53309
build(deps): bump syn from 2.0.51 to 2.0.52 ( #35371 )
...
* build(deps): bump syn from 2.0.51 to 2.0.52
Bumps [syn](https://github.com/dtolnay/syn ) from 2.0.51 to 2.0.52.
- [Release notes](https://github.com/dtolnay/syn/releases )
- [Commits](https://github.com/dtolnay/syn/compare/2.0.51...2.0.52 )
---
updated-dependencies:
- dependency-name: syn
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-03-01 00:50:47 +08:00
83de6a5930
Moves in_mem_accounts_index.rs into accounts_index directory ( #35360 )
2024-02-29 06:51:18 -05:00
c9c2fbbdd6
Add `Message::is_maybe_writable` ( #35340 )
2024-02-29 10:27:33 +08:00
990ca1d0b8
Add limit to looping in banking-stage ( #35342 )
2024-02-28 17:36:45 -08:00
312f786abf
Rename `SanitizedMessage::try_from` to `try_from_legacy_message` ( #35338 )
...
* Simplify and refactor tx message creation in tests
* Rename SanitizedMessage::try_from to try_from_legacy_message
2024-02-29 08:25:22 +08:00
9146236f02
Removes ouroboros dependency ( #35355 )
2024-02-28 17:58:14 -05:00
2e10b3b64f
Removes InMemAccountsIndex::get() ( #35354 )
2024-02-28 17:57:55 -05:00
140c21f8a9
Removes ReadAccountMapEntry ( #35351 )
2024-02-28 16:08:00 -05:00
6aaaf858c9
Adds more info to panic message in AccountsHashVerifier ( #35353 )
2024-02-28 15:55:05 -05:00
a7a41e7631
adds Merkle shred variant with retransmitter's signature ( #35293 )
...
Moving towards locking down Turbine propagation path, the commit
reserves a buffer within shred payload for retransmitter's signature.
2024-02-28 20:31:40 +00:00
98ec72e6ed
change default `bench-tps` client to `tpu-client` ( #35335 )
...
* change default bench-tps client to tpu-client
* remote client default to tpu-client
* add --use-tpu-client back in. hide --use-thin-client
* address nit, inform of future thinclient deprecation
2024-02-28 12:30:24 -08:00
140818221c
Rename SamplePerformanceService thread for consistency ( #35332 )
...
- Rename thread
- Add uniform service start/stop logs
- Misc cleanup with variables / constants / exit flag check
2024-02-28 13:47:27 -06:00
7c48cbb7aa
Replaces InMemAccountsIndex::get() with AccountsIndex::get_cloned() ( #35352 )
2024-02-28 14:45:08 -05:00
6402198902
Replaces ReadAccountMapEntry in calculate_accounts_hash_from_index() ( #35349 )
2024-02-28 14:38:19 -05:00
8f3e960640
Add tests for private functions in SVM `account_loader.rs` ( #35334 )
2024-02-28 14:17:45 -03:00
f340c1c181
Replaces ReadAccountMapEntry in do_scan_secondary_index() ( #35219 )
2024-02-28 11:43:33 -05:00
695fe1e7c8
build(deps): bump ahash from 0.8.9 to 0.8.10 ( #35347 )
...
* build(deps): bump ahash from 0.8.9 to 0.8.10
Bumps [ahash](https://github.com/tkaitchuck/ahash ) from 0.8.9 to 0.8.10.
- [Release notes](https://github.com/tkaitchuck/ahash/releases )
- [Commits](https://github.com/tkaitchuck/ahash/compare/v0.8.9...v0.8.10 )
---
updated-dependencies:
- dependency-name: ahash
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-02-28 23:38:18 +08:00
089cead024
add bench for precompiled programs ( #35310 )
...
* add bench for ed25519 instruction
* add bench for secp256k1 instruction
* Apply suggestions from code review
Co-authored-by: Andrew Fitzgerald <apfitzge@gmail.com>
* prepare unique txs for benching
* use iter::Cycle for endless loop
---------
Co-authored-by: Andrew Fitzgerald <apfitzge@gmail.com>
2024-02-28 09:06:55 -06:00
e6f8cdce01
Refactor - `LoadedPrograms::assign_program()` ( #35233 )
...
* Forbids all program replacements except for reloads and builtins.
* Adds test_assign_program_failure() and test_assign_program_success().
* Explicitly disallows LoadedProgramType::DelayVisibility to be inserted in the global cache.
2024-02-28 09:20:11 +01:00
6ee3bb973c
build(deps): bump tempfile from 3.10.0 to 3.10.1 ( #35328 )
...
* build(deps): bump tempfile from 3.10.0 to 3.10.1
Bumps [tempfile](https://github.com/Stebalien/tempfile ) from 3.10.0 to 3.10.1.
- [Changelog](https://github.com/Stebalien/tempfile/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Stebalien/tempfile/compare/v3.10.0...v3.10.1 )
---
updated-dependencies:
- dependency-name: tempfile
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-02-28 11:36:14 +08:00
a4e1a9ac98
Adds AccountsIndex::get_account_info_with_and_then() ( #35336 )
2024-02-27 20:01:29 -05:00
da088681ba
Adds safer alternatives to get_internal() ( #35325 )
2024-02-27 18:08:25 -05:00
94698b8dd0
Name PubSubService tokio threads ( #35331 )
...
Also add logs for service starting/stopping
2024-02-27 14:59:07 -06:00
8be9930c98
Bump platform tools version ( #35330 )
...
Co-authored-by: Dmitri Makarov <dmakarov@users.noreply.github.com>
2024-02-27 17:58:26 -03:00
8ad125d0c0
rpc: optimize `getTokenLargestAccounts` ( #35315 )
...
* rpc: optimize `getTokenLargestAccounts`
* use tuple instead of struct
* untuple
Co-authored-by: Tyera <teulberg@gmail.com>
---------
Co-authored-by: Tyera <teulberg@gmail.com>
2024-02-27 00:08:29 -07:00
09925a11eb
Remove the Blockstore thread pool used for fetching Entries ( #34768 )
...
There are several cases for fetching entries from the Blockstore:
- Fetching entries for block replay
- Fetching entries for CompletedDataSetService
- Fetching entries to service RPC getBlock requests
All of these operations occur in a different calling thread. However,
the currently implementation utilizes a shared thread-pool within the
Blockstore function. There are several problems with this:
- The thread pool is shared between all of the listed cases, despite
block replay being the most critical. These other services shouldn't
be able to interfere with block replay
- The thread pool is overprovisioned for the average use; thread
utilization on both regular validators and RPC nodes shows that many
of the thread see very little activity. But, these thread existing
introduce "accounting" overhead
- rocksdb exposes an API to fetch multiple items at once, potentially
with some parallelization under the hood. Using parallelization in
our API and the underlying rocksdb is overkill and we're doing more
damage than good.
This change removes that threadpool completely, and instead fetches
all of the desired entries in a single call. This has been observed
to have a minor degradation on the time spent within the Blockstore
get_slot_entries_with_shred_info() function. Namely, some buffer
copying and deserialization that previously occurred in parallel now
occur serially.
However, the metric that tracks the amount of time spent replaying
blocks (inclusive of fetch) is unchanged. Thus, despite spending
marginally more time to fetch/copy/deserialize with only a single
thread, the gains from not thrashing everything else with the pool
keep us at parity.
2024-02-26 20:27:03 -06:00
bf2e8ee32f
AccountsIndex::get_cloned() *must* add entry to in-mem cache ( #35322 )
2024-02-26 18:20:21 -05:00
8143fc3f4a
Replaces ReadAccountMapEntry in read_index_for_accessor_or_load_slow() ( #35220 )
2024-02-26 14:19:18 -05:00
8235feefc4
Removes get_for_tests() ( #35311 )
2024-02-26 14:17:33 -05:00
0ab425b43b
splits test_shred_variant_compat into separate test-cases ( #35306 )
2024-02-26 17:32:47 +00:00
c8ee4f59ad
uses struct instead of tuple for Merkle shreds variant ( #35303 )
...
Working towards adding a new Merkle shred variant with retransmitter's
signature, the commit uses struct instead of tuple to describe Merkle shred
variant.
2024-02-26 15:58:40 +00:00
6c6e691c80
build(deps): bump socket2 from 0.5.5 to 0.5.6 ( #35318 )
...
* build(deps): bump socket2 from 0.5.5 to 0.5.6
Bumps [socket2](https://github.com/rust-lang/socket2 ) from 0.5.5 to 0.5.6.
- [Release notes](https://github.com/rust-lang/socket2/releases )
- [Changelog](https://github.com/rust-lang/socket2/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/socket2/compare/v0.5.5...v0.5.6 )
---
updated-dependencies:
- dependency-name: socket2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-02-26 23:04:25 +08:00
2fd2f34b35
build(deps): bump syn from 2.0.50 to 2.0.51 ( #35317 )
...
* build(deps): bump syn from 2.0.50 to 2.0.51
Bumps [syn](https://github.com/dtolnay/syn ) from 2.0.50 to 2.0.51.
- [Release notes](https://github.com/dtolnay/syn/releases )
- [Commits](https://github.com/dtolnay/syn/compare/2.0.50...2.0.51 )
---
updated-dependencies:
- dependency-name: syn
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-02-26 23:03:33 +08:00
e74d5ccca3
hash: Use `finalize().into()` instead of `try_into()` for hash results ( #35300 )
...
`sha2` and `sha3` crates already moved to `generic-array` 0.14.7,
which means that we can safely convert the hash result to a sized
array just by calling `finalize().into()`, which doesn't return
any errors.
2024-02-23 19:31:32 -07:00
9f581113bd
Scheduler: Leader-Slot metrics for Scheduler ( #35087 )
2024-02-23 17:06:22 -08:00
54706a885b
Adds get_with_and_then() to AccountsIndex ( #35307 )
2024-02-23 18:48:36 -05:00
1e47aacd0d
Removes get_account_read_entry() ( #35309 )
2024-02-23 22:25:30 +00:00
58c1b7aefb
Replaces ReadAccountMapEntry in more tests ( #35308 )
2024-02-23 21:20:42 +00:00
ec63b813f5
Move account filter test to SVM ( #35304 )
2024-02-23 17:44:26 -03:00
c02f47a6fb
fix: cleanup ( #35298 )
2024-02-23 19:59:52 +00:00
fe571bbab3
Plumb `CommitmentConfig` through `bench-tps` client types ( #35282 )
...
* use --commitment-config <commitment-level> for setting blockhash commitment level for sending transactions with rpc-client
* clarify default
* leave get_balance_with_commitment at processed()
* rm unused variable
* refactor commitment_config flag read in
* update cli and change send_batch's get_latest_blockhash() to get_latest_blockhash_with_client_commitment() and use client's internal commitment level
* change fix some nits based on PR comments
* rm unused import
2024-02-23 11:50:41 -08:00
72734a9539
move changelog note of default central-scheduler ( #35217 )
2024-02-23 11:13:23 -08:00
74758d9fbf
Refactor - Move recompilation out of program loading ( #35297 )
...
Moves recompilation specifics out of load_program().
2024-02-23 17:25:32 +01:00
Brooks
Han Yang
Sean Young
Ashwin Sekar
dependabot[bot]
Justin Starry
Pankaj Garg
behzad nouri
Greg Cusack
steviez
Lucas Steuernagel
Tao Zhu
Alexander Meißner
Kirill Fomichev
Michal Rostecki
Andrew Fitzgerald
enjoyoor
Greg Cusack