207820879b
rolls out merkle shreds to ~50% of mainnet slots ( #32678 )
2023-08-04 20:33:08 +00:00
a5bde0a79c
TieredStorage struct (3/N) -- new_readonly and reader structs ( #32579 )
...
#### Summary of Changes
This PR implements TieredStorage::new_readonly() and introduces
TieredStorageReader and HotStorageReader.
#### Test Plan
Updated the existing unit test.
2023-08-04 12:18:38 -07:00
533f42dae6
remove type cast in scan metric report ( #32704 )
...
Co-authored-by: HaoranYi <haoran.yi@solana.com>
2023-08-04 13:03:32 -05:00
226d7d986b
Simplify root slot lookup from BankForks ( #32717 )
...
No need to get an Arc<Bank> when we want the root slot from BankForks;
can just use BankForks::root().
2023-08-04 12:03:22 -06:00
04e25ff3ce
Adds doc comments for Bank fns that get accounts/snapshot hashes ( #32716 )
2023-08-04 13:56:15 -04:00
ca7a7ad2f3
add some doc comments identified in audit ( #32709 )
...
* add some doc comments identified in audit
* Update runtime/src/bank.rs
Co-authored-by: Brooks <brooks@prumo.org>
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks <brooks@prumo.org>
* Update runtime/src/accounts_db.rs
Co-authored-by: Brooks <brooks@prumo.org>
---------
Co-authored-by: Brooks <brooks@prumo.org>
2023-08-04 10:52:01 -07:00
a310dd776c
Fix - Uses `std::mem::transmute` and `std::ptr::write` in unsafe code in append_vec.rs ( #32711 )
...
Uses std::mem::transmute and std::ptr::write in unsafe code in append_vec.rs
2023-08-04 17:18:13 +02:00
1844c423a7
Add required cluster argument to solana feature activate subcommand ( #32693 )
...
This extra argument serves as an extra guardrail to ensure that the
feature key holder is activating the feature on the intended cluster,
and not solely using a default or config-file stored RPC url to
determine which cluster the feature will be activated on.
2023-08-04 08:28:01 -06:00
7ca45ae159
Bump serde from 1.0.180 to 1.0.181 ( #32710 )
...
* Bump serde from 1.0.180 to 1.0.181
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.180 to 1.0.181.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.180...v1.0.181 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-08-04 12:36:46 +00:00
b0a4669336
demotes unknown_epoch_staked_nodes metric to debug ( #32701 )
2023-08-04 12:33:08 +00:00
20fc3a5ded
Remove improper &Arc<Blockstore> instances ( #32698 )
...
Update to either &Blockstore if the function just needs a ref, or
Arc<Blockstore> if the function needs to hang onto a copy.
2023-08-03 15:10:25 -06:00
5edd032c79
Remove unnecessary clone ( #32707 )
2023-08-03 13:54:43 -06:00
8076b0fd4f
fix typo ( #32706 )
...
Co-authored-by: HaoranYi <haoran.yi@solana.com>
2023-08-03 12:59:00 -05:00
f5c8bb789a
remove unused bank creation/freezing progress ( #32699 )
2023-08-03 10:12:44 -07:00
33c33f5f79
Fix - Adds missing feature pubkeys to the `FEATURES_AFFECTING_RBPF` list ( #32703 )
...
Adds missing feature pubkeys to the FEATURES_AFFECTING_RBPF list.
2023-08-03 17:45:30 +02:00
b5a80a72f0
Fix - Adds missing "Executable account not owned by the BPF loader" error to `remove_bpf_loader_incorrect_program_id` ( #32695 )
...
Adds missing "Executable account not owned by the BPF loader" error.
2023-08-03 15:26:02 +02:00
2225aecfa9
Bump cc from 1.0.80 to 1.0.81 ( #32691 )
...
* Bump cc from 1.0.80 to 1.0.81
Bumps [cc](https://github.com/rust-lang/cc-rs ) from 1.0.80 to 1.0.81.
- [Release notes](https://github.com/rust-lang/cc-rs/releases )
- [Commits](https://github.com/rust-lang/cc-rs/compare/1.0.80...1.0.81 )
---
updated-dependencies:
- dependency-name: cc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-08-03 15:42:15 +08:00
fefc03c859
Update quinn-proto to 0.10.2 ( #32694 )
2023-08-02 17:12:33 -07:00
349f5e0846
read-locks Turbine QUIC connection cache for lookups ( #32687 )
...
Frequently accessed remote addresses are cached, making a shared-lock
sufficient which would reduce lock contention for the more common
cache-hit lookups.
2023-08-02 21:54:45 +00:00
8c14886891
sdk: Limited Borsh 0.9 support (Pubkey and helpers) ( #32511 )
...
* sdk: Implement Borsh 0.9 traits on Pubkey
* Alphabetize cargo.toml
* Add backwards-compatible borsh file
* Add borsh0_10.rs for more clarity
* Deprecate `borsh` utils, use borsh0_10 everywhere
* Mark borsh 0.9 helpers as deprecated
* Add macros for deriving helper impls
* Add borsh 0.9 tests
* Refactor tests into macro
2023-08-02 23:15:24 +02:00
1552a07f5b
Bump indicatif from 0.17.5 to 0.17.6 ( #32690 )
...
* Bump indicatif from 0.17.5 to 0.17.6
Bumps [indicatif](https://github.com/console-rs/indicatif ) from 0.17.5 to 0.17.6.
- [Release notes](https://github.com/console-rs/indicatif/releases )
- [Commits](https://github.com/console-rs/indicatif/commits )
---
updated-dependencies:
- dependency-name: indicatif
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-08-02 18:11:20 +00:00
4e4b0a361e
uses RwLock instead of Mutex for cache entries in ClusterNodesCache ( #32686 )
...
For as long as cache entries have not expired yet, a shared lock is
enough and would avoid lock contention.
2023-08-02 18:08:18 +00:00
4dc6eb14e0
ci: fix cc only support unix and window since 1.0.80 ( #32689 )
2023-08-02 16:47:54 +00:00
67b2f891f7
Bump rustls from 0.21.5 to 0.21.6 ( #32685 )
...
* Bump rustls from 0.21.5 to 0.21.6
Bumps [rustls](https://github.com/rustls/rustls ) from 0.21.5 to 0.21.6.
- [Release notes](https://github.com/rustls/rustls/releases )
- [Commits](https://github.com/rustls/rustls/compare/v/0.21.5...v/0.21.6 )
---
updated-dependencies:
- dependency-name: rustls
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-08-02 14:09:14 +00:00
ae4d17e11a
Bump cc from 1.0.79 to 1.0.80 ( #32681 )
...
* Bump cc from 1.0.79 to 1.0.80
Bumps [cc](https://github.com/rust-lang/cc-rs ) from 1.0.79 to 1.0.80.
- [Release notes](https://github.com/rust-lang/cc-rs/releases )
- [Commits](https://github.com/rust-lang/cc-rs/compare/1.0.79...1.0.80 )
---
updated-dependencies:
- dependency-name: cc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-08-02 12:54:54 +00:00
be1ba04282
Bump quinn from 0.10.1 to 0.10.2 ( #32683 )
...
* Bump quinn from 0.10.1 to 0.10.2
Bumps [quinn](https://github.com/quinn-rs/quinn ) from 0.10.1 to 0.10.2.
- [Release notes](https://github.com/quinn-rs/quinn/releases )
- [Commits](https://github.com/quinn-rs/quinn/commits )
---
updated-dependencies:
- dependency-name: quinn
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-08-02 12:53:25 +00:00
69336ab5da
resets packet flags obtained from QUIC datagrams ( #32673 )
...
Packets obtained from recycler have dirty meta information and need to
re-initialized.
2023-08-01 21:50:25 +00:00
727cca5d20
QosService inline metrics reporting ( #32670 )
2023-08-01 10:19:02 -07:00
7afefd9e1b
Bump serde from 1.0.177 to 1.0.180 ( #32672 )
...
* Bump serde from 1.0.177 to 1.0.180
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.177 to 1.0.180.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.177...v1.0.180 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-08-01 13:19:49 +00:00
3dcb382731
avoid giant memory allocation in hash calc ( #32646 )
...
* avoid giant memory allocation in hash calc
* update comment
* reorder to avoid clone
* simplify references
* update comment on get_item
2023-07-31 13:13:19 -07:00
f4504d055a
Uses Mutex::into_inner() at end of de_dup_accounts() ( #32667 )
2023-07-31 17:02:45 +00:00
91fd2a3a93
abs purge slots in parallel ( #32536 )
...
* abs purge slots in parallel
* remove arc clone
2023-07-31 09:22:53 -07:00
0dd4c208e6
Remove redundant inc_new_counter for num received packets ( #32664 )
...
The same value is reported as a field in StreamerReceiveStats in
/streamer/src/streamer.rs
2023-07-31 09:53:17 -06:00
bb407d2b62
add metric read_only_cache_load_us ( #32559 )
2023-07-31 07:07:13 -07:00
58882e33ef
Bump syn from 2.0.27 to 2.0.28 ( #32666 )
...
* Bump syn from 2.0.27 to 2.0.28
Bumps [syn](https://github.com/dtolnay/syn ) from 2.0.27 to 2.0.28.
- [Release notes](https://github.com/dtolnay/syn/releases )
- [Commits](https://github.com/dtolnay/syn/compare/2.0.27...2.0.28 )
---
updated-dependencies:
- dependency-name: syn
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-07-31 12:18:02 +00:00
58e796dc64
Removes unnecessary clippy-allow for needless-collect when generating index ( #32656 )
2023-07-29 22:30:11 -04:00
fc8cfb63ae
Unstable sort slots when generating index ( #32653 )
2023-07-29 22:28:33 -04:00
ad4ddd3cb0
stores stake-accounts in parallel after epoch rewards calculations ( #32633 )
2023-07-29 20:47:28 +00:00
3cc97c75e6
Add changelog ( #26894 )
...
* Add changelog
* Lint: remove trailing whitespace
* Update based on review feedback
* Remove branch tracking from inside the changelog.
* Factor out duplication
* Add instruction about using the same wording when backporting
* Formatting - 80 character wrap
* Clarify ambiguous language
* Remove instruction that is only relelvant to backports
* Revert "Remove instruction that is only relelvant to backports"
This reverts commit 31fe048a5ec5493cf1c8524db10769cd14d2be0d.
* Update wording baased on review feedback
* Add core contributors to audience
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
* Updated based on review feedback.
* Add noteworthy criteria.
* Move instructions to bottom (below changelog).
* Add detail to instructions.
* Update core contributors to contributors
Co-authored-by: mvines <mvines@gmail.com>
* Remove superfluous "ABI"
Co-authored-by: mvines <mvines@gmail.com>
* Add anchor link at the top to the instructions at the bottom
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
* Add instructions for maintaining the changelog
* wording. add entry for edge channel.
* switch language from "branches" to "channels"
* adds entry for edge channel
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
* Remove whitespace in link
---------
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
Co-authored-by: mvines <mvines@gmail.com>
2023-07-28 17:09:35 -05:00
16ec9a68c9
Unzips Option when deserializing snapshot data files ( #32652 )
2023-07-28 15:21:22 -04:00
965ed1ab1f
Simplifies if-let when rebuilding bank ( #32654 )
...
Simplifies let-Some when rebuilding bank
2023-07-28 17:55:58 +00:00
e1d0785f4f
Unzips Option when rebuilding bank ( #32651 )
2023-07-28 12:28:49 -04:00
7f062624eb
Bump serde from 1.0.176 to 1.0.177 ( #32647 )
...
* Bump serde from 1.0.176 to 1.0.177
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.176 to 1.0.177.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.176...v1.0.177 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-07-28 14:01:54 +00:00
e337631f32
Cleanup backup_and_clear_blockstore() ( #32461 )
...
Some of the cleanup tasks include ...
- Make subfunctions return a Result and allow error handling above
- Add some clarifying comments
- Give backup directory name a more meaningful name
- Add some additional logs (with timing info) for long running parts
2023-07-28 06:43:04 -05:00
e3f253d559
introduce SerializedAccountMetadata ( #32644 )
...
* bpf_loader: move computing original account lengths inside serialize_paramters_(aligned|unaligned)
This is in preparation of returning more than just the original length
* bpf_loader: deserialize*: take original lens as an iterator instead of a slice
This is in preparation of extracting account lenghts from a larger
context
* bpf_loader: introduce SerializedAccountMetadata
Instead of passing original_account_lengths around as Vec<usize>,
introduce an explicit type that includes the length and soon more.
2023-07-28 18:34:27 +07:00
6f88587652
cpi: change unnecessary &mut MemoryMapping to &MemoryMapping ( #32643 )
2023-07-28 14:11:17 +07:00
029f7b1d56
BorrowedAccount: reserve() doesn't need to check for can_data_be_changed() ( #32642 )
...
reserve() only changes the capacity of the vector that holds the account data,
it doesn't modify the account in any way
2023-07-28 14:10:43 +07:00
de02601d73
Cleanups metrics in add_bank_snapshot() ( #32645 )
2023-07-27 20:24:25 +00:00
4417f49728
Adds more timing metrics to add_bank_snapshot() ( #32639 )
2023-07-27 14:52:34 -04:00
028f10d3d1
ledger-tool: Add flag to ignore open file descriptor limit error ( #32624 )
...
The current desired open file descriptor limit is 1,000,000. This is
quite a large number, and not needed for every command. Namely, commands
that do not unpack a snapshot and create an AccountsDB will likely not
use this many files.
There is already an option in BlockstoreOptions to ignore errors if the
desired value cannot be set; this PR just bubbles that option up to a
CLI flag in ledger-tool.
2023-07-27 11:50:45 -05:00
behzad nouri
Yueh-Hsuan Chiang
HaoranYi
steviez
Brooks
Jeff Washington (jwash)
Alexander Meißner
dependabot[bot]
Lijun Wang
Jon Cinque
Yihau Chen
Andrew Fitzgerald
Will Hickey
Alessandro Decina