Yueh-Hsuan Chiang
94273434ce
[TieredStorage] HotStorageReader::get_account_meta_from_offset() ( #33724 )
...
#### Problem
HotStorageReader currently only implements get_footer(). It does not
have a function to obtain the account meta.
#### Summary of Changes
This PR implements HotStorageReader::get_account_meta_from_offset().
A function that returns the account meta located at the specified offset.
This will be the helper function that will be later used to obtain the account
meta when the offset is available from the index block of a hot storage file.
#### Test Plan
A new test is included in this PR.
2023-10-18 12:27:39 -07:00
behzad nouri
afd044e296
removes redundant ClusterInfo::drain_push_queue ( #33753 )
2023-10-18 18:53:58 +00:00
behzad nouri
2465abce5c
simplifies pull-responses handling ( #33743 )
...
Following:
https://github.com/solana-labs/solana/pull/33722
from pubkey in PullResponse is no longer used in processing
pull-responses and so the code can be simplified.
2023-10-18 18:06:14 +00:00
Illia Bobyr
84c2f9de55
program::message::AccountKeys: `Clone`, `Default`, `Debug`, `Eq` ( #33749 )
...
It is a pretty standard set of traits to implement on most types. Both `Pubkey`
and `LoadedAddresses` contained within the `AccountKeys` already implement them.
Doing the same for `AccountKeys` could simplify unit tests and/or some common
value manipulation logic.
2023-10-18 10:22:33 -07:00
Brooks
e96678b302
Uses SeqLock for CachedAccountInner::hash ( #33696 )
2023-10-18 10:43:35 -04:00
behzad nouri
c699bc9cab
down samples outgoing gossip pull requests ( #33719 )
...
Push message propagation has improved in recent versions of the gossip
code and we don't rely on pull requests as much as before. Handling pull
requests is also inefficient and expensive.
The commit reduces number of outgoing pull requests by down sampling.
2023-10-18 13:41:42 +00:00
Brooks
785959bbc3
Upgrades lock_api to v0.4.10 ( #33736 )
2023-10-17 23:35:49 -04:00
Illia Bobyr
9baa0b1c02
ci/env.sh: Log `CI_BASE_BRANCH` ( #33744 )
...
When debugging CI failures it helps when I can see all the variables set
by `env.sh`.
Order environment variables in the output to match the order they are
set a bit better.
`CI_BASE_BRANCH` was not set at all for unknown environment. Does not
matter much, but it seems consistent to include it in the list next to
all the other variables.
2023-10-17 20:20:59 -07:00
Yueh-Hsuan Chiang
0b05e8db11
[TieredStorage] Footer test for HotStorageReader ( #33718 )
...
#### Problem
HotStorageReader currently doesn't have a test that covers its footer.
#### Summary of Changes
This PR includes a test for HotStorageReader that verifies the footer.
2023-10-17 15:24:38 -07:00
Jeff Washington (jwash)
c09cbbb778
sort ancient append vec target_slots_sorted ( #33729 )
2023-10-17 14:49:46 -07:00
Jeff Washington (jwash)
56a7485998
log ancient stats each time we run ( #33730 )
2023-10-17 14:41:23 -07:00
HaoranYi
673a38c892
move timer after early exit ( #33732 )
...
Co-authored-by: HaoranYi <haoran.yi@solana.com>
2023-10-17 15:20:29 -05:00
Jacob Creech
2c6cc4dd7d
docs: move rpc info to rpc docs ( #33723 )
...
docs: link fixes
docs: link fixes
docs: link fixes
2023-10-17 14:55:29 -05:00
HaoranYi
f178975185
typo ( #33734 )
...
Co-authored-by: HaoranYi <haoran.yi@solana.com>
2023-10-17 14:45:17 -05:00
Greg Cusack
6efc7ec61d
remove redundant pubkey update record ( #33722 )
...
* remove redundant pubkey update record
* from became unused, so removed from all process_pull_response() calls
2023-10-17 10:34:12 -07:00
Jeff Washington (jwash)
5de9163625
add metric for ancient can't move slots ( #33713 )
...
* add metric for ancient can't move slots
* rename
* fix erors in replacing text
* rename
2023-10-17 08:34:18 -07:00
dependabot[bot]
b241cef813
build(deps): bump regex from 1.10.1 to 1.10.2 ( #33725 )
...
* build(deps): bump regex from 1.10.1 to 1.10.2
Bumps [regex](https://github.com/rust-lang/regex ) from 1.10.1 to 1.10.2.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.10.1...1.10.2 )
---
updated-dependencies:
- dependency-name: regex
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-10-17 15:21:28 +00:00
dependabot[bot]
122ec75e4b
build(deps): bump const_format from 0.2.31 to 0.2.32 ( #33727 )
...
Bumps [const_format](https://github.com/rodrimati1992/const_format_crates ) from 0.2.31 to 0.2.32.
- [Release notes](https://github.com/rodrimati1992/const_format_crates/releases )
- [Changelog](https://github.com/rodrimati1992/const_format_crates/blob/master/Changelog.md )
- [Commits](https://github.com/rodrimati1992/const_format_crates/commits )
---
updated-dependencies:
- dependency-name: const_format
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-17 14:07:11 +00:00
dependabot[bot]
9faae48d19
build(deps): bump @babel/traverse from 7.19.6 to 7.23.2 in /docs ( #33726 )
...
Bumps [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse ) from 7.19.6 to 7.23.2.
- [Release notes](https://github.com/babel/babel/releases )
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md )
- [Commits](https://github.com/babel/babel/commits/v7.23.2/packages/babel-traverse )
---
updated-dependencies:
- dependency-name: "@babel/traverse"
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-17 14:03:27 +00:00
Illia Bobyr
b5b48eeb72
Cargo.toml: Sort dependency and feature lists ( #33670 )
...
Keeping these sorted reduces merge conflicts.
2023-10-17 01:12:15 -07:00
Pierre
8a20e7f8de
sdk: fix broken C examples ( #33701 )
...
fix C broken example
2023-10-16 23:53:03 +02:00
Jeff Washington (jwash)
69495f4c13
Fix non-determinism in account_hash_ignore_slot on genesis ( #33692 )
2023-10-16 12:47:07 -07:00
Jeff Washington (jwash)
d948e5bf69
ancient shrink on its own cadence ( #33712 )
2023-10-16 10:06:20 -07:00
steviez
8bd0e4cd95
Change getHealth to compare optimistically confirmed slots ( #33651 )
...
The current getHealth mechanism checks a local accounts hash slot vs.
those of other nodes as specified by --known-validator. This is a
very coarse comparison given that the default for this value is 100
slots. More so, any nodes using a value larger than the default
(ie --incremental-snapshot-interval 500) will likely see getHealth
return status behind at some point.
Change the underlying mechanism of how health is computed. Instead of
using the accounts hash slots published in gossip, use the latest
optimistically confirmed slot from the cluster. Even when a node is
behind, it is able to observe cluster optimistically confirmed by slots
by viewing votes published in gossip.
Thus, the latest cluster optimistically confirmed slot can be compared
against the latest optimistically confirmed bank from replay to
determine health. This new comparison is much more granular, and not
needing to depend on individual known validators is also a plus.
2023-10-16 11:21:33 -05:00
Pankaj Garg
f4fb957a38
Code cleanup in cargo-registry ( #33711 )
2023-10-16 08:58:53 -07:00
HaoranYi
167dac204f
Retry hash file allocation ( #33565 )
...
* retry hash file allocation
* add sleep
* submit a datapoint for retry
* typo
* more typos
* Update accounts-db/src/accounts_hash.rs
Co-authored-by: Brooks <brooks@prumo.org>
* fmt
---------
Co-authored-by: HaoranYi <haoran.yi@solana.com>
Co-authored-by: Brooks <brooks@prumo.org>
2023-10-16 09:21:08 -05:00
dependabot[bot]
bec4a47886
build(deps): bump flate2 from 1.0.27 to 1.0.28 ( #33708 )
...
* build(deps): bump flate2 from 1.0.27 to 1.0.28
Bumps [flate2](https://github.com/rust-lang/flate2-rs ) from 1.0.27 to 1.0.28.
- [Release notes](https://github.com/rust-lang/flate2-rs/releases )
- [Commits](https://github.com/rust-lang/flate2-rs/compare/1.0.27...1.0.28 )
---
updated-dependencies:
- dependency-name: flate2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-10-16 12:54:44 +00:00
dependabot[bot]
d548993cb4
build(deps): bump async-trait from 0.1.73 to 0.1.74 ( #33707 )
...
* build(deps): bump async-trait from 0.1.73 to 0.1.74
Bumps [async-trait](https://github.com/dtolnay/async-trait ) from 0.1.73 to 0.1.74.
- [Release notes](https://github.com/dtolnay/async-trait/releases )
- [Commits](https://github.com/dtolnay/async-trait/compare/0.1.73...0.1.74 )
---
updated-dependencies:
- dependency-name: async-trait
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-10-16 12:54:13 +00:00
dependabot[bot]
c7f2c331c2
build(deps): bump regex from 1.10.0 to 1.10.1 ( #33705 )
...
* build(deps): bump regex from 1.10.0 to 1.10.1
Bumps [regex](https://github.com/rust-lang/regex ) from 1.10.0 to 1.10.1.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.10.0...1.10.1 )
---
updated-dependencies:
- dependency-name: regex
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-10-16 12:53:44 +00:00
Joe C
8a483a8302
RPC: update websocket docs ( #33460 )
...
* [rpc]: update websocket docs
* rename rewards to showRewards
* add remaining optional fields for slotsUpdates
* update block subscription showRewards
2023-10-16 09:44:11 +02:00
dependabot[bot]
c0fbfc6422
build(deps): bump serde from 1.0.188 to 1.0.189 ( #33686 )
...
* build(deps): bump serde from 1.0.188 to 1.0.189
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.188 to 1.0.189.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.188...v1.0.189 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-10-14 17:58:36 +00:00
Sanjay Singh
a60d1857bf
updated inner_call for hashing fn to follow generic approach ( #33128 )
...
* updated inner_call for hashing fn to follow generic approach
* different hash compute budget values for all digests
* fixed conflicts
* reverted changes to compute_budget.rs and added 3method to trait to get compute budget values
* updated type for result fn for HasherImpl
* using Hash directly in result fn, got rid of HASH_BYTES and removed comment form compute_budget
* updated import statement
* cargo fmt -all
* removed unused import and reference related warning
* oops forgot semicolon
* removed trailing white space
2023-10-13 14:53:19 -06:00
Alexander Meißner
a3f85aba21
Refactor - LoadedPrograms part 2 ( #33694 )
2023-10-13 12:59:48 -07:00
Pankaj Garg
1155d46266
Add CLI command to show/dump v4 programs ( #33693 )
2023-10-13 12:13:45 -07:00
Pankaj Garg
09e858d939
Handle cargo registry index lookup requests ( #33681 )
2023-10-13 07:54:37 -07:00
Pankaj Garg
fd9297775a
Prevent delay_visibility_of_program_deployment feature from cache pruning ( #33689 )
2023-10-13 14:21:18 +00:00
Sean Young
47511999bb
bank: do not remove trailing 0 bytes from return data ( #33639 )
...
This is creating havoc for Solang, as the return data is borsh encoded
and therefore `u64` values like 0x100 get truncated.
2023-10-13 08:00:41 +01:00
Yihau Chen
923d5b5324
chore: remove install-nodejs.sh and install-redis.sh ( #33684 )
...
chore: remove unused scripts
2023-10-13 12:47:06 +08:00
Yihau Chen
abfecad785
remove redis setup from net.sh ( #33680 )
...
remove redis setup for perf tests
2023-10-13 12:46:45 +08:00
Tyera
01a3b1b52f
Blockstore: clean/save old TransactionMemos sensibly ( #33678 )
...
* Convert OldestSlot to named struct
* Add clean_slot_0 to OldestSlot
* Set AtomicBool to true when all primary-index keys returning slot 0 should be purged
* Add PurgedFilter::clean_slot_0
* Use clean_slot_0 to preserve deprecated TransactionMemos
* Also set AtomicBool to true immediately on boot, if highest_primary_index_slot.is_none
* Add test
* Fixup test
2023-10-12 22:43:27 -06:00
Ryo Onodera
53925b6182
Make goto_end_of_slot() take Arc<Bank> ( #33650 )
2023-10-13 13:08:38 +09:00
Pankaj Garg
47540af978
Replace cargo registry server's GIT index with sparse index ( #33666 )
...
* Replace cargo registry server's GIT index with sparse index
* Remove GIT index support
* handler for crate download request processing
* restructure the index code
2023-10-12 15:58:01 -07:00
Brooks
452fd5d384
Adds `--no-skip-initial-accounts-db-clean` *hidden* CLI flag ( #33664 )
2023-10-12 13:32:40 -04:00
dependabot[bot]
ac788ab455
build(deps): bump num-derive from 0.4.0 to 0.4.1 ( #33671 )
...
* build(deps): bump num-derive from 0.4.0 to 0.4.1
Bumps [num-derive](https://github.com/rust-num/num-derive ) from 0.4.0 to 0.4.1.
- [Changelog](https://github.com/rust-num/num-derive/blob/master/RELEASES.md )
- [Commits](https://github.com/rust-num/num-derive/compare/num-derive-0.4.0...num-derive-0.4.1 )
---
updated-dependencies:
- dependency-name: num-derive
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-10-12 15:04:18 +00:00
Jeff Washington (jwash)
c354879a3f
stop padding new append vecs to page size ( #33658 )
...
* stop padding new append vecs to page size
* fix test
* fix another test
* for creating test accounts, allocate larger like we used to
2023-10-12 07:11:20 -07:00
HaoranYi
1a2c7f106e
fix typo in comments ( #33665 )
...
Co-authored-by: HaoranYi <haoran.yi@solana.com>
2023-10-12 09:05:10 -05:00
Tyera
d286c00a30
Blockstore: track when all primary-index data has been purged ( #33668 )
...
* Fix typo
* Add Blockstore::highest_primary_index_slot
* Add getter
* Populate highest_primary_index_slot on boot
* Wipe highest_primary_index_slot when surpassed by oldest_slot
* Update highest_primary_index_slot in exact purge
* Return indexes early if highest_primary_index_slot has been cleared
* Limit read_transaction_status based on highest_primary_index_slot
* Limit read_transaction_memos based on highest_primary_index_slot
* Use highest_primary_index_slot to add early return to get_transaction_status_with_counter
* Fixup tests
* Use existing getter for highest_primary_index_slot
Co-authored-by: steviez <stevecz@umich.edu>
---------
Co-authored-by: steviez <stevecz@umich.edu>
2023-10-12 07:12:33 +00:00
dependabot[bot]
0ad519961b
build(deps): bump num-derive from 0.3.3 to 0.4.0 ( #33654 )
...
* build(deps): bump num-derive from 0.3.3 to 0.4.0
Bumps [num-derive](https://github.com/rust-num/num-derive ) from 0.3.3 to 0.4.0.
- [Changelog](https://github.com/rust-num/num-derive/blob/master/RELEASES.md )
- [Commits](https://github.com/rust-num/num-derive/compare/num-derive-0.3.3...num-derive-0.4.0 )
---
updated-dependencies:
- dependency-name: num-derive
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* updates programs/sbf/Cargo.lock
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: behzad nouri <behzadnouri@gmail.com>
2023-10-12 12:19:21 +08:00
Lijun Wang
21b2fce6f4
Correct num_packets stats ( #33630 )
...
Do not count the empty packets from cache warmer in num_packets stats as they are not sent.
2023-10-11 14:00:30 -07:00
Wen
295d610f43
We need to publish solana-wen-restart so we can publish 1.18.0 later. ( #33662 )
2023-10-11 11:27:09 -07:00