Commit Graph

22373 Commits

Author SHA1 Message Date
Yihau Chen f6591158ab
ci: use the sccache which installed in the docker image (#31332) 2023-04-25 11:44:43 +08:00
Xiang Zhu 16f3dcd5d2
Update fn create_and_verify_snapshot (#31245)
* only 1 snapshot per archive in create_and_verify_snapshot

* Update create_and_verify_snapshot with the newer funtion calls

* Fix test_package_snapshots

* Remove account path access change

* Rename slot to num_snapshots

* Remove unncessary purge_old_bank_snapshots in test

* Update non-deterministic format comment

* Cleanup unnecessary hash calls

* Use get_accounts_hash

* Remove extra declaration

* Remove rehash

* Remove clean_accounts

* Revert "Cleanup unnecessary hash calls"

This reverts commit 06b1457462cf6d7acf62e0e5531633caf5d9fc58.

Removing unncessary hash calls should be done for create_and_verify_snapshot,
not bank_to_full_snapshot_archive

* Fix typo appenedvecs

* Remove bank_snapshots_dir after rebasing
2023-04-24 18:52:50 -07:00
Ryo Onodera 6f9a15c36b
ci: suggest to use hidden_unless_forced() (#31321)
* ci: suggest to use hidden_unless_forced()

* shellcheck...
2023-04-25 09:43:42 +09:00
DimAn bd782634dc
Add ability to manage public TPU Forwards address (#31201)
A node operator can manage a public TPU address (at node startup and while it's running), but doesn't have the ability to manage the TPU Forwards address as well.

This PR adds that functionality.

Added the start argument --public-tpu-forwards-address
Reworked the set-public-tpu-address subcommand into the set-public-address subcommand
2023-04-24 23:04:36 +00:00
Alexander Meißner 4b0e16d06f
Refactor - `BuiltinPrograms` (#31324)
* Moves BuiltinProgram of the program runtime into its own file.

* Unifies the runtimes Builtin and program runtimes BuiltinProgram definitions.

* Moves BuiltinPrograms from bank.rs into the program runtime.
2023-04-24 19:01:40 +02:00
behzad nouri 1b08d01a80
removes shred_version from LegacyContactInfo public interface (#31304)
Working towards LegacyContactInfo => ContactInfo migration, the commit
adds more api parity between the two.
2023-04-24 15:19:33 +00:00
x19 c3eb17f2a3
sort vetted bootstrap rpcs based on ping times (#31285)
* sort and filter rpc nodes based on ping times
2023-04-24 08:11:11 -07:00
Jeff Washington (jwash) 05391b5244
packed ancient: report random stat (#31274) 2023-04-24 07:40:45 -07:00
Jeff Washington (jwash) 8b30aa187b
ancient packing: leave same append vecs alone (#31295) 2023-04-24 07:40:05 -07:00
Ryo Onodera cece64daad
ci: prefer clippy::default_trait_access over shell (#31318)
Prefer clippy::default_trait_access over shell
2023-04-24 14:04:11 +09:00
Yihau Chen ee10a48739
ci: soft fail trigger_secondary_step (#31296)
ci: soft failed trigger_secondary_step
2023-04-24 12:43:59 +08:00
behzad nouri 33bde55bbd
adds tpu_quic field to RpcContactInfo (#31310) 2023-04-22 20:18:58 +00:00
behzad nouri a88024e295
removes wallclock from LegacyContactInfo public interface (#31303) 2023-04-22 20:18:39 +00:00
Pankaj Garg a35e31f269
Do not evict tombstones (#31311) 2023-04-21 16:36:22 -07:00
dependabot[bot] d7ad0ce093
Bump libc from 0.2.140 to 0.2.142 (#31308)
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.140 to 0.2.142.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](rust-lang/libc@0.2.140...0.2.142)

---
updated-dependencies:
- dependency-name: libc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-04-21 15:51:32 -07:00
dependabot[bot] 74e02ad14e
Bump num_cpus from 1.13.1 to 1.15.0 (#31309)
Bumps [num_cpus](https://github.com/seanmonstar/num_cpus) from 1.13.1 to 1.15.0.
- [Release notes](https://github.com/seanmonstar/num_cpus/releases)
- [Changelog](https://github.com/seanmonstar/num_cpus/blob/master/CHANGELOG.md)
- [Commits](seanmonstar/num_cpus@v1.13.1...v1.15.0)

---
updated-dependencies:
- dependency-name: num_cpus
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-04-21 12:02:41 -07:00
Jeff Biseda 3cdd59e55f
check for prior discard in shred_fetch_stage (#31293) 2023-04-21 11:43:10 -07:00
dependabot[bot] 39b548153a
Bump socket2 from 0.4.7 to 0.4.9 (#31302)
* Bump socket2 from 0.4.7 to 0.4.9

Bumps [socket2](https://github.com/rust-lang/socket2) from 0.4.7 to 0.4.9.
- [Release notes](https://github.com/rust-lang/socket2/releases)
- [Changelog](https://github.com/rust-lang/socket2/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/socket2/commits/v0.4.9)

---
updated-dependencies:
- dependency-name: socket2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-21 12:01:43 -06:00
dependabot[bot] 4975a1a4c8
Bump either from 1.8.0 to 1.8.1 (#31299)
* Bump either from 1.8.0 to 1.8.1

Bumps [either](https://github.com/bluss/either) from 1.8.0 to 1.8.1.
- [Release notes](https://github.com/bluss/either/releases)
- [Commits](https://github.com/bluss/either/compare/1.8.0...1.8.1)

---
updated-dependencies:
- dependency-name: either
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-21 11:48:22 -06:00
dependabot[bot] fb3684ff86
Bump serde_with from 2.2.0 to 2.3.2 (#31300)
* Bump serde_with from 2.2.0 to 2.3.2

Bumps [serde_with](https://github.com/jonasbb/serde_with) from 2.2.0 to 2.3.2.
- [Release notes](https://github.com/jonasbb/serde_with/releases)
- [Commits](https://github.com/jonasbb/serde_with/compare/v2.2.0...v2.3.2)

---
updated-dependencies:
- dependency-name: serde_with
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-21 11:46:15 -06:00
Alexander Meißner e5490b8d09
Refactor - Use builtin function interface from rbpf (#31221)
* Removes test_program_entry_debug().

* Uses declare_process_instruction!() in all tests and benchmarks.

* Replaces with ProcessInstructionWithContext with solana_rbpf::BuiltInFunction.
2023-04-21 18:08:32 +02:00
behzad nouri cb65a785bc
makes sockets in LegacyContactInfo private (#31248)
Working towards LegacyContactInfo => ContactInfo migration, the commit
hides some implementation details of LegacyContactInfo and expands API
parity with the new ContactInfo.
2023-04-21 15:39:16 +00:00
Xiang Zhu b2e1d736f9
Purge snapshot dirs before loading from an archive (#31283)
* Purge snapshot dirs before loading from an archive

* Refine comment

* Should not remove the bank_snapshots_dir directory
2023-04-21 05:57:49 -07:00
Yihau Chen def2af1653
ci: fix test result doesn't upload (#31297) 2023-04-21 16:31:35 +08:00
Yihau Chen 17eab32ad0
ci: run stable tests partially (#31151)
* ci: run stable tests partially

* ci: improve uploading test result

* use buildkite's retry

* test common

* fix indent issue

* extract assert eq

* use diff to print test error

* pretty format

* test build stable steps

* add test all function

* lint

* lint

* keep dollar sign

* switch got and want's diff direction

* use 'EOF' to make code more readable

* rename EMPTY_LINE to DELETE_THIS_LINE

* rename N => INDEX

* rename M => LIMIT

* check variable in a more elegant way

* wording

* more explain for code
2023-04-21 14:51:17 +08:00
Tao Zhu b4331ae955
use checked arithmetic (#31259)
* use checked arithmetic
* add feature gate; updated tests
* allow collapsible-else-if

Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
Co-authored-by: mvines <mvines@gmail.com>
2023-04-20 22:56:08 -05:00
Illia Bobyr 94350f0959
Revert: Bump console from 0.15.0 to 0.15.5 (#31289) (#31294)
commit 4e3300e7d6
    Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    Date:   Thu Apr 20 15:40:14 2023 -0700
  
        Bump console from 0.15.0 to 0.15.5 (#31289)
  
        Bumps [console](https://github.com/console-rs/console) from 0.15.0 to 0.15.5.
        - [Release notes](https://github.com/console-rs/console/releases)
        - [Changelog](https://github.com/console-rs/console/blob/master/CHANGELOG.md)
        - [Commits](console-rs/console@0.15.0...0.15.5)
  
        ---
        updated-dependencies:
        - dependency-name: console
          dependency-type: direct:production
          update-type: version-update:semver-patch
        ...
  
        Signed-off-by: dependabot[bot] <support@github.com>

Windows build is broken with the following error:

    Compiling solana-genesis-utils v1.16.0 (D:\a\solana\solana\genesis-utils)
    error[E0432]: unresolved import `winapi::um::winuser`
       --> install\src\command.rs:385:17
        |
    385 |             um::winuser::{
        |                 ^^^^^^^ could not find `winuser` in `um`
  
    For more information about this error, try `rustc --explain E0432`.

https://github.com/solana-labs/solana/actions/runs/4759519915/jobs/8458877323
2023-04-20 19:37:36 -07:00
Tyera 03c1744e1d
Register SendTransactionService exit (#31261)
* Pass exit into SendTransactionService

* Abort SendTransactionService with BanksService

* Register SendTransactionService exit as part of RpcService validator Exit

* Improve test, ensure receiver has been dropped
2023-04-20 18:23:14 -06:00
dependabot[bot] 4e3300e7d6
Bump console from 0.15.0 to 0.15.5 (#31289)
Bumps [console](https://github.com/console-rs/console) from 0.15.0 to 0.15.5.
- [Release notes](https://github.com/console-rs/console/releases)
- [Changelog](https://github.com/console-rs/console/blob/master/CHANGELOG.md)
- [Commits](console-rs/console@0.15.0...0.15.5)

---
updated-dependencies:
- dependency-name: console
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-04-20 15:40:14 -07:00
sakridge 719de094a4
Add time field to solana vote-account rewards output (#31260)
Add block time into vote epoch rewards output
2023-04-20 23:54:26 +02:00
dependabot[bot] 32f3e1a895
Bump protobuf-src from 1.0.5+3.19.3 to 1.1.0+21.5 (#31287)
Bumps [protobuf-src](https://github.com/MaterializeInc/rust-protobuf-native) from 1.0.5+3.19.3 to 1.1.0+21.5.
- [Release notes](https://github.com/MaterializeInc/rust-protobuf-native/releases)
- [Changelog](https://github.com/MaterializeInc/rust-protobuf-native/blob/master/release.toml)
- [Commits](https://github.com/MaterializeInc/rust-protobuf-native/compare/protobuf-src-v1.0.5+3.19.3...protobuf-src-v1.1.0)

---
updated-dependencies:
- dependency-name: protobuf-src
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-04-20 14:18:19 -07:00
dependabot[bot] 1cdddfae6c
Bump const_format from 0.2.26 to 0.2.30 (#31286)
Bumps [const_format](https://github.com/rodrimati1992/const_format_crates) from 0.2.26 to 0.2.30.
- [Release notes](https://github.com/rodrimati1992/const_format_crates/releases)
- [Changelog](https://github.com/rodrimati1992/const_format_crates/blob/master/Changelog.md)
- [Commits](https://github.com/rodrimati1992/const_format_crates/commits)

---
updated-dependencies:
- dependency-name: const_format
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-04-20 13:24:16 -07:00
dependabot[bot] e40ff3bd5d
Bump caps from 0.5.4 to 0.5.5 (#31288)
* Bump caps from 0.5.4 to 0.5.5

Bumps [caps](https://github.com/lucab/caps-rs) from 0.5.4 to 0.5.5.
- [Release notes](https://github.com/lucab/caps-rs/releases)
- [Commits](https://github.com/lucab/caps-rs/compare/v0.5.4...v0.5.5)

---
updated-dependencies:
- dependency-name: caps
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-20 20:22:37 +00:00
Illia Bobyr a21e68a351
Upgrade Rust to 1.68.2 (#31276) 2023-04-20 11:31:54 -07:00
sakridge f2befbb78e
Add note on how cargo build-bpf works (#30938) 2023-04-20 20:30:11 +02:00
Brooks 04bbf3bccb
bootstrap: Sunset using LegacySnapshotHashes for snapshot discovery (#31275) 2023-04-20 10:33:04 -04:00
Pankaj Garg e1de4c0429
Suppress warning for unused_mut in rbpf-cli (#31281) 2023-04-20 13:06:31 +00:00
Pankaj Garg 9629ef3095
Fix finding ancestor during program cache pruning (#31118) 2023-04-20 04:45:05 -07:00
Andrew Fitzgerald 7a393e479d
Scheduler Messages (#30976) 2023-04-19 15:14:47 -07:00
Ashwin Sekar 37ab00d361
Link issue for vote state latency feature gate (#31266) 2023-04-19 15:44:56 -06:00
Brooks b4ea10413f
bootstrap: Refactor retaining the highest snapshot hashes (#31254) 2023-04-19 16:00:00 -04:00
Andrew Fitzgerald 10d637d2e6
PohRecorder take Arc not &Arc for blockstore (#31234) 2023-04-19 11:41:18 -07:00
Tyera c37b82e01d
Bump h2 to 0.3.18 (#31265)
Changes: https://github.com/hyperium/h2/compare/v0.3.17...v0.3.18
2023-04-19 11:39:19 -07:00
Jeff Washington (jwash) 318f981274
add `is_recyclable` to `AccountsFile` (#31257) 2023-04-19 11:36:44 -07:00
Jeff Washington (jwash) 9124d1f35d
rework assert_no_shrink_in_progress to get assert stack easily (#31251) 2023-04-19 11:36:24 -07:00
Jeff Washington (jwash) 812d899c7f
add lifetimes to refs in ReadableAccount (#31258) 2023-04-19 11:35:59 -07:00
steviez 377ba53a31
Fix bug where ReplayStage holds an Arc<Bank> for process lifetime (#31267)
* Fix bug where ReplayStage holds an Arc<Bank> for process lifetime

When ReplayStage::new() kicks off, it needs to do some setup with the
working bank prior to entering the main processing loop. This setup is
done before entering the main processing loop; however, a bug made it
such that an Arc<Bank> remained in scope after the processing loop had
been entered. The processing loop is only exited when the process exits,
so this means that Bank was being held for the lifetime of the process.
This is a waste of resources and prevents background cleanup.

* clippy
2023-04-19 18:12:34 +00:00
Xiang Zhu a5275f8839
Remove bank_snapshots_dir param (#31249)
* Remove bank_snapshots_dir param

* Remove outdated comment

* Revert "Remove outdated comment"

This reverts commit e4441432bec57edb0dc22c4bacf4d48ce26ed818.

* Handle parent() error

* Fix format error
2023-04-19 09:37:46 -07:00
Andrew Fitzgerald 748220c9d3
Forwarder: Add common setup for tests (#31232) 2023-04-19 09:08:13 -07:00
Brooks ca1bde3591
Use Arc instead of &Arc in AccountsBackgroundService::new (#31268) 2023-04-19 11:10:41 -04:00