Commit Graph

22395 Commits

Author SHA1 Message Date
Brennan 685ebcb3b0
Rework bank to allow RentCollectionCycleParams private (#31361) 2023-04-26 14:48:51 -07:00
dependabot[bot] 6b1980285b
Bump signal-hook from 0.3.14 to 0.3.15 (#31322)
* Bump signal-hook from 0.3.14 to 0.3.15

Bumps [signal-hook](https://github.com/vorner/signal-hook) from 0.3.14 to 0.3.15.
- [Release notes](https://github.com/vorner/signal-hook/releases)
- [Changelog](https://github.com/vorner/signal-hook/blob/master/CHANGELOG.md)
- [Commits](https://github.com/vorner/signal-hook/compare/v0.3.14...v0.3.15)

---
updated-dependencies:
- dependency-name: signal-hook
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-26 14:24:56 -06:00
dependabot[bot] b6e2c83177
Bump serde_json from 1.0.83 to 1.0.96 (#31356)
* Bump serde_json from 1.0.83 to 1.0.96

Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.83 to 1.0.96.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.83...v1.0.96)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-26 13:37:28 -06:00
Brennan a540690778
Move partition logic out of bank (#31343)
* Move partition logic out of bank
2023-04-26 12:37:02 -07:00
Xiang Zhu f3e94ca73c
AHV processes the snapshot dirs in place (#30978)
* AHV processes the snapshot dirs in place

Let account pacakge use the snapshot dir, so AHV computes the accounts hash and turns the pre snapshot dir into a post snapshot dir

* fix status cache path to maintain the archive layout for the in-place snapshot dir archiving

* fix test_package_snapshots

* Fix test_concurrent_snapshot_packaging

* Remove debug change.

* Fix snapshot_links path

* change to borrow for bank_snapshots_dir

* Reverted changes in create_and_verify_snapshot

* Fix param errors

* Fix rebase errors

* Remove NOTE 1

* Remove unwrap

* Remove the variables to make it apparent taht snapshot_links is the bank_snapshots_dir

* Use soft link instead of hard link for snapshot and status cache

* After switching to soft symlinking, the src path should be absolute
2023-04-26 11:48:48 -07:00
Jeff Washington (jwash) 6f7429556b
avoid incorrect internal assert in purge_slot_cache_pubkeys (#31344) 2023-04-26 09:09:38 -07:00
Brooks c73b6545e6
Spins up AccountsHashVerifier in ledger-tool (#31358) 2023-04-26 12:07:35 -04:00
Andrew Fitzgerald 2d91c52373
derive Debug for multi_iterator_scanner::ProcessingDecision (#31312) 2023-04-26 08:53:31 -07:00
Brooks 18aa54a4b6
Removes bank_snapshots_dir param from bank_fields_from_snapshot_archives() (#31349) 2023-04-26 11:45:00 -04:00
Dmitri Makarov c658d4e737
Overload with_mock_invoke_context with custom BuiltinPrograms option (#31347) 2023-04-26 07:45:33 -07:00
Alexander Meißner c05d1d5c51
Refactor - Moves bpf_loader registration into the runtime (#31345)
* Moves the registration of bpf_loader built-ins from the ledger into the runtime.

* Removes bpf_loader built-ins registration in tests and benchmarks.

* Removes declare_builtin!() of bpf_loader built-ins.

* Removes built-ins from the SDK.

* Adjusts tests.
2023-04-26 14:44:19 +02:00
Yihau Chen 2dcdfff5f4
ci: stop windows building on master temporarily (#31353) 2023-04-26 01:29:28 +00:00
Yihau Chen e79e13899d
ci: use crates api to get owner list (#31348)
use crete api to get owner lists
2023-04-26 08:36:50 +08:00
Yihau Chen 466c3c36d8
ci: don't run test for openbook-dex temporarily (#31350)
ci: don't run openbook-dex temporarily
2023-04-26 06:58:21 +08:00
Brooks 32fb15655e
Upgrades fs_extra to v1.3.0 (#31341) 2023-04-25 18:29:19 -04:00
Alexander Meißner 7002c568fb
Cleanup - Removes the CLI option "no-bpf-jit" (#31329)
* Enables JIT everywhere by default.

* Removes the CLI argument "no-bpf-jit" and its plumbering through out the validator code base.

* Removes with_jit bpf_loader variants.

* Removes the to_builtin!() macro.
2023-04-25 19:04:11 +02:00
steviez 758bc1ca75
Make ReplayStage panic before dumping repeated-repair-attempt slots (#31333)
When ReplayStage repeatedly fails to compute the correct for a block
after purging and repairing, it panics on the assumption that something
is very wrong and will require human intervention.

If this is the case, there is typically something to be debugged, and
having the slot available locally is valuable. This change does the
retry check that will panic before purging the failure slot.
2023-04-25 11:50:47 -05:00
Yihau Chen c9ca6e3461
ci: update buildkite's hook (#31298)
* remove unnecessary files

* unify the hooks's header

* don't use set -e in post-checkout

* shellcheck.sh include .buildkite/hooks

* xxx: make ci unhappy

* Revert "xxx: make ci unhappy"

This reverts commit a0fdfb40db8aa226a2669e474a06fb0f45f8c5c4.
2023-04-25 15:49:58 +00:00
Brooks cd2b2d4a14
Upgrades Rust to 1.69.0 (#31336) 2023-04-25 10:22:38 -04:00
Yihau Chen 186b0d77f0
ci: use stable wasm-pack version in docker (#31338)
* ci: use latest wasm-pack version in docker

* print wasm-pack version in test-check.sh
2023-04-25 22:08:01 +08:00
Illia Bobyr cc6c454076
Bump syn from 1.0.109 to 2.0.5 (#31263)
Update users based on the new syn ABI.

Short API update summary can be found here:

  https://github.com/dtolnay/syn/releases/tag/2.0.0
2023-04-24 22:18:51 -07:00
Ryo Onodera 37576c8949
ci: show sccache version and prefix (#31317)
* ci: Show sccache version as well

* hmm, where's sccache?? (and prefix bonus)

* Use $PATH's sccache for consistency
2023-04-25 13:11:58 +09:00
Yihau Chen f6591158ab
ci: use the sccache which installed in the docker image (#31332) 2023-04-25 11:44:43 +08:00
Xiang Zhu 16f3dcd5d2
Update fn create_and_verify_snapshot (#31245)
* only 1 snapshot per archive in create_and_verify_snapshot

* Update create_and_verify_snapshot with the newer funtion calls

* Fix test_package_snapshots

* Remove account path access change

* Rename slot to num_snapshots

* Remove unncessary purge_old_bank_snapshots in test

* Update non-deterministic format comment

* Cleanup unnecessary hash calls

* Use get_accounts_hash

* Remove extra declaration

* Remove rehash

* Remove clean_accounts

* Revert "Cleanup unnecessary hash calls"

This reverts commit 06b1457462cf6d7acf62e0e5531633caf5d9fc58.

Removing unncessary hash calls should be done for create_and_verify_snapshot,
not bank_to_full_snapshot_archive

* Fix typo appenedvecs

* Remove bank_snapshots_dir after rebasing
2023-04-24 18:52:50 -07:00
Ryo Onodera 6f9a15c36b
ci: suggest to use hidden_unless_forced() (#31321)
* ci: suggest to use hidden_unless_forced()

* shellcheck...
2023-04-25 09:43:42 +09:00
DimAn bd782634dc
Add ability to manage public TPU Forwards address (#31201)
A node operator can manage a public TPU address (at node startup and while it's running), but doesn't have the ability to manage the TPU Forwards address as well.

This PR adds that functionality.

Added the start argument --public-tpu-forwards-address
Reworked the set-public-tpu-address subcommand into the set-public-address subcommand
2023-04-24 23:04:36 +00:00
Alexander Meißner 4b0e16d06f
Refactor - `BuiltinPrograms` (#31324)
* Moves BuiltinProgram of the program runtime into its own file.

* Unifies the runtimes Builtin and program runtimes BuiltinProgram definitions.

* Moves BuiltinPrograms from bank.rs into the program runtime.
2023-04-24 19:01:40 +02:00
behzad nouri 1b08d01a80
removes shred_version from LegacyContactInfo public interface (#31304)
Working towards LegacyContactInfo => ContactInfo migration, the commit
adds more api parity between the two.
2023-04-24 15:19:33 +00:00
x19 c3eb17f2a3
sort vetted bootstrap rpcs based on ping times (#31285)
* sort and filter rpc nodes based on ping times
2023-04-24 08:11:11 -07:00
Jeff Washington (jwash) 05391b5244
packed ancient: report random stat (#31274) 2023-04-24 07:40:45 -07:00
Jeff Washington (jwash) 8b30aa187b
ancient packing: leave same append vecs alone (#31295) 2023-04-24 07:40:05 -07:00
Ryo Onodera cece64daad
ci: prefer clippy::default_trait_access over shell (#31318)
Prefer clippy::default_trait_access over shell
2023-04-24 14:04:11 +09:00
Yihau Chen ee10a48739
ci: soft fail trigger_secondary_step (#31296)
ci: soft failed trigger_secondary_step
2023-04-24 12:43:59 +08:00
behzad nouri 33bde55bbd
adds tpu_quic field to RpcContactInfo (#31310) 2023-04-22 20:18:58 +00:00
behzad nouri a88024e295
removes wallclock from LegacyContactInfo public interface (#31303) 2023-04-22 20:18:39 +00:00
Pankaj Garg a35e31f269
Do not evict tombstones (#31311) 2023-04-21 16:36:22 -07:00
dependabot[bot] d7ad0ce093
Bump libc from 0.2.140 to 0.2.142 (#31308)
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.140 to 0.2.142.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](rust-lang/libc@0.2.140...0.2.142)

---
updated-dependencies:
- dependency-name: libc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-04-21 15:51:32 -07:00
dependabot[bot] 74e02ad14e
Bump num_cpus from 1.13.1 to 1.15.0 (#31309)
Bumps [num_cpus](https://github.com/seanmonstar/num_cpus) from 1.13.1 to 1.15.0.
- [Release notes](https://github.com/seanmonstar/num_cpus/releases)
- [Changelog](https://github.com/seanmonstar/num_cpus/blob/master/CHANGELOG.md)
- [Commits](seanmonstar/num_cpus@v1.13.1...v1.15.0)

---
updated-dependencies:
- dependency-name: num_cpus
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-04-21 12:02:41 -07:00
Jeff Biseda 3cdd59e55f
check for prior discard in shred_fetch_stage (#31293) 2023-04-21 11:43:10 -07:00
dependabot[bot] 39b548153a
Bump socket2 from 0.4.7 to 0.4.9 (#31302)
* Bump socket2 from 0.4.7 to 0.4.9

Bumps [socket2](https://github.com/rust-lang/socket2) from 0.4.7 to 0.4.9.
- [Release notes](https://github.com/rust-lang/socket2/releases)
- [Changelog](https://github.com/rust-lang/socket2/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/socket2/commits/v0.4.9)

---
updated-dependencies:
- dependency-name: socket2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-21 12:01:43 -06:00
dependabot[bot] 4975a1a4c8
Bump either from 1.8.0 to 1.8.1 (#31299)
* Bump either from 1.8.0 to 1.8.1

Bumps [either](https://github.com/bluss/either) from 1.8.0 to 1.8.1.
- [Release notes](https://github.com/bluss/either/releases)
- [Commits](https://github.com/bluss/either/compare/1.8.0...1.8.1)

---
updated-dependencies:
- dependency-name: either
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-21 11:48:22 -06:00
dependabot[bot] fb3684ff86
Bump serde_with from 2.2.0 to 2.3.2 (#31300)
* Bump serde_with from 2.2.0 to 2.3.2

Bumps [serde_with](https://github.com/jonasbb/serde_with) from 2.2.0 to 2.3.2.
- [Release notes](https://github.com/jonasbb/serde_with/releases)
- [Commits](https://github.com/jonasbb/serde_with/compare/v2.2.0...v2.3.2)

---
updated-dependencies:
- dependency-name: serde_with
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-04-21 11:46:15 -06:00
Alexander Meißner e5490b8d09
Refactor - Use builtin function interface from rbpf (#31221)
* Removes test_program_entry_debug().

* Uses declare_process_instruction!() in all tests and benchmarks.

* Replaces with ProcessInstructionWithContext with solana_rbpf::BuiltInFunction.
2023-04-21 18:08:32 +02:00
behzad nouri cb65a785bc
makes sockets in LegacyContactInfo private (#31248)
Working towards LegacyContactInfo => ContactInfo migration, the commit
hides some implementation details of LegacyContactInfo and expands API
parity with the new ContactInfo.
2023-04-21 15:39:16 +00:00
Xiang Zhu b2e1d736f9
Purge snapshot dirs before loading from an archive (#31283)
* Purge snapshot dirs before loading from an archive

* Refine comment

* Should not remove the bank_snapshots_dir directory
2023-04-21 05:57:49 -07:00
Yihau Chen def2af1653
ci: fix test result doesn't upload (#31297) 2023-04-21 16:31:35 +08:00
Yihau Chen 17eab32ad0
ci: run stable tests partially (#31151)
* ci: run stable tests partially

* ci: improve uploading test result

* use buildkite's retry

* test common

* fix indent issue

* extract assert eq

* use diff to print test error

* pretty format

* test build stable steps

* add test all function

* lint

* lint

* keep dollar sign

* switch got and want's diff direction

* use 'EOF' to make code more readable

* rename EMPTY_LINE to DELETE_THIS_LINE

* rename N => INDEX

* rename M => LIMIT

* check variable in a more elegant way

* wording

* more explain for code
2023-04-21 14:51:17 +08:00
Tao Zhu b4331ae955
use checked arithmetic (#31259)
* use checked arithmetic
* add feature gate; updated tests
* allow collapsible-else-if

Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
Co-authored-by: mvines <mvines@gmail.com>
2023-04-20 22:56:08 -05:00
Illia Bobyr 94350f0959
Revert: Bump console from 0.15.0 to 0.15.5 (#31289) (#31294)
commit 4e3300e7d6
    Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    Date:   Thu Apr 20 15:40:14 2023 -0700
  
        Bump console from 0.15.0 to 0.15.5 (#31289)
  
        Bumps [console](https://github.com/console-rs/console) from 0.15.0 to 0.15.5.
        - [Release notes](https://github.com/console-rs/console/releases)
        - [Changelog](https://github.com/console-rs/console/blob/master/CHANGELOG.md)
        - [Commits](console-rs/console@0.15.0...0.15.5)
  
        ---
        updated-dependencies:
        - dependency-name: console
          dependency-type: direct:production
          update-type: version-update:semver-patch
        ...
  
        Signed-off-by: dependabot[bot] <support@github.com>

Windows build is broken with the following error:

    Compiling solana-genesis-utils v1.16.0 (D:\a\solana\solana\genesis-utils)
    error[E0432]: unresolved import `winapi::um::winuser`
       --> install\src\command.rs:385:17
        |
    385 |             um::winuser::{
        |                 ^^^^^^^ could not find `winuser` in `um`
  
    For more information about this error, try `rustc --explain E0432`.

https://github.com/solana-labs/solana/actions/runs/4759519915/jobs/8458877323
2023-04-20 19:37:36 -07:00
Tyera 03c1744e1d
Register SendTransactionService exit (#31261)
* Pass exit into SendTransactionService

* Abort SendTransactionService with BanksService

* Register SendTransactionService exit as part of RpcService validator Exit

* Improve test, ensure receiver has been dropped
2023-04-20 18:23:14 -06:00