Commit Graph

24985 Commits

Author SHA1 Message Date
steviez d0cb5e273a Name previously unnamed thread pool threads (#104)
Several rayon and tokio threadpools did not have names; give them names
to make tracking them in debug tools easier
2024-03-09 13:26:34 -06:00
Brennan 54b44a382f fix typo (#57) 2024-03-09 13:26:34 -06:00
steviez f944227dba Use tokio directly instead of jsonrpc_server_utils's re-export (#116) 2024-03-09 13:24:55 -06:00
Tao Zhu c9549399fb assert simple vote tx const cost (#100)
* assert simple vote tx const cost
2024-03-09 13:23:06 -06:00
Jon C 1f7e6f269b frozen-abi: Remove proc_macro_hygiene featurization (#109) 2024-03-09 13:23:06 -06:00
Tyera e6a71366fa Cli: improve vote-account vote-authority display (#95)
* Simplify vote-authority display

* Add handling for new vote authority

* Add proper None handling, because unit test (shouldn't happen IRL, though)

* Unwrap->expect
2024-03-09 13:23:06 -06:00
steviez f3c6c08752 Give SigVerify and ShredFetch threads unique names (#98)
- solTvuFetchPmod ==> solTvuPktMod + solTvuRepPktMod
- solSigVerifier ==> solSigVerTpu + solSigVerTpuVot
2024-03-09 13:23:06 -06:00
steviez 4753dcae71 Rename and uniquify QUIC thread names (#28)
When viewing in various tools such as gdb and perf, it is not easy to
distinguish which threads are serving which function (TPU or TPU FWD)
2024-03-09 13:23:06 -06:00
Brooks f6cd7c278e Increases account hash's stack buffer to hold 200 bytes of data (#56) 2024-03-09 13:23:06 -06:00
steviez e81ecfbe9f
Revert "remove repetitive words (#35434)" (#35436)
This reverts commit 556a749948.
2024-03-08 23:36:52 -06:00
gcmutator 556a749948
remove repetitive words (#35434)
Signed-off-by: gcmutator <329964069@qq.com>
2024-03-08 23:01:33 -06:00
Yihau Chen cb4ddfb5c1
ci: disable dependabot (#35430) 2024-03-07 12:18:39 +08:00
Will Hickey 9b1243ee4c Revert "[anza migration] replace binaries backend (#6)"
This reverts commit 9355518424.
2024-03-05 10:19:55 -06:00
Will Hickey 6e01a074df Revert "[anza migration] ci (#5)"
This reverts commit b0022d73ea.
2024-03-05 10:19:45 -06:00
Will Hickey 4cb7c315b8 Revert "[anza migration] ci: fix path (#8)"
This reverts commit 58e9a19f11.
2024-03-05 10:19:20 -06:00
Will Hickey e72f6ba503 Revert "[anza migration] ci: removed unused s3 upload in Windows build (#9)"
This reverts commit 91e3dd2250.
2024-03-05 10:19:12 -06:00
Will Hickey df57657985 Revert "[anza migration] rename crates (#10)"
This reverts commit 3f9a7a52ea.
2024-03-05 10:18:50 -06:00
Jon C 0eb0e7cfcc windows: Use vcpkg for openssl dep (#73) 2024-03-05 09:43:25 -06:00
Tyera 5efc4eb7ab Rpc: deprecate `getStakeActivation` and make inactive_stake consistent (#69)
* Make inactive_stake consistent

* Add rpc_deprecated_v1_18 module

* Move get_stake_activation to deprecated list

* Fix typo
2024-03-05 09:43:25 -06:00
Ashwin Sekar 94ed7a31e9 blockstore_purge: fix inspect -> inspect_err (#66) 2024-03-05 09:43:25 -06:00
Brooks f94752d514 Adds StartingSnapshotStorages to AccountsHashVerifier (#58) 2024-03-05 09:43:25 -06:00
Brennan b63a9af2eb update mio to 0.8.11 (#60) 2024-03-05 09:43:25 -06:00
Brooks 932bcd902a Adds a bench for hash_account() (#47) 2024-03-05 09:43:25 -06:00
Yihau Chen 14cb9cff92 [anza migration] rename crates (#10)
* rename geyser-plugin-interface

* rename cargo registry

* rename watchtower

* rename ledger tool

* rename validator

* rename install

* rename geyser plugin interface when patch
2024-03-05 09:43:25 -06:00
Yihau Chen ff1d892277 [anza migration] ci: removed unused s3 upload in Windows build (#9)
ci: removed unused s3 upload in Windows build
2024-03-05 09:43:25 -06:00
Yihau Chen d2a4f0f5e6 [anza migration] ci: fix path (#8)
* ci: fix windows build

* ci: publish sdk docker image with the new name

* update automerge status
2024-03-05 09:43:25 -06:00
Yihau Chen f01ec82284 [anza migration] ci (#5)
* Update README.md

* ci: update CodeCov report link

* ci: update github pr link

* ci: rename secondary pipeline

* replace org name in .mergify

* update channel info link

* update dependabot pr link

* use anza docker image

* delete travis

---------

Co-authored-by: Will Hickey <will.hickey@solana.com>
2024-03-05 09:43:25 -06:00
Yihau Chen b84d81b7a5 [anza migration] replace binaries backend (#6)
* ci: add upload-gcs-artifact

* ci: publish release binaries to GCS

* ci: redirect github repo to anza-xyz

* ci: publish windows binaries to GCS

* replace release.solana.com with release.anza.xyz

* use a explicit name for credential
2024-03-05 09:43:25 -06:00
Will Hickey 4b25ab207c
Add github action to close new pull requests (#35400)
Add github action to close new pull requests with a comment directing them to agave
2024-03-04 11:17:29 -06:00
Will Hickey a780ffb941
Update SECURITY.md to direct people to agave (#35399) 2024-03-02 23:19:37 -06:00
Will Hickey 3b940a4746
Add GHA to close new issues with a comment (#35151)
* Add GHA to close new issues with a comment

* Remove trailing whitespace
2024-03-02 22:58:37 -06:00
Ashwin Sekar cc4072bce8
blockstore: atomize slot clearing, relax parent slot meta check (#35124)
* blockstore: atomize slot clearing, relax parent slot meta check

clear_unconfirmed_slot can leave blockstore in an irrecoverable state
if it panics in the middle. write batch this function, so that any
errors can be recovered after restart.

additionally relax the constraint that the parent slot meta must exist,
as it could have been cleaned up if outdated.

* pr feedback: use PurgeType, don't pass slot_meta

* pr feedback: add unit test

* pr feedback: refactor into separate function

* pr feedback: add special columns to helper, err msg, comments

* pr feedback: reword comments and write batch error message

* pr feedback: bubble write_batch error to caller

* pr feedback: reword comments

Co-authored-by: steviez <stevecz@umich.edu>

---------

Co-authored-by: steviez <stevecz@umich.edu>
2024-03-02 23:23:55 -05:00
Alexander Meißner ccc6a6bf6f
Fix - `test_feature_activation_loaded_programs_recompilation_phase()` (#35299)
* Fixes test_feature_activation_loaded_programs_recompilation_phase() to trigger the recompilation phase before the epoch boundary.

* Adds a direct check of the cached entries around recompilation.
2024-03-02 06:55:53 -08:00
Lucas Steuernagel bd93285025
Proposal: Use SanitizedMessage when possible in `svm/account_loader.rs` (#35390) 2024-03-02 06:12:24 -03:00
dependabot[bot] f31ec1f2d6
build(deps): bump indexmap from 2.2.3 to 2.2.5 (#35389)
* build(deps): bump indexmap from 2.2.3 to 2.2.5

Bumps [indexmap](https://github.com/indexmap-rs/indexmap) from 2.2.3 to 2.2.5.
- [Changelog](https://github.com/indexmap-rs/indexmap/blob/master/RELEASES.md)
- [Commits](https://github.com/indexmap-rs/indexmap/compare/2.2.3...2.2.5)

---
updated-dependencies:
- dependency-name: indexmap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-03-02 13:27:37 +08:00
dependabot[bot] 9f60168a56
build(deps): bump rayon from 1.8.1 to 1.9.0 (#35348)
* build(deps): bump rayon from 1.8.1 to 1.9.0

Bumps [rayon](https://github.com/rayon-rs/rayon) from 1.8.1 to 1.9.0.
- [Changelog](https://github.com/rayon-rs/rayon/blob/main/RELEASES.md)
- [Commits](https://github.com/rayon-rs/rayon/compare/rayon-core-v1.8.1...rayon-core-v1.9.0)

---
updated-dependencies:
- dependency-name: rayon
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-03-02 13:27:27 +08:00
Wen bfe44d95f4
Wen restart aggregate last voted fork slots (#33892)
* Push and aggregate RestartLastVotedForkSlots.

* Fix API and lint errors.

* Reduce clutter.

* Put my own LastVotedForkSlots into the aggregate.

* Write LastVotedForkSlots aggregate progress into local file.

* Fix typo and name constants.

* Fix flaky test.

* Clarify the comments.

* - Use constant for wait_for_supermajority
- Avoid waiting after first shred when repair is in wen_restart

* Fix delay_after_first_shred and remove loop in wen_restart.

* Read wen_restart slots inside the loop instead.

* Discard turbine shreds while in wen_restart in windows insert rather than
shred_fetch_stage.

* Use the new Gossip API.

* Rename slots_to_repair_for_wen_restart and a few others.

* Rename a few more and list all states.

* Pipe exit down to aggregate loop so we can exit early.

* Fix import of RestartLastVotedForkSlots.

* Use the new method to generate test bank.

* Make linter happy.

* Use new bank constructor for tests.

* Fix a bad merge.

* - add new const for wen_restart
- fix the test to cover more cases
- add generate_repairs_for_slot_not_throtted_by_tick and
  generate_repairs_for_slot_throtted_by_tick to make it readable

* Add initialize and put the main logic into a loop.

* Change aggregate interface and other fixes.

* Add failure tests and tests for state transition.

* Add more tests and add ability to recover from written records in
last_voted_fork_slots_aggregate.

* Various name changes.

* We don't really care what type of error is returned.

* Wait on expected progress message in proto file instead of sleep.

* Code reorganization and cleanup.

* Make linter happy.

* Add WenRestartError.

* Split WenRestartErrors into separate erros per state.

* Revert "Split WenRestartErrors into separate erros per state."

This reverts commit 4c920cb8f8d492707560441912351cca779129f6.

* Use individual functions when testing for failures.

* Move initialization errors into initialize().

* Use anyhow instead of thiserror to generate backtrace for error.

* Add missing Cargo.lock.

* Add error log when last_vote is missing in the tower storage.

* Change error log info.

* Change test to match exact error.
2024-03-01 18:52:47 -08:00
Yueh-Hsuan Chiang 608329b974
[TieredStorage] rent_epoch() returns 0 for zero-lamport accounts (#35344)
#### Problem
In TieredAccountMeta, RENT_EXEMPT_RENT_EPOCH will be used when
its optional field rent_epoch is None.  However, for legacy reasons, 0
should be used for zero-lamport accounts.

#### Summary of Changes
Return 0 for TieredAccountMeta::rent_epoch() for zero-lamport accounts.

#### Test Plan
accounts_db::tests::test_clean_zero_lamport_and_dead_slot
2024-03-01 15:18:12 -08:00
Pankaj Garg cb260f10d1
Remove unnecessary unwrap from `simulate_transaction_unchecked()` (#35375)
Remove unnecessary unwrap from simulate_transaction_unchecked()
2024-03-01 13:37:51 -08:00
Greg Cusack 5f6d66e87b
Deprecate `ThinClient` and remove `ThinClient` from `bench-tps` (#35365)
* deprecate ThinClient

* switch localcluster bench test to use tpuclient

add back in command line args for thinclient. add thin-client deprecation README

refactor TpuClient connection

* remove thin-client from net/

* change 2.0.0 to 1.19.0
2024-03-01 12:14:52 -08:00
steviez 7d6f1d5911
Give streamer::receiver() threads unique names (#35369)
The name was previously hard-coded to solReceiver. The use of the same
name makes it hard to figure out which thread is which when these
threads are handling many services (Gossip, Tvu, etc).
2024-03-01 13:36:08 -06:00
Brooks 564a9f78a0
Casts executable bool to integer when computing account hash (#35373) 2024-03-01 14:28:28 -05:00
Brooks 59ed049dc5
Gives back 8 bytes to stack buffer for account data when hashing (#35374) 2024-03-01 14:27:48 -05:00
Brooks 3ec020f742
Removes cap_accounts_data_size_per_block feature (#35381) 2024-03-01 14:22:25 -05:00
Brooks 672943224e
Removes cap_accounts_data_len feature (#35378) 2024-03-01 14:22:19 -05:00
Andrew Fitzgerald ede9163633
Comments clarifying non-emptiness of threadset (#35388) 2024-03-01 11:18:42 -08:00
Lucas Steuernagel 532b806bef
Add more unit tests to SVM (#35383) 2024-03-01 16:04:08 -03:00
steviez 7c878973e2
Cleanup ReplayStage loop timing struct (#35361)
- Track loop_count in the struct
- Rename ReplayTiming ==> ReplayLoopTiming
- Make all metrics consistent to end with "_elapsed_us"
2024-03-01 12:30:50 -06:00
Pankaj Garg 7399178c78
Set slot and env in tx batch specific cache (#35377) 2024-03-01 08:20:17 -08:00
Tyera a7f9fe103f
Split runtime utilities out of stake_state.rs (#35386)
* Add points module

* Add rewards module

* Hide rewards doc

* Fixup ledger-tool imports
2024-03-01 09:08:55 -07:00