Commit Graph

24678 Commits

Author SHA1 Message Date
Ryo Onodera bd103865df
Introduce primitive threading in unified scheduler (#34676)
* Introduce primitive threading in unified scheduler

* Make the internal struct ExecutedTask not pub

* Improve wording a bit

* Explain scheduler main loop's overhead sensitivity

* Improve wording a bit

* Define ChainedChannel{Sender, Receiver} wrappers

* Clean up a bit

* Use derivative to avoid manual Clone impl

* Clarify comment

* Remove extra whitespace in comment

* Remove unneeded dyn trait for ChainedChannel

* Remove the accumulator thread for now

* Fix typo

* Use unimplemented!() to convey intention better
2024-01-24 12:46:16 +09:00
Brooks bfbe03a536
Updates mergify backport actions for new minor version (#34921) 2024-01-23 22:29:21 -05:00
Yueh-Hsuan Chiang 1810feadc2
[TieredStorage] In-memory struct for writing OwnersBlock (#34853)
#### Problem
To write the owners-block, it requires an in-memory struct that maintains
a set of unique owner addresses while providing a look-up function to
obtain the OwnerOffset with the specified owner address. 

#### Summary of Changes
This PR adds OwnersTable, the in-memory struct that maintains
a set of unique owner addresses while providing a look-up function to
obtain the OwnerOffset with the specified owner address.

#### Test Plan
A new unit-test is added.
2024-01-23 14:57:53 -08:00
Brooks 3303c2566c
Removes fs-err dependency (#34911) 2024-01-23 17:25:03 -05:00
Tyera 7ebe0bccd6
Fix epoch rewards partition-data program owner (#34913)
Fix account program owner
2024-01-23 15:19:21 -07:00
Will Hickey ad0aabcd1c
Update changelog in preparation for creating new v1.18 branch (#34912) 2024-01-23 15:28:57 -06:00
Brooks e74f04ad0d
Replaces fs-err in snapshot_utils.rs (#34908) 2024-01-23 14:48:30 -05:00
Brooks b150de6d10
Replaces fs-err in clean_orphaned_account_snapshot_dirs() (#34902)
* Replaces fs-err in clean_orphaned_account_snapshot_dirs()

* pr: revert info message format changes
2024-01-23 19:46:02 +00:00
Brooks c30db7ad92
Replaces fs-err in snapshot_version_from_file() (#34904) 2024-01-23 14:35:10 -05:00
Tao Zhu 73d3973c7c
Remove congestion multiplier from calculate fee (#34865)
* remove println from a test

* sync fee_structure with fee_rate_governor;
remove congestion_multiplier from calculacte_fee(), leave parameters unused for now.
2024-01-23 12:59:50 -06:00
Brooks 22fc49c444
Replaces fs-err in rebuild_storages_from_snapshot_dir() (#34907) 2024-01-23 13:26:23 -05:00
Brooks 94f35da8e2
Replaces fs-err in purge_bank_snapshot() (#34906) 2024-01-23 17:50:39 +00:00
Brooks a21cfbd13f
Replaces fs-err in untar_snapshot_create_shared_buffer() (#34905) 2024-01-23 12:46:31 -05:00
Brooks 4bd8eedc06
Replaces fs-err in move_and_async_delete_path() (#34903) 2024-01-23 12:42:44 -05:00
Andrew Fitzgerald bb829c0bcf
remove unused functions (#34895) 2024-01-23 09:32:35 -08:00
Brooks 8ff511e8fa
Moves create_and_canonicalize_directories() into accounts-db utils (#34882) 2024-01-23 06:46:27 -05:00
dependabot[bot] 9263cc6c82
build(deps): bump proc-macro2 from 1.0.76 to 1.0.78 (#34873)
* build(deps): bump proc-macro2 from 1.0.76 to 1.0.78

Bumps [proc-macro2](https://github.com/dtolnay/proc-macro2) from 1.0.76 to 1.0.78.
- [Release notes](https://github.com/dtolnay/proc-macro2/releases)
- [Commits](https://github.com/dtolnay/proc-macro2/compare/1.0.76...1.0.78)

---
updated-dependencies:
- dependency-name: proc-macro2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-01-23 16:30:28 +08:00
dependabot[bot] b3ac7c7ae5
build(deps): bump smallvec from 1.12.0 to 1.13.1 (#34872)
* build(deps): bump smallvec from 1.12.0 to 1.13.1

Bumps [smallvec](https://github.com/servo/rust-smallvec) from 1.12.0 to 1.13.1.
- [Release notes](https://github.com/servo/rust-smallvec/releases)
- [Commits](https://github.com/servo/rust-smallvec/compare/v1.12.0...v1.13.1)

---
updated-dependencies:
- dependency-name: smallvec
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-01-23 16:26:57 +08:00
dependabot[bot] ac1f8ca5d6
build(deps): bump regex from 1.10.2 to 1.10.3 (#34871)
* build(deps): bump regex from 1.10.2 to 1.10.3

Bumps [regex](https://github.com/rust-lang/regex) from 1.10.2 to 1.10.3.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.10.2...1.10.3)

---
updated-dependencies:
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-01-23 16:26:11 +08:00
dependabot[bot] 00b037fc25
build(deps): bump openssl from 0.10.62 to 0.10.63 (#34874)
* build(deps): bump openssl from 0.10.62 to 0.10.63

Bumps [openssl](https://github.com/sfackler/rust-openssl) from 0.10.62 to 0.10.63.
- [Release notes](https://github.com/sfackler/rust-openssl/releases)
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.62...openssl-v0.10.63)

---
updated-dependencies:
- dependency-name: openssl
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-01-23 16:25:16 +08:00
Tyera 8aa726bfdf
Define epoch-rewards partition data program id (#34862)
* Create new program id for epoch-rewards partition data PDAs

* Remove misleading repr attribute

* Remove storage of HasherKind

* Split up seeds
2024-01-22 19:14:29 -07:00
steviez 9122193e17
blockstore: Make is_orphan() a method of SlotMeta (#34889)
The old function's only input is a SlotMeta, so makes sense to move
it a member function of SlotMeta
2024-01-22 19:14:51 -06:00
Brooks 098076f5ca
Uses accounts run and snapshot dir constants (#34879) 2024-01-22 19:47:58 -05:00
Joe C 9caf9e8f17
rpc: add tests for simulate transaction inner instructions (#34495)
* rpc: add tests for simulate transaction inner instructions

* update encoding

* take out extra test case
2024-01-22 18:27:27 -06:00
Andrew Fitzgerald 45a2a701de
TransactionState: add TransactionCost (#34881) 2024-01-22 16:21:06 -08:00
Brooks 2f744f1639
Moves create_all_accounts_run_and_snapshot_dirs() into accounts-db utils (#34877) 2024-01-22 18:18:43 -05:00
Brooks 8cfad7f165
Replaces fs-err in verify_snapshot_archive() (#34887) 2024-01-22 17:20:00 -05:00
Brooks 16698b19d8
Replaces fs-err in snapshot_utils fns (#34883) 2024-01-22 21:36:22 +00:00
Tao Zhu a5c470d2fb
harden bank tests (#34821)
* harden bank tests by specifying exact genesis config wrt the fee rate and rent

* rename to clarify test function, add comments
2024-01-22 13:38:56 -06:00
Yihau Chen 9db4e84e72
bump shlex to 1.3.0 (#34878) 2024-01-23 03:18:07 +08:00
Brooks c264307f10
Removes get_io_error() (#34863) 2024-01-22 14:07:29 -05:00
Andrew Fitzgerald 5e4332ee35
Feature Impl: cost model uses number of requested write locks (#34820) 2024-01-22 09:22:49 -08:00
Brooks b78d41792a
Replaces fs-err in snapshot_utils tests (#34870) 2024-01-22 06:55:32 -05:00
Brooks d005b3a5b8
Removes fs-err dependency from accounts-db crate (#34869) 2024-01-22 06:55:13 -05:00
Yihau Chen f9bfb60c83
ci: publish crates directly (#34794) 2024-01-22 10:43:21 +08:00
Brooks 90933fea75
Replaces fs-err in snapshot_bank_utils.rs (#34861) 2024-01-21 20:54:25 -05:00
behzad nouri 9a520fd5b4
adds chained merkle shreds variant (#34787)
With the new chained variants, each Merkle shred will also embed the Merkle
root of the previous erasure batch.
2024-01-20 16:08:16 +00:00
samkim-crypto c071cf5cd0
[clap-v3-utils] Replace `pubkeys_sigs_of` with `try_pubkeys_sigs_of` (#34801)
* replace `pubkeys_sigs_of` with `try_pubkeys_sigs_of`

* propagate error from `try_pubkeys_sigs_of` to the caller
2024-01-20 11:20:51 +09:00
Brooks 3916c31cb4
Replaces fs-err in tiered storage (#34859) 2024-01-19 17:16:56 -05:00
Wen 4a2871f384
Add RestartHeaviestFork to Gossip (#34161)
* Add RestartHeaviestFork to Gossip.

* Add a test for out of bound value.

* Send observed_stake and total_epoch_stake in ResatartHeaviestFork.

* Remove total_epoch_stake from RestartHeaviestFork.

* Forgot to update ABI digest.

* Remove checking of whether stake is zero.

* Remove unnecessary new function and make new_rand pub(crate).
2024-01-19 13:59:25 -08:00
Brooks 3eb06b4b37
Replaces fs-err in accounts-db (#34860) 2024-01-19 16:35:02 -05:00
Tao Zhu acef7baab6
harden cli tests (#34844)
harden cli tests by setting up TestValidator correctly
2024-01-19 12:14:31 -06:00
Brooks 6835e10ba5
Replaces fs-err for some snapshot errors (#34837) 2024-01-19 12:53:10 -05:00
Nick Frostbutter 17de7a33e1
[docs] CI white spaces (#34858)
chore: whitespaces and formatting
2024-01-19 12:50:44 -05:00
Brooks a915e2f2a0
Returns ArchiveSnapshotPackageError from archive_snapshot_package() (#34855) 2024-01-19 11:21:14 -05:00
Brooks 2b0b5ae1ba
Gracefully handles errors when archiving snapshots (#34856) 2024-01-19 11:15:53 -05:00
Yueh-Hsuan Chiang 81b3210eec
[TieredStorage] Code refactoring for OwnersBlock (#34854)
#### Problem
The OwnersBlockFormat is currently defined inside footer.rs
instead of inside owners.rs.  In addition, the implementation of
OwnersBlock doesn't honor OwnersBlockFormat.

#### Summary of Changes
This PR moves OwnersBlockFormat from footer.rs to owners.rs
and repurpose OwnersBlock as OwnersBlockFormat (just like
the IndexBlockFormat inside index.rs)

#### Test Plan
Existing unit-tests.
2024-01-19 08:15:25 -08:00
dependabot[bot] 39687a01be
build(deps): bump wasm-bindgen from 0.2.89 to 0.2.90 (#34790)
* build(deps): bump wasm-bindgen from 0.2.89 to 0.2.90

Bumps [wasm-bindgen](https://github.com/rustwasm/wasm-bindgen) from 0.2.89 to 0.2.90.
- [Release notes](https://github.com/rustwasm/wasm-bindgen/releases)
- [Changelog](https://github.com/rustwasm/wasm-bindgen/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rustwasm/wasm-bindgen/compare/0.2.89...0.2.90)

---
updated-dependencies:
- dependency-name: wasm-bindgen
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-01-19 23:30:22 +08:00
dependabot[bot] 4650c8dabe
build(deps): bump js-sys from 0.3.66 to 0.3.67 (#34783)
* build(deps): bump js-sys from 0.3.66 to 0.3.67

Bumps [js-sys](https://github.com/rustwasm/wasm-bindgen) from 0.3.66 to 0.3.67.
- [Release notes](https://github.com/rustwasm/wasm-bindgen/releases)
- [Changelog](https://github.com/rustwasm/wasm-bindgen/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rustwasm/wasm-bindgen/commits)

---
updated-dependencies:
- dependency-name: js-sys
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-01-19 23:29:44 +08:00
dependabot[bot] cd4a424244
build(deps): bump rayon from 1.8.0 to 1.8.1 (#34826)
* build(deps): bump rayon from 1.8.0 to 1.8.1

Bumps [rayon](https://github.com/rayon-rs/rayon) from 1.8.0 to 1.8.1.
- [Changelog](https://github.com/rayon-rs/rayon/blob/master/RELEASES.md)
- [Commits](https://github.com/rayon-rs/rayon/compare/rayon-core-v1.8.0...rayon-core-v1.8.1)

---
updated-dependencies:
- dependency-name: rayon
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2024-01-19 23:28:56 +08:00