661aa303d2
build(deps): bump js-sys from 0.3.64 to 0.3.65 ( #34000 )
...
* build(deps): bump js-sys from 0.3.64 to 0.3.65
Bumps [js-sys](https://github.com/rustwasm/wasm-bindgen ) from 0.3.64 to 0.3.65.
- [Release notes](https://github.com/rustwasm/wasm-bindgen/releases )
- [Changelog](https://github.com/rustwasm/wasm-bindgen/blob/main/CHANGELOG.md )
- [Commits](https://github.com/rustwasm/wasm-bindgen/commits )
---
updated-dependencies:
- dependency-name: js-sys
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-10 13:29:42 +00:00
6d9ed2c5c7
build(deps): bump serde_json from 1.0.107 to 1.0.108 ( #34001 )
...
* build(deps): bump serde_json from 1.0.107 to 1.0.108
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.107 to 1.0.108.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.107...v1.0.108 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-10 13:29:23 +00:00
985ff402fb
build(deps): bump quinn-proto from 0.10.5 to 0.10.6 ( #34002 )
...
* build(deps): bump quinn-proto from 0.10.5 to 0.10.6
Bumps [quinn-proto](https://github.com/quinn-rs/quinn ) from 0.10.5 to 0.10.6.
- [Release notes](https://github.com/quinn-rs/quinn/releases )
- [Commits](https://github.com/quinn-rs/quinn/commits )
---
updated-dependencies:
- dependency-name: quinn-proto
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-10 13:28:59 +00:00
67f8daf6e9
chore: Update light-poseidon to 0.2.0 ( #33923 )
...
That new release contains an important change which prevents a
potential DDoS.
* Lightprotocol/light-poseidon#32
Invoking `from_bytes_be` function light-poseidon 0.1.1 inverts all
the inputs before performing a check whether their length exceeds
the modulus of the prime field. Therefore, it was prone to an
attack, where a mailicious user could submit long byte slices just
to DDoS the validator, being stuck on inverting large byte sequences.
The update and mentioned change fixes the same issue as #33363 aims
to address.
The new release contains also few other less important changes like:
* Lightprotocol/light-poseidon#37
* Lightprotocol/light-poseidon#38
* Lightprotocol/light-poseidon#39
2023-11-10 16:00:10 +09:00
1057ba8406
Use is_trusted bool in insert_shreds() instead manually adjusting root ( #34010 )
...
The test_duplicate_with_pruned_ancestor test needs to get around a
limitation where the shreds with a parent older than the latest root are
discarded. The previous approach manually adjusted the root value in the
blockstore; this is not ideal in that it is fiddling with the inner
working of Blockstore.
So, use the is_trusted argument in Blockstore::insert_shreds(); setting
is_trusted=true bypasses the sanity checks (including the parent >=
latest root check).
2023-11-09 22:56:48 -06:00
59eb55990c
Move filter_executable_program_accounts to bank.rs ( #34004 )
2023-11-09 14:40:04 -08:00
9f25f67e60
Simplifies adding uncleaned pubkeys during index generation ( #34007 )
2023-11-09 16:06:15 -05:00
a96be5d2f0
Uses IntSet for uncleaned roots during index generation ( #34008 )
2023-11-09 15:04:19 -05:00
28e08ac141
Add Blockstore::get_rooted_block_with_entries method ( #33995 )
...
* Add helper structs to hold block and entry summaries
* Add Blockstore::get_rooted_block_with_entries and dedupe innards
* Review comments
2023-11-09 10:03:56 -07:00
a9509f56b7
Feature - Epoch boundary recompilation phase ( #33477 )
...
* Adds LoadedPrograms::upcoming_environments.
* Moves LoadedPrograms::prune_feature_set_transition() into LoadedPrograms::prune().
* Adds parameter recompile to Bank::load_program().
* Sets latest_root_slot/epoch and environments in Bank::finish_init().
* Removes FEATURES_AFFECTING_RBPF list.
* Adjusts test_feature_activation_loaded_programs_recompilation_phase().
2023-11-09 13:10:59 +01:00
874fae507f
[TieredStorage] Make HotStorageReader use AccountOffset type ( #33964 )
...
#### Problem
#33927 introduced a new type AccountOffset, but HotStorageReader
still uses `usize` to access accounts.
#### Summary of Changes
This PR makes HotStorageReader use the new AccountOffset type.
2023-11-08 21:58:44 -08:00
230779d459
Revert " Remove redundant bounds check from getBlock and getBlockTime… ( #33996 )
...
Revert " Remove redundant bounds check from getBlock and getBlockTime (#33901 )"
This reverts commit 03a456e7bb
2023-11-08 18:16:51 -06:00
bba6ea2d69
Returns IntMap from select_candidates_by_total_usage() ( #33976 )
2023-11-08 16:15:51 -05:00
783f136214
expands transport configs in turbine QUIC endpoint ( #33864 )
2023-11-08 20:28:19 +00:00
3ac2507d36
adds keep-alive-interval to repair QUIC transport config ( #33866 )
...
QUIC connections may timeout due to infrequent repair requests. The commit
configures keep_alive_interval and max_idle_timeout to avoid timeouts.
2023-11-08 20:09:23 +00:00
7cb83bc491
Adds `S` to HashMap/HashSet impls of Contains ( #33973 )
2023-11-08 15:08:33 -05:00
06884a044d
build(deps): bump light-poseidon from 0.1.1 to 0.1.2 ( #33988 )
...
* build(deps): bump light-poseidon from 0.1.1 to 0.1.2
Bumps [light-poseidon](https://github.com/Lightprotocol/light-poseidon ) from 0.1.1 to 0.1.2.
- [Release notes](https://github.com/Lightprotocol/light-poseidon/releases )
- [Commits](https://github.com/Lightprotocol/light-poseidon/compare/v0.1.1...v0.1.2 )
---
updated-dependencies:
- dependency-name: light-poseidon
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-08 18:47:12 +00:00
32792d8259
build(deps): bump syn from 2.0.38 to 2.0.39 ( #33987 )
...
* build(deps): bump syn from 2.0.38 to 2.0.39
Bumps [syn](https://github.com/dtolnay/syn ) from 2.0.38 to 2.0.39.
- [Release notes](https://github.com/dtolnay/syn/releases )
- [Commits](https://github.com/dtolnay/syn/compare/2.0.38...2.0.39 )
---
updated-dependencies:
- dependency-name: syn
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-08 18:46:52 +00:00
e5d3dbe2fa
build(deps): bump serde from 1.0.190 to 1.0.192 ( #33986 )
...
* build(deps): bump serde from 1.0.190 to 1.0.192
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.190 to 1.0.192.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.190...v1.0.192 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-08 18:46:28 +00:00
4f1d9e00fd
build(deps): bump index_list from 0.2.7 to 0.2.11 ( #33985 )
...
* build(deps): bump index_list from 0.2.7 to 0.2.11
Bumps [index_list](https://github.com/Fairglow/index-list ) from 0.2.7 to 0.2.11.
- [Release notes](https://github.com/Fairglow/index-list/releases )
- [Commits](https://github.com/Fairglow/index-list/compare/v0.2.7...v0.2.11 )
---
updated-dependencies:
- dependency-name: index_list
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-08 18:46:09 +00:00
69cec7e7b7
Remove RwLock on BlockNotifier ( #33981 )
2023-11-08 10:27:50 -08:00
7cdfba9259
Display error message while laoding geyser plugins ( #33990 )
2023-11-08 18:16:42 +00:00
03a456e7bb
Remove redundant bounds check from getBlock and getBlockTime ( #33901 )
...
JsonRpcRequestProcessor::check_blockstore_root() contained some logic
that performed duplicate sanity checking on a Blockstore fetch result.
The checking involved creating rocksdb iterators, which has non-trivial
overhead.
This PR removes the duplicate checking, and also adds comments to help
reason about how JsonRpcRequestProcessor interprets the Blockstore
result.
2023-11-08 12:09:10 -06:00
73815aee51
Move and rename ledger services from core to ledger ( #33947 )
...
These services currently live in core/; however, they operate on the
ledger. Mores so, these two services operate on the blockstore only,
and not necessarily the entire ledger. So, it makes sense to move these
services out of core and into ledger. We've recently been doing similar
changes with breaking things out into individual crates in order to
reduce the scope of core.
So, this change moves the services from core/ to ledger/, and replaces
ledger with blockstore.
2023-11-08 11:58:31 -06:00
8c5b5f18be
scripts/cargo-clippy.sh: Extract our non-trivial `cargo clippy` command ( #33982 )
...
CI uses a number of parameters when running `cargo clippy`. Repeating
the same command manually requires some copy/pasting. It is easier when
there is a common script that can be run by everyone.
2023-11-08 02:50:38 -08:00
5efba1fb3a
ci: add the ability to use GCS backend for sccache ( #33967 )
2023-11-08 11:03:35 +08:00
29b21253ec
changelog: Uses fastboot by default ( #33900 )
2023-11-07 16:00:09 -05:00
6f213c38aa
Removes Default from RollingBitField ( #33969 )
2023-11-07 15:58:52 -05:00
fdab44f768
build(deps): bump openssl from 0.10.57 to 0.10.59 ( #33952 )
...
* build(deps): bump openssl from 0.10.57 to 0.10.59
Bumps [openssl](https://github.com/sfackler/rust-openssl ) from 0.10.57 to 0.10.59.
- [Release notes](https://github.com/sfackler/rust-openssl/releases )
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.57...openssl-v0.10.59 )
---
updated-dependencies:
- dependency-name: openssl
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-07 13:52:49 -07:00
29b4ba0dc1
build(deps): bump indexmap from 2.0.2 to 2.1.0 ( #33954 )
...
* build(deps): bump indexmap from 2.0.2 to 2.1.0
Bumps [indexmap](https://github.com/bluss/indexmap ) from 2.0.2 to 2.1.0.
- [Changelog](https://github.com/bluss/indexmap/blob/master/RELEASES.md )
- [Commits](https://github.com/bluss/indexmap/compare/2.0.2...2.1.0 )
---
updated-dependencies:
- dependency-name: indexmap
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-07 13:51:24 -07:00
dd2845b072
build(deps): bump futures from 0.3.28 to 0.3.29 ( #33953 )
...
* build(deps): bump futures from 0.3.28 to 0.3.29
Bumps [futures](https://github.com/rust-lang/futures-rs ) from 0.3.28 to 0.3.29.
- [Release notes](https://github.com/rust-lang/futures-rs/releases )
- [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.28...0.3.29 )
---
updated-dependencies:
- dependency-name: futures
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-07 13:49:42 -07:00
e93725e788
Add more comments about solana-program patch (downstream) ( #33965 )
...
* Add more comments re solana-program patch
* More specific advice
2023-11-07 13:30:10 -07:00
87b4dc64e3
Add --release-with-debug option to cargo-install-all.sh ( #33383 )
...
* Add --canary option to cargo-install-all for building with separate debug symbols
* lint
* Remove debug-assertions
* switch flag from --canary to --release-with-debug
2023-11-07 13:48:11 -06:00
eba1b2d3e3
Remove RwLock on TransactionNotifier ( #33962 )
...
* Remove RwLock on TransactionNotifier
2023-11-07 10:28:56 -08:00
b013c03afa
[TieredStorage] Add IndexOffset type ( #33929 )
...
#### Problem
TieredStorage conceptually has different offsets. However, the current code directly
uses the same primitive type for accessing offsets, which is error-prone as one could
easily use one offset to access data that should be accessed with a different offset
type.
#### Summary of Changes
This PR adds IndexOffset type -- a struct for obtaining the ith entry inside the
index-block to obtain account's offset and address.
2023-11-07 10:26:21 -08:00
b8115b4303
chunk all ancient append vecs ( #33909 )
...
* chunk all ancient append vecs
* fix a test comments
* remove unneeded dead_code attr
* do full chunking when pack is used to create ancient storage
* refacotr and fix tests
* clippy
* add cache hash file stats
* comments
* fix test
* Update accounts-db/src/accounts_db.rs
Co-authored-by: Brooks <brooks@prumo.org>
* Update accounts-db/src/accounts_db.rs
Co-authored-by: Brooks <brooks@prumo.org>
* test_case
* remove commented out code
* remove hash cache data stats
* typo
---------
Co-authored-by: HaoranYi <haoran.yi@solana.com>
Co-authored-by: HaoranYi <haoran.yi@gmail.com>
Co-authored-by: Brooks <brooks@prumo.org>
2023-11-07 09:10:59 -06:00
ec0ddc9468
Fix `solana-install init` making unnecessary API requests ( #33949 )
...
* Fix `solana-install init` making unnecessary API requests
* Add `is_init` check
* chore: Move `semver_update_type` to where it's being used
2023-11-06 17:06:49 -07:00
8c69a0ec38
Remove RwLock on AccountsUpdateNotifier ( #33960 )
2023-11-06 14:03:25 -08:00
da130b87d3
[TieredStorage] Add AccountOffset type ( #33927 )
...
#### Problem
TieredStorage conceptually has different offsets. However, the current code directly
uses the same primitive type for accessing offsets, which is error-prone as one could
easily use one offset to access data that should be accessed with a different offset
type.
#### Summary of Changes
This PR introduces the AccountOffset type, which allows static-check to on different
type of TieredStorage offsets.
2023-11-06 12:21:08 -08:00
70d97d3261
Adds `iter_ones()` to RollingBitField ( #33956 )
2023-11-06 14:06:43 -05:00
ee29647f67
Remove Option<_> from Blockstore::get_rooted_block_time() return type ( #33955 )
...
Instead of returning Result<Option<UnixTimestamp>>, return
Result<UnixTimestamp> and map None to an error. This makes the return
type similar to that of Blockstore::get_rooted_block().
2023-11-06 12:56:10 -06:00
6624a09d38
[TieredStorage] Rename account-index to index-block ( #33928 )
...
#### Problem
The current tiered-storage code uses "account-index" to call index-block.
This could lead to confusion especially as we start giving each offset/position/index a specific type.
#### Summary of Changes
This PR renames all structs/variables that use account-index to refer to index-block.
2023-11-06 10:32:19 -08:00
d6ac9bea84
Geyser: return real parent blockhash, or default ( #33873 )
...
Return real parent blockhash, or default
2023-11-06 11:14:18 -07:00
75e598ece3
rekey stake redelegate feature ( #33957 )
...
Co-authored-by: HaoranYi <haoran.yi@solana.com>
2023-11-06 17:57:54 +00:00
0c3cab77fb
docs: updating apt install to apt upgrade ( #33920 )
2023-11-06 13:27:41 +01:00
63fd5cf049
chore: impl decode for UiAccountData ( #33632 )
2023-11-06 13:24:13 +01:00
e840b9759a
Remove RWLock from EntryNotifier because it causes perf degradation ( #33797 )
...
* Remove RWLock from EntryNotifier because it causes perf degradation when entry notifications are enabled on geyser
* remove unused RWLock
* Remove RWLock
2023-11-06 00:55:36 -08:00
ebe8afb0c3
Burn fees collected into invalid accounts ( #33887 )
...
* refactor: create bank::fee_distribution module
* feature: add checks to fee distribution
* refactor: move Bank::deposit fn into test_utils
* feedback
* feedback 2
* add datapoints
* change to datapoint_warn
* typo
2023-11-06 10:02:22 +08:00
662ac8bc86
ci: reorg docker images ( #33815 )
...
* ci: remove unnecessary args from docker-run.sh
* ci: remove cargo uninstall from buildkite post checkout
* ci: reorg docker images
* ci: add mscgen for docs
2023-11-03 20:32:38 +08:00
43668c4246
build(deps): bump num_enum from 0.7.0 to 0.7.1 ( #33932 )
...
* build(deps): bump num_enum from 0.7.0 to 0.7.1
Bumps [num_enum](https://github.com/illicitonion/num_enum ) from 0.7.0 to 0.7.1.
- [Commits](https://github.com/illicitonion/num_enum/commits )
---
updated-dependencies:
- dependency-name: num_enum
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-11-03 20:29:46 +08:00
dependabot[bot]
vadorovsky
steviez
Pankaj Garg
Brooks
Tyera
Alexander Meißner
Yueh-Hsuan Chiang
behzad nouri
Lijun Wang
galactus
Illia Bobyr
Yihau Chen
Will Hickey
Jeff Washington (jwash)
acheron
HaoranYi
Max Kaplan
Sylwester Rąpała
Liam Vovk
Justin Starry