86cf0ad758
ledger-tool: Skip compaction in purge command by default ( #30891 )
...
Performing a manual ledger compaction can be very time consuming.
Although the compaction will optimize storage use, swapping to skip
compaction favors the command completing faster. Additionally, we no
longer do regular compaction in the validator (via LedgerCleanupService)
and instead make use of range deletion which is much more efficient.
Given the above, this changes alters the default behavior to skip ledger
compaction by default, and introduces a flag should a user really want
to run compaction.
2023-03-29 10:34:00 -05:00
bcdf5dad47
Bump proptest from 1.0.0 to 1.1.0 ( #30956 )
...
Bumps [proptest](https://github.com/proptest-rs/proptest ) from 1.0.0 to 1.1.0.
- [Release notes](https://github.com/proptest-rs/proptest/releases )
- [Changelog](https://github.com/proptest-rs/proptest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/proptest-rs/proptest/compare/1.0.0...v1.1.0 )
---
updated-dependencies:
- dependency-name: proptest
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-29 09:20:48 -06:00
0679db23ee
Abstract RPC bootstrap gossip exit into function ( #30948 )
2023-03-29 08:19:30 -07:00
a6ad37f3ad
Cleanup - `load_and_get_programs_from_cache()` ( #30959 )
...
* Replaces assign_program() by replenish() in load_and_get_programs_from_cache().
* Replaces LoadedProgramEntry by a boolean.
* Only lock the global cache once all missing programs have been loaded
* Factors out call of self.rc.accounts.filter_executable_program_accounts().
2023-03-29 16:11:14 +02:00
4bd7de4887
Update comments around snapshot retention policy unit tests ( #30955 )
2023-03-29 08:55:05 -05:00
823d55ea9f
disk index find_entry -> find_index_entry ( #30941 )
2023-03-29 06:54:03 -07:00
f198d7426a
Use feature gate to set effective slot of loaded programs ( #30950 )
2023-03-29 04:47:49 -07:00
2646fb72ed
Remove workaround for already-fixed clippy bug ( #30952 )
2023-03-29 13:45:27 +09:00
3713bb32b5
tpu-client: Fix counter for expired blockhash retries ( #30360 )
...
tpu-client: Fix counter for expired blockhash retries
The original counter would expire after saying "1 retry left", which was
misleading. We can safely change the comparison to >= 0 as our counter
is an i32.
2023-03-28 22:48:52 -05:00
2c842e9932
chore: workspace inheritance ( #30939 )
...
* client/Cargo.toml
* udp-client/Cargo.toml
* tpu-client/Cargo.toml
* thin-client/Cargo.toml
* storage-proto/Cargo.toml
* quic-client/Cargo.toml
* dos/Cargo.toml
* entry/Cargo.toml
* perf/Cargo.toml
* program-runtime/Cargo.toml
* program-test/Cargo.toml
* programs/address-lookup-table/Cargo.toml
* programs/loader-v3/Cargo.toml
* connection-cache/Cargo.toml
* programs/sbf/rust/big_mod_exp/Cargo.toml
* programs/zk-token-proof-tests/Cargo.toml
2023-03-29 03:28:56 +00:00
6f73aafa09
Make BanksClient timeout after 10 seconds instead of 60 ( #30904 )
...
* don't increase the deadline by 50 seconds
* add test demonstrating a timeout panic
* add back missing Duration import for tests
* cargo fmt
* clarify test comments
* clarify comment
* make timeout test finish in 1 second
* sort dependencies
2023-03-28 17:55:44 -06:00
8e910b494f
Forwarder: separate get_leader_and_addr ( #30922 )
2023-03-28 16:34:36 -07:00
564f8c9b17
ledger: Extract `BatchExecutionTiming` ( #30806 )
...
Extracted time metrics related to transaction execution into a separate
structure. This allows me to call `process_entries_with_callback()`
without locking the whole instance of `ConfirmationTiming`, passing just
the `BatchExecutionTiming` part.
I want to add a new metric that starts at the beginning of the
`confirm_slot_entries()` call and ends until the very end. In order to
use a `scopeguard::defer`, I need to be able to have an excursive
reference to it for the whole body of `confirm_slot_entries()`.
Plus a few minor renamings to clarify which verifications and results
variables actually store. And corrected a few messages, that
incorrectly stated PoH verification, while they were actually issued
for transaction verification failures.
2023-03-28 15:37:34 -07:00
b72be0f086
Forwarder: clean up packet_vec filter ( #30921 )
2023-03-28 14:54:04 -07:00
932301583c
Plumb Entry notification into plugin manager ( #30910 )
...
Plumb entry notification into plugin manager
2023-03-28 14:53:27 -06:00
1f420f2b03
Moves shrink after flush and clean ( #30918 )
2023-03-28 16:11:56 -04:00
2dfc46c71e
Forwarder: separate update_data_budget ( #30920 )
2023-03-28 12:58:39 -07:00
6285aaee89
store data and index occupy in bitvec ( #30899 )
2023-03-28 12:17:28 -07:00
4787b22bd6
Bump base64 from 0.13.0 to 0.13.1 ( #30931 )
...
* Bump base64 from 0.13.0 to 0.13.1
Bumps [base64](https://github.com/marshallpierce/rust-base64 ) from 0.13.0 to 0.13.1.
- [Release notes](https://github.com/marshallpierce/rust-base64/releases )
- [Changelog](https://github.com/marshallpierce/rust-base64/blob/master/RELEASE-NOTES.md )
- [Commits](https://github.com/marshallpierce/rust-base64/compare/v0.13.0...v0.13.1 )
---
updated-dependencies:
- dependency-name: base64
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-03-28 19:13:40 +00:00
bf488eb384
Update documentation of instruction error and add a unit test ( #30915 )
...
* Update documentation of instruction error and add a unit test
* update test name
2023-03-28 11:54:49 -07:00
035c974a8c
Remove redundant check during loading upgradeable program for writing ( #30561 )
...
* Remove redundant check during loading upgradeable program
* Apply clippy suggestion
2023-03-28 11:50:49 -07:00
aebc191c38
Stop loading program accounts if program exists in cache ( #30703 )
...
* Stop loading program accounts if program exists in cache
* load accounts for upgradeable programs
* revert loader change to conditionally use program data account
* load instruction accounts
* generate TransactionExecutorCache from loaded programs
* cleanup account_found_and_dep_index variable
* address review comments
* handle tombstones in loader
* unify tombstone constructor
* handle multiple tombstones
2023-03-28 11:49:56 -07:00
e7887cfb06
RootBankCache must use Acquire-Release semantics when accessing BankForks::root ( #30936 )
2023-03-28 14:35:02 -04:00
359d9c7b9f
upgrades ahash to 0.8.3 ( #30935 )
2023-03-28 18:23:33 +00:00
77aac98672
adding metrics deployment scripts ( #30926 )
...
* adding metrics deployment scripts
* fix trailing whitespaces
* fix more trailing whitespaces
* fix typos
* fix trailing whitespace
* fix loops
* update env vars
* fix shellcheck source
* add source references
2023-03-28 12:26:26 -05:00
75abfc79a6
removes unused dependencies ( #30917 )
2023-03-28 17:25:44 +00:00
aaac046b6b
flush individual buckets every n ages ( #30855 )
...
disk index flush individual buckets every n ages
2023-03-28 09:26:34 -07:00
42dfb85cc1
Bump hyper from 0.14.23 to 0.14.25 ( #30930 )
...
* Bump hyper from 0.14.23 to 0.14.25
Bumps [hyper](https://github.com/hyperium/hyper ) from 0.14.23 to 0.14.25.
- [Release notes](https://github.com/hyperium/hyper/releases )
- [Changelog](https://github.com/hyperium/hyper/blob/v0.14.25/CHANGELOG.md )
- [Commits](https://github.com/hyperium/hyper/compare/v0.14.23...v0.14.25 )
---
updated-dependencies:
- dependency-name: hyper
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-03-28 10:16:33 -06:00
29f776c676
reports cluster-nodes metrics by stake ( #30912 )
2023-03-28 12:45:09 +00:00
d7ae05c3fd
Unifies logging of start/stop for background services ( #30916 )
2023-03-28 08:32:18 -04:00
2cefbd1dfd
chore: add bare type to testnet-automation.sh ( #30933 )
...
feat: add bare option to testnet-automation.sh
2023-03-28 20:02:49 +08:00
742c56ae28
[cargo-test-sbf] Rename sbf-tools to platform-tools and use sbfv1 ( #30927 )
...
rename sbf-tools to platform-tools and use sbfv1
2023-03-28 20:30:14 +09:00
92189d82b4
Quic server log data rate ( #30892 )
...
* Add more statistics to better track incoming data rate to the Quic server
2023-03-28 15:33:40 +08:00
7fbd9e526a
validator: Refactor deprecated arguments logic ( #30924 )
...
It is better to have a single list of deprecated arguments. It is also
very common that an argument is replaced by another single argument -
provide a standard way to describe that.
2023-03-27 22:58:05 -07:00
bf986d64f8
Add more explict error messages for hardlink operations ( #30913 )
2023-03-27 19:55:10 -07:00
49b8ea771e
simplifies ServeRepair::run_orphan ( #30908 )
2023-03-27 23:19:55 +00:00
301a944e51
validator: Move `skip_poh_verify` into the deprecated list ( #30885 )
...
Follow-up for
commit 809041b#30811 )
`poh_verify` actually disables transaction signature, tick count and
built in program argument verifications as well. It is somewhat
confusing to call it `poh_verify`.
2023-03-27 16:12:18 -07:00
d4b30adffe
reworks gossip crds timeouts ( #30468 )
...
CrdsGossipPull::make_timeouts iterates over the stakes hashmap and
creates a new hashmap which is unnecessary:
https://github.com/solana-labs/solana/blob/c032dc275/gossip/src/crds_gossip_pull.rs#L517-L539
The commit instead keeps a reference to the stakes hashmap.
2023-03-27 21:52:48 +00:00
b53656b517
Bump wasm-bindgen from 0.2.82 to 0.2.84 ( #30887 )
...
* Bump wasm-bindgen from 0.2.82 to 0.2.84
Bumps [wasm-bindgen](https://github.com/rustwasm/wasm-bindgen ) from 0.2.82 to 0.2.84.
- [Release notes](https://github.com/rustwasm/wasm-bindgen/releases )
- [Changelog](https://github.com/rustwasm/wasm-bindgen/blob/main/CHANGELOG.md )
- [Commits](https://github.com/rustwasm/wasm-bindgen/compare/0.2.82...0.2.84 )
---
updated-dependencies:
- dependency-name: wasm-bindgen
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-03-27 12:07:18 -06:00
89bc86f11a
use trait for disk bucket header ( #30875 )
...
* use trait for disk bucket header
* pr feedback
* remove debug and default
* as_mut_ptr
* add comments
* verify slice is large enough
2023-03-27 11:07:02 -07:00
956d849c93
Bump nix from 0.25.0 to 0.25.1 ( #30889 )
...
* Bump nix from 0.25.0 to 0.25.1
Bumps [nix](https://github.com/nix-rust/nix ) from 0.25.0 to 0.25.1.
- [Release notes](https://github.com/nix-rust/nix/releases )
- [Changelog](https://github.com/nix-rust/nix/blob/v0.25.1/CHANGELOG.md )
- [Commits](https://github.com/nix-rust/nix/compare/v0.25.0...v0.25.1 )
---
updated-dependencies:
- dependency-name: nix
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-03-27 12:05:01 -06:00
9a681b8461
Bump prost-types from 0.11.6 to 0.11.8 ( #30888 )
...
* Bump prost-types from 0.11.6 to 0.11.8
Bumps [prost-types](https://github.com/tokio-rs/prost ) from 0.11.6 to 0.11.8.
- [Release notes](https://github.com/tokio-rs/prost/releases )
- [Commits](https://github.com/tokio-rs/prost/compare/v0.11.6...v0.11.8 )
---
updated-dependencies:
- dependency-name: prost-types
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2023-03-27 12:03:52 -06:00
a575ea2ee0
LeaderBankNotifier ( #30395 )
2023-03-27 08:17:17 -07:00
cbf70430a5
Fix deployment slot for upgraded programs ( #30902 )
2023-03-27 06:48:26 -07:00
0df28f6d51
Increment usage count for loaded programs and call eviction ( #30900 )
2023-03-27 06:48:05 -07:00
3bc670a47b
Revert Rust 1.68.0 upgrade ( #30897 )
...
Specifically the nightly upgrade is breaking the
`geyser_plugin_manager`. We will probably need more investigation
before we can move forward with it.
2023-03-25 02:41:12 +00:00
244430d643
Upgrades Rust to 1.68.0 ( #30664 )
2023-03-24 18:06:38 -04:00
fb7d303995
Refactor - mock_process_instruction() ( #30893 )
...
* Uses InvokeContext::process_instruction() in mock_process_instruction().
* Uses InvokeContext::process_instruction() in tests of loader-v3.
* Only throw InstructionError::BuiltinProgramsMustConsumeComputeUnits if result.is_ok().
* Adds CU cost to loader-v3.
2023-03-24 22:45:03 +01:00
bf7fa02214
Add units to incremental accounts hash datapoint ( #30894 )
2023-03-24 21:39:20 +00:00
2a05b25732
Standardize Thread Naming - Prioritization Fee Cache ( #30890 )
...
Thread naming in accordance with #27237
2023-03-24 13:48:55 -07:00
steviez
dependabot[bot]
Brennan
Alexander Meißner
Jeff Washington (jwash)
Pankaj Garg
Ryo Onodera
Kevin Ji
Yihau Chen
Kevin Heavey
Andrew Fitzgerald
Illia Bobyr
Tyera
Brooks
behzad nouri
joeaba
samkim-crypto
ryleung-solana
Xiang Zhu