f4339bc0f2
faucet: Expose time-slice, per-time-cap, and per-request-cap in test validator ( #29812 )
2023-01-21 08:18:49 -08:00
9a5aca36e6
validator: remove `--no-duplicate-instance-check` ( #29785 )
2023-01-19 14:51:40 -07:00
d0aa93de21
Refactors accounts hash cache ( #29625 )
2023-01-12 10:43:50 -05:00
c9fe21e3c3
ancient append vecs enabled at -10k by default ( #29565 )
2023-01-10 05:33:43 -08:00
8db1f53fe7
Add pubsub address to RpcContactInfo ( #29165 )
...
* rpc: add pubsub address to RpcContactInfo
* cli: add pubsub endpoint to gossip node info
* dashboard: add pubsub endpoint
* add missing pubsub info test_rpc_get_cluster_nodes
2023-01-08 22:25:56 -07:00
8c212f59ad
renames ContactInfo to LegacyContactInfo ( #29566 )
...
Working towards adding a new ContactInfo where new sockets can be
added in a backward compatible way.
2023-01-08 16:00:55 +00:00
0f2bfa2b02
cleanup get_snapshot_storages ( #29488 )
...
* cleanup get_snapshot_storages
* pr feedback
2023-01-03 12:22:28 -08:00
4cc1890f00
skip_rewrites will only be feature driven ( #29468 )
2023-01-02 20:15:42 -08:00
067facfbef
Remove println ( #29342 )
2022-12-20 19:31:40 +00:00
053775ad77
Elides unnecessary lifetimes ( #29299 )
2022-12-20 12:44:17 -05:00
c8dd5bbd48
Move getSecondaryIndexKeySize RPC to admin_rpc_service ( #29003 )
...
* Move getSecondaryIndexKeySize to admin_rpc_service
* Add AdminRpc test framework
* Move test to admin_rpc_service
* Update test
* Remove full-api infra
2022-12-19 19:54:05 -07:00
4530d161b7
Fixes format strings ( #29327 )
2022-12-19 17:26:38 -05:00
a44ea779bd
add support for a repair protocol whitelist ( #29161 )
2022-12-15 19:24:23 -08:00
356372b175
remove TestValidatorGenesis::caching_enabled ( #29229 )
2022-12-13 07:20:44 -08:00
560143a267
remove ValidatorConfig.caching_enabled ( #29172 )
2022-12-09 11:31:55 -08:00
33b15240ac
Revert #28945 ( #29127 )
...
revert #28945
2022-12-06 17:08:56 -06:00
aeb6b53502
Remove unused Option<> around ValidatorConfig's SnapshotConfig ( #29090 )
...
Remove Option<> around ValidatorConfig's SnapshotConfig
The SnapshotConfig is required and is currently hard-coded to be a
Some().
2022-12-06 22:47:55 +00:00
9524c9dbff
patches errors from clippy::uninlined_format_args
...
https://rust-lang.github.io/rust-clippy/master/index.html#uninlined_format_args
2022-12-06 19:32:15 +00:00
b090bb4f56
Update validator/src/cli.rs
...
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-12-06 13:31:50 -06:00
e1ba5a2a63
add monitoring for open file descriptors stat
2022-12-06 13:31:50 -06:00
b43eabaa47
change test validator from non upgradable bpf loader to upgradable bpf loader ( #29051 )
...
change for test validator from non upgradable to upgradable
2022-12-05 11:49:40 -08:00
e42649a8ba
remove cli arg to specify # accounts hash scan passes ( #28976 )
2022-11-29 16:47:51 -08:00
f0ef316b19
remove cli arg "--no-accounts-db-caching" ( #28912 )
2022-11-21 12:38:35 -08:00
3d91c3f5cf
Refactor, move solana-validator CLI related configs to its own module ( #28548 )
...
* Refactor, move validator CLI related stuff to its own module(cli.rs)
The main function of the validator is getting big. Improve readability by moving away the CLI setup stuff to its own module.
* Restore help cli line
* Refactor, move test validator CLI config to cli.rs module
* Fix imports (cargo fmt)
2022-11-18 21:39:20 -08:00
c32377b5af
Split out quic- and udp-client definitions ( #28762 )
...
* Move ConnectionCache back to solana-client, and duplicate ThinClient, TpuClient there
* Dedupe thin_client modules
* Dedupe tpu_client modules
* Move TpuClient to TpuConnectionCache
* Move ThinClient to TpuConnectionCache
* Move TpuConnection and quic/udp trait implementations back to solana-client
* Remove enum_dispatch from solana-tpu-client
* Move udp-client to its own crate
* Move quic-client to its own crate
2022-11-18 12:21:45 -07:00
e8c8235474
Get Index Key Size RPC Support ( #28383 )
...
Co-authored-by: K-anon <IntokuSatori@users.noreply.github.com>
2022-11-16 20:39:11 -07:00
f69e847137
allow ancient append vec threshold to be set on cli ( #28707 )
...
* allow ancient append vec threshold to be set on cli
* pr responses
2022-11-11 11:30:05 -08:00
d1ba42180d
clippy for rust 1.65.0 ( #28765 )
2022-11-09 19:39:38 +00:00
59bf1809fe
Uses SnapshotHash type in snapshot archive fields ( #28681 )
2022-10-31 14:28:35 -04:00
34865d032c
chore: update Solana docs and code comments that specify "BPF" to "SBF"
2022-10-31 14:14:25 -04:00
2272fd807e
Remove Blockstore manual compaction code ( #28409 )
...
The manual Blockstore compaction that was being initiated from
LedgerCleanupService has been disabled for quite some time in favor of
several optimizations.
Co-authored-by: Ryo Onodera <ryoqun@gmail.com>
2022-10-28 10:39:00 +02:00
510cd933a1
Fixes typo in bootstrap log ( #28483 )
2022-10-19 17:58:03 -04:00
1e79053dd1
Requires known validators to have all snapshot hashes at bootstrap ( #28284 )
2022-10-19 10:08:02 -04:00
235da8c538
chore: bump serde_yaml from 0.8.26 to 0.9.13 ( #28388 )
...
* chore: bump serde_yaml from 0.8.26 to 0.9.13 (#27970 )
* chore: bump serde_yaml from 0.8.26 to 0.9.13
Bumps [serde_yaml](https://github.com/dtolnay/serde-yaml ) from 0.8.26 to 0.9.13.
- [Release notes](https://github.com/dtolnay/serde-yaml/releases )
- [Commits](https://github.com/dtolnay/serde-yaml/compare/0.8.26...0.9.13 )
---
updated-dependencies:
- dependency-name: serde_yaml
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
* Prepend ---
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-10-14 22:02:39 -06:00
1224c545d5
Make FIFO related validator arguments public ( #28282 )
...
#### Summary of Changes
This PR makes two FIFO-related validator arguments public:
--rocksdb_shred_compaction and --rocksdb_fifo_shred_storage_size.
#### Test Plan
* There're already ~26 validators running FIFO in mainnet-beta for more than 30 days,
no issues were reported so far.
* Ran a validator with FIFO for days and observed it's able to consistently catch up
and create new roots.
2022-10-09 16:42:59 -07:00
00a18a962e
formats logs in bootstrap ( #28291 )
2022-10-07 18:42:57 +00:00
c802b12e10
Separate deprecated arguments out to reduce clutter ( #28250 )
2022-10-06 14:27:32 -05:00
7fef7d569a
Make RocksFifo storage size API expose an Option<u64> ( #28192 )
...
A fifo rocksdb instance must be opened with max size parameter on the
fifo columns. To support this, we previously plumbed a constant up to
callers that provided a default if unbounded growth desired.
This change attempts to be more rusty by exposing an option for this
value, and converting the option to a constant at the lowest level
possible.
2022-10-04 12:38:40 -05:00
599677f965
Derive rocksdb_fifo_shred_storage_size based on limit-ledger-size ( #27459 )
...
### Problem
When FIFO compaction is used while --rocksdb_fifo_shred_storage_size
is unspecified, the FIFO shred storage size is set to a const default based
on the default `--limit-ledger-size`.
### Summary of the Change
When --rocksdb_fifo_shred_storage_size is unspecified, it is now
derived from `--limit-ledger-size` by reserving 1500 bytes for each
shred.
2022-09-28 00:32:27 -07:00
060ecf9cdb
Revert "chore: bump serde_yaml from 0.8.26 to 0.9.13 ( #27970 )" ( #28055 )
...
This reverts commit da9206fb87
2022-09-25 04:49:11 +00:00
da9206fb87
chore: bump serde_yaml from 0.8.26 to 0.9.13 ( #27970 )
...
* chore: bump serde_yaml from 0.8.26 to 0.9.13
Bumps [serde_yaml](https://github.com/dtolnay/serde-yaml ) from 0.8.26 to 0.9.13.
- [Release notes](https://github.com/dtolnay/serde-yaml/releases )
- [Commits](https://github.com/dtolnay/serde-yaml/compare/0.8.26...0.9.13 )
---
updated-dependencies:
- dependency-name: serde_yaml
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-09-22 16:25:20 -06:00
9a57c64f21
patches clippy errors from new rust nightly release ( #27996 )
2022-09-22 22:23:03 +00:00
e1a49f7766
chore: bump indicatif from 0.17.0 to 0.17.1 ( #27968 )
...
* chore: bump indicatif from 0.17.0 to 0.17.1
Bumps [indicatif](https://github.com/console-rs/indicatif ) from 0.17.0 to 0.17.1.
- [Release notes](https://github.com/console-rs/indicatif/releases )
- [Commits](https://github.com/console-rs/indicatif/compare/0.17.0...0.17.1 )
---
updated-dependencies:
- dependency-name: indicatif
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-09-21 23:32:11 +00:00
8e460773dc
chore: bump fd-lock from 3.0.5 to 3.0.6 ( #27963 )
...
* chore: bump fd-lock from 3.0.5 to 3.0.6
Bumps [fd-lock](https://github.com/yoshuawuyts/fd-lock ) from 3.0.5 to 3.0.6.
- [Release notes](https://github.com/yoshuawuyts/fd-lock/releases )
- [Commits](https://github.com/yoshuawuyts/fd-lock/compare/v3.0.5...v3.0.6 )
---
updated-dependencies:
- dependency-name: fd-lock
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <you@example.com>
2022-09-21 18:29:54 +00:00
baf31b0753
bootstrap: Sleep in loop to get rpc peers ( #27843 )
2022-09-18 19:15:14 +00:00
c0e4379f43
Whickey/version v1.15 ( #27739 )
...
* Bump version to v1.13.0
* Bump version to v1.14.0
* Bump version to v1.15.0
2022-09-13 09:06:15 -05:00
83d4d128c2
Add --process-ledger-before-service flag to solana-validator
2022-09-11 07:58:42 -07:00
f338aa62ba
chore: bump serde from 1.0.143 to 1.0.144 ( #27511 )
...
* chore: bump serde from 1.0.143 to 1.0.144
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.143 to 1.0.144.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.143...v1.0.144 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-09-07 16:54:44 -06:00
7f223dc582
Added option to turn on UDP for TPU transaction and make UDP based TPU off by default ( #27462 )
...
--tpu-enable-udp is introduced. And when this is on, the transaction receive and transaction forward is enabled using udp.
Except for a few tests which was hard-coded sending transactions using udp, most tests are being done with udp based tpu disabled.
2022-09-07 13:19:14 -07:00
ebf10960b5
validator: clippy nightly fixes ( #27518 )
2022-09-07 10:45:52 -05:00
93a4f80a2c
Handling snapshot requests is now required ( #27537 )
2022-09-07 10:08:42 -04:00
72a2c02ee7
add --accounts-db-verify-refcounts for debugging ( #27504 )
2022-09-06 09:39:39 -07:00
6684c62280
Add SnapshotUsage to SnapshotConfig ( #27508 )
2022-09-02 08:56:23 -04:00
66717ff87d
chore: bump chrono from 0.4.21 to 0.4.22 ( #27509 )
...
* chore: bump chrono from 0.4.21 to 0.4.22
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.21 to 0.4.22.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/v0.4.22/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.21...v0.4.22 )
---
updated-dependencies:
- dependency-name: chrono
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-08-31 22:39:12 +00:00
574097f640
Wait for first incremental snapshot after a full snapshot before restarting
2022-08-30 11:31:28 -07:00
7bd08ad3ae
Featurize spinner in rpc-client and tpu-client ( #27381 )
...
* Add spinner features to rpc-client and tpu-client, and disable where unneeded
* Add doc comment
2022-08-30 09:56:56 -06:00
46a48760db
Switch concurrent replay from feature to param ( #27401 )
...
* Switch concurrent replay from feature to param
2022-08-26 12:36:02 -07:00
b8b3d723da
Use new client crates ( #27360 )
...
* Update ancillary cli crates
* Update cli
* Update command-line tools
* Update rpc, etc
* Update client-test
* Update core, validator
* Update local-cluster
2022-08-24 10:47:02 -06:00
e4a7d01e10
Rust v1.63 ( #27303 )
...
* Upgrade to Rust v1.63.0
* Add nightly_clippy_allows
* Resolve some new clippy nightly lints
* Increase QUIC packets completion timeout
* Update quinn-udp crate
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-08-22 18:01:03 -07:00
3f4731b37f
Standardize thread names
...
Tenets:
1. Limit thread names to 15 characters
2. Prefix all Solana-controlled threads with "sol"
3. Use Camel case. It's more character dense than Snake or Kebab case
2022-08-20 07:49:39 -07:00
dba2fd5a16
Enable QUIC client by default. Add arg to disable QUIC client. (Forward port #26927 ) ( #27194 )
...
Enable QUIC client by default. Add arg to disable QUIC client.
* Enable QUIC client by default. Add arg to disable QUIC client.
* Deprecate --disable-quic-servers arg
* Add #[ignore] annotation to failing tests
2022-08-19 09:15:15 -05:00
7573000d87
Revert "Rust v1.63.0 ( #27148 )" ( #27245 )
...
This reverts commit a2e7bdf50a
2022-08-19 09:19:44 +01:00
a2e7bdf50a
Rust v1.63.0 ( #27148 )
...
* Upgrade to Rust v1.63.0
* Add nightly_clippy_allows
* Resolve some new clippy nightly lints
* Increase QUIC packets completion timeout
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-08-17 15:48:33 -07:00
67d1628602
chore: bump libc from 0.2.129 to 0.2.131 ( #27162 )
...
* chore: bump libc from 0.2.129 to 0.2.131
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.129 to 0.2.131.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.129...0.2.131 )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-08-16 13:01:37 -06:00
42572ebb44
remove abort() from test-validator ( #27124 )
2022-08-16 09:34:10 -07:00
b28657ff46
test-validator: improve multi-value arg help output ( #26650 )
2022-08-15 14:08:26 +02:00
5618e9fd07
Allow overriding the runtime transaction account lock limit ( #26948 )
...
* Add --transaction-account-lock-limit cli arg to test-validator
* Allow overriding the tx account lock limit in ProgramTest
2022-08-12 15:07:48 +01:00
e50013acdf
Handle JsonRpcService startup failure ( #27075 )
2022-08-11 23:25:20 -07:00
fc6cee9c06
allow staked nodes weight override ( #26870 )
...
* Allowed staked nodes weight override (#26407 )
* Allowed staked nodes weight override, passing only HashMap over to core module
Co-authored-by: Ondra Chaloupka <chalda@chainkeepers.io>
2022-08-11 14:34:04 -07:00
da4028b24f
Connect to RPC nodes in parallel w/ reduced timeout ( #26892 )
...
* Connect to RPC nodes in parallel w/ reduced timeout
2022-08-11 14:32:22 -07:00
f641d3bad6
chore: bump chrono from 0.4.19 to 0.4.21 ( #27076 )
...
* chore: bump chrono from 0.4.19 to 0.4.21
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.19 to 0.4.21.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/main/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.19...v0.4.21 )
---
updated-dependencies:
- dependency-name: chrono
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <you@example.com>
2022-08-11 09:28:50 -06:00
a77131abce
chore: bump libc from 0.2.126 to 0.2.129 ( #27063 )
...
* chore: bump libc from 0.2.126 to 0.2.129
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.126 to 0.2.129.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.126...0.2.129 )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-08-10 15:53:09 -06:00
e3a8d2ecdd
chore: bump serde_json from 1.0.81 to 1.0.83 ( #27036 )
...
* chore: bump serde_json from 1.0.81 to 1.0.83
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.81 to 1.0.83.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.81...v1.0.83 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-08-10 09:45:42 -06:00
ae5b680c6f
chore: bump serde from 1.0.138 to 1.0.143 ( #27015 )
...
* chore: bump serde from 1.0.138 to 1.0.143
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.138 to 1.0.143.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.138...v1.0.143 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-08-10 05:08:43 +00:00
ccfbc54195
Move vote program state and instructions to solana-program
2022-08-09 20:52:47 -07:00
ad0acaa6fa
added arg --rpc-max-request-payload-size to validator ( #26377 )
...
* added ability to pass --rpc-max-request-payload-size to validator
* fixed lint errors
* more lint fix
* patch
Co-authored-by: ultd <ultd>
Co-authored-by: Justin Starry <justin@solana.com>
2022-08-08 13:50:05 +01:00
ed8c224374
Bump version to v1.12 ( #26967 )
2022-08-06 13:20:30 -05:00
65e670725a
chore: bump indicatif from 0.16.2 to 0.17.0 ( #26890 )
...
* chore: bump indicatif from 0.16.2 to 0.17.0
Bumps [indicatif](https://github.com/console-rs/indicatif ) from 0.16.2 to 0.17.0.
- [Release notes](https://github.com/console-rs/indicatif/releases )
- [Commits](https://github.com/console-rs/indicatif/compare/0.16.2...0.17.0 )
---
updated-dependencies:
- dependency-name: indicatif
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
* Accommodate api changes
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2022-08-05 21:11:17 +00:00
0f4b858224
Revert "Enable QUIC client by default. Add arg to disable QUIC client… ( #26913 )
...
Revert "Enable QUIC client by default. Add arg to disable QUIC client. (#26879 )"
This reverts commit 4c29750095
2022-08-04 13:26:43 -05:00
fbf1bf6d86
Bump Version to 1.11.6 ( #26906 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-08-03 12:48:43 -05:00
4c29750095
Enable QUIC client by default. Add arg to disable QUIC client. ( #26879 )
2022-08-03 10:39:55 -05:00
f3b760dd91
Add IO metrics ( #26804 )
...
* Add Disk IO metrics
2022-08-02 14:29:53 -07:00
5d038b9d2a
Bump Version to 1.11.5 ( #26758 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-07-25 13:05:14 -06:00
a603c8b0bc
Enable QUIC servers by default
2022-07-22 15:45:10 -06:00
2ee19f536a
Revert "Revert "core: disable quic servers on mainnet-beta" ( #26216 )"
...
This reverts commit 4a7fb2a808
2022-07-22 15:45:10 -06:00
4a7fb2a808
Revert "core: disable quic servers on mainnet-beta" ( #26216 )
...
Enable QUIC server
2022-07-20 20:37:24 +02:00
7c1ce867ce
account_from_dir flag renamed to account_dir
2022-07-20 10:24:20 -07:00
3377f40d75
Update validator/src/bin/solana-test-validator.rs
...
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-07-20 10:24:20 -07:00
4fb70f48d6
test-validator: add accounts-from-dir flag
2022-07-20 10:24:20 -07:00
c831185968
Cleanup from PR #25914 ( #26644 )
2022-07-20 00:01:35 -05:00
f0994c4ba1
Merge pull request from GHSA-x236-qc46-7v8j
...
* Restrict the usable port range of the validator such that adding QUIC_PORT_OFFSET never gets us an invalid port. Also validate this for incoming ContactInfos
* Require the proper port range in ContactInfo::valid_client_facing_addr
* Use asserts instead of panics, and enforce USABLE_PORT_RANGE for all the ports in ContactInfo
* Fix typo
* Make the quic client return errors on the quinn endpoint connect() call,
not just the result of awaiting the connect() call, as the connect()
call can itself fail realistically (e.g. due to expected/invalid IPs, etc)
* Update USABLE_PORT_RANGE to a better range and use port_range_validator to validate dynamic-port-range rather than a panic
* Fall back on UDP when the remote peer's tpu port is too large to have QUIC_PORT_OFFSET added to it
* Get rid of tpu port sanitization in ContactInfo
* Turn USABLE_PORT_RANGE into a Range and make connnection_cache fall back on UDP when the tpu port is out of range
* Fix build
* Dummy commit
* Reert dummy commit
* dummy commit
* revert dummy commit
* Fix typo
* Fix range validation
* Fix formatting
* Fix USABLE_PORT_RANGE
* Remove USABLE_PORT_RANGE
* Avoid creating a QuicLazyInitializedEndpoint when forcing the use of UDP
* Implement test for connection cache overflow
2022-07-19 14:54:42 +02:00
4f71ae6102
test-validator: use ADDRESS from account flag
2022-07-14 11:23:07 -07:00
fd5df1cf25
Bump Version to 1.11.4 ( #26578 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-07-11 23:30:38 -05:00
ee0a40937e
Add validator argument log_messages_bytes_limit to change log truncation limit.
...
Add new cli argument log_messages_bytes_limit to solana-validator to control how long program logs can be before truncation
2022-07-11 10:53:18 -05:00
9d937fb8a0
Bump Version to 1.11.3 ( #26481 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-07-07 14:39:46 -05:00
37f4621c06
chore: bump serde from 1.0.137 to 1.0.138 ( #26421 )
...
* chore: bump serde from 1.0.137 to 1.0.138
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.137 to 1.0.138.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.137...v1.0.138 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-07-05 23:18:08 -06:00
26176af4aa
cleanup cli arg help ( #26366 )
2022-07-05 14:49:05 -05:00
47c596ff12
Bump --contact-debug-interval default to 2m from 10s
2022-07-01 09:41:27 -07:00
649229f7b8
Tweak bootstrap::build_known_snapshot_hashes() (logs and tests) ( #26144 )
2022-06-30 12:36:13 -05:00
a4ce2d4de2
Combine bootstrap modules: with and without incremental snapshots ( #25732 )
2022-06-29 20:12:35 -05:00
1884275882
Support reading keypair from stdin in `solana-validator set-identity`/`solana-validator authorized-voter add` ( #26056 )
...
* Add keypair reading from stdin in `validator set-identity`
* Add keypair reading from stdin in `validator authorized-voter add`
2022-06-24 16:21:03 +00:00
5c2f819f99
Bump Version to 1.11.2 ( #26159 )
2022-06-22 21:16:18 -05:00
f3639b76ce
Remove some clippy lints
2022-06-22 09:23:22 -07:00
51f26dc96e
Bump version to 1.11.1 ( #26104 )
2022-06-21 12:07:46 -05:00
a5f290a66f
core: disable quic servers on mainnet-beta
2022-06-17 20:04:05 -06:00
32a58dd9e0
Add ability to use a non-default app profile id in bigtable requests ( #25968 )
...
* Add ability to use a non-default app profile id in bigtable requests
* Only run subcommand once when getting global configs
* Remove unneded scoping on option type
2022-06-16 00:58:16 +00:00
29b597cea5
Connection pool support in connection cache and QUIC connection reliability improvement ( #25793 )
...
* Connection pool in connection cache and handle connection errors
1. The connection not has a pool of connections per address, configurable, default 4
2. The connections per address share a lazy initialized endpoint
3. Handle connection issues better, avoid race conditions
4. Various log improvement for help debug connection issues
2022-06-10 09:25:24 -07:00
79a8ecd0ac
client: Remove static connection cache, plumb it instead ( #25667 )
...
* client: Remove static connection cache, plumb it instead
* Add TpuClient::new_with_connection_cache to not break downstream
* Refactor get_connection and RwLock into ConnectionCache
* Fix merge conflicts from new async TpuClient
* Remove `ConnectionCache::set_use_quic`
* Move DEFAULT_TPU_USE_QUIC to client, use ConnectionCache::default()
2022-06-08 13:57:12 +02:00
591986eb01
Helper function for creating ShredStorageType::RocksFifo ( #25569 )
...
#### Problem
Currently, the creation of ShredStorageType::RocksFifo is hard coded in validator/src/main.rs.
But this common code will also need to be used in other places like ledger-tool.
#### Summary of Changes
This PR creates a helper functionShredStorageType::rocks_fifo that takes a total shred_storage_size
and equally allocates to data-shred and coding-shred storage.
2022-06-08 07:58:58 +08:00
ba04063956
Add CPUmetrics ( #25802 )
...
Add in some CPU utilization metrics such as: number of vCPUs, clock frequency, average load across different time intervals, and number of total threads
2022-06-07 11:34:25 -07:00
8674c96a66
Make the default values of FIFO compaction consistent with validator args ( #25778 )
...
#### Problem
When FIFO compaction is used, the size ratio between data shred and coding
shred is set to 1:1 based on the `--rocksdb_fifo_shred_storage_size` arg.
However, BlockstoreRocksFifoOptions::default() uses a slightly optimized
5:4 ratio instead, and the default() function is only used in benchmarks.
#### Summary of Changes
This PR makes both validator argument and BlockstoreRocksFifoOptions::default()
to use 1:1 ratio between data and coding shred size.
2022-06-07 15:24:58 +08:00
395dbc0f40
choose highest incremental snapshot first ( #25584 )
2022-06-02 16:12:03 -05:00
81231a89b9
adds support for different variants of ShredCode and ShredData
...
The commit implements two new types:
pub enum ShredCode {
Legacy(legacy::ShredCode),
}
pub enum ShredData {
Legacy(legacy::ShredData),
}
Following commits will extend these types by adding merkle variants:
pub enum ShredCode {
Legacy(legacy::ShredCode),
Merkle(merkle::ShredCode),
}
pub enum ShredData {
Legacy(legacy::ShredData),
Merkle(merkle::ShredData),
}
2022-06-02 18:55:50 +00:00
1c2ae470c5
Fix forwarding of transactions over QUIC ( #25674 )
...
* Spawn QUIC server to receive forwarded txs
* Update validator port range
* forward votes using UDP
* no forwarding from unstaked nodes
* forwarding stats in banking stage
* fix test builds
* fix lifetime of forward sender
2022-06-02 11:14:58 -07:00
5b67960c76
(Refactor) Move blocktore options related stuff to blockstore_options.rs ( #25509 )
...
#### Problem
blockstore_db.rs has a mutual dependency between blockstore_metrics.rs.
#### Summary of Changes
This PR removes the mutual dependency by moving the option-related stuff
out from blockstore_db.rs to its new home --- blockstore_options.rs.
By doing this, we address the mutual dependency and also make the code cleaner.
2022-05-26 16:59:26 -07:00
b05c7d91ed
Fix derive_partial_eq_without_eq clippy lint
2022-05-22 22:22:21 -07:00
6e5612dd55
chore: bump libc from 0.2.125 to 0.2.126 ( #25332 )
...
* chore: bump libc from 0.2.125 to 0.2.126
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.125 to 0.2.126.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.125...0.2.126 )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-19 13:58:12 -06:00
3b47250d4a
chore: bump signal-hook from 0.3.13 to 0.3.14 ( #25281 )
...
* chore: bump signal-hook from 0.3.13 to 0.3.14
Bumps [signal-hook](https://github.com/vorner/signal-hook ) from 0.3.13 to 0.3.14.
- [Release notes](https://github.com/vorner/signal-hook/releases )
- [Changelog](https://github.com/vorner/signal-hook/blob/master/CHANGELOG.md )
- [Commits](https://github.com/vorner/signal-hook/compare/v0.3.13...v0.3.14 )
---
updated-dependencies:
- dependency-name: signal-hook
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-18 09:28:52 -06:00
24122768da
fix bootstrap without known validators ( #25293 )
2022-05-18 06:12:05 -05:00
a1522d0024
Use consistent naming for compute unit limit ( #25229 )
...
* Use consistent naming for compute unit limit
* feedback
2022-05-18 13:14:31 +08:00
795f6eda44
`--rpc-pubsub-notification-threads 0` now turns off the internal PubSub notification machinery ( #25307 )
2022-05-17 20:23:51 -07:00
0bdc4cdb7e
Reduce admin rpc service thread count from the number of available cores to 3 ( #25306 )
2022-05-17 19:40:13 -07:00
3e44046a73
Support lz4 for snapshot archives ( #25089 )
...
* add lz4
* add cargo package file
* fix tests
* use fast lz4 compression
* report snapshot archive format
* add test
* code review feedback
* add cargo.lock
* fix var name
* refactor archive format parsing and add default compress cli arg
* clippy
* add from_cli_arg test
* update cargo.lock
* add lz4 support for mmap
* cargo.lock
* clippy
2022-05-16 12:44:15 -05:00
a8930ee14b
add --accounts-db-ancient-append-vecs ( #25125 )
2022-05-11 08:47:07 -05:00
b2dcda8980
(LedgerStore) Move metric sample counters out from LedgerColumnOptions ( #25042 )
...
#### Problem
LedgerColumnOptions contain two fields, perf_read_counter and perf_write_counter,
that are not really options but internal counters.
#### Summary of Changes
This PR introduces BlockstoreRocksDbPerfSamplingStatus, a struct that holds internal
status for RocksDB perf sampling and moves perf_read_counter and perf_write_counter
out from LedgerColumnOptions.
2022-05-10 16:13:19 -07:00
2fa9bc3e70
Add options to store full and/or incremental snapshots in separate locations ( #24247 )
2022-05-10 16:37:41 -04:00
bece7f32c8
chore: bump log from 0.4.16 to 0.4.17 ( #24987 )
...
* chore: bump log from 0.4.16 to 0.4.17
Bumps [log](https://github.com/rust-lang/log ) from 0.4.16 to 0.4.17.
- [Release notes](https://github.com/rust-lang/log/releases )
- [Changelog](https://github.com/rust-lang/log/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/log/commits/0.4.17 )
---
updated-dependencies:
- dependency-name: log
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-05 01:49:18 +00:00
61a9faae17
chore: bump serde_json from 1.0.80 to 1.0.81 ( #24960 )
...
* chore: bump serde_json from 1.0.80 to 1.0.81
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.80 to 1.0.81.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.80...v1.0.81 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <you@example.com>
2022-05-04 14:57:38 -06:00
9258d81ba3
chore: bump serde from 1.0.136 to 1.0.137 ( #24957 )
...
* chore: bump serde from 1.0.136 to 1.0.137
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.136 to 1.0.137.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.136...v1.0.137 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-03 22:14:59 -06:00
2c9d2a2140
chore: bump serde_json from 1.0.79 to 1.0.80 ( #24943 )
...
* chore: bump serde_json from 1.0.79 to 1.0.80
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.79 to 1.0.80.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.79...v1.0.80 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-03 13:46:45 -06:00
8fa2913d08
chore: bump libc from 0.2.124 to 0.2.125 ( #24914 )
...
* chore: bump libc from 0.2.124 to 0.2.125
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.124 to 0.2.125.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.124...0.2.125 )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-03 10:10:55 -06:00
88c16c0176
Check if quic is enabled before warming up quic connections ( #24821 )
...
* Check if quic is enabled before warming up quic connections
* fix after rebase
* don't start warmup service if quic not enabled
* fix test
2022-05-01 03:52:38 +00:00
5245eb4229
(LedgerStore) Hidden validator argument for RocksDB perf samples ( #24684 )
...
#### Summary of Changes
This PR replaces the use of thread_rng in RocksDB perf metric samples by
AtomicU32 with Ordering::Relaxed to improve the performance of determining
whether to sample the current RocksDB's read/write perf metric.
2022-04-29 17:55:34 -07:00
b56c091b37
(LedgerStore) Hidden validator argument for RocksDB perf samples ( #24682 )
...
#### Problem
Currently, the number of RocksDB perf samples is controlled by an env arg
which is later handled using a lazy_static variable. However, there is a known
performance overhead of using lazy_static as mentioned in
https://github.com/solana-labs/solana/pull/6472 .
#### Summary of Changes
Instead, this PR uses a hidden validator argument, --rocksdb-perf-sample-interval,
for controlling how often RocksDB read/write performance sample is collected.
2022-04-29 15:28:50 -07:00
aee17f3b50
fix typo on validator help ( #24844 )
...
Co-authored-by: Austin <support@thetaproxies.com>
2022-04-29 13:47:04 -06:00
4aeb566c85
Add maybe clone flag to solana-test-validator
...
add --maybe-clone, which silently ignores accounts to be cloned, rather than dying
2022-04-25 19:56:57 -07:00
aee48406bc
Increase default --maximum-local-snapshot-age to 2500
2022-04-21 16:06:11 -07:00
7c61e438fc
Batch tpu calls in send-transaction-service ( #24083 )
...
Introduced flag --tpu-do-batch2.
Introduced flag to control the batch size-- by default 100
The default batch timeout is 200ms -- configurable. If either it time out or the batch size is filled, a new batch is sent
The batch honor the retry rate on the transaction already sent before.
Introduced two threads in STS: one for receiving new transactions and doing batch send and one for retrying old transactions and doing batch.6.
Fixes #
2022-04-21 12:43:08 -07:00
40b48f807a
chore: bump libc from 0.2.120 to 0.2.124 ( #24520 )
...
* chore: bump libc from 0.2.120 to 0.2.124
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.120 to 0.2.124.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.120...0.2.124 )
---
updated-dependencies:
- dependency-name: libc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-04-20 15:45:13 -06:00
cfe2177e16
validator option: accounts-db-skip-rewrites ( #24504 )
2022-04-20 09:41:00 -05:00
9e4999ef6a
Remove halt_at_slot from RuntimeConfig, it's not a runtime concern
2022-04-19 19:23:58 -07:00
77182fcdda
chore: bump fd-lock from 3.0.4 to 3.0.5 ( #24344 )
...
Bumps [fd-lock](https://github.com/yoshuawuyts/fd-lock ) from 3.0.4 to 3.0.5.
- [Release notes](https://github.com/yoshuawuyts/fd-lock/releases )
- [Commits](https://github.com/yoshuawuyts/fd-lock/compare/v3.0.4...v3.0.5 )
---
updated-dependencies:
- dependency-name: fd-lock
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-14 16:13:25 -06:00
26899359d1
Support quic in bench-tps ( #24295 )
...
* Update comment
* Use connection_cache in tpu_client
* Add --tpu-use-quic to bench-tps
* Use connection_cache async send
2022-04-13 12:17:10 -06:00
1bc49d219d
IndexLimitMb option adds 'Unspecified' state ( #24249 )
2022-04-12 09:38:09 -05:00
9b8850f99e
test-validator: Add `--max-compute-units` flag ( #24130 )
...
* test-validator: Add `--max-compute-units` flag
* Add `RuntimeConfig` for tweaking runtime behavior
* Actually add the file
* Move RuntimeConfig to runtime
2022-04-12 02:28:10 +02:00
60b2155bd3
Add accounts-filler-size command line option ( #23896 )
2022-04-11 13:10:09 -05:00
f8628d39e0
Check tpu quic socket ( #24122 )
2022-04-11 16:48:36 +02:00
330bdc6580
filter the list before checking --no-snapshot-fetch
2022-04-09 00:41:56 -06:00
fb67ff14de
Remove replica-node crates ( #24152 )
2022-04-06 16:52:19 -06:00
8b72200afb
Thin client quic ( #23973 )
...
Change thin-client to use connection-cache
2022-03-31 15:47:00 -04:00
Kevin Ji
Trent Nelson
Brooks
Jeff Washington (jwash)
Pires
behzad nouri
Tyera
Jeff Biseda
HaoranYi
steviez
Luca
eloylp
K-anon
Dmitri Makarov
Yueh-Hsuan Chiang
dependabot[bot]
Will Hickey
Michael Vines
Lijun Wang
apfitzge
Jeff Washington (jwash)
Brennan Watt
Justin Starry
janlegner
Ahmad
github-actions[bot]
sakridge
skrrb
ryleung-solana
Nicholas Clarke
DimAn
Ivan Mironov
Dan Coombs
Jon Cinque
Pankaj Garg
Code Monkey
hanako mumei
Giorgio Gambino
Bijie Zhu