Tyera Eulberg
50fa577af8
Use cluster confirmations in rpc and pubsub ( #9138 )
...
* Add runtime methods to simply get status and slot
* Add helper function to get slot confirmation_count from BlockCommitmentCache
* Return cluster confirmations in getSignatureStatus
* Remove use of invalid get_signature_confirmation_status
* Remove unused methods
* Update pubsub to use cluster confirmations
* Fix test_check_signature_subscribe failure
* Refactor confirmations to read commitment cache only once
* Review comments
* Use bank, root from BlockCommitmentCache
* Update docs
* Add metric for block-commitment aggregations
Co-authored-by: Justin Starry <justin@solana.com>
2020-03-30 17:53:25 -06:00
Tyera Eulberg
62040cef56
Store BlockCommitmentCache slot and root metadata ( #9154 )
...
automerge
2020-03-30 10:29:30 -07:00
sakridge
ae66c0e497
Add repair message support to dos tool ( #9090 )
2020-03-29 14:44:25 -07:00
sakridge
c67703e7a3
Make repair metrics less chatty ( #9094 )
2020-03-29 14:43:58 -07:00
dependabot-preview[bot]
2ed3e2160d
Bump serde_json from 1.0.48 to 1.0.49 ( #9139 )
...
* Bump serde_json from 1.0.48 to 1.0.49
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.48 to 1.0.49.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.48...v1.0.49 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* Update serde_json in programs
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Justin Starry <justin@solana.com>
2020-03-28 12:19:40 -07:00
Justin Starry
8bbf6e3f54
Fix race in RPC subscriptions test ( #9142 )
2020-03-29 01:58:51 +08:00
Michael Vines
d7fa40087c
Bump version to 1.2.0
2020-03-28 09:44:13 -07:00
Michael Vines
4a8b1d9b2c
RpcClient now returns Signatures instead of Strings ( #9129 )
2020-03-27 15:46:00 -07:00
Justin Starry
c1a3b6ecc2
Add RPC subscription api for rooted slots ( #9118 )
...
automerge
2020-03-27 09:33:40 -07:00
carllin
d47262d233
Reduce transmit frequency ( #9113 )
...
Co-authored-by: Carl <carl@solana.com>
2020-03-26 23:33:28 -07:00
carllin
5a8658283a
Add check for propagation of leader block before generating further blocks ( #8758 )
...
Co-authored-by: Carl <carl@solana.com>
2020-03-26 19:57:27 -07:00
Tyera Eulberg
4b97e58cba
Consolidate signature-status rpcs ( #9069 )
...
* getSignatureStatus: return confirmations for non-rooted transactions
* Remove getNumConfirmations.. rpc
* Remove getSignatureConfirmation
* Review comments
* More review comments
2020-03-26 19:21:01 -06:00
carllin
f3d556e3f9
Refactor VoteTracker ( #9084 )
...
* Refactor VoteTracker
Co-authored-by: Carl <carl@solana.com>
2020-03-26 17:55:17 -07:00
sakridge
b7b4aa5d4d
move rpc types from client to client-types crate ( #9039 )
...
* Separate client types into own crate, so ledger does not need it
Removes about 50 crates of dependency from ledger
* Drop Rpc name from transaction-status types
2020-03-26 13:29:30 -07:00
sakridge
ed036b978d
Accumulate blockstore metrics and submit every 2s ( #9075 )
2020-03-26 12:51:41 -07:00
Justin Starry
e4472db33f
Unflake rpc subscriptions test by reducing sub count ( #9078 )
...
automerge
2020-03-25 20:43:38 -07:00
carllin
076fef5e57
Update Cluster Slots to support multiple threads ( #9071 )
...
Co-authored-by: Carl <carl@solana.com>
2020-03-25 18:09:19 -07:00
dependabot-preview[bot]
095c79e863
Bump regex from 1.3.5 to 1.3.6 ( #9055 )
...
Bumps [regex](https://github.com/rust-lang/regex ) from 1.3.5 to 1.3.6.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.3.5...1.3.6 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-25 17:24:14 -07:00
Ryo Onodera
f987c18a7e
Strictly validate the contents of snapshot/genesis ( #8959 )
...
automerge
2020-03-25 02:46:41 -07:00
Justin Starry
8f38bc7dc0
Refactor how pubsub subscriptions are added ( #9042 )
2020-03-25 00:53:32 +08:00
Justin Starry
19dfb87b1f
Fix timeout for subscriptions test ( #9043 )
...
automerge
2020-03-24 01:57:28 -07:00
Justin Starry
eed8087d87
Respect confirmations param for signature subscription notifications ( #9019 )
...
automerge
2020-03-23 17:00:34 -07:00
Tyera Eulberg
1b8f9e75dd
Update getSignatureStatus: support multiple signatures, include slot in each response item ( #9022 )
...
* Rename enable-rpc-get-confirmed-block
* Rename RpcTransactionStatus -> RpcTransactionStatusMeta
* Return simplified RpcTransactionStatus; Add support for multiple transactions
* Update docs
* typo
2020-03-23 11:25:39 -06:00
sakridge
4b397d15b3
Accounts cleanup service and perf improvements ( #8799 )
...
* Use atomic for ref count instead of taking rwlock
* Accounts cleanup service
* Review comments
2020-03-23 08:50:23 -07:00
sakridge
4d2b83d01f
Add option to disable rocks compaction ( #9011 )
2020-03-23 08:42:32 -07:00
Justin Starry
a0ffcc61ae
Add slot info to Bank::get_signature_confirmation_status ( #9018 )
2020-03-23 21:55:15 +08:00
Justin Starry
4b4819cd07
Add slot context to rpc pubsub notifications ( #9001 )
...
automerge
2020-03-23 05:34:42 -07:00
Michael Vines
88ba8439fc
Add frozen account support ( #8989 )
...
automerge
2020-03-22 11:10:04 -07:00
Michael Vines
aa24181a53
Remove blockstream unix socket support. RPC or bust ( #9004 )
...
automerge
2020-03-21 20:17:11 -07:00
Michael Vines
18c1f0dfe9
Remove stub core/src/genesis_utils.rs ( #8999 )
2020-03-21 10:54:40 -07:00
sakridge
909321928c
Shred fetch comment and debug message tweak ( #8980 )
...
automerge
2020-03-20 11:00:48 -07:00
sakridge
453f5ce8f2
Shred filter ( #8975 )
...
Thread bank_forks into shred fetch
2020-03-20 07:49:48 -07:00
carllin
dc1db33ec9
Add Capabilities to Signal BroadcastStage to Retransmit ( #8899 )
2020-03-19 23:35:01 -07:00
dependabot-preview[bot]
24d871b529
Bump serde from 1.0.104 to 1.0.105 ( #8954 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.104 to 1.0.105.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.104...v1.0.105 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-18 22:35:30 -07:00
dependabot-preview[bot]
2dc50cff5b
Bump bv from 0.11.0 to 0.11.1 ( #8952 )
...
automerge
2020-03-18 21:37:21 -07:00
sakridge
c51049a59b
Add counter for accounts hash verification. ( #8928 )
2020-03-18 08:39:09 -07:00
anatoly yakovenko
9cedeb0a8d
Pull streamer out into its own module. ( #8917 )
...
automerge
2020-03-17 23:30:23 -07:00
sakridge
7079559c2d
Fix windows build by removing sys-info ( #8860 )
...
Doesn't build for windows.
2020-03-16 12:53:13 -07:00
sakridge
dc347dd3d7
Add Accounts hash consistency halting ( #8772 )
...
* Accounts hash consistency halting
* Add option to inject account hash faults for testing.
Enable option in local cluster test to see that node halts.
2020-03-16 08:37:31 -07:00
Carl
ead6dc553a
If let
2020-03-16 07:57:07 -07:00
Carl
009c124fac
Remove generic
2020-03-16 07:57:07 -07:00
Carl
9411fc00b8
Lower error level
2020-03-16 07:57:07 -07:00
carllin
9afc5da2e1
Fix vote polling ( #8829 )
...
Co-authored-by: Carl <carl@solana.com>
2020-03-15 20:31:05 -07:00
Michael Vines
5481d1a039
Validators now run a full gossip node while looking for a snapshot
2020-03-15 09:31:55 -07:00
Michael Vines
29fb79382c
Rework validator vote account defaults to half voting fees
2020-03-13 20:13:33 -07:00
carllin
53b8d0d528
Remove holding Poh lock ( #8838 )
...
automerge
2020-03-13 15:15:13 -07:00
dependabot-preview[bot]
52b254071c
Bump regex from 1.3.4 to 1.3.5 ( #8830 )
...
Bumps [regex](https://github.com/rust-lang/regex ) from 1.3.4 to 1.3.5.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.3.4...1.3.5 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-13 07:43:07 -06:00
anatoly yakovenko
9a79be5ca0
Use cluster information about slots to prioritize repair ( #8820 )
...
automerge
2020-03-12 17:34:46 -07:00
dependabot-preview[bot]
f93c8290f4
Bump sys-info from 0.5.9 to 0.5.10 ( #8810 )
...
Bumps [sys-info](https://github.com/FillZpp/sys-info-rs ) from 0.5.9 to 0.5.10.
- [Release notes](https://github.com/FillZpp/sys-info-rs/releases )
- [Changelog](https://github.com/FillZpp/sys-info-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/FillZpp/sys-info-rs/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-12 13:42:31 -06:00
dependabot-preview[bot]
48ac038f7a
Bump serial_test from 0.3.2 to 0.4.0 ( #8808 )
...
Bumps [serial_test](https://github.com/palfrey/serial_test ) from 0.3.2 to 0.4.0.
- [Release notes](https://github.com/palfrey/serial_test/releases )
- [Commits](https://github.com/palfrey/serial_test/compare/v0.3.2...v0.4.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-12 11:14:37 -06:00
anatoly yakovenko
f64ab49307
Cluster has no way to know which slots are available ( #8732 )
...
automerge
2020-03-11 21:31:50 -07:00
Jack May
6eb4973780
Don't use move semantics if not needed ( #8793 )
2020-03-11 14:37:23 -07:00
dependabot-preview[bot]
75a84ecdae
Bump reqwest from 0.10.1 to 0.10.4 ( #8787 )
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.10.1 to 0.10.4.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.10.1...v0.10.4 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-11 09:02:40 -06:00
dependabot-preview[bot]
e41ff2df66
Bump chrono from 0.4.10 to 0.4.11 ( #8755 )
...
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.10 to 0.4.11.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/master/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.10...v0.4.11 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-10 08:43:18 -06:00
dependabot-preview[bot]
f88b79d42b
Bump itertools from 0.8.2 to 0.9.0 ( #8756 )
...
Bumps [itertools](https://github.com/bluss/rust-itertools ) from 0.8.2 to 0.9.0.
- [Release notes](https://github.com/bluss/rust-itertools/releases )
- [Changelog](https://github.com/rust-itertools/itertools/blob/master/CHANGELOG.md )
- [Commits](https://github.com/bluss/rust-itertools/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-10 08:42:11 -06:00
dependabot-preview[bot]
1a0dd53450
Bump rayon from 1.2.0 to 1.3.0 ( #8757 )
...
Bumps [rayon](https://github.com/rayon-rs/rayon ) from 1.2.0 to 1.3.0.
- [Release notes](https://github.com/rayon-rs/rayon/releases )
- [Changelog](https://github.com/rayon-rs/rayon/blob/master/RELEASES.md )
- [Commits](https://github.com/rayon-rs/rayon/compare/v1.2.0...rayon-core-v1.3.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-10 08:40:02 -06:00
carllin
9872430bd2
Add VoteTracker for tracking cluster's votes in gossip ( #8327 )
...
Track votes by slot in cluster_vote_listener
2020-03-09 22:03:09 -07:00
Michael Vines
36fa3a1a0a
Wait for 80% of the active stake instead of 75%
2020-03-09 20:31:09 -07:00
dependabot-preview[bot]
fad08a19cc
Bump serde_json from 1.0.46 to 1.0.48 ( #8260 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.46 to 1.0.48.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.46...v1.0.48 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-09 20:20:19 -06:00
dependabot-preview[bot]
ff74452ef3
Bump libc from 0.2.66 to 0.2.67 ( #8680 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.66 to 0.2.67.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.66...0.2.67 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-03-08 21:38:58 -07:00
Michael Vines
f992ee3140
Remove unnecessary snapshot hash verification ( #8711 )
2020-03-07 09:04:52 -07:00
sakridge
97986a5241
Move download code to download-utils crate ( #8704 )
2020-03-07 07:08:01 -08:00
Michael Vines
cea8067219
Disable setLogFilter RPC API by default ( #8693 )
...
automerge
2020-03-06 16:03:10 -08:00
Trent Nelson
4db074a5aa
RPC: Add `getFeeCalculatorForBlockhash` method call ( #8687 )
...
Returns the `FeeCalculator` associated with the given blockhash, or
`null` if said blockhash has expired
2020-03-06 17:01:31 -07:00
Michael Vines
cb6848aa80
Publish initial snapshot hash in gossip on validator startup ( #8679 )
...
automerge
2020-03-05 22:52:31 -08:00
Greg Fitzgerald
2242b1b4a5
Bump byteorder from 1.3.2 to 1.3.4 ( #8159 )
...
Bumps [byteorder](https://github.com/BurntSushi/byteorder ) from 1.3.2 to 1.3.4.
- [Release notes](https://github.com/BurntSushi/byteorder/releases )
- [Changelog](https://github.com/BurntSushi/byteorder/blob/master/CHANGELOG.md )
- [Commits](https://github.com/BurntSushi/byteorder/compare/1.3.2...1.3.4 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-03-05 17:07:18 -07:00
carllin
f47a789b15
Add find_incomplete_slots ( #8654 )
...
* Add find_incomplete_slots
* Add live slots iterator
2020-03-05 10:58:00 -08:00
Trent Nelson
fd00e5cb35
Store FeeCalculator with blockhash in nonce accounts ( #8650 )
...
* Copy current state version to v0
* Add `FeeCalculator` to nonce state
* fixup compile
* Dump v0 handling...
Since we new account data is all zeros, new `Current` versioned accounts
look like v0. We could hack around this with some data size checks, but
the `account_utils::*State` traits are applied to `Account`, not the
state data, so we're kind SOL...
* Create more representative test `RecentBlockhashes`
* Improve CLI nonce account display
Co-Authored-By: Michael Vines <mvines@gmail.com>
* Fix that last bank test...
* clippy/fmt
Co-authored-by: Michael Vines <mvines@gmail.com>
2020-03-05 07:40:26 -07:00
Michael Vines
448b957a13
Add --bind-address and --rpc-bind-address validator arguments ( #8628 )
2020-03-04 22:46:43 -07:00
carllin
dec3da8f9d
Add orphan iterator ( #8636 )
2020-03-04 18:10:30 -08:00
Grimes
f89c22b5ee
`solana catchup` now detects when you try to catchup to yourself ( #8635 )
...
automerge
2020-03-04 14:44:21 -08:00
carllin
f23dc11a86
compute_bank_stats needs to return newly computed ForkStats ( #8608 )
...
* Fix broken confirmation, add test
2020-03-04 11:49:56 -08:00
Michael Vines
306783c661
Don't advertise the snapshot that the node was loaded from
...
snapshot_packager_service will remove this snapshot hash from gossip
when it starts
2020-03-02 18:58:53 -07:00
Justin Starry
8ec8204a30
Run pubsub test poller in tokio runtime ( #8494 )
2020-03-03 09:44:39 +08:00
Michael Vines
42c5c59800
Only gossip packaged snapshots
2020-03-02 14:17:17 -07:00
carllin
8ef8c9094a
Add ReplayStage changes for checking switch threshold ( #8504 )
...
* Refactor for supporting switch threshold check
2020-03-02 12:43:43 -08:00
Michael Vines
13551885c2
--wait-for-supermajority now requires a SLOT
2020-03-02 12:59:35 -07:00
Michael Vines
1ca4913328
Avoid is_x86_feature_detected when not building for x86
2020-03-01 18:10:43 -07:00
Michael Vines
862a4a243f
Demote gossip responder error log messages to info!
2020-03-01 10:43:20 -07:00
Michael Vines
2a5605db24
Reduce max snapshot hashes to stay under MTU
2020-02-29 09:21:52 -07:00
carllin
6a5a6387e2
Fix skipping own leader slots ( #8533 )
...
automerge
2020-02-29 00:05:35 -08:00
Michael Vines
0f31adeafb
GET for /snapshot.tar.bz2 now redirects to the latest snapshot
2020-02-28 23:23:59 -07:00
Michael Vines
ae817722d8
Include validator version in log
2020-02-28 23:23:59 -07:00
Trent Nelson
90bedd7e06
Split signature throughput tracking out of `FeeCalculator` ( #8447 )
...
* SDK: Split new `FeeRateGovernor` out of `FeeCalculator`
Leaving `FeeCalculator` to *only* calculate transaction fees
* Replace `FeeCalculator` with `FeeRateGovernor` as appropriate
* Expose recent `FeeRateGovernor` to clients
* Move `burn()` back into `FeeCalculator`
Appease BPF tests
* Revert "Move `burn()` back into `FeeCalculator`"
This reverts commit f3035624307196722b62ff8b74c12cfcc13b1941.
* Adjust BPF `Fee` sysvar test to reflect removal of `burn()` from `FeeCalculator`
* Make `FeeRateGovernor`'s `lamports_per_signature` private
* rebase artifacts
* fmt
* Drop 'Recent'
* Drop _with_commitment variant
* Use a more portable integer for `target_signatures_per_slot`
* Add docs for `getReeRateCalculator` JSON RPC method
* Don't return `lamports_per_signature` in `getFeeRateGovernor` JSONRPC reply
2020-02-28 13:27:01 -07:00
Michael Vines
3acf956f6f
Fix test_concurrent_snapshot_packaging
2020-02-26 23:32:53 -07:00
Michael Vines
0d4cb252c4
Adapt local-cluster/
2020-02-26 23:32:53 -07:00
Michael Vines
fcabc6f799
Rename snapshot.tar.bz2 to snapshot-<slot>-<hash>.tar.bz2
2020-02-26 23:32:53 -07:00
carllin
5f766cd20b
Remove loop ( #8493 )
2020-02-26 19:59:28 -08:00
Michael Vines
27c5ec0149
Use the same reqwest features across the repo
2020-02-26 20:47:43 -07:00
Justin Starry
e743414908
Choose more appropriate options for pubsub websocket server ( #8354 )
...
* Choose more sensible options for pubsub websocket server
* Increase max payload size for pubsub service
2020-02-27 08:54:53 +08:00
carllin
d47a47924a
Update voting simulation ( #8460 )
2020-02-26 14:09:07 -08:00
carllin
7a2bf7e7eb
Limit leader schedule search space ( #8468 )
...
* Limit leader schedule search space
* Fix and add test
* Rename
2020-02-26 13:35:50 -08:00
Michael Vines
fbf78b83c4
Add retry mechanism when downloading genesis and snapshots
2020-02-26 14:21:37 -07:00
Justin Starry
021d0a46f8
Move docs from book/ to docs/ ( #8469 )
...
automerge
2020-02-26 07:11:38 -08:00
Justin Starry
8839dbfe5b
Use runtime executor to send pubsub notifications ( #8353 )
...
automerge
2020-02-25 20:23:54 -08:00
carllin
d821fd29d6
Add versioning ( #8348 )
...
automerge
2020-02-25 17:12:01 -08:00
sakridge
004f1d5aed
Combine replay stage memory reporting ( #8455 )
...
automerge
2020-02-25 16:04:27 -08:00
sakridge
1caeea8bc2
Refactor new bank paths into common function ( #8454 )
2020-02-25 15:49:59 -08:00
Michael Vines
2059af822d
Remove unnecessary new_banks_from_blockstore() argument ( #8433 )
...
automerge
2020-02-24 23:27:19 -08:00
carllin
39282be486
Determine vote_state ahead of time ( #8303 )
...
automerge
2020-02-24 19:27:04 -08:00