6d81eede93
Add CLI options and runtime support for selection of output snapshot version. ( #10536 )
2020-06-19 14:38:37 +09:00
ed4c71fe2d
Merge heaviest bank modules ( #10672 )
...
* Merge heaviest bank modules
* Merge heaviest fork choice modules
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-06-18 03:59:08 +00:00
0550b893b0
Fix typos ( #10675 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-06-17 20:54:52 -07:00
39984cdcc3
Wait until bank is frozen before sending RPC notifications ( #10654 )
2020-06-18 00:44:51 +08:00
6ee222363e
Move BankForks to solana_runtime ( #10637 )
...
* Move BankForks to solana_runtime
* Update imports
2020-06-17 15:27:03 +00:00
0de6c444d6
Simd poh ( #10604 )
...
* Simd poh
* Fix poh verify bench
2020-06-16 23:03:26 -07:00
891aa8c13e
Add RequestProcessor constructor to simplify testing ( #10631 )
...
* Add JsonRpcRequestProcessor constructor
* Avoid start_rpc_handler_with_tx monolith in rpc tests
* pub
* Pass an Arc, so that caller can poke the bank
2020-06-16 23:30:59 -06:00
5673343f49
Add address to non-circulating supply
2020-06-16 21:20:33 -07:00
1eca9b19ab
Entry verify cleanup and gossip counters ( #10632 )
...
* Add prune message counter
* Switch to us verification time to match other counters
* Add separate transaction/poh verify timing
2020-06-16 14:00:29 -07:00
f8b88d717e
Enable fork choice and switch votes, devnet => now, testnet => epoch 63 ( #10615 )
...
* Enable fork choice, devnet => now, testnet => epoch 63
* Set development to 0
* Enable switch vote slot
Co-authored-by: Carl <carl@solana.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-06-16 09:55:36 +00:00
480f69cc5e
Bump serde from 1.0.111 to 1.0.112
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.111 to 1.0.112.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.111...v1.0.112 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-15 07:58:16 -07:00
a0692c9b4c
Further fix the ci ( #10559 )
2020-06-14 14:53:49 +09:00
d159bc71e7
Fix trailing whitespace ( #10558 )
2020-06-14 14:43:43 +09:00
ba83e4ca50
Fix fannout gossip bench ( #10509 )
...
* Gossip benchmark
* Rayon tweaking
* push pulls
* fanout to max nodes
* fixup! fanout to max nodes
* fixup! fixup! fanout to max nodes
* update
* multi vote test
* fixup prune
* fast propagation
* fixups
* compute up to 95%
* test for specific tx
* stats
* stats
* fixed tests
* rename
* track a lagging view of which nodes have the local node in their active set in the local received_cache
* test fixups
* dups are old now
* dont prune your own origin
* send vote to tpu
* tests
* fixed tests
* fixed test
* update
* ignore scale
* lint
* fixup
* fixup
* fixup
* cleanup
Co-authored-by: Stephen Akridge <sakridge@gmail.com>
2020-06-13 22:03:38 -07:00
48febf153b
Change documentation introduction to indicate Foundation IP transfer ( #10440 )
2020-06-13 14:41:05 -07:00
b6a9573748
Route all loader messages to log collector ( #10528 )
2020-06-13 13:20:08 -07:00
8dd5384d6d
Split commitment module ( #10541 )
...
automerge
2020-06-12 17:16:10 -07:00
f54c049b43
Add FdGYQ... to non-circulation withdrawer authority list ( #10542 )
...
automerge
2020-06-12 16:45:20 -07:00
2eb6f498a8
Remove redundant BankForks parameter ( #10537 )
2020-06-12 11:04:17 -06:00
dfe72d5242
Optimize stale slot shrinking for previously cleaned roots ( #10099 )
...
* Prioritize shrinking of previously cleaned roots
* measure time of stale slot shrinking
* Disable shrink for test
* shrink: budgeting, store count, force for snapshot
* Polish implementation and fix tests
* Fix ci..
* Clean up a bit
* Further polish implementation and fix/add tests
* Rebase fixes
* Remove unneeded Default for AccountStorageEntry
* Address review comments
* More cleanup
* More cleanup
2020-06-12 14:51:43 +09:00
fb8612be49
Update non-circulating pubkeys ( #10524 )
...
automerge
2020-06-11 16:30:25 -07:00
9077c4a776
Enable jsonrpc client ( #10522 )
2020-06-11 16:51:25 -06:00
526eefac97
Fix clippy ( #10521 )
...
Co-authored-by: Carl <carl@solana.com>
2020-06-11 15:26:00 -06:00
2e1d59ff85
Adopt heaviest subtree fork choice rule ( #10441 )
...
* Add HeaviestSubtreeForkChoice
* Make replay stage switch between two fork choice rules
Co-authored-by: Carl <carl@solana.com>
2020-06-11 12:16:04 -07:00
4c140acb3b
ClusterInfo cleanup ( #10504 )
...
automerge
2020-06-10 17:00:17 -07:00
6eb5ef6ac7
Add back missing pull_response success counter ( #10491 )
2020-06-10 09:17:57 -07:00
ecb6959720
Optimize process pull responses ( #10460 )
...
* Batch process pull responses
* Generate pull requests at 1/2 rate
* Do filtering work of process_pull_response in read lock
Only take write lock to insert if needed.
2020-06-09 17:08:13 -07:00
a264a9dd0b
Bump serde_json from 1.0.53 to 1.0.54
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.53 to 1.0.54.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.53...v1.0.54 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-09 16:57:46 -07:00
8e2745c2a2
Clean up delinquency slot distance computation
2020-06-09 11:27:30 -07:00
ed351400b2
Add SendTransactionService
2020-06-09 07:46:40 -07:00
832d324a23
Revert "Gossip PullRequests tend to return a lot of duplicates. ( #10326 )" ( #10455 )
...
This reverts commit 31e20eff82
2020-06-09 07:27:00 -07:00
e23340d89e
Clippy cleanup for all targets and nighly rust (also support 1.44.0) ( #10445 )
...
* address warnings from 'rustup run beta cargo clippy --workspace'
minor refactoring in:
- cli/src/cli.rs
- cli/src/offline/blockhash_query.rs
- logger/src/lib.rs
- runtime/src/accounts_db.rs
expect some performance improvement AccountsDB::clean_accounts()
* address warnings from 'rustup run beta cargo clippy --workspace --tests'
* address warnings from 'rustup run nightly cargo clippy --workspace --all-targets'
* rustfmt
* fix warning stragglers
* properly fix clippy warnings test_vote_subscribe()
replace ref-to-arc with ref parameters where arc not cloned
* Remove lock around JsonRpcRequestProcessor (#10417 )
automerge
* make ancestors parameter optional to avoid forcing construction of empty hash maps
Co-authored-by: Greg Fitzgerald <greg@solana.com>
2020-06-09 09:38:14 +09:00
af8c21c559
Remove lock around JsonRpcRequestProcessor ( #10417 )
...
automerge
2020-06-07 20:54:03 -07:00
0645a0c96d
Gossip cleanup remove duplicate gossip metrics and name worker threads ( #10435 )
...
Refactor into functions
2020-06-06 15:05:45 -07:00
ebb612ab4e
Enable and add tick rate to metrics ( #10430 )
2020-06-06 11:47:11 -07:00
7e2651ca51
RPC simulateTransaction endpoint now returns program log output ( #10432 )
2020-06-06 10:18:28 -07:00
2725acebea
Lower counter level ( #10428 )
2020-06-05 15:53:09 -07:00
2e37eccfc4
Bump jsonrpc-core-client from 14.1.0 to 14.2.0 ( #10425 )
...
Bumps [jsonrpc-core-client](https://github.com/paritytech/jsonrpc ) from 14.1.0 to 14.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.1.0...v14.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-05 15:51:01 -06:00
3d2230f1a9
Add pull request count metrics ( #10421 )
2020-06-05 09:36:31 -07:00
31e20eff82
Gossip PullRequests tend to return a lot of duplicates. ( #10326 )
...
* filter messages that are likely to be pushed from the response
* tests
* tests
* wait to start filtering responses, and push stats to influx
* wait to start filtering responses, and push stats to influx
* reduce the timers to match the publish self timeout
* fmt
* fmt
2020-06-05 08:01:45 -07:00
aa6832964c
ledger_cleanup_service: compact at a slower rate than purging ( #10414 )
2020-06-04 21:06:06 -07:00
318835e3a0
Merge pull request #10410 from solana-labs/dependabot/cargo/jsonrpc-pubsub-14.2.0
...
Bump jsonrpc-pubsub from 14.1.0 to 14.2.0
2020-06-04 19:06:14 -07:00
754f25ae99
Avoid AccountInUse errors when simulating transactions ( #10391 )
...
automerge
2020-06-04 19:06:01 -07:00
68f95c791a
Bump jsonrpc-ws-server from 14.1.0 to 14.2.0
...
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc ) from 14.1.0 to 14.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.1.0...v14.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-04 19:02:30 -07:00
8736247554
Bump jsonrpc-http-server from 14.1.0 to 14.2.0
...
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 14.1.0 to 14.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.1.0...v14.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-04 19:00:28 -07:00
ea9b958dff
Bump jsonrpc-derive from 14.1.0 to 14.2.1
...
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc ) from 14.1.0 to 14.2.1.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-03 12:16:54 -07:00
f58b6b3431
Bump jsonrpc-core from 14.1.0 to 14.2.0
...
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc ) from 14.1.0 to 14.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-03 09:02:07 -07:00
6cf30c38a4
Bump reqwest from 0.10.5 to 0.10.6
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.10.5 to 0.10.6.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-03 09:01:36 -07:00
2cf719ac2c
Cache tvu peers for broadcast ( #10373 )
2020-06-03 08:24:05 -07:00
f901571026
Bump serde from 1.0.110 to 1.0.111
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.110 to 1.0.111.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.110...v1.0.111 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-02 23:29:14 -07:00
8498b75d6c
Bump indexmap from 1.3.2 to 1.4.0
...
Bumps [indexmap](https://github.com/bluss/indexmap ) from 1.3.2 to 1.4.0.
- [Release notes](https://github.com/bluss/indexmap/releases )
- [Commits](https://github.com/bluss/indexmap/compare/1.3.2...1.4.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-02 23:28:57 -07:00
eee9a08376
Purge TransactionStatus and AddressSignatures exactly from ledger-tool ( #10358 )
...
* Add failing test
* Add execution path to purge primary-index columns exactly
* Fail gracefully if older TransactionStatus rocksdb keys are present
* Remove columns_empty check for special columns
* Move blockstore purge methods to submodule
* Remove unused column empty check
2020-06-02 19:49:31 -06:00
ebf8a65526
Add test_rpc_send_transaction_preflight
2020-06-01 17:51:04 -07:00
9158479dc4
Add node health check to transaction preflight
2020-06-01 17:51:04 -07:00
9dbf3d5430
Factor out RpcHealth module
2020-06-01 17:51:04 -07:00
189aa7962e
Add preflight checks to sendTransaction RPC method
2020-06-01 17:51:04 -07:00
ef37b82ffa
More cluster stats and add epoch stakes cache in retransmit stage ( #10345 )
...
* More cluster info metrics for push request/response counts
* Cache staked peers for the epoch
2020-06-01 08:37:54 -07:00
d9366776b2
Add operating mode gating ( #10332 )
...
Co-authored-by: Carl <carl@solana.com>
2020-05-30 00:03:19 -07:00
19d11800bf
Remove WithSigner ( #10325 )
...
automerge
2020-05-29 23:17:44 -07:00
eb45aaa6c3
Added --health-check-slot-distance ( #10324 )
2020-05-29 15:31:52 -07:00
778078e1dc
Distinguish switch/non-switching votes in ReplayStage ( #10218 )
...
* Add SwitchForkDecision, change vote instruction based on decision
* Factor out SelectVoteAndResetForkResult
Co-authored-by: Carl <carl@solana.com>
2020-05-29 14:40:36 -07:00
b563b49ed5
Improve Rpc inflation tooling ( #10309 )
...
automerge
2020-05-29 11:50:25 -07:00
fb4d8e1f62
cleanup clippy tests ( #10172 )
...
automerge
2020-05-29 00:26:06 -07:00
a71833c17b
Bump regex from 1.3.8 to 1.3.9 ( #10308 )
...
* Bump regex from 1.3.8 to 1.3.9
Bumps [regex](https://github.com/rust-lang/regex ) from 1.3.8 to 1.3.9.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.3.8...1.3.9 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2020-05-28 21:48:39 -07:00
9eefb2c929
Bump version to 1.3.0
2020-05-28 15:01:13 -07:00
e68621b8bb
Fix repair dos ( #10299 )
...
Co-authored-by: Carl <carl@solana.com>
2020-05-28 14:16:24 -07:00
0442c45d5b
Feign RPC health while in a `--wait-for-supermajority` holding pattern ( #10295 )
2020-05-28 12:22:19 -07:00
3f508b37fd
Skip gossip requests with different shred version and split lock ( #10240 )
2020-05-28 11:38:13 -07:00
9227874ada
Bump regex from 1.3.7 to 1.3.8 ( #10293 )
...
* Bump regex from 1.3.7 to 1.3.8
Bumps [regex](https://github.com/rust-lang/regex ) from 1.3.7 to 1.3.8.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/regex-1.3.7...1.3.8 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2020-05-28 10:02:23 -07:00
3f0995d3b4
Add commitment parameter to getFeeCalculatorForBlockhash ( #10255 )
...
* Accept commitment parameter on getFeeCalculatorForBlockhash
* Update docs
* Add get_fee_calculator_for_blockhash_with_commitment to rpc client
2020-05-26 17:23:58 -06:00
4e431bc818
Add mechanism to get blockhash's last valid slot ( #10239 )
...
automerge
2020-05-26 12:06:21 -07:00
7ebd8ee531
Cluster info metrics ( #10215 )
2020-05-25 15:03:34 -07:00
156387aba4
LedgerCleanupService no longer causes an OOM and actually purges ( #10199 )
...
* cleanup_ledger() now services new_root_receiver while purging
* purge_slots() now fully deletes before compacting
* Add ledger pruning grafana graph
2020-05-24 21:41:54 -07:00
3aae98c8be
Add switching vote instruction ( #10197 )
...
* Add switching vote
* Make sure vote size stays under gossip limit
Co-authored-by: Carl <carl@solana.com>
2020-05-24 15:38:35 -07:00
42aaacf520
Factor out LockedPubkeyReferences ( #10198 )
...
Co-authored-by: Carl <carl@solana.com>
2020-05-22 23:23:17 -07:00
48c0845359
Update another non-circulating account
2020-05-22 15:11:33 -07:00
10b1895357
Optimize banking processing of AccountInUse ( #10154 )
...
* Optimize banking processing of AccountInUse and thread count
* Add more options to banking-bench
2020-05-22 15:01:01 -07:00
f1e932c90a
Trigger notifications on supermajority votes confirmation ( #10137 )
...
automerge
2020-05-22 14:53:47 -07:00
e2b5cd6d47
Add another non-circulating account ( #10186 )
...
automerge
2020-05-22 13:06:03 -07:00
2928c5d103
Add SingleGossip commitment level to use for subscriptions ( #10147 )
...
automerge
2020-05-22 12:55:17 -07:00
b7a32f01c0
Multi-version snapshot support ( #9980 )
...
* Multi-version snapshot support
* rustfmt
* Remove CLI options and runtime support for selection output snapshot version.
Address some clippy complaints.
* Muzzle clippy type complexity warning.
Despite clippy's suggestion, it is not currently possible to create type aliases
for traits and so everything within the 'Box<...>' cannot be type aliased.
This then leaves creating full blown traits, and either implementing
said traits by closure (somehow) or moving the closures into new structs
implementing said traits which seems a bit of a palaver.
Alternatively it is possible to define and use the type alias 'type ResultBox<T> = Result<Box<T>>'
which does seems rather pointless and not a great reduction in complexity but is enough to keep clippy happy.
In the end I simply went with squelching the clippy warning.
* Remove now unused Serialize/Deserialize trait implementations for AccountStorageEntry and AppendVec
* refactor versioned de/serialisers
* rename serde_utils to serde_snapshot
* move call to accounts_db.generate_index() back down to context_accountsdb_from_stream()
* update version 1.1.1 to 1.2.0
remove nested use of serialize_bytes
* cleanups
* Add back measurement of account storage entry serialization.
Remove construction of Vec and HashMap temporaries during serialization.
* consolidate serialisation test cases into serde_snapshot.
clean up leakage of implementation details in serde_snapshot.
* move short term / legacy snapshot code into child module
* add serialize_iter_as_tuple
* preliminary integration of following commit
commit 6d58b73c47294bfb93465d5a83cd2175660b6e6d
Author: Ryo Onodera <ryoqun@gmail.com>
Date: Wed May 20 14:02:02 2020 +0900
Confine snapshot 1.1 relic to versioned codepath
* refactored serde_snapshot, rustfmt
legacy accounts_db format now "owns" both leading u64s, legacy bank_rc format has none
* reduce type complexity (clippy)
2020-05-23 02:54:24 +09:00
12a3b1ba6a
Fixup deserialize_bs58_transaction, and make a few error types more targeted ( #10171 )
...
automerge
2020-05-21 17:30:02 -07:00
18be7a7966
REST API now returns supply in SOL rather than lamports ( #10170 )
...
automerge
2020-05-21 15:50:06 -07:00
486168b796
Revert "Add AVX2 runtime checks ( #10033 )" ( #10167 )
...
This reverts commit cf8eb7700b
2020-05-21 13:13:52 -07:00
10d60288e8
Update default subscription commitment level from recent to single ( #10161 )
...
* Update default subscription commitment level from recent to single
* Update jsonrpc docs
* Fix failing tests
2020-05-22 00:33:24 +08:00
324cfd40f0
Add v0 REST APIs for circulating and total supply ( #10102 )
2020-05-20 20:04:07 -07:00
ce17de7d25
Add option to wait for a specific epoch length to bench-tps ( #10083 )
2020-05-20 16:42:46 -07:00
417f0e41fa
Add stake-o-matic ( #10044 )
...
automerge
2020-05-20 16:15:03 -07:00
ad7b113944
Ignore test_tvu_exit ( #10134 )
...
automerge
2020-05-19 23:40:27 -07:00
d9919b99d2
Remove folds ( #10128 )
...
automerge
2020-05-19 18:13:41 -07:00
439fd30840
Fix erasure ( #10095 )
...
* Fix bad FEC blocks
* Add test
Co-authored-by: Carl <carl@solana.com>
2020-05-19 16:13:12 -07:00
97f2bcff69
master: Add nonce to shreds repairs, add shred data size to header ( #10109 )
...
* Add nonce to shreds/repairs
* Add data shred size to header
Co-authored-by: Carl <carl@solana.com>
2020-05-19 12:38:18 -07:00
427c78d891
Add SimulateTransaction RPC endpoint ( #10106 )
...
automerge
2020-05-19 12:08:19 -07:00
759c0e0b03
Update accounts whitelist ( #10100 )
2020-05-18 14:17:56 -06:00
bac4aec16f
Trigger RPC notifications after block commitment cache update ( #10077 )
...
* Fixup commitment-aggregation metric
* Trigger notifications after commitment-cache update
* Fixup fn name
* Add single-confirmation commitment level
* Rename to highest_confirmed_slot
* Pass commitment-cache info directly to notifications
* Use match
* Update commitment docs
* Update out of date pubsub docs
2020-05-18 12:49:01 -06:00
bfcfbab818
Add Vote PubSub endpoint for live gossip votes. ( #10045 )
...
* Add Vote PubSub endpoint for live gossip votes.
* Updated tests for Vote RPC and Vote Listener
* Add JSON RPC documentation for Vote RPC.
* Base58 encode hash in Vote RPC response.
2020-05-17 15:01:08 -06:00
f562ed4cc8
Distinguish between shred type in shred fetch stage duplicate filter ( #10068 )
...
* Shred type check
* Test
2020-05-15 13:23:56 -07:00
58ef02f02b
9951 clippy errors in the test suite ( #10030 )
...
automerge
2020-05-15 09:35:43 -07:00
1da1667920
Forge a confirmed root before halting for RPC inspection ( #10061 )
2020-05-15 09:02:48 -07:00
eb1acaf927
Remove archiver and storage program ( #9992 )
...
automerge
2020-05-14 18:22:47 -07:00
4e4a21f9b7
`solana-gossip spy` can now specify a shred version ( #10040 )
2020-05-13 19:37:40 -07:00
cf8eb7700b
Add AVX2 runtime checks ( #10033 )
...
automerge
2020-05-13 12:19:22 -07:00
1eb40c3fe0
Introduce eager rent collection ( #9527 )
...
* Switch AccountsIndex.account_maps from HashMap to BTreeMap
* Introduce eager rent collection
* Start to add tests
* Avoid too short eager rent collection cycles
* Add more tests
* Add more tests...
* Refacotr!!!!!!
* Refactoring follow up
* More tiny cleanups
* Don't rewrite 0-lamport accounts to be deterministic
* Refactor a bit
* Do hard fork, restore tests, and perf. mitigation
* Fix build...
* Refactor and add switch over for testnet (TdS)
* Use to_be_bytes
* cleanup
* More tiny cleanup
* Rebase cleanup
* Set Bank::genesis_hash when resuming from snapshot
* Reorder fns and clean ups
* Better naming and commenting
* Yet more naming clarifications
* Make prefix width strictly uniform for 2-base partition_count
* Fix typo...
* Revert cluster-dependent gate
* kick ci?
* kick ci?
* kick ci?
2020-05-13 16:22:14 +09:00
ee7f15eff1
Rpc: optionally filter getLargestAccounts by circulating/nonCirculating ( #10007 )
...
* Add circ/non-circ filter to getLargestAccounts
* Plumb largest accounts into client and cli
* Bump timeout toward CI flakiness
* Update docs
2020-05-12 21:05:05 -06:00
a9b82cf95b
Enable disk metrics ( #10009 )
2020-05-12 15:24:39 -07:00
59de1b3b62
Compute Switch Threshold ( #9218 )
...
* Add switching threshold check
Co-authored-by: Carl <carl@solana.com>
2020-05-11 22:20:11 -07:00
84b6120983
getClusterNodes RPC API now includes the node software version ( #9990 )
2020-05-11 21:30:01 -07:00
2521f75c18
Advertise node software version in gossip ( #9981 )
...
* Advertise node version in gossip
* Remove solana_clap_utils::version! macro
2020-05-11 15:02:01 -07:00
965204b8e0
Check slot cleaned up for RPC blockstore/slot queries ( #9982 )
...
automerge
2020-05-11 14:47:40 -07:00
903a8a3196
Add retransmit packets_by_slot metrics ( #9975 )
2020-05-11 13:49:10 -07:00
1a47b1cd86
Retransmit and shred fetch metrics ( #9965 )
...
* Retransmit stats
* Shred fetch stats
2020-05-10 21:37:05 -07:00
288c9751c1
Bump serde from 1.0.106 to 1.0.110 ( #9964 )
...
* Bump serde from 1.0.106 to 1.0.110
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.106 to 1.0.110.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.106...v1.0.110 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2020-05-10 16:24:25 -07:00
0541431ea8
Bump serde_json from 1.0.52 to 1.0.53 ( #9957 )
...
* Bump serde_json from 1.0.52 to 1.0.53
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.52 to 1.0.53.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.52...v1.0.53 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2020-05-10 11:46:29 -07:00
3ee702a922
Rpc: Add getCirculatingSupply endpoint, redux ( #9953 )
...
* Add Bank.clock() helper
* Add non-circulating calculations
* Plumb getSupply rpc endpoint
* Add docs for getSupply, and remove getTotalSupply from docs
* Add pubkeys! procedural macro
* Use procedural macro in non_circulating_supply
2020-05-09 12:05:29 -06:00
f98bfda6f9
Security changes ( #9923 )
...
* Move test-only functions to test modules
* Remove sigverify disable
* Remove chacha CTR code
2020-05-08 10:00:23 -07:00
01ab1d1369
Add metrics for logging time taken in replaystage steps ( #9933 )
...
automerge
2020-05-08 03:46:29 -07:00
e970c58330
Properly handle ancestor/descendant maps ( #9932 )
...
* Account for descendants < root not existing in BankForks, purge ancestors/descendants map for consistency with BankForks and progress map
Co-authored-by: Carl <carl@solana.com>
2020-05-07 23:39:57 -07:00
754c65c066
Refactor RPC subscriptions account handling ( #9888 )
...
* Switch subscriptions to use commitment instead of confirmations
* Add bank method to return account and last-modified slot
* Add last_modified_slot to subscription data and use to filter account subscriptions
* Update tests to non-zero last_notified_slot
* Add accounts subscriptions to test; fails at higher tx load
* Pass BankForks to RpcSubscriptions
* Use BankForks on add_account_subscription to properly initialize last_notified_slot
* Bundle subscriptions
* Check for non-equality
* Use commitment to initialize last_notified_slot; revert context.slot chage
2020-05-07 00:23:06 -06:00
445e6668c2
Fix ( #9896 )
...
Co-authored-by: Carl <carl@solana.com>
2020-05-06 11:44:49 -07:00
09ae61651a
Eliminate BankForksInfo ( #9887 )
2020-05-06 08:24:59 -07:00
16ddd001f6
Gossip no longer pushes/pulls from nodes with a different shred version ( #9868 )
2020-05-05 20:15:19 -07:00
72312ad615
Avoid holding the entire rooted path while loading bank forks ( #9885 )
2020-05-05 19:45:41 -07:00
3442f36f8a
Repair alternate versions of dead slots ( #9805 )
...
Co-authored-by: Carl <carl@solana.com>
2020-05-05 14:07:21 -07:00
627bc7e3a9
Rpc: Filter blockstore data by cluster-confirmed root ( #9873 )
...
automerge
2020-05-04 18:39:27 -07:00
f5b0d13f08
Rpc: add getLargestAccounts endpoint ( #9869 )
...
automerge
2020-05-04 16:46:10 -07:00
6deaf649ef
Add commitment Root variant, and add fleshed out --commitment arg to Cli ( #9806 )
...
automerge
2020-04-29 21:55:33 -07:00
a91236012d
Pass around --max-genesis-archive-unpacked-size ( #9161 )
...
automerge
2020-04-29 18:53:34 -07:00
a0514eb2ae
thiserror, docs, remove general Failure case ( #9741 )
...
automerge
2020-04-29 18:12:51 -07:00
230df0ec0c
Upgrade to Rust 1.43.0 ( #9754 )
2020-04-29 18:02:05 -07:00
efb4988d10
Rpc: remove unwraps ( #9793 )
...
automerge
2020-04-29 12:06:09 -07:00
eb24f3df84
Update dalek version
2020-04-28 21:02:47 -06:00
9d91cca73c
Remove commented code
2020-04-28 15:47:41 -06:00
655e3bc418
Rpc: Use cluster largest_confirmed_root as commitment max ( #9750 )
...
automerge
2020-04-28 10:20:43 -07:00
a12428a5b8
Use Blockstore lowest_slot to start root iterator ( #9738 )
2020-04-28 10:22:10 -06:00
193dbb1794
sanitize lowest slots ( #9747 )
2020-04-27 20:22:30 -07:00
c11abf88b7
Clean up `use` to keep rust 1.43.0 from complaining ( #9740 )
2020-04-27 16:54:11 -07:00
8ef097bf6f
Input values are not sanitized after they are deserialized, making it far too easy for Leo to earn SOL ( #9706 )
...
* sanitize gossip protocol messages
* sanitize transactions
* crds protocol sanitize
2020-04-27 11:06:00 -07:00
a7f33b5014
Cache banks in BankForks until optional largest_confirmed_root ( #9678 )
...
automerge
2020-04-24 15:49:57 -07:00
d7f37a703e
Bump jsonrpc-derive from 14.0.5 to 14.1.0 ( #9702 )
...
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc ) from 14.0.5 to 14.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/jsonrpc-derive-v14.0.5...v14.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-24 15:24:18 -07:00
c92f95e0b8
Bump jsonrpc-ws-server from 14.0.6 to 14.1.0 ( #9701 )
...
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc ) from 14.0.6 to 14.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/ipc-14.0.6...v14.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-24 15:24:07 -07:00
fa20963b93
Revert shred fs ( #9712 )
...
* Revert "Untar is called for shred archives that do not exist. (#9565 )"
This reverts commit 729cb5eec6#9366 )"
This reverts commit 5ed39de8c5
2020-04-24 15:04:23 -07:00
76b1c2baf0
One less alloc per transaction ( #9705 )
...
* One less alloc per transaction
* Fix benches
* Fix compiler warnings in bench build
* Fix move build
* Fix bench
2020-04-24 13:03:46 -06:00
767a0f9384
Fix comment in serve_repair ( #9703 )
...
automerge
2020-04-24 10:00:23 -07:00
79829c98db
Fix vote listener passing bad transactions ( #9694 )
2020-04-23 17:04:09 -07:00
d2cef8ed9b
Bump num_cpus from 1.12.0 to 1.13.0 ( #9682 )
...
* Bump num_cpus from 1.12.0 to 1.13.0
Bumps [num_cpus](https://github.com/seanmonstar/num_cpus ) from 1.12.0 to 1.13.0.
- [Release notes](https://github.com/seanmonstar/num_cpus/releases )
- [Changelog](https://github.com/seanmonstar/num_cpus/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/num_cpus/compare/v1.12.0...v1.13.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2020-04-23 13:08:06 -07:00
17a8b0f783
Bump jsonrpc-core-client from 14.0.5 to 14.1.0 ( #9683 )
...
Bumps [jsonrpc-core-client](https://github.com/paritytech/jsonrpc ) from 14.0.5 to 14.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/jsonrpc-core-client-v14.0.5...v14.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-23 13:07:50 -07:00
d1cbccd9ba
solana-dos can now DoS gossip nodes ( #9652 )
...
automerge
2020-04-23 11:46:12 -07:00
5d2f488004
Add getLowestNonpurgedBlock rpc; use blockstore api in getConfirmedBlocks ( #9656 )
...
automerge
2020-04-22 13:33:06 -07:00
d5abff82e0
Add largest_confirmed_root to BlockCommitmentCache ( #9640 )
...
* Add largest_confirmed_root to BlockCommitmentCache
* clippy
* Add blockstore to BlockCommitmentCache to check root
* Add rooted_stake helper fn and test
* Nodes that are behind should correctly id confirmed roots
* Simplify rooted_stake collector
2020-04-22 12:22:09 -06:00
08e73e5366
Bump jsonrpc-http-server from 14.0.6 to 14.1.0 ( #9628 )
...
automerge
2020-04-22 09:21:05 -07:00
2e8349196e
Custom epochslots debug ( #9647 )
2020-04-22 08:55:08 -07:00
2a935ec15f
Bump jsonrpc-pubsub from 14.0.6 to 14.1.0 ( #9649 )
...
Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc ) from 14.0.6 to 14.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/ipc-14.0.6...v14.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-04-22 07:49:35 -07:00
bab3502260
Push down cluster_info lock ( #9594 )
...
* Push down cluster_info lock
* Rework budget decrement
Co-authored-by: Carl <carl@solana.com>
2020-04-21 12:54:45 -07:00
ad186b8652
Flag test_tvu_exit as serial to hopefully reduce CI flakiness ( #9509 )
2020-04-21 12:54:16 -07:00
3023691487
RPC: Allow single slot address history queries ( #9630 )
2020-04-22 01:08:06 +08:00
64e5684d45
Bump bs58 from 0.3.0 to 0.3.1
...
Bumps [bs58](https://github.com/mycorrhiza/bs58-rs ) from 0.3.0 to 0.3.1.
- [Release notes](https://github.com/mycorrhiza/bs58-rs/releases )
- [Commits](https://github.com/mycorrhiza/bs58-rs/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-04-21 08:07:00 -07:00
18cba86f77
Wait for supermajority of cluster to have rooted a transaction to consider it finalized ( #9618 )
...
* Add rooted stake to BlockCommitment
* Use rooted stake to include cluster check
2020-04-20 23:25:49 -06:00
914b022663
cli: Add transaction-history ( #9614 )
...
automerge
2020-04-20 22:01:09 -07:00
8a69ea971f
test
2020-04-20 08:44:39 -07:00
b1ca74ed30
Bump regex from 1.3.6 to 1.3.7
...
Bumps [regex](https://github.com/rust-lang/regex ) from 1.3.6 to 1.3.7.
- [Release notes](https://github.com/rust-lang/regex/releases )
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/regex/compare/1.3.6...regex-1.3.7 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-04-20 08:02:22 -07:00
77fb4230d6
Calculate distance between u64 without overflow ( #9592 )
...
* fix overflow
* fixed num_live_peers overflow
2020-04-19 23:05:26 -07:00
1607891b29
log proper slot ( #9576 )
...
Co-authored-by: Carl <carl@solana.com>
2020-04-19 14:24:45 -07:00
65a9658b13
Budget for gossip traffic ( #9550 )
2020-04-18 22:11:17 -07:00
a7aa7e172b
validator: Consider the activated stake of this node to be online again ( #9573 )
...
automerge
2020-04-18 10:16:19 -07:00
cb0a1a94a7
Bump jsonrpc-core from 14.0.5 to 14.1.0
...
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc ) from 14.0.5 to 14.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-04-17 20:06:15 -07:00
8509dcb8a0
Report offline/wrong-shred nodes while waiting for a super majority in gossip
2020-04-17 13:32:19 -07:00
7b5cdf6adf
Reduce ReceiveUpdates log spam
2020-04-17 13:32:19 -07:00
55ed52a71d
Increase the number of JSON RPC service threads ( #9551 )
...
automerge
2020-04-17 12:37:33 -07:00
b58338b066
Make rpc_subscriptions.rs tests serial ( #9556 )
...
automerge
2020-04-17 10:48:39 -07:00
e655cba5bd
Make rpc tests serial ( #9537 )
2020-04-16 22:02:55 -07:00
bcfd379f32
Simplify EpochSlots update ( #9545 )
...
Co-authored-by: Carl <carl@solana.com>
2020-04-16 19:32:19 -07:00
47ae57610a
Only build x86_64-unknown-linux-gnu on docs.rs
2020-04-16 19:06:17 -07:00
5ed39de8c5
Dont insert shred payload into rocksdb ( #9366 )
...
automerge
2020-04-16 18:20:55 -07:00
66abe45ea1
Decouple accounts hash calculation from snapshot hash ( #9507 )
2020-04-16 15:12:20 -07:00
7aa4d401f7
Fix broadcast metrics ( #9461 )
...
* Rework broadcast metrics to support multiple threads
* Update dashboards
Co-authored-by: Carl <carl@solana.com>
2020-04-15 15:22:16 -07:00
a8b8c2f438
Move slow compaction test to integration ( #9506 )
2020-04-15 11:54:03 -07:00
241a05fc52
Add native loader entry points ( #9486 )
2020-04-15 09:41:29 -07:00
40737e9efa
Add health check URI
2020-04-15 09:06:24 -07:00
69f1e487b3
Reduce cluster-info metrics. ( #9465 )
2020-04-14 21:21:58 -07:00
83a96c557d
Ensure --dynamic-port-range is wide enough
2020-04-14 12:21:05 -07:00
8cda974552
Fix flaky new_archiver_external_ip_test ( #9457 )
...
automerge
2020-04-12 11:49:34 -07:00
3037eb8d4f
Remove slot field, add test ( #9444 )
...
Co-authored-by: Carl <carl@solana.com>
2020-04-10 23:52:37 -07:00
aa8dfac313
Simplify vote simulation ( #9435 )
...
Co-authored-by: Carl <carl@solana.com>
2020-04-10 15:16:12 -07:00
ae5a6419d4
ReceiveUpdates spams the log, adjust the threshold higher ( #9429 )
2020-04-10 10:21:46 -07:00
85feca305b
Avoid port conflict in new_with_external_ip_test_gossip
2020-04-09 20:27:54 -07:00
91159ea8e3
Rpc: Add getConfirmedSignaturesForAddress ( #9407 )
...
automerge
2020-04-09 20:21:31 -07:00
d5a9ee97f2
Add --allow-dead-slots argument to `slot`/`print`/`json` commands ( #9408 )
...
automerge
2020-04-09 20:10:51 -07:00
900933bbcc
Reduce rpc test code ( #9413 )
...
automerge
2020-04-09 18:05:56 -07:00
be77bdef12
Allow lower shred count ( #9410 )
2020-04-09 16:36:44 -07:00
f3afe5c99c
Remove dead code ( #9404 )
...
automerge
2020-04-09 13:09:59 -07:00
e1aa247548
Rpc: Add getConfirmedTransaction ( #9381 )
...
* Add blockstore method to return a complete transaction by signature
* Plumb getConfirmedTransaction rpc
* Add doc
2020-04-09 00:57:30 -06:00
ad0482be73
Revert "Add native loader entry points ( #9275 )" Breaks genesis_config abi ( #9377 )
...
This reverts commit ed86d8d1fc
2020-04-08 14:36:18 -07:00
4522e85ac4
Add Metrics/Dashboards tracking block production ( #9342 )
...
* Add metric tracking blocks/dropped blocks
Co-authored-by: Carl <carl@solana.com>
2020-04-08 14:35:24 -07:00
36e73cada4
Add blockstore address-to-signature index ( #9367 )
...
automerge
2020-04-08 12:50:39 -07:00
4677cdb4c2
Optimize broadcast cluster_info critical section ( #9327 )
2020-04-06 17:36:22 -07:00
96c23110ae
Make TestValidator mint_lamports configurable ( #9337 )
...
automerge
2020-04-06 16:20:55 -07:00
62cb2cd13c
Bump serde_json from 1.0.49 to 1.0.51
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.49 to 1.0.51.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.49...v1.0.51 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-04-06 08:40:55 -07:00
acf64f8476
Update getSignatureStatuses to return historical statuses ( #9314 )
...
automerge
2020-04-06 03:04:54 -07:00
b28ec430e4
Introduce background stale AppendVec shrink mechanism ( #9219 )
...
* Introduce background AppendVec shrink mechanism
* Support ledger tool
* Clean up
* save
* save
* Fix CI
* More clean up
* Add tests
* Clean up yet more
* Use account.hash...
* Fix typo....
* Add comment
* Rename accounts_cleanup_service
2020-04-06 17:30:23 +09:00
7b68628e6c
Remove write lock ( #9311 )
...
* Remove write lock
Co-authored-by: Carl <carl@solana.com>
2020-04-05 15:18:45 -07:00
Kristofer Peterson
Greg Fitzgerald
Justin Starry
sakridge
publish-docs.sh
carllin
dependabot-preview[bot]
Ryo Onodera
anatoly yakovenko
R. M. Shea
Jack May
Michael Vines
Tyera Eulberg
Reisen
Trent Nelson
Ryo Onodera
Tyera Eulberg
Leopold Schabel
Anatoly Yakovenko