Sagar Dhawan
b1ac8f933b
Fix storage program space issues and limit storage transaction data ( #4677 )
2019-06-13 17:53:54 -07:00
Michael Vines
8628f33d0b
Fix HostId field in the testnet dashboard
2019-06-13 16:09:09 -07:00
carllin
8c1b9a0b67
Data plane verification ( #4639 )
...
* Add signature to blob
* Change Signable trait to support returning references to signable data
* Add signing to broadcast
* Verify signatures in window_service
* Add testing for signatures to erasure
* Add RPC for getting current slot, consume RPC call in test_repairman_catchup for more deterministic results
2019-06-12 16:43:05 -07:00
Michael Vines
d807217be7
Simplify and camelCase getEpochVoteAccounts RPC API ( #4658 )
...
* Simplify and camelCase getEpochVoteAccounts RPC API
* Set a commission for testing
2019-06-12 14:12:08 -07:00
Sagar Dhawan
8019bff391
Fixes for storage program and rework storage stage ( #4654 )
...
automerge
2019-06-11 18:27:47 -07:00
Rob Walker
697228a484
rpc vote_accounts by ecurrent pocch, not stakers epoch ( #4651 )
2019-06-11 16:57:47 -07:00
Rob Walker
3217a1d70c
use highest staked node as bootstrap leader, remove bootstrap_leader from genesis_block ( #4635 )
...
* use highest staked node as bootstrap leader, remove bootstrap_leader from genesis_block
* clippy
* fixup
* fixup
2019-06-11 11:44:58 -07:00
dependabot-preview[bot]
1d957b6b80
Bump byteorder from 1.3.1 to 1.3.2 ( #4641 )
...
Bumps [byteorder](https://github.com/BurntSushi/byteorder ) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/BurntSushi/byteorder/releases )
- [Changelog](https://github.com/BurntSushi/byteorder/blob/master/CHANGELOG.md )
- [Commits](https://github.com/BurntSushi/byteorder/compare/1.3.1...1.3.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-11 11:21:26 -07:00
Rob Walker
e56430c9fb
make runtime depend on bpf_loader ( #4601 )
...
* make runtime depend on bpf_loader
* remove vote redundancy, move bpf_loader to genesis, export program\! from bpf_loader crate
* move bpf_loader specification into genesis
* bpf tests to use genesis with bpf
* need to avoid depending on programs, except for macros
2019-06-11 10:27:22 -07:00
Michael Vines
e4d8ea11ac
Make lamports_per_signature dynamic based on cluster load ( #4562 )
...
* Make lamports_per_signature dynamic based on cluster load
* Move transaction-fees.md to implemented
2019-06-10 22:18:32 -07:00
carllin
a4035a3c65
Remove record locks and parent locks from accounts ( #4633 )
...
* Revert "Fix parent record locks usage in child banks (#4159 )"
This reverts commit 69eeb7cf08
.
* Revert "Fix DuplicateSignatures caused by races on frozen banks (#3819 )"
This reverts commit 083090817a
.
* Remove unused imports
2019-06-10 22:05:46 -07:00
dependabot-preview[bot]
64d63966c7
Bump jsonrpc crates to 12.0.0 ( #4553 )
...
* Bump jsonrpc-pubsub from 11.0.0 to 12.0.0
Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc ) from 11.0.0 to 12.0.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/commits/v12.0.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* Update all jsonrpc crates
2019-06-10 13:22:57 -06:00
Rob Walker
a18c0e34f4
add activate_stake to stake_api ( #4600 )
2019-06-10 12:17:29 -07:00
Michael Vines
0dbe5ee559
Add chacha-sys crate ( #4620 )
...
* af9ff9c7f9/src/cpu-crypt
* Add chacha-sys crate
* Remove chacha feature
* Remove erasure feature
* Add .gitignore
2019-06-10 07:14:02 -07:00
TristanDebrunner
0c4cb76acf
Add GPU based PoH verification ( #4524 )
...
* Add GPU poh verify
* Switch to single PoH verify function
* Add EntrySlice verify tests with hashes and txs
* Add poh-verify benchmarks
2019-06-08 10:21:43 -06:00
Pankaj Garg
ac6dbf8f04
Broadcast blobs even if the peers have no stake ( #4597 )
2019-06-07 14:12:27 -07:00
carllin
c9d63204eb
Replace unneeded seqcst with relaxed on atomic operations ( #4587 )
2019-06-06 23:53:21 -07:00
Michael Vines
cfab54511b
Ignore bench_banking_stage_multi_accounts ( #4590 )
...
automerge
2019-06-06 21:47:07 -07:00
Pankaj Garg
194491ae96
Removed some dead code ( #4563 )
...
* Removed some dead code
* remove dead code from Replicator
2019-06-06 14:26:12 -07:00
anatoly yakovenko
82df267ec9
s/avalanche/turbine ( #4561 )
...
* s/avalanche/turbine/g
2019-06-06 12:48:40 -07:00
Michael Vines
51aacfe3ca
Use pure-rust reed-solomon-erasure for windows ( #4548 )
2019-06-04 21:49:27 -07:00
Michael Vines
8ec5a47027
Add EntryWriter::write() stub for windows ( #4546 )
2019-06-04 20:15:37 -07:00
carllin
5bd3eb4557
Up number of threads ( #4541 )
2019-06-04 18:01:28 -07:00
dependabot-preview[bot]
e9cb4a12dc
Bump serde_derive from 1.0.91 to 1.0.92 ( #4505 )
...
automerge
2019-06-04 15:48:23 -07:00
Sagar Dhawan
de5cad9211
Add account owner to Storage Accounts ( #4537 )
...
* Add account owner to Storage Accounts
* Fix tests
2019-06-04 14:52:52 -07:00
dependabot-preview[bot]
ce2ce76958
Bump serde from 1.0.91 to 1.0.92 ( #4504 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.91 to 1.0.92.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.91...v1.0.92 )
2019-06-04 14:32:09 -07:00
dependabot-preview[bot]
d77c98530f
Bump libc from 0.2.55 to 0.2.58 ( #4514 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.55 to 0.2.58.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.55...0.2.58 )
2019-06-04 14:31:06 -07:00
Michael Vines
3635a68129
solana-install now compiles for Windows ( #4531 )
...
automerge
2019-06-04 08:51:20 -07:00
Pankaj Garg
70a16e91a5
Randomize avalanche broadcast peer table for each blob ( #4529 )
...
* fix clippy warnings
2019-06-03 20:38:05 -07:00
Sagar Dhawan
a77775cb58
Move validation submissions into its own fn ( #4528 )
...
automerge
2019-06-03 18:27:06 -07:00
Sagar Dhawan
167e15a5ae
Update replicator sampling and proof generation ( #4522 )
...
* Update replicator sampling and proof generation
* Clippy
2019-06-03 17:27:28 -07:00
Rob Walker
c56052ff16
remove from_account from stake_instruction ( #4502 )
2019-06-03 09:04:51 -07:00
Pankaj Garg
3574469052
Add random distribution for avalanche peers ( #4493 )
...
* Add random distribution for avalanche peers
* fix clippy warnings
* bug fixes
* nits
2019-06-01 07:55:43 -07:00
Rob Walker
028e111fbc
remove payer from vote instructions ( #4475 )
2019-05-31 11:45:17 -07:00
Sathish
182096dc1a
Create bank snapshots ( #4244 )
...
* Revert "Revert "Create bank snapshots (#3671 )" (#4243 )"
This reverts commit 81fa69d347
.
* keep saved and unsaved copies of status cache
* fix format check
* bench for status cache serialize
* misc cleanup
* remove appendvec storage on purge
* fix accounts restore
* cleanup
* Pass snapshot path as args
* Fix clippy
2019-05-30 21:31:35 -07:00
Sagar Dhawan
b8aff218e2
Shutdown all services before bailing replicator init ( #4487 )
...
automerge
2019-05-30 14:36:47 -07:00
carllin
045d4d5294
Unignore test test_repairman_catchup ( #4484 )
2019-05-30 13:21:12 -07:00
Michael Vines
39b40dfff8
Remove runtime dependency on storage ( #4480 )
2019-05-30 10:54:28 -07:00
carllin
c82f4a1b6d
Unignore test_repairman_catchup
2019-05-29 21:59:41 -07:00
Michael Vines
7a021dff05
Beautify Cargo.tomls with |cargo tomlfmt| ( #4477 )
2019-05-29 18:30:49 -07:00
carllin
348c2263ba
Remove genesis blockhash ( #4471 )
...
* Remove genesis blockhash
* Remove genesis blockhash from tests
* Fix golden
2019-05-29 17:29:02 -07:00
Pankaj Garg
b5324063f1
Use thread pools for rayon par_iter ( #4473 )
...
* Use thread pools for rayon par_iter
* address review comments
* cleanup
2019-05-29 17:16:36 -07:00
Sagar Dhawan
6ed071c4dd
Fix storage stage operating on empty slots ( #4474 )
...
* Fix storage stage operating on empty slots
* Reduce fn argument count
* Fix tests
2019-05-29 15:01:20 -07:00
sakridge
4404634b14
Coalesce packets better ( #4456 )
2019-05-29 12:17:50 -07:00
Rob Walker
6a1de33138
tighten up packets_to_blobs ( #4464 )
...
* tighten up packets_to_blobs
* missed a test
2019-05-29 10:08:35 -07:00
carllin
534244b322
Fix set_roots to use cached bank parents instead of searching blocktree ( #4466 )
2019-05-29 09:43:22 -07:00
Sagar Dhawan
335dfdc4d5
Fix Gossip skipping push for some values ( #4463 )
...
* Make gossip skip over values from Pruned nodes
* Add test and init blooms to contain the origin
2019-05-28 18:39:40 -07:00
Pankaj Garg
c8a03c7b3d
Save RNG for generating random storage sampling offsets ( #4450 )
...
* Save RNG for generating random storage sampling offsets
* fix clippy
* fix stable-perf
* fix chacha
2019-05-28 14:14:46 -07:00
sakridge
5340800cea
Add some optimizing to ThinClient ( #4112 )
...
Can create a multi-socketed ThinClient which will use request time
from get_recent_blockhash to tune for the best node to talk to.
2019-05-27 20:54:44 -07:00
dependabot-preview[bot]
13c2e50b38
Bump sys-info from 0.5.6 to 0.5.7 ( #4445 )
...
automerge
2019-05-27 20:31:12 -07:00
carllin
65f89d6729
Bump logging level of validator procsesing errors ( #4442 )
2019-05-27 16:19:38 -07:00
Michael Vines
ed6a438c51
v0.16.0
2019-05-26 19:42:15 -07:00
Michael Vines
2adb98a4a0
Ignore flaky test_repairman_catchup ( #4439 )
...
automerge
2019-05-26 12:24:20 -07:00
carllin
aa3c00231a
Fix should_update check to update EpochSlots in gossip ( #4435 )
...
automerge
2019-05-25 06:44:40 -07:00
carllin
d772a27936
Plumb ClusterInfoRepairListener ( #4428 )
...
automerge
2019-05-24 19:20:09 -07:00
Rob Walker
0302f13b97
add datapoint for corrupt vote_account ( #4424 )
2019-05-24 18:34:56 -07:00
Pankaj Garg
1f71d05299
remove copying of forwarded packets ( #4425 )
...
automerge
2019-05-24 17:35:09 -07:00
Sagar Dhawan
4c9b7c9d2b
Submit all incoming proofs as valid ( #4377 )
2019-05-24 14:49:10 -07:00
carllin
cf4bb70d80
Rename id to pubkey in cluster_info_repair_listener ( #4421 )
2019-05-24 04:31:32 -07:00
carllin
57f8a15b96
Fix issues in ClusterInfoRepairListener ( #4418 )
...
* Sort repairmen before shuffling so order is the same across all validators
* Reduce repair redundancy to 1 for now
* Fix local cache of roots so that 1) Timestamps are only updated to acknowledge a repair was sent 2) Roots are updated even when timestamps aren't updated to keep in sync with network
* Refactor code, add test
2019-05-24 00:47:51 -07:00
Michael Vines
cfe5afd34c
_id => _pubkey variable renaming ( #4419 )
...
* wallet: rename *_account_id to *_account_pubkey
* s/from_id/from_pubkey/g
* s/node_id/node_pubkey/g
* s/stake_id/stake_pubkey/g
* s/voter_id/voter_pubkey/g
* s/vote_id/vote_pubkey/g
* s/delegate_id/delegate_pubkey/g
* s/account_id/account_pubkey/g
* s/to_id/to_pubkey/g
* s/my_id/my_pubkey/g
* cargo fmt
* s/staker_id/staker_pubkey/g
* s/mining_pool_id/mining_pool_pubkey/g
* s/leader_id/leader_pubkey/g
* cargo fmt
* s/funding_id/funding_pubkey/g
2019-05-23 23:20:04 -07:00
Michael Vines
94beb4b8c2
More fullnode -> validator renaming ( #4414 )
...
* s/fullnode_config/validator_config/g
* s/FullnodeConfig/ValidatorConfig/g
* mv core/lib/fullnode.rs core/lib/validator.rs
* s/Fullnode/Validator/g
* Add replicator-x.sh
* Rename fullnode.md to validator.md
* cargo fmt
2019-05-23 22:05:16 -07:00
Rob Walker
35e8f966e3
add freeze_lock() and fix par_process_entries() failure to detect self conflict ( #4415 )
...
* add freeze_lock and fix par_process_entries failure to detect self conflict
* fixup
* fixup
2019-05-23 17:35:15 -07:00
Michael Vines
b37d2fde3d
Add storage mining pool ( #4364 )
...
* Add storage mining pool
* Set gossip port
* Add create-storage-mining-pool-account wallet command
* Add claim-storage-reward wallet command
* Create storage account upfront
* Add storage program to genesis
* Use STORAGE_ACCOUNT_SPACE
* Fix tests
* Add wallet commands to create validator/replicator storage accounts
* Add create_validator_storage_account()
* Storage stage no longer implicitly creates a storage account
2019-05-23 14:50:23 -07:00
carllin
6a9e0bc593
Change EpochSlots to use BtreeSet so that serialization/deserialization returns the same order ( #4404 )
...
automerge
2019-05-23 03:50:41 -07:00
carllin
591fd72e0b
Implement listener for serving repairs through Repairman protocol ( #4306 )
...
* Make listener for serving repairs through Repairman protocol
2019-05-23 03:10:16 -07:00
Michael Vines
2ed77b040a
create_genesis_block() now returns a struct ( #4403 )
2019-05-22 20:39:00 -07:00
Pankaj Garg
b8f6c17dee
Don't filter transactions if we are buffering it locally ( #4395 )
...
automerge
2019-05-22 17:54:28 -07:00
Pankaj Garg
36019cb1e3
Tweaks to real PoH based on perf testing ( #4396 )
...
* Some counters for real poh perf analysis
* more metrics
* Comment on CPU affinity change, and reduce hash batch size based on TPS perf
* review comments
2019-05-22 15:54:24 -07:00
Tyera Eulberg
99d2428041
Transaction format changes toward Credit-Only accounts ( #4386 )
...
* Add num_readonly_accounts slice
* Impl programs in account_keys
* Emulate current account-loading functionality using program-account_keys (breaks exchange_program_api tests)
* Fix test
* Add temporary exchange faucet id
* Update chacha golden
* Split num_credit_only_accounts into separate fields
* Improve readability
* Move message field constants into Message
* Add MessageHeader struct and fixup comments
2019-05-22 18:23:16 -04:00
Pankaj Garg
eef2bdf690
Add CPU affinity for PoH service thread ( #4394 )
...
automerge
2019-05-22 14:21:43 -07:00
dependabot[bot]
190656967d
Bump nix from 0.13.0 to 0.14.0 ( #4382 )
...
Bumps [nix](https://github.com/nix-rust/nix ) from 0.13.0 to 0.14.0.
- [Release notes](https://github.com/nix-rust/nix/releases )
- [Changelog](https://github.com/nix-rust/nix/blob/master/CHANGELOG.md )
- [Commits](https://github.com/nix-rust/nix/compare/v0.13.0...v0.14.0 )
Signed-off-by: dependabot[bot] <support@dependabot.com>
2019-05-22 14:07:35 -07:00
sakridge
1d7a758c97
Bump perf libs version to fix out buffer sizing ( #4385 )
2019-05-22 13:00:03 -07:00
Rob Walker
578c2ad3ea
add bank hash to votes ( #4381 )
2019-05-21 21:45:38 -07:00
sakridge
52d453d06f
Reduce broadcast prints ( #4368 )
2019-05-21 17:02:19 -07:00
Sagar Dhawan
c9ba9e4eb7
Add storage space constant ( #4366 )
...
automerge
2019-05-21 11:07:13 -07:00
sakridge
f877fb8c8f
Don't print leader update message unless leader actually updates ( #4365 )
2019-05-21 11:06:56 -07:00
Michael Vines
6374e69a69
Add mining pool wallet commands ( #4360 )
...
automerge
2019-05-21 07:32:38 -07:00
carllin
1a77486f8e
Make RootedSlotsIterator for traversing slots on the root fork ( #4361 )
2019-05-20 23:09:00 -07:00
Rob Walker
ead15d294e
add get_epoch_vote_accounts rpc ( #4317 )
...
* add get_epoch_vote_accounts rpc
* fixups
* documentation and type updates
2019-05-20 22:21:13 -07:00
carllin
f1e5edee14
Modify Roots Column To Support Multiple Roots ( #4321 )
...
* Fix 1) Roots column family to handle storing multiple slots, 2) Store all slots on the rooted path in the roots column family
2019-05-20 19:04:18 -07:00
sakridge
7153abd483
Revert "Performance tweaks ( #4340 )" ( #4350 )
...
* Revert "Performance tweaks (#4340 )"
This reverts commit 55cee5742f
.
* Revert Rc change
2019-05-20 17:48:42 -07:00
Sagar Dhawan
af82b0dce9
Fix sending root slots instead of current slot ( #4354 )
...
automerge
2019-05-20 15:01:55 -07:00
Rob Walker
d4da2fbacd
fix bench warnings ( #4356 )
2019-05-20 14:32:23 -07:00
Rob Walker
86e03a6d1b
support issuing vote instructions from system account ( #4338 )
...
* issue vote instructions from system account
* fixup
* bring back KeypairUtil
2019-05-20 13:32:32 -07:00
Michael Vines
114e2989fa
Improve PoH unit test asserts ( #4351 )
...
automerge
2019-05-20 13:02:44 -07:00
sakridge
7024c73e9b
Revert banking threads increase which seems to be slower in testing. ( #4349 )
2019-05-20 11:42:37 -07:00
Michael Vines
f079a78c5e
Remove fee arg from system_transaction::* ( #4346 )
...
automerge
2019-05-20 10:03:19 -07:00
Michael Vines
6365c4c061
Use cleanup ( #4347 )
2019-05-20 09:58:27 -07:00
sakridge
55cee5742f
Performance tweaks ( #4340 )
...
* Use Rc to prevent clone of Packets
* Fix min => max in banking_stage threads.
Coalesce packet buffers better since a larger batch will
be faster through banking and sigverify.
Deconstruct batches into banking_stage from sigverify since
sigverify likes to accumulate batches but then a single banking_stage
thread will be stuck with a large batch. Maximize parallelism by
creating more chunks of work for banking_stage.
2019-05-20 09:15:00 -07:00
Michael Vines
034eda4546
Fix a couple replicator nits ( #4345 )
...
automerge
2019-05-20 08:55:45 -07:00
Sagar Dhawan
06eb2364f2
Handle missed slots in storage stage ( #4337 )
...
* Handle missed slots in storage stage
* Fix test compile
* Make test use the new missed slot support
2019-05-18 15:24:50 -07:00
Michael Vines
392a39dd54
Poh subsystem cleanup, genesis plumbing, enable real PoH on edge testnet ( #4292 )
...
* Remove unused PohServiceConfig::Step
* Clarify variable name
* Poh::hash() now takes an iteration counter
* man -> max
* Inline functions with single call site
* Move PohServiceConfig into GenesisBlock
* Add plumbing to enable real PoH on testnets
* Batch hashes to improve PoH hash rate
* Ensure a constant hashes_per_tick
* Remove PohEntry mixin field
* Poh/PohEntry no longer maintains tick_height
* Ensure a constant hashes_per_tick
* ci/localnet-sanity.sh: Use real PoH
* Rework Poh/PohService to keep PohRecorder unlocked as much as possible while hashing
2019-05-18 14:01:36 -07:00
Pankaj Garg
9476fe5ce3
Use log levels for datapoint metrics ( #4335 )
...
* Use log levels for datapoint metrics
* address review comments
* fix cyclomatic complexity
2019-05-17 17:34:05 -07:00
Sagar Dhawan
788290ad82
Rework Storage Program to accept multiple proofs per segment ( #4319 )
...
automerge
2019-05-17 14:52:54 -07:00
dependabot[bot]
6b5bcfaa58
Bump libc from 0.2.54 to 0.2.55 ( #4324 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.54 to 0.2.55.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.54...0.2.55 )
Signed-off-by: dependabot[bot] <support@dependabot.com>
2019-05-17 13:24:12 -07:00
sakridge
b114bc3674
Add benchmark for sigverify stage ( #4320 )
2019-05-17 11:09:42 -07:00
Pankaj Garg
b2ce5dc9f5
Adjust log level for counter metrics ( #4323 )
2019-05-17 07:00:06 -07:00
Pankaj Garg
e920191de0
Rate limit metrics per log level ( #4313 )
...
* Rate limit metrics per log level
* fix tests
2019-05-16 22:27:05 -07:00
Rob Walker
39e85a3e53
kill some bs58 ( #4316 )
...
* kill some bs58
* fixup
2019-05-16 21:43:18 -07:00