Michael Vines
eb3991b9ba
Replay stage log message nits ( #5408 )
2019-08-02 10:08:42 -07:00
Michael Vines
aee63f15c2
Rename state.tgz to snapshot.tgz to match rpc service
2019-08-02 10:07:29 -07:00
dependabot-preview[bot]
f03e066ec5
Bump log from 0.4.7 to 0.4.8 ( #5382 )
...
Bumps [log](https://github.com/rust-lang/log ) from 0.4.7 to 0.4.8.
- [Release notes](https://github.com/rust-lang/log/releases )
- [Changelog](https://github.com/rust-lang-nursery/log/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/log/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-01 14:31:18 -07:00
Rob Walker
f7d3f55566
fix epoch_stakes again ( #5396 )
2019-08-01 14:27:47 -07:00
carllin
6cb2040a1b
Snapshot Packaging Service ( #5262 )
...
* Snapshot serialization and packaging
2019-07-31 17:58:10 -07:00
sakridge
c2fc0f2418
Plumb libra accounts to genesis ( #5333 )
...
* Plumb move_loader to genesis
* Remove core dependency on genesis-programs
2019-07-31 16:10:55 -07:00
Rob Walker
9278201198
fix epoch_stakes ( #5355 )
...
* fix epoch_stakes
* fix stake_state to use stakers_epoch
* don't allow withdrawal before deactivation
2019-07-31 15:13:26 -07:00
Jack May
d09afdbefe
Synchronize and cleanup instruction processor lists ( #5356 )
2019-07-31 14:28:14 -07:00
dependabot-preview[bot]
01d2b4e952
Bump jsonrpc-http-server from 12.1.0 to 13.0.0 ( #5361 )
...
* Bump jsonrpc-http-server from 12.1.0 to 13.0.0
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 12.1.0 to 13.0.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.1.0...v13.0.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* Update all jsonrpc crates to v13.0.0
2019-07-31 14:30:47 -06:00
Jack May
6d7cb23c61
Add command to create genesis accounts ( #5343 )
2019-07-30 23:43:12 -07:00
Michael Vines
bd7e269280
Kill rsync ( #5336 )
...
automerge
2019-07-30 22:43:47 -07:00
Pankaj Garg
b05b42d74d
Reduce max blob size ( #5345 )
...
* Reduce max blob size
* ignore test_star_network_push_rstar_200
2019-07-30 22:15:07 -07:00
dependabot-preview[bot]
af733a678a
Bump serde_derive from 1.0.97 to 1.0.98 ( #5314 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.97 to 1.0.98.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.97...v1.0.98 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-30 21:45:34 -07:00
Michael Vines
4a336eb5ff
ValidatorConfig path reform: use Path/PathBuf for paths ( #5353 )
2019-07-30 19:47:24 -07:00
dependabot-preview[bot]
b7e08052ae
Bump serde from 1.0.97 to 1.0.98 ( #5315 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.97 to 1.0.98.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.97...v1.0.98 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-30 19:46:50 -07:00
Michael Vines
c78db6a94b
ledger path reform: use Path/PathBuf instead of strings ( #5344 )
2019-07-30 15:53:41 -07:00
carllin
7dc5cc26a6
Make max_epoch check in next_leader_at in leader schedule ( #5342 )
2019-07-30 15:51:02 -07:00
Sagar Dhawan
d7a2b790dc
Limit the size of gossip push and gossip pull response ( #5348 )
...
* Limit the size of gossip push and gossip pull response
* Remove Default::default
* Rename var
2019-07-30 15:43:17 -07:00
Pankaj Garg
a7a10e12c7
Forward transactions as packets instead of blobs ( #5334 )
...
* Forward transactions as packets instead of blobs
* clippy
2019-07-30 14:50:02 -07:00
sakridge
8d243221f0
Ignore flaky local cluster tests ( #5347 )
...
* Add logging to local_cluster tests
* Ignore flaky test_leader_failure_4, test_repairman_catchup
And crashing banking benchmarks.
2019-07-30 13:48:46 -07:00
Justin Starry
84368697af
Fix metrics when leader does not report metrics ( #5291 )
2019-07-30 16:18:33 -04:00
sakridge
a642168369
Add move to bench-tps ( #5250 )
2019-07-27 15:28:00 -07:00
Dan Albert
b8835312bb
Update cargo.toml files to 0.18.0-pre0 ( #5303 )
2019-07-27 11:42:06 -06:00
Pankaj Garg
aef7bae60d
Let grace ticks to roll over into multiple leader slots ( #5268 )
...
* Let grace ticks to roll over into multiple leader slots
* address review comments
2019-07-26 11:33:51 -07:00
Tyera Eulberg
dab7de7496
Add confidence cache to BankForks ( #5066 )
...
* Add confidence cache to BankForks
* Include stake-weighted lockouts in cache
* Add cache test
* Move confidence cache updates to handle_votable_bank
* Prune confidence cache on prune_non_root()
* Spin thread to process aggregate_stake_lockouts
* Add long-running thread for stake_weighted_lockouts computation
2019-07-26 11:27:57 -06:00
dependabot-preview[bot]
349ebec629
Bump serde from 1.0.94 to 1.0.97 ( #5285 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.94 to 1.0.97.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.94...v1.0.97 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-26 07:22:25 -06:00
Sagar Dhawan
a233a1c822
Fix poh recorder not flushing virtual ticks immediately ( #5277 )
...
* Fix poh not flushing virtual ticks immediately
* Fix test_would_be_leader_soon
2019-07-25 11:08:44 -07:00
dependabot-preview[bot]
7ee8383e02
Bump serde_derive from 1.0.94 to 1.0.97 ( #5279 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.94 to 1.0.97.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.94...v1.0.97 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-25 06:47:24 -06:00
Sagar Dhawan
535df0026d
Fixes for Blocktree space amplification and slot deletion ( #5266 )
...
* Fixes for Blocktree space amplification and slot deletion
2019-07-24 17:28:08 -07:00
Sagar Dhawan
937816e67b
Post warning if window service isn't receiving any data ( #5269 )
...
automerge
2019-07-24 12:46:10 -07:00
dependabot-preview[bot]
610a02c518
Bump jsonrpc-ws-server from 12.0.0 to 12.1.0 ( #5261 )
...
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc ) from 12.0.0 to 12.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.0.0...v12.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-24 10:52:44 -06:00
Justin Starry
547a7a345f
Add logs to indicate when the leader changes ( #5253 )
2019-07-23 22:19:20 -04:00
Sagar Dhawan
81f4fd56c7
Log the repairee pubkey when unable to serve them ( #5222 )
...
automerge
2019-07-22 14:13:29 -07:00
dependabot-preview[bot]
a6302acfd5
Bump jsonrpc-http-server from 12.0.0 to 12.1.0 ( #5211 )
...
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 12.0.0 to 12.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.0.0...v12.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-22 10:34:27 -06:00
Michael Vines
0d8f5379a0
Add time units
2019-07-22 08:22:21 -07:00
Sagar Dhawan
a07b17b9b5
Drop older slots in the ledger ( #5188 )
...
* Add facility to delete blocktree columns in range
* Add ledger cleanup service
* Add local_cluster test
2019-07-20 13:13:55 -07:00
dependabot-preview[bot]
0958905df8
Bump reqwest from 0.9.18 to 0.9.19 ( #5201 )
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.9.18 to 0.9.19.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.18...v0.9.19 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-19 16:13:34 -06:00
Tyera Eulberg
3f54c0f1a6
Update struct order arbitrarily to match rpc output ( #5197 )
2019-07-19 11:45:04 -06:00
dependabot-preview[bot]
4684faa5e8
Bump jsonrpc-core from 12.0.0 to 12.1.0 ( #5143 )
...
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc ) from 12.0.0 to 12.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.0.0...v12.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-19 09:59:56 -07:00
sakridge
8b69998379
Lower recovery messages ( #5181 )
2019-07-19 09:20:14 -07:00
dependabot-preview[bot]
19e131d710
Bump jsonrpc-derive from 12.0.0 to 12.1.0 ( #5193 )
...
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc ) from 12.0.0 to 12.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.0.0...v12.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-19 07:34:48 -07:00
dependabot-preview[bot]
9fd34cd985
Bump untrusted from 0.6.2 to 0.7.0 ( #5194 )
...
Bumps [untrusted](https://github.com/briansmith/untrusted ) from 0.6.2 to 0.7.0.
- [Release notes](https://github.com/briansmith/untrusted/releases )
- [Commits](https://github.com/briansmith/untrusted/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-19 07:34:04 -07:00
Michael Vines
adfb8ff2a1
Add getEpochInfo() and getLeaderSchedule() RPC methods ( #5189 )
...
* Add getLeaderSchedule() RPC method
* Add getEpochInfo() RPC method
* Add JSON RPC docs
2019-07-19 07:31:18 -07:00
Rob Walker
afa05acb32
more replay_stage grooming ( #5163 )
2019-07-18 14:54:27 -07:00
Sagar Dhawan
a3a91ba222
Fix misleading variable name ( #5176 )
...
automerge
2019-07-18 14:07:32 -07:00
Sagar Dhawan
751b54b60b
Skip sleeping in replay stage if a bank was recently processed ( #5161 )
...
* Skip sleeping in replay stage if a bank was recently processed
* Remove return
2019-07-18 12:04:53 -07:00
Sagar Dhawan
6ad9dc18d8
Add ability to prune ledger ( #5128 )
...
* Add utility to prune the ledger
* Add tests
* Fix clippy
* Fix off by one
* Rework to force delete every column
* Minor fixup
2019-07-17 14:42:29 -07:00
Rob Walker
027ebb6670
no more OUT_DIR ( #5139 )
...
* no more OUT_DIR
* no more OUT_DIR
* more information about failure
2019-07-17 14:27:58 -07:00
Rob Walker
0ffd91df27
groom poh_recorder ( #5127 )
...
* groom poh_recorder
* fixup
* nits
* slot() from the outside means "the slot the recorder is working on"
* remove redundant check
* review comments, put next_tick back in the "is reset" check
* remove redundant check
2019-07-17 14:10:15 -07:00
Sagar Dhawan
10d85f8366
Add weighted shuffle support for values upto u64::MAX ( #5151 )
...
automerge
2019-07-17 12:44:28 -07:00
dependabot-preview[bot]
bbd0455418
Bump log from 0.4.6 to 0.4.7 ( #5144 )
...
Bumps [log](https://github.com/rust-lang/log ) from 0.4.6 to 0.4.7.
- [Release notes](https://github.com/rust-lang/log/releases )
- [Changelog](https://github.com/rust-lang-nursery/log/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/log/compare/0.4.6...0.4.7 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-17 09:25:57 -06:00
Rob Walker
f88c72c41e
stress tweaks ( #5140 )
2019-07-16 22:04:40 -07:00
sakridge
94db9cd412
Reduce banking_stage bench copy-paste code and fix programs bench ( #4926 )
2019-07-16 18:28:18 -07:00
Justin Starry
bf5bce50a4
Fix stake pruning test ( #5124 )
2019-07-16 13:20:03 -04:00
Rob Walker
fe87c05423
fix transaction_count ( #5110 )
...
* fix transaction_count
* add sig count to bank hash
2019-07-15 13:42:59 -07:00
sakridge
40faaef9da
Revert "Logging ( #5017 )" ( #5096 )
...
This reverts commit b50a3bae72
.
2019-07-14 18:48:15 -07:00
Rob Walker
0d27515d09
tmp dirs target to farf ( #5079 )
2019-07-12 18:28:42 -07:00
Pankaj Garg
1c966aac25
Facility to generate a blocktree prune list using ledger tool ( #5041 )
...
automerge
2019-07-12 16:58:13 -07:00
Sagar Dhawan
7aecb87bce
Add a version field to blobs ( #5057 )
2019-07-12 13:43:19 -07:00
Michael Vines
ebcdc06dc3
Restore ledger-tool print and json commands ( #5048 )
...
* Restore ledger-tool print and json commands
* Remove obsolete read_ledger()
2019-07-11 20:33:36 -07:00
Sagar Dhawan
0a36a78133
Fix replicator segment selection ( #5046 )
2019-07-11 18:31:41 -07:00
Trent Nelson
5698d48dc8
merkle-tree: Make instantiation a little less painful ( #5037 )
...
automerge
2019-07-11 15:15:08 -07:00
Pankaj Garg
4c90898f0b
Dynamic erasure set configuration ( #5018 )
...
* Use local erasure session to create/broadcast coding blobs
* Individual session for each recovery (as the config might be different)
* address review comments
* new constructors for session and coding generator
* unit test for dynamic erasure config
2019-07-11 13:58:33 -07:00
Tyera Eulberg
b2c776eabc
Fix getProgramAccounts RPC ( #5024 )
...
* Use scan_accounts to load accounts by program_id
* Add bank test
* Use get_program_accounts in RPC
2019-07-11 12:58:28 -06:00
Sagar Dhawan
e4926e4110
Set exit when replicator run exits ( #5016 )
2019-07-10 16:27:18 -07:00
carllin
b50a3bae72
Logging ( #5017 )
...
* Add logging to replay_stage
* locktower logging
2019-07-10 15:52:31 -07:00
Sagar Dhawan
35ec7a5156
Decouple turns from segments in PoRep ( #5004 )
...
* Decouple Segments from Turns in Storage
* Get replicator local cluster tests running in a reasonable amount of time
* Fix unused imports
* Document new RPC APIs
* Check for exit while polling
2019-07-10 13:33:29 -07:00
Mark E. Sinclair
a383ea532f
Implement new Index Column ( #4827 )
...
* Implement new Index Column
* Correct slicing of blobs
* Mark coding blobs as coding when they're recovered
* Prevent broadcast stages from mixing coding and data blobs in blocktree
* Mark recovered blobs as present in the index
* Fix indexing error in recovery
* Fix broken tests, and some bug fixes
* increase min stack size for coverage runs
2019-07-10 11:08:17 -07:00
Rob Walker
f537482c86
remove set_leader from cluster_info ( #4998 )
2019-07-09 22:06:47 -07:00
Sagar Dhawan
b8e7736af2
Move SLOTS_PER_SEGMENT to genesis ( #4992 )
...
automerge
2019-07-09 16:48:40 -07:00
Rob Walker
f777a1a74c
groom replay_stage and poh_recorder ( #4961 )
...
* groom replay_stage and poh_recorder
* fixup
* fixup
* don't freeze() parent, need to review bank_forks and maybe vote...
2019-07-09 15:36:30 -07:00
carllin
22ef3c7c54
Blob verify ( #4951 )
...
* Ensure signable data is not out of range
* Add a broadcast stage that puts bad sizes in blobs
* Resign blob after modifyign size
* Remove assertions that fail when size != meta.size
2019-07-08 18:21:52 -07:00
Rob Walker
417e8d5064
fix blocktree_processor test_process_entries_stress ( #4967 )
2019-07-08 18:11:58 -07:00
Trent Nelson
1feb9bea21
Harden Merkle Tree against second pre-image attacks ( #4925 )
...
* merkle-tree: Harden against second pre-image attacks
* core/chacha: Bump test golden hash
2019-07-08 19:00:06 -06:00
Trent Nelson
c5ba2e0883
bank_forks test stability ( #4959 )
...
automerge
2019-07-08 15:55:49 -07:00
Rob Walker
eb4edd75e6
make bank commit_credits non public ( #4944 )
...
* make bank commit_credits non pub
* track down create() failure
* move bank_client to process_transaction(), which commits credits
2019-07-08 15:37:54 -07:00
Sagar Dhawan
bb6bcd79c0
Handle replicator errors without panicking ( #4955 )
...
* Handle replicator errors without panicking
* Unwelcome println
2019-07-08 12:43:35 -07:00
Sagar Dhawan
ef7022d638
Refactor replicators to not block on startup ( #4932 )
...
* Refactor replicators to not block on startup
* Ignore setup failure
2019-07-08 10:17:25 -07:00
carllin
2aac094f63
Ensure blobs are deserializable without unwrapping ( #4948 )
...
* Return result from deserializing blobs in blocktree instead of assuming deserialization will succeed
* Mark bad deserialization as dead fork
* Add test for corrupted blobs in blocktree and replay_stage
2019-07-07 14:37:12 -07:00
carllin
fc180f4cbf
Halve stake of malicious validator ( #4937 )
2019-07-05 15:45:39 -07:00
dependabot-preview[bot]
db13b52e6a
Bump serde_json from 1.0.39 to 1.0.40 ( #4881 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.39 to 1.0.40.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.39...v1.0.40 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-03 16:15:56 -06:00
Rob Walker
2ec5d2c7f5
start local_cluster nodes from genesis blocks ( #4928 )
2019-07-03 14:03:52 -07:00
Sagar Dhawan
55b8ff72d0
Enable parallel tests to reduce test time ( #4919 )
...
* Add crate to serialize some tests
* Ignore unused attribute warning
* Enable parallel run in CI
* Try to fix lograte tests
* Fix interdependent counter tests
2019-07-02 17:35:03 -07:00
Rob Walker
12ef0c25b5
change vote commission to u8 (from u32) ( #4887 )
...
automerge
2019-07-02 14:18:11 -07:00
Pankaj Garg
3615445a12
Broadcast run for injecting fake blobs in turbine ( #4889 )
...
* Broadcast run for injecting fake blobs in turbine
* address review comments
* new local cluster test that uses fake blob broadcast
* added a test to make sure tvu_peers ordering is guaranteed
2019-07-01 17:54:03 -07:00
Sagar Dhawan
65adce65fa
Always send pull responses to the origin addr ( #4894 )
2019-07-01 16:49:05 -07:00
carllin
c1953dca8f
Cleanup some of banking stage ( #4878 )
...
* Add committable transactions that cause errors like InstructionErrors back to retryable list on MaxHeightReached
* Remove unnecessary logic
* Add comments/renaming for clarity
2019-07-01 12:14:40 -07:00
Tyera Eulberg
d7ed3b8024
Add RPC api to return program accounts ( #4876 )
...
automerge
2019-06-29 09:59:07 -07:00
sakridge
a89589a1d5
Add Measure abstraction over measuring time intervals ( #4851 )
...
Allows one to swap in different implementations. This provides
the normal Insant::now() -> .elapsed() path.
2019-06-29 15:34:49 +02:00
carllin
75b494d4a3
Lower warn to info, fetch from validator root instead of root + 1 ( #4870 )
...
* Lower warn to info, fetch from validator root instead of root + 1
* b/c -> because
2019-06-28 16:17:20 -07:00
dependabot-preview[bot]
f0191a98ab
Bump serde from 1.0.93 to 1.0.94 ( #4864 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.93 to 1.0.94.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.93...v1.0.94 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-28 15:07:16 -07:00
sakridge
0fa1af5d47
Cleanup num_threads() and batch_limit numbers ( #4852 )
2019-06-28 10:55:24 +02:00
Tyera Eulberg
66552d7047
Credit-Only Accounts: Cache account balance for thread-safe load/store ( #4691 )
...
* Implement CreditOnlyLocks
* Update credit-only atomic on account load
* Update credit-only atomic after bank.freeze_lock; store credits if all credit-only lock references are dropped
* Commit credit-only credits on bank freeze
* Update core to CreditAccountLocks
* Impl credit-only in System Transfer
* Rework CreditAccountLocks, test, and fix bugs
* Review comments: Pass CreditAccountLocks by reference; Tighten up insert block
* Only store credits on completed slot
* Check balance in bench_exchange funding to ensure commit_credits has completed
* Add is_debitable info to KeyedAccount meta to pass into programs
* Reinstate CreditOnlyLocks check on lock_account
* Rework CreditAccountLocks to remove strong_count usage
* Add multi-threaded credit-only locks test
* Improve RwLocks usage
* Review comments: panic if bad things happen; tighter code
* Assert lock_accounts race does not happen
* Revert panic if bad things happen; not a bad thing
2019-06-27 17:25:10 -04:00
dependabot-preview[bot]
979df17328
Bump serde_derive from 1.0.93 to 1.0.94 ( #4856 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.93 to 1.0.94.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.93...v1.0.94 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-27 13:18:19 -07:00
carllin
6cec61dcfc
Re-enable tests ( #4848 )
2019-06-27 12:09:14 -07:00
sakridge
a9b044f0ab
Fix banking_stage benchmark sends ( #4850 )
...
Only one big batch was being sent so only 1
thread active at a time in the benchmark.
2019-06-27 10:37:33 +02:00
sakridge
fbea9d8621
Page-pin packet memory for cuda ( #4250 )
...
* Page-pin packet memory for cuda
Bring back recyclers and pin offset buffers
* Add packet recycler to streamer
* Add set_pinnable to sigverify vecs to pin them
* Add packets reset test
* Add test for recycler and reduce the gc lock critical section
* Add comments/tests to cuda_runtime
* Add recycler to recv_blobs path.
* Add trace/names for debug and PacketsRecycler to bench-streamer
* Predict realloc and unpin beforehand.
* Add helper to reserve and pin
* Cap buffered packets length
* Call cuda wrapper functions
2019-06-27 09:32:32 +02:00
carllin
97c97db97e
Fix early exit clearing all buffered packets ( #4810 )
2019-06-26 22:39:50 -07:00
carllin
9a52b01171
Change to crossbeam channel in banking_threads VerifiedReceiver ( #4822 )
...
* Add crossbeam channel instead of channel in banking_stage
2019-06-26 18:42:27 -07:00
Sagar Dhawan
df1c473341
Add storage point tracking and tie in storage rewards to economics ( #4824 )
...
* Add storage point tracking and tie in storage rewards to epochs and economics
* Prevent validators from updating their validations for a segment
* Fix test
* Retain syscall scoping for readability
* Update Credits to own epoch tracking
2019-06-26 10:40:03 -07:00
Rob Walker
8a64e1ddc3
add fee burning ( #4818 )
2019-06-26 10:13:21 -07:00
dependabot-preview[bot]
eb47538a82
Bump chrono from 0.4.6 to 0.4.7 ( #4812 )
...
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.6 to 0.4.7.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/master/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.6...v0.4.7 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-26 07:58:41 -06:00
Justin Starry
861d6468ca
Stake weighted pruning for the gossip network ( #4769 )
...
* Stake weighted pruning
* Fix compile error
* Fix clippy errors
* Add helper for creating a connected staked network
* Bug fixes and test groundwork
* Small refactor
* Anatoly's feedback and tests
* Doc updates
* @rob-solana's feedback
* Fix test bug and add log trace
* @rob-solana's feedback
2019-06-26 00:30:16 -07:00
carllin
d6737b8cc9
Set epoch schedule in set_root in leader schedule cache ( #4821 )
2019-06-26 00:19:48 -07:00
Trent Nelson
f20ba423ca
Merklize PoH TX mixin hash ( #4644 )
2019-06-25 14:44:27 -06:00
Sathish
9e7f618cff
Set proper count value for account stores ( #4797 )
...
* set count values for store accounts
* Use AppendVecId type
2019-06-25 07:21:45 -07:00
Sagar Dhawan
74a06e4230
Update thinclient to resend the same tx until its blockhash expires ( #4807 )
2019-06-24 16:46:34 -07:00
Pankaj Garg
3f8ff23125
Forward transactions to the leader for next Nth slot ( #4806 )
...
* review comments
2019-06-24 15:56:50 -07:00
anatoly yakovenko
29611fb61d
tower consensus naming ( #4598 )
...
s/locktower/tower/g
2019-06-24 13:41:23 -07:00
Michael Vines
206e62271b
Ignore flaky test_two_unbalanced_stakes ( #4794 )
...
automerge
2019-06-23 20:55:43 -07:00
dependabot-preview[bot]
4e78354ab6
Bump serde_derive from 1.0.92 to 1.0.93 ( #4790 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.92...v1.0.93 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-23 20:23:41 -07:00
dependabot-preview[bot]
0e1480b84e
Bump serde from 1.0.92 to 1.0.93 ( #4791 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.92...v1.0.93 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-23 17:23:41 -07:00
Sagar Dhawan
11992946a4
Add storage reward pools ( #4779 )
2019-06-22 17:18:35 -07:00
Dan Albert
9911942dbd
Increment cargo.toml files to v0.17.0
2019-06-22 04:35:25 +00:00
Trent Nelson
8acbb4ab2f
Bank cap rpc ( #4774 )
...
* core/rpc: Name magic number for minted lamports in tests genesis block
* core/rpc: Expose bank::capitalization() via getSolTotalSupply RPC method
* book: Add entry for getTotalSupply RPC method
2019-06-21 21:00:26 -07:00
Rob Walker
a49f5378e2
rewrite vote credits redemption to eat from rewards_pools on an epoch-sensitive basis ( #4775 )
...
* move redemption to rewards pools
* rewrite redemption, touch a few other things
* re-establish test coverage
2019-06-21 20:43:24 -07:00
Michael Vines
f39e74f0d7
serde the full FeeCalculator ( #4778 )
...
automerge
2019-06-21 17:23:26 -07:00
Sagar Dhawan
22b767308a
Add insturctions to run a replicator on testnet ( #4733 )
2019-06-21 16:32:23 -07:00
Michael Vines
36aa876833
Avoid linking with CUDA directly
2019-06-21 15:26:22 -07:00
carllin
06ba0b7279
Remove holding cluster_info lock while forwarding packets ( #4773 )
2019-06-21 15:21:49 -07:00
Sagar Dhawan
da925142d1
Update replicator ports and silence socket timeout on windows ( #4770 )
...
automerge
2019-06-21 11:28:52 -07:00
dependabot-preview[bot]
deb83cdef6
Bump rayon from 1.0.3 to 1.1.0 ( #4729 )
...
automerge
2019-06-21 09:32:41 -07:00
dependabot-preview[bot]
20db335aed
Bump reqwest from 0.9.17 to 0.9.18
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.9.17 to 0.9.18.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.17...v0.9.18 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-06-21 08:50:49 -07:00
Michael Vines
36c9e22e3d
Revert "Dynamic erasure ( #4653 )"
...
This reverts commit ada4d16c4c
.
2019-06-20 20:53:03 -07:00
Mark E. Sinclair
ada4d16c4c
Dynamic erasure ( #4653 )
...
Remove erasure-related constants
Remove unneeded `Iterator::collect` call
Document erasure module
Randomize coding blobs used for repair
2019-06-20 20:27:41 -05:00
carllin
aacb38864c
Mark dead forks in replay stage ( #4715 )
...
* Add DeadSlots column family
* Filter dead forks from get_slots_since
* Mark erroring slots as dead in replay stage, add test
* Mark dead forks in progress instead of removing them
* Fix logging process_entries failures in replay_stage
* Unignore test_fail_entry_verification_leader
2019-06-20 15:50:41 -07:00
Michael Vines
4a32bc48d2
ignore unstable test_repairman_catchup
2019-06-20 09:24:11 -07:00
Pankaj Garg
9800e09431
Thread pool for par_iter in EntrySlice::verify ( #4732 )
...
* Use thread pool for entry verify par iter
* some performance metrics
* check batch size and use CPU for smaller batches
2019-06-19 16:31:32 -07:00
carllin
61483c18ca
Change seed for retransmit to use blob signature ( #4727 )
...
* Switch seed for retransmit to use blob signature
* Use seed_len
* Use last bytes of signature as seed instead of first bytes
2019-06-19 15:36:06 -07:00
Rob Walker
41fbdc6e08
use stake ( #4721 )
2019-06-19 11:54:52 -07:00
carllin
46bb79df29
Support for custom BroadcastStage in local cluster tests ( #4716 )
...
* Refactor BroadcastStage to support custom implementations, add FailEntryVerificationBroadcastRun implementation
* Plumb switch on broadcast type through validator
* Add test for validator generating non-verifiable entries to local_cluster
* Fix bad initializers
* Refactor broadcast run code into utils
2019-06-19 00:13:19 -07:00
dependabot-preview[bot]
2da7c7fbd3
Bump nix from 0.14.0 to 0.14.1 ( #4642 )
...
automerge
2019-06-18 11:36:26 -07:00
Michael Vines
5683282c94
Update to solana-perf-libs v0.14.0, with support for both CUDA 10.0 and 10.1
2019-06-18 10:41:03 -07:00
Sathish Ambley
8b41a5d725
periodically save config in separate folders
2019-06-17 22:48:27 -07:00
Sathish Ambley
7fd879b417
Restart validator nodes from snapshots
2019-06-17 22:48:27 -07:00
Sathish Ambley
dc5c6e7cf8
validator restart
2019-06-17 22:48:27 -07:00
Michael Vines
feeaad619a
Avoid panic if no rpc peers exist
2019-06-17 19:47:45 -07:00
sakridge
9cafd1f85e
Change check_txs to ignore recv errors and re-enable test ( #4593 )
...
Use more chunks to avoid duplicate signature failures:
Duplicate signatures can occur because bank.clear_signatures()
can occur before the bank has actually committed the signatures
to the status cache and then error out on the next set of transactions.
2019-06-17 19:04:21 -07:00
Sagar Dhawan
cc48773b03
Add "download from replicator" utility ( #4709 )
...
automerge
2019-06-17 18:12:13 -07:00
Sagar Dhawan
8fbf0e2d9f
Update replicators to use the storage blockhash to generate offsets ( #4712 )
2019-06-17 16:39:26 -07:00
Michael Vines
5bf87de136
Add obvious log message indicating CUDA feature state
2019-06-17 11:01:55 -07:00
Michael Vines
97a136ea20
Set rustc-cfg=cuda explicitly, also code cleanup
2019-06-17 11:01:55 -07:00
Rob Walker
4c6a6d63bf
add MiningPools, fund validator MiningPools from inflation ( #4676 )
...
* add MiningPool fund validator MinigPools from inflation
* fixup
* finish rename of MINIMUM_SLOT_LENGTH to MINIMUM_SLOTS_PER_EPOCH
* deterministic miningpool location
* point_value, not credit_value... use f64
2019-06-14 11:38:37 -07:00
Sagar Dhawan
119467df59
Add storage mining pool to genesis and implement automatic reward redeeming ( #4683 )
...
* Add storage mining pool to genesis and implement automatic reward collection
* Address review comments
2019-06-13 22:30:51 -07:00
Sagar Dhawan
b1ac8f933b
Fix storage program space issues and limit storage transaction data ( #4677 )
2019-06-13 17:53:54 -07:00
Michael Vines
8628f33d0b
Fix HostId field in the testnet dashboard
2019-06-13 16:09:09 -07:00
carllin
8c1b9a0b67
Data plane verification ( #4639 )
...
* Add signature to blob
* Change Signable trait to support returning references to signable data
* Add signing to broadcast
* Verify signatures in window_service
* Add testing for signatures to erasure
* Add RPC for getting current slot, consume RPC call in test_repairman_catchup for more deterministic results
2019-06-12 16:43:05 -07:00
Michael Vines
d807217be7
Simplify and camelCase getEpochVoteAccounts RPC API ( #4658 )
...
* Simplify and camelCase getEpochVoteAccounts RPC API
* Set a commission for testing
2019-06-12 14:12:08 -07:00
Sagar Dhawan
8019bff391
Fixes for storage program and rework storage stage ( #4654 )
...
automerge
2019-06-11 18:27:47 -07:00
Rob Walker
697228a484
rpc vote_accounts by ecurrent pocch, not stakers epoch ( #4651 )
2019-06-11 16:57:47 -07:00