0fde19239b
Rate limit counter metrics points to one per second ( #5496 )
...
* Rate limit counter metrics points to one per second
* Remove old env var
* Test that metrics counter is incrementing
* Fix typo
2019-08-12 18:15:34 -04:00
771d1a78fd
Bump libc from 0.2.60 to 0.2.61 ( #5491 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.60 to 0.2.61.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.60...0.2.61 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-12 15:39:26 -06:00
a8eb0409b7
Fix gossip messages growing beyond blob size ( #5460 )
...
* fixed bloom filter math
* Add split each pull request into multiple pulls with different filters
* Rework CrdsFilter to generate all possible masks to cover the keyspace
* Limit the bloom sizes such that each pull request is no larger than mtu
2019-08-12 13:51:29 -07:00
1b84092b94
Fix slots_since_snapshot in BankForks.add_root() ( #5489 )
2019-08-12 11:56:03 -07:00
b1d43ace14
Add columns for data and code shreds ( #5461 )
2019-08-12 10:03:57 -07:00
54f4d13350
Validator log filter may now be reconfigured at runtime ( #5473 )
...
* Log filter may now be reconfigured at runtime
* Add RPC API and bash script to reconfigure the log filter
2019-08-10 22:54:46 -07:00
799d3b1575
Bump nix from 0.14.1 to 0.15.0 ( #5488 )
...
Bumps [nix](https://github.com/nix-rust/nix ) from 0.14.1 to 0.15.0.
- [Release notes](https://github.com/nix-rust/nix/releases )
- [Changelog](https://github.com/nix-rust/nix/blob/master/CHANGELOG.md )
- [Commits](https://github.com/nix-rust/nix/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-10 18:48:36 -06:00
5884469d11
count commitable in banking_stage ( #5477 )
2019-08-09 21:14:20 -07:00
ed093f86f9
harmonize percentage members ( #5459 )
...
* harmonize percentage members
* update tests
* update capitalization when burning fees
* verify capitalization in fee burn
* fixup
2019-08-09 13:58:46 -07:00
5b4ee36cfd
Log more socket addresses at validator startup ( #5471 )
2019-08-08 15:38:23 -07:00
4f86c0b74a
Rate limit transaction counters ( #5447 )
...
* Rate limit transaction counters
* @sakridge feedback
* Set default high metrics rate for multinode demo
* Fix tests
* Swap defaults and fix env var tests
* Only set metrics rate if not already set
2019-08-08 17:05:06 -04:00
238aa2133d
Move local_cluster tests into own crate ( #5465 )
2019-08-08 11:04:33 -07:00
8c15214923
Add --dev-halt-at-slot option ( #5453 )
2019-08-08 09:14:30 -07:00
5b51bb27b6
Rpc to return software version ( #5456 )
...
* Add getSoftwareVersion rpc
* Add getSoftwareVersion to doc
* Rename to getVersion and return object
* Update jsonrpc-api.md
2019-08-07 20:06:27 -06:00
6597c71e23
Implement shred erasure recovery and reassembly ( #5444 )
...
* Implement shred erasure recovery and reassembly
* fixes and unit test
* clippy
* review comments, additional tests, and some fixes
* address review comments
* more tests and cleanup
2019-08-07 17:02:49 -07:00
8aa7a851ca
Fix hardlinking across filesystem boundaries ( #5449 )
...
* Fix hardlinking across filesystem boundaries
* create output dir for snapshot tar
2019-08-07 13:12:53 -07:00
be9fa22db7
Bump hashbrown from 0.3.1 to 0.5.0 ( #5450 )
...
Bumps [hashbrown](https://github.com/rust-lang/hashbrown ) from 0.3.1 to 0.5.0.
- [Release notes](https://github.com/rust-lang/hashbrown/releases )
- [Changelog](https://github.com/rust-lang/hashbrown/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/hashbrown/compare/v0.3.1...v0.5.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-07 08:35:54 -06:00
b72c5689c9
Blow away snapshots directory on start ( #5446 )
2019-08-06 21:41:38 -07:00
9dcf3347f5
Refactor status cache and remove complex serialize/deserialize ( #5335 )
...
automerge
2019-08-06 18:47:30 -07:00
3ae9357a36
Bump hashbrown from 0.2.2 to 0.3.1 ( #5381 )
...
Bumps [hashbrown](https://github.com/rust-lang/hashbrown ) from 0.2.2 to 0.3.1.
- [Release notes](https://github.com/rust-lang/hashbrown/releases )
- [Changelog](https://github.com/rust-lang/hashbrown/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/hashbrown/compare/v0.2.2...v0.3.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-06 10:16:18 -06:00
1dbb5c8647
Deserialize snapshots ( #5417 )
...
* Deserialize snapshots
2019-08-05 22:53:19 -07:00
c524d62ce0
Implement coding shred generation ( #5415 )
...
* Implemenet coding shred generation
* address review comments
2019-08-05 16:32:34 -07:00
dd4640e1ed
Revert "Revert "Bump version to 0.18.0-pre1""
...
This reverts commit 42c7d57fc0
2019-08-05 15:55:13 -07:00
42c7d57fc0
Revert "Bump version to 0.18.0-pre1"
...
This reverts commit 14f6d5c82b
2019-08-05 15:53:55 -07:00
efd09ecd37
Revert fork metrics ( #5427 )
...
* Revert "Remove duplicate row (#5419 )"
This reverts commit a81dd80d60#5406 )"
This reverts commit 92e419f1c7
2019-08-05 15:53:36 -07:00
14f6d5c82b
Bump version to 0.18.0-pre1
2019-08-05 15:11:44 -07:00
92e419f1c7
Log fork stake-percentage in metrics, and display ( #5406 )
...
* Log fork stake percentage data
* Add fork stake percentage to dashboard
* Call out parent slot
2019-08-02 19:16:23 -06:00
80bb0158b7
Initial implementation of packet shredder ( #5401 )
...
* Initial implementation of packet shredder
* tests
* clippy
* review comments
2019-08-02 15:53:42 -07:00
eb3991b9ba
Replay stage log message nits ( #5408 )
2019-08-02 10:08:42 -07:00
aee63f15c2
Rename state.tgz to snapshot.tgz to match rpc service
2019-08-02 10:07:29 -07:00
f03e066ec5
Bump log from 0.4.7 to 0.4.8 ( #5382 )
...
Bumps [log](https://github.com/rust-lang/log ) from 0.4.7 to 0.4.8.
- [Release notes](https://github.com/rust-lang/log/releases )
- [Changelog](https://github.com/rust-lang-nursery/log/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/log/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-01 14:31:18 -07:00
f7d3f55566
fix epoch_stakes again ( #5396 )
2019-08-01 14:27:47 -07:00
6cb2040a1b
Snapshot Packaging Service ( #5262 )
...
* Snapshot serialization and packaging
2019-07-31 17:58:10 -07:00
c2fc0f2418
Plumb libra accounts to genesis ( #5333 )
...
* Plumb move_loader to genesis
* Remove core dependency on genesis-programs
2019-07-31 16:10:55 -07:00
9278201198
fix epoch_stakes ( #5355 )
...
* fix epoch_stakes
* fix stake_state to use stakers_epoch
* don't allow withdrawal before deactivation
2019-07-31 15:13:26 -07:00
d09afdbefe
Synchronize and cleanup instruction processor lists ( #5356 )
2019-07-31 14:28:14 -07:00
01d2b4e952
Bump jsonrpc-http-server from 12.1.0 to 13.0.0 ( #5361 )
...
* Bump jsonrpc-http-server from 12.1.0 to 13.0.0
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 12.1.0 to 13.0.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.1.0...v13.0.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* Update all jsonrpc crates to v13.0.0
2019-07-31 14:30:47 -06:00
6d7cb23c61
Add command to create genesis accounts ( #5343 )
2019-07-30 23:43:12 -07:00
bd7e269280
Kill rsync ( #5336 )
...
automerge
2019-07-30 22:43:47 -07:00
b05b42d74d
Reduce max blob size ( #5345 )
...
* Reduce max blob size
* ignore test_star_network_push_rstar_200
2019-07-30 22:15:07 -07:00
af733a678a
Bump serde_derive from 1.0.97 to 1.0.98 ( #5314 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.97 to 1.0.98.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.97...v1.0.98 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-30 21:45:34 -07:00
4a336eb5ff
ValidatorConfig path reform: use Path/PathBuf for paths ( #5353 )
2019-07-30 19:47:24 -07:00
b7e08052ae
Bump serde from 1.0.97 to 1.0.98 ( #5315 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.97 to 1.0.98.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.97...v1.0.98 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-30 19:46:50 -07:00
c78db6a94b
ledger path reform: use Path/PathBuf instead of strings ( #5344 )
2019-07-30 15:53:41 -07:00
7dc5cc26a6
Make max_epoch check in next_leader_at in leader schedule ( #5342 )
2019-07-30 15:51:02 -07:00
d7a2b790dc
Limit the size of gossip push and gossip pull response ( #5348 )
...
* Limit the size of gossip push and gossip pull response
* Remove Default::default
* Rename var
2019-07-30 15:43:17 -07:00
a7a10e12c7
Forward transactions as packets instead of blobs ( #5334 )
...
* Forward transactions as packets instead of blobs
* clippy
2019-07-30 14:50:02 -07:00
8d243221f0
Ignore flaky local cluster tests ( #5347 )
...
* Add logging to local_cluster tests
* Ignore flaky test_leader_failure_4, test_repairman_catchup
And crashing banking benchmarks.
2019-07-30 13:48:46 -07:00
84368697af
Fix metrics when leader does not report metrics ( #5291 )
2019-07-30 16:18:33 -04:00
a642168369
Add move to bench-tps ( #5250 )
2019-07-27 15:28:00 -07:00
b8835312bb
Update cargo.toml files to 0.18.0-pre0 ( #5303 )
2019-07-27 11:42:06 -06:00
aef7bae60d
Let grace ticks to roll over into multiple leader slots ( #5268 )
...
* Let grace ticks to roll over into multiple leader slots
* address review comments
2019-07-26 11:33:51 -07:00
dab7de7496
Add confidence cache to BankForks ( #5066 )
...
* Add confidence cache to BankForks
* Include stake-weighted lockouts in cache
* Add cache test
* Move confidence cache updates to handle_votable_bank
* Prune confidence cache on prune_non_root()
* Spin thread to process aggregate_stake_lockouts
* Add long-running thread for stake_weighted_lockouts computation
2019-07-26 11:27:57 -06:00
349ebec629
Bump serde from 1.0.94 to 1.0.97 ( #5285 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.94 to 1.0.97.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.94...v1.0.97 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-26 07:22:25 -06:00
a233a1c822
Fix poh recorder not flushing virtual ticks immediately ( #5277 )
...
* Fix poh not flushing virtual ticks immediately
* Fix test_would_be_leader_soon
2019-07-25 11:08:44 -07:00
7ee8383e02
Bump serde_derive from 1.0.94 to 1.0.97 ( #5279 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.94 to 1.0.97.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.94...v1.0.97 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-25 06:47:24 -06:00
535df0026d
Fixes for Blocktree space amplification and slot deletion ( #5266 )
...
* Fixes for Blocktree space amplification and slot deletion
2019-07-24 17:28:08 -07:00
937816e67b
Post warning if window service isn't receiving any data ( #5269 )
...
automerge
2019-07-24 12:46:10 -07:00
610a02c518
Bump jsonrpc-ws-server from 12.0.0 to 12.1.0 ( #5261 )
...
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc ) from 12.0.0 to 12.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.0.0...v12.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-24 10:52:44 -06:00
547a7a345f
Add logs to indicate when the leader changes ( #5253 )
2019-07-23 22:19:20 -04:00
81f4fd56c7
Log the repairee pubkey when unable to serve them ( #5222 )
...
automerge
2019-07-22 14:13:29 -07:00
a6302acfd5
Bump jsonrpc-http-server from 12.0.0 to 12.1.0 ( #5211 )
...
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 12.0.0 to 12.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.0.0...v12.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-22 10:34:27 -06:00
0d8f5379a0
Add time units
2019-07-22 08:22:21 -07:00
a07b17b9b5
Drop older slots in the ledger ( #5188 )
...
* Add facility to delete blocktree columns in range
* Add ledger cleanup service
* Add local_cluster test
2019-07-20 13:13:55 -07:00
0958905df8
Bump reqwest from 0.9.18 to 0.9.19 ( #5201 )
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.9.18 to 0.9.19.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.18...v0.9.19 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-19 16:13:34 -06:00
3f54c0f1a6
Update struct order arbitrarily to match rpc output ( #5197 )
2019-07-19 11:45:04 -06:00
4684faa5e8
Bump jsonrpc-core from 12.0.0 to 12.1.0 ( #5143 )
...
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc ) from 12.0.0 to 12.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.0.0...v12.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-19 09:59:56 -07:00
8b69998379
Lower recovery messages ( #5181 )
2019-07-19 09:20:14 -07:00
19e131d710
Bump jsonrpc-derive from 12.0.0 to 12.1.0 ( #5193 )
...
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc ) from 12.0.0 to 12.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.0.0...v12.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-19 07:34:48 -07:00
9fd34cd985
Bump untrusted from 0.6.2 to 0.7.0 ( #5194 )
...
Bumps [untrusted](https://github.com/briansmith/untrusted ) from 0.6.2 to 0.7.0.
- [Release notes](https://github.com/briansmith/untrusted/releases )
- [Commits](https://github.com/briansmith/untrusted/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-19 07:34:04 -07:00
adfb8ff2a1
Add getEpochInfo() and getLeaderSchedule() RPC methods ( #5189 )
...
* Add getLeaderSchedule() RPC method
* Add getEpochInfo() RPC method
* Add JSON RPC docs
2019-07-19 07:31:18 -07:00
afa05acb32
more replay_stage grooming ( #5163 )
2019-07-18 14:54:27 -07:00
a3a91ba222
Fix misleading variable name ( #5176 )
...
automerge
2019-07-18 14:07:32 -07:00
751b54b60b
Skip sleeping in replay stage if a bank was recently processed ( #5161 )
...
* Skip sleeping in replay stage if a bank was recently processed
* Remove return
2019-07-18 12:04:53 -07:00
6ad9dc18d8
Add ability to prune ledger ( #5128 )
...
* Add utility to prune the ledger
* Add tests
* Fix clippy
* Fix off by one
* Rework to force delete every column
* Minor fixup
2019-07-17 14:42:29 -07:00
027ebb6670
no more OUT_DIR ( #5139 )
...
* no more OUT_DIR
* no more OUT_DIR
* more information about failure
2019-07-17 14:27:58 -07:00
0ffd91df27
groom poh_recorder ( #5127 )
...
* groom poh_recorder
* fixup
* nits
* slot() from the outside means "the slot the recorder is working on"
* remove redundant check
* review comments, put next_tick back in the "is reset" check
* remove redundant check
2019-07-17 14:10:15 -07:00
10d85f8366
Add weighted shuffle support for values upto u64::MAX ( #5151 )
...
automerge
2019-07-17 12:44:28 -07:00
bbd0455418
Bump log from 0.4.6 to 0.4.7 ( #5144 )
...
Bumps [log](https://github.com/rust-lang/log ) from 0.4.6 to 0.4.7.
- [Release notes](https://github.com/rust-lang/log/releases )
- [Changelog](https://github.com/rust-lang-nursery/log/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/log/compare/0.4.6...0.4.7 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-17 09:25:57 -06:00
f88c72c41e
stress tweaks ( #5140 )
2019-07-16 22:04:40 -07:00
94db9cd412
Reduce banking_stage bench copy-paste code and fix programs bench ( #4926 )
2019-07-16 18:28:18 -07:00
bf5bce50a4
Fix stake pruning test ( #5124 )
2019-07-16 13:20:03 -04:00
fe87c05423
fix transaction_count ( #5110 )
...
* fix transaction_count
* add sig count to bank hash
2019-07-15 13:42:59 -07:00
40faaef9da
Revert "Logging ( #5017 )" ( #5096 )
...
This reverts commit b50a3bae72
2019-07-14 18:48:15 -07:00
0d27515d09
tmp dirs target to farf ( #5079 )
2019-07-12 18:28:42 -07:00
1c966aac25
Facility to generate a blocktree prune list using ledger tool ( #5041 )
...
automerge
2019-07-12 16:58:13 -07:00
7aecb87bce
Add a version field to blobs ( #5057 )
2019-07-12 13:43:19 -07:00
ebcdc06dc3
Restore ledger-tool print and json commands ( #5048 )
...
* Restore ledger-tool print and json commands
* Remove obsolete read_ledger()
2019-07-11 20:33:36 -07:00
0a36a78133
Fix replicator segment selection ( #5046 )
2019-07-11 18:31:41 -07:00
5698d48dc8
merkle-tree: Make instantiation a little less painful ( #5037 )
...
automerge
2019-07-11 15:15:08 -07:00
4c90898f0b
Dynamic erasure set configuration ( #5018 )
...
* Use local erasure session to create/broadcast coding blobs
* Individual session for each recovery (as the config might be different)
* address review comments
* new constructors for session and coding generator
* unit test for dynamic erasure config
2019-07-11 13:58:33 -07:00
b2c776eabc
Fix getProgramAccounts RPC ( #5024 )
...
* Use scan_accounts to load accounts by program_id
* Add bank test
* Use get_program_accounts in RPC
2019-07-11 12:58:28 -06:00
e4926e4110
Set exit when replicator run exits ( #5016 )
2019-07-10 16:27:18 -07:00
b50a3bae72
Logging ( #5017 )
...
* Add logging to replay_stage
* locktower logging
2019-07-10 15:52:31 -07:00
35ec7a5156
Decouple turns from segments in PoRep ( #5004 )
...
* Decouple Segments from Turns in Storage
* Get replicator local cluster tests running in a reasonable amount of time
* Fix unused imports
* Document new RPC APIs
* Check for exit while polling
2019-07-10 13:33:29 -07:00
a383ea532f
Implement new Index Column ( #4827 )
...
* Implement new Index Column
* Correct slicing of blobs
* Mark coding blobs as coding when they're recovered
* Prevent broadcast stages from mixing coding and data blobs in blocktree
* Mark recovered blobs as present in the index
* Fix indexing error in recovery
* Fix broken tests, and some bug fixes
* increase min stack size for coverage runs
2019-07-10 11:08:17 -07:00
f537482c86
remove set_leader from cluster_info ( #4998 )
2019-07-09 22:06:47 -07:00
b8e7736af2
Move SLOTS_PER_SEGMENT to genesis ( #4992 )
...
automerge
2019-07-09 16:48:40 -07:00
f777a1a74c
groom replay_stage and poh_recorder ( #4961 )
...
* groom replay_stage and poh_recorder
* fixup
* fixup
* don't freeze() parent, need to review bank_forks and maybe vote...
2019-07-09 15:36:30 -07:00
22ef3c7c54
Blob verify ( #4951 )
...
* Ensure signable data is not out of range
* Add a broadcast stage that puts bad sizes in blobs
* Resign blob after modifyign size
* Remove assertions that fail when size != meta.size
2019-07-08 18:21:52 -07:00
Justin Starry
dependabot-preview[bot]
Sagar Dhawan
carllin
Pankaj Garg
Michael Vines
Rob Walker
sakridge
Tyera Eulberg
Jack May
Justin Starry
sakridge
Dan Albert
Trent Nelson
Tyera Eulberg
Mark E. Sinclair