Pankaj Garg
ca9d4e34df
Broadcast stage tuning ( #5989 )
2019-09-19 16:29:52 -07:00
dependabot-preview[bot]
5157bdd8ce
Bump jsonrpc-http-server from 13.1.0 to 13.2.0 ( #5975 )
...
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 13.1.0 to 13.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.1.0...v13.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-19 13:10:54 -06:00
Rob Walker
5cbd1190b2
transaction batch ( #5962 )
...
* transaction batch
* fixup
2019-09-19 10:06:08 -07:00
dependabot-preview[bot]
1a71804ef2
Bump bs58 from 0.2.5 to 0.3.0 ( #5974 )
...
Bumps [bs58](https://github.com/mycorrhiza/bs58-rs ) from 0.2.5 to 0.3.0.
- [Release notes](https://github.com/mycorrhiza/bs58-rs/releases )
- [Commits](https://github.com/mycorrhiza/bs58-rs/compare/0.2.5...0.3.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-19 10:39:37 -06:00
dependabot-preview[bot]
e83f6332bf
Bump serde_derive from 1.0.100 to 1.0.101 ( #5945 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.100 to 1.0.101.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.100...v1.0.101 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-18 21:29:40 -07:00
Pankaj Garg
0dbf7995b5
Remove unnecessary serialize of shred data ( #5967 )
...
* Remove unnecessary serialize of shred data
* remove obsolete code
* fix golden hash
2019-09-18 20:08:27 -07:00
Sagar Dhawan
e0858cfe06
Add parallel shred signing to shredder ( #5964 )
2019-09-18 18:00:07 -07:00
Pankaj Garg
783e8672e7
Removed Shred enum ( #5963 )
...
* Remove shred enum and it's references
* rename ShredInfo to Shred
* clippy
2019-09-18 16:24:30 -07:00
Pankaj Garg
6c4e656795
Remove obsoleted code from shred ( #5954 )
...
* Remove obsoleted code from shred
* fix broken test
2019-09-18 13:56:44 -07:00
Sagar Dhawan
b757294864
Add minor performance bump to shredding ( #5956 )
2019-09-18 12:35:52 -07:00
Rob Walker
0d4a2c5eb0
simplify poh recorder => broadcast channel ( #5940 )
...
* simplify poh recorder broadcast channel
* fixup
* fixup
2019-09-18 12:16:22 -07:00
dependabot-preview[bot]
31a276b628
Bump jsonrpc-core from 13.1.0 to 13.2.0 ( #5894 )
...
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc ) from 13.1.0 to 13.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.1.0...v13.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-18 11:44:47 -06:00
dependabot-preview[bot]
75c0a268e0
Bump jsonrpc-derive from 13.1.0 to 13.2.0 ( #5893 )
...
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc ) from 13.1.0 to 13.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.1.0...v13.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-18 10:48:37 -06:00
carllin
2f50d0e145
Refactor confidence from replay stage ( #5938 )
2019-09-17 19:43:40 -07:00
Pankaj Garg
ff608992ee
Replace Shred usage with ShredInfo ( #5939 )
...
* Replace Shred usage with ShredInfo
* Fix tests
* fix clippy
2019-09-17 18:22:46 -07:00
Rob Walker
a2595b44c6
test randomize with error ( #5916 )
...
* test randomize with error
* update magic numbers
* fixup
* fixup
* fixup
* no more blobs
* fixup
2019-09-17 15:11:29 -07:00
Sagar Dhawan
14cb6353c0
Change erasure ratio to 0.25 and increase data shreds to 16 ( #5931 )
...
* Change erasure ratio to 0.25 and increase data shreds to 16
* Fix case where no coding shreds are requested
2019-09-17 11:59:14 -07:00
Michael Vines
e26f68fe62
Get transactions from LockedAccountsResults when possible ( #5923 )
2019-09-17 08:41:56 -07:00
Michael Vines
f10438d530
Respect randomized transaction order when unlocking accounts ( #5918 )
2019-09-16 21:45:16 -07:00
Pankaj Garg
7459eb15c3
A new data-structure in shreds for partial deserialization ( #5915 )
...
* A new datastructure in shreds for partial deserialization
* fix chacha golden hash
* fix clippy and address review comments
2019-09-16 20:28:54 -07:00
Sagar Dhawan
c44e7ce184
Leaders should not broadcast to replicators ( #5917 )
2019-09-16 17:56:34 -07:00
Sagar Dhawan
82615c703b
Switch erasure to solana-reed-solomon-erasure ( #5913 )
...
* Switch to solana-reed-solomon-erasure
* Disable Rayon for solana-reed-solomon-erasure
2019-09-16 16:14:55 -07:00
dependabot-preview[bot]
bc2141fbe0
Bump ureq from 0.11.0 to 0.11.1 ( #5905 )
...
Bumps [ureq](https://github.com/algesten/ureq ) from 0.11.0 to 0.11.1.
- [Release notes](https://github.com/algesten/ureq/releases )
- [Commits](https://github.com/algesten/ureq/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-16 16:51:45 -06:00
carllin
d5ba90d375
Don't verify blobs that are less than root in window service ( #5901 )
2019-09-16 13:13:53 -07:00
Pankaj Garg
5f54573613
More shred related cleanup ( #5909 )
...
* More shred related cleanup
* fix uncle
2019-09-16 10:28:28 -07:00
Pankaj Garg
c1880e3f3e
Reduce number of shreds per FEC block ( #5908 )
2019-09-15 10:37:12 -07:00
Pankaj Garg
ee791e2e3e
Optimizations to shred writing and signing ( #5890 )
...
* Optimizations to shred writing and signing
* fix broken tests
* fixes
2019-09-14 21:05:54 -07:00
sakridge
ceacc42126
Call gpu init earlier to force compilation. ( #5902 )
2019-09-14 12:32:57 -07:00
Michael Vines
84c8a5bbec
Add replay-stage-mark_dead_slot datapoint ( #5907 )
2019-09-14 08:50:53 -07:00
Pankaj Garg
8135279335
Reduce serialize/deserialize in shred recovery ( #5887 )
2019-09-12 21:52:13 -07:00
Sagar Dhawan
c1d788880d
Limit Rayon threadpool threads ( #5871 )
2019-09-12 11:39:39 -07:00
Pankaj Garg
385086359c
Reduce serializations/deserializations of shreds ( #5879 )
2019-09-12 10:10:25 -07:00
dependabot-preview[bot]
a85604b2ba
Bump sys-info from 0.5.7 to 0.5.8 ( #5877 )
...
Bumps [sys-info](https://github.com/FillZpp/sys-info-rs ) from 0.5.7 to 0.5.8.
- [Release notes](https://github.com/FillZpp/sys-info-rs/releases )
- [Commits](https://github.com/FillZpp/sys-info-rs/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-11 10:53:23 -07:00
Jack May
1853771930
Add support for SDK sysvar types ( #5876 )
2019-09-10 18:53:02 -07:00
carllin
ee4266bc59
Remove banks in locktower not in bank_forks ( #5837 )
...
* Remove unnecessary calculations from collect_vote_lockouts
* Add test for locktower startup from snapshot
2019-09-10 13:58:27 -07:00
dependabot-preview[bot]
294d531e0b
Bump serde_derive from 1.0.99 to 1.0.100 ( #5864 )
...
automerge
2019-09-10 13:31:11 -07:00
dependabot-preview[bot]
0d7efe5176
Bump serde from 1.0.99 to 1.0.100 ( #5862 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.99 to 1.0.100.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.99...v1.0.100 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-10 12:27:41 -07:00
Pankaj Garg
b426dfb2c0
Change tx batching in banking process and record ( #5832 )
...
* Change tx batching in banking process and record
* Change batching to reduce impact on replay stage
2019-09-10 11:04:03 -07:00
Pankaj Garg
fd33b27af1
Fix coding shred generator ( #5865 )
2019-09-10 09:35:07 -07:00
Pankaj Garg
7682db4826
Generate coding shreds on the fly based on erasure limits ( #5852 )
...
* Generate coding shreds on the fly based on erasure limits
* fix uncle
2019-09-09 17:26:51 -07:00
carllin
7607800d47
Refactor restart function in local cluster to support separate exit and restart functions ( #5845 )
2019-09-08 17:53:34 -07:00
Michael Vines
df205f8752
Use ureq instead of influx_db_client ( #5839 )
2019-09-07 12:48:45 -07:00
Jack May
e8d88f3237
Split SDK's timing.rs ( #5823 )
2019-09-06 14:30:56 -07:00
dependabot-preview[bot]
f28782cb84
Bump chrono from 0.4.8 to 0.4.9 ( #5775 )
...
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.8 to 0.4.9.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/master/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/commits/v0.4.9 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-06 13:55:36 -06:00
Michael Vines
1f9fde5f7b
ThinClient internal name grooming ( #5800 )
2019-09-06 09:07:40 -07:00
Sagar Dhawan
a452249bf3
Use retain on Packets instead of creating new ones ( #5804 )
...
* Use remove on Packets instead of creating a new one
* Fix compile after rebase
2019-09-05 19:16:18 -07:00
Pankaj Garg
3d3b03a123
Verify signature of recovered shred before adding them to blocktree ( #5811 )
...
* Verify signature of recovered shred before adding them to blocktree
* fix failing tests, and review comments
2019-09-05 18:20:30 -07:00
Pankaj Garg
05d2eec45c
Remove unnecessary erasure config references ( #5809 )
2019-09-05 14:46:41 -07:00
Pankaj Garg
3237e897d7
Adjust packet batching post-decoupling from blobs ( #5783 )
2019-09-05 11:22:39 -07:00
carllin
bd74e63702
Offload remaining confidence cache computation to separate thread ( #5792 )
...
* Move remaining confidence cache computation to separate thread
* Move confidence cache out of bank forks
2019-09-04 23:10:25 -07:00
Pankaj Garg
f78b865cba
Cleanup shreds to remove FirstShred data structure ( #5789 )
...
* Cleanup shreds to remove FirstShred data structure
* Also reduce size used by parent slot information in shred header
* clippy
* fixes
* fix chacha test
2019-09-04 21:06:47 -07:00
carllin
7062fe4b47
Refactor Blocktree for clarity and correctness ( #5700 )
...
* Refactor shreds to prevent insertion of any metadata on bad shreds
* Refactor fetching Index in blocktree
* Refactor get_slot_meta_entry
* Re-enable local cluster test
* cleanup
* Add tests for success/fail insertion of coding/data shreds
* Remove assert
* Fix and add tests for should_insert coding and data blobs
2019-09-04 17:14:42 -07:00
Pankaj Garg
02ee2a601c
Further cleanup of blocktree after Blob deprecation ( #5780 )
2019-09-04 12:47:09 -07:00
Tyera Eulberg
b19d9a50d3
Transition to ureq http client ( #5777 )
...
* Transition to ureq http client
* Remove unwrap
2019-09-04 12:11:44 -07:00
carllin
dfa6238342
Remove unnecessary construction of descendants ( #5742 )
2019-09-04 01:49:42 -07:00
Pankaj Garg
3b0d48e3b8
Remove blocktree blob references ( #5691 )
...
* Remove blocktree blob references
* fixes and cleanup
* replace uninitialized() call with MaybeUninit
* fix bench
2019-09-03 21:32:51 -07:00
Sagar Dhawan
62f6a78ccd
Make data plane shred filter parallel again ( #5740 )
2019-09-03 21:50:57 +00:00
dependabot-preview[bot]
f7e039e7ac
Bump chrono from 0.4.7 to 0.4.8 ( #5761 )
...
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.7 to 0.4.8.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/master/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-03 14:49:48 -07:00
dependabot-preview[bot]
61bd14c40a
Bump rayon from 1.1.0 to 1.2.0 ( #5758 )
...
Bumps [rayon](https://github.com/rayon-rs/rayon ) from 1.1.0 to 1.2.0.
- [Release notes](https://github.com/rayon-rs/rayon/releases )
- [Changelog](https://github.com/rayon-rs/rayon/blob/master/RELEASES.md )
- [Commits](https://github.com/rayon-rs/rayon/compare/rayon-core-v1.1.0...v1.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-09-03 13:39:58 -06:00
Tyera Eulberg
85e5fbeb35
Add absoluteSlot to getEpochInfo ( #5765 )
2019-09-02 12:21:06 -07:00
anatoly yakovenko
475f6fe666
votes only need slots and the last bank hash ( #5499 )
...
churn
cleanup
reverse test slot hashes
test check_slots_are_valid
updates
only send the minimum bank vote difference
fixup! only send the minimum bank vote difference
some banks may not have a voting account setup
fixup! votes only need slots and the last bank hash
fixup! fixup! votes only need slots and the last bank hash
fmt
fixed compare
fixed vote
fixup! fixed vote
poke ci
filter the local votes via the last bank vote
2019-09-02 12:01:09 -07:00
sakridge
0c2a49391a
Disable pinned gpu memory ( #5753 )
2019-08-31 16:44:07 -07:00
Michael Vines
e3a6c9234a
Entrypoint RPC service discovery now blocks until the entrypoint is actually found ( #5756 )
...
automerge
2019-08-30 16:12:58 -07:00
Michael Vines
643d0b0868
Make the world flat again; remove utils/ subdirectory ( #5752 )
...
automerge
2019-08-30 11:57:39 -07:00
dependabot-preview[bot]
f840eefcbf
Bump bs58 from 0.2.4 to 0.2.5 ( #5747 )
...
Bumps [bs58](https://github.com/mycorrhiza/bs58-rs ) from 0.2.4 to 0.2.5.
- [Release notes](https://github.com/mycorrhiza/bs58-rs/releases )
- [Commits](https://github.com/mycorrhiza/bs58-rs/compare/0.2.4...0.2.5 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-30 11:41:41 -06:00
dependabot-preview[bot]
e1f3e33bfb
Bump jsonrpc-pubsub from 13.0.0 to 13.1.0 ( #5708 )
...
Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc ) from 13.0.0 to 13.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.0.0...v13.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-30 11:40:58 -06:00
Michael Vines
4786143524
Add a more helpful error on genesis block mismatch ( #5744 )
...
automerge
2019-08-30 09:10:22 -07:00
dependabot-preview[bot]
c3f07eb85a
Bump jsonrpc-ws-server from 13.0.0 to 13.1.0 ( #5721 )
...
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc ) from 13.0.0 to 13.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.0.0...v13.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-29 09:12:02 -06:00
Pankaj Garg
8adac30c05
Integrate shreds to the replicators ( #5711 )
...
* Integrate shreds to the replicators
* fix cuda stuff
* fix cuda tests
2019-08-28 22:34:47 -07:00
dependabot-preview[bot]
156399e8aa
Bump jsonrpc-http-server from 13.0.0 to 13.1.0 ( #5707 )
...
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 13.0.0 to 13.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.0.0...v13.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-28 14:21:17 -06:00
dependabot-preview[bot]
5745a54d4c
Bump indexmap from 1.0.2 to 1.1.0 ( #5706 )
...
Bumps [indexmap](https://github.com/bluss/indexmap ) from 1.0.2 to 1.1.0.
- [Release notes](https://github.com/bluss/indexmap/releases )
- [Commits](https://github.com/bluss/indexmap/compare/1.0.2...v1.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-28 14:20:45 -06:00
Parth
7dfb735db9
randomize tx ordering ( #4978 )
...
Summary of Changes:
This change adds functionality to randomize tx execution for every entry. It does this by implementing OrderedIterator that iterates tx slice as per the order specified. The order is generated randomly for every entry.
2019-08-28 21:08:32 +05:30
Pankaj Garg
2510f3d352
Remove extra call to serialize in shred verify ( #5698 )
2019-08-27 19:28:00 -07:00
Pankaj Garg
47535b9ff1
Use serialize_into to fill in shreds instead of writing one byte at a time ( #5695 )
...
automerge
2019-08-27 17:11:24 -07:00
Sunny Gleason
34ab25a88b
feat: getInflation() endpoint ( #5681 )
2019-08-27 18:17:03 -04:00
carllin
8b9c3a2561
Blocktree last_root to enforce a slot floor ( #5593 )
...
* Add last_root to blocktree
* Don't repair earlier than last_root
* Add integration test to make sure blocktree floor is enforced
2019-08-27 15:09:41 -07:00
Michael Vines
0c62cf8980
Add metrics for snapshot generation ( #5677 )
2019-08-27 13:04:20 -07:00
Pankaj Garg
f1d58f980b
Ignore retransmit channel error ( #5680 )
...
automerge
2019-08-27 12:41:04 -07:00
Pankaj Garg
12ad95eb5e
Erasure statistics for shreds ( #5676 )
2019-08-27 11:22:06 -07:00
dependabot-preview[bot]
85f03b590d
Bump jsonrpc-derive from 13.0.0 to 13.1.0 ( #5668 )
...
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc ) from 13.0.0 to 13.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.0.0...v13.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-27 08:48:34 -07:00
Michael Vines
a29f0484dc
Add newline before cluster info log ( #5671 )
2019-08-27 08:33:48 -07:00
dependabot-preview[bot]
8e6e72babd
Bump jsonrpc-core from 13.0.0 to 13.1.0 ( #5669 )
...
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc ) from 13.0.0 to 13.1.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.0.0...v13.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-27 07:49:16 -07:00
dependabot-preview[bot]
7257d2845d
Bump hex-literal from 0.2.0 to 0.2.1 ( #5638 )
...
Bumps [hex-literal](https://github.com/RustCrypto/utils ) from 0.2.0 to 0.2.1.
- [Release notes](https://github.com/RustCrypto/utils/releases )
- [Commits](https://github.com/RustCrypto/utils/compare/hex-literal-v0.2.0...hex-literal-v0.2.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-26 21:32:42 -07:00
Michael Vines
db768b4c3a
Log contact info every 10 seconds ( #5663 )
2019-08-26 18:31:14 -07:00
Pankaj Garg
4ac1213c9c
Integrate coding shreds and recovery ( #5625 )
...
* Integrate coding shreds and recovery
* More tests for shreds and some fixes
* address review comments
* fixes to code shred generation
* unignore tests
* fixes to recovery
2019-08-26 18:27:45 -07:00
Michael Vines
a0f3208828
Ignore flaky test_banking_stage_entryfication ( #5659 )
...
automerge
2019-08-26 16:49:34 -07:00
carllin
28f2c75137
Add bigger buffers for shred column families in rocks ( #5653 )
...
automerge
2019-08-26 15:58:26 -07:00
Rob Walker
615da845cd
remove replicode in run_purge_batch() ( #5630 )
...
* remove replicode
* bigger timeout
* backout 90 min timeout
2019-08-26 09:47:48 -07:00
Michael Vines
ba59741b60
Bump to 0.19.0-pre0
2019-08-25 21:47:29 -07:00
Michael Vines
52da207f83
test_snapshots_restart_validity now passes ( #5644 )
...
automerge
2019-08-25 21:33:41 -07:00
carllin
6e82978931
Fix race with LedgerCleanupService ( #5622 )
2019-08-23 23:40:20 -07:00
Michael Vines
4e827af392
Remove unnecessary trailing semicolons ( #5636 )
2019-08-23 22:47:54 -07:00
Rob Walker
0ffe7a9c8f
plumb some rent ( #5610 )
...
* plumb some rent
* nits
* fixups
* fixups
* fixups
2019-08-23 14:04:53 -07:00
Michael Vines
9b8d59d2e9
Revert "Bump indexmap from 1.0.2 to 1.1.0 ( #5565 )" ( #5624 )
...
This reverts commit f1ad69c84e
.
2019-08-23 13:20:31 -07:00
Michael Vines
3fc5009ef2
Snapshot pipefitting through the validator cli ( #5617 )
...
* Handle 404 errors better
* Snapshot pipefitting through the validator cli
* Add download progress bar
* Log the current entrypoint slot
2019-08-23 13:02:07 -07:00
dependabot-preview[bot]
f1ad69c84e
Bump indexmap from 1.0.2 to 1.1.0 ( #5565 )
...
Bumps [indexmap](https://github.com/bluss/indexmap ) from 1.0.2 to 1.1.0.
- [Release notes](https://github.com/bluss/indexmap/releases )
- [Commits](https://github.com/bluss/indexmap/compare/1.0.2...v1.1.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-23 11:06:24 -07:00
Rob Walker
52f6da5cee
upgrade rust to 1.37 ( #5611 )
2019-08-23 08:55:51 -07:00
Pankaj Garg
aeaa0feb61
Add range lookups for erasure set indexes ( #5612 )
2019-08-22 16:32:38 -07:00
dependabot-preview[bot]
4125d01668
Bump reqwest from 0.9.19 to 0.9.20 ( #5598 )
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.9.19 to 0.9.20.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/v0.9.20/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.19...v0.9.20 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-22 07:57:33 -07:00
carllin
087c43b9ef
Add snapshotting integration test ( #5519 )
...
* Add snapshotting integration test
* Update ContactInfo on restart in local cluster nodes
2019-08-21 23:59:11 -07:00
Pankaj Garg
c18ea3ccc9
Fix ignored tests in blocktree ( #5591 )
2019-08-21 20:07:51 -07:00
Michael Vines
e2d6f01ad3
solana-validator now verifies its genesis blockhash against the cluster entrypoint ( #5589 )
2019-08-21 18:16:40 -07:00
Michael Vines
faafee6b42
to to/the the ( #5590 )
2019-08-21 17:46:59 -07:00
carllin
80f618f011
Add info logging around snapshot tarball generation ( #5592 )
...
automerge
2019-08-21 16:36:21 -07:00
Pankaj Garg
0dc0594aaa
Fixes to repair and orphan logic for data shreds ( #5587 )
2019-08-21 15:27:42 -07:00
Michael Vines
d651cb7a25
Adjust |ulimit -n| automatically, no bash required ( #5586 )
2019-08-21 14:55:58 -07:00
dependabot-preview[bot]
ab4f370e15
Bump serde_derive from 1.0.98 to 1.0.99 ( #5539 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.98 to 1.0.99.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.98...v1.0.99 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-21 12:14:58 -07:00
dependabot-preview[bot]
d6f824abc0
Bump bs58 from 0.2.2 to 0.2.4 ( #5560 )
...
Bumps [bs58](https://github.com/mycorrhiza/bs58-rs ) from 0.2.2 to 0.2.4.
- [Release notes](https://github.com/mycorrhiza/bs58-rs/releases )
- [Commits](https://github.com/mycorrhiza/bs58-rs/compare/0.2.2...0.2.4 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-21 12:13:52 -07:00
Michael Vines
3450b9a44d
Rename solana to solana-core ( #5583 )
2019-08-21 10:23:33 -07:00
Michael Vines
afaf95cf53
Refine error message when ledger can't be opened ( #5582 )
2019-08-21 09:44:12 -07:00
carllin
bb558acdf0
Change JsonRpc exit to use wait->close ( #5566 )
...
* Add wait-close-join pattern to rpc_service
* Create ValidatorExit struct
2019-08-20 23:59:31 -07:00
Pankaj Garg
4798e7fa73
Integrate data shreds ( #5541 )
...
* Insert data shreds in blocktree and database
* Integrate data shreds with rest of the code base
* address review comments, and some clippy fixes
* Fixes to some tests
* more test fixes
* ignore some local cluster tests
* ignore replicator local cluster tests
2019-08-20 17:16:06 -07:00
Michael Vines
8e0f41a790
Cargo.lock
2019-08-20 16:59:44 -07:00
Michael Vines
b1203da82c
Bump to 0.18.0-pre2
2019-08-20 16:56:00 -07:00
Rob Walker
93ae98812b
change DEFAULT_NUM_TICKS_PER_SECOND to DEFAULT_TICKS_PER_SECOND ( #5559 )
2019-08-19 23:22:56 -07:00
Sagar Dhawan
bd193535c9
Cap CrdsFilter sizes such that PullRequest no longer exceeds MTU ( #5561 )
2019-08-19 18:14:10 -07:00
dependabot-preview[bot]
8b7cca986a
Bump serde from 1.0.98 to 1.0.99 ( #5540 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.98 to 1.0.99.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.98...v1.0.99 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-19 10:06:15 -06:00
Rob Walker
814af378a7
stake cooldown ( #5553 )
...
* stake cooldown
* fixups
* sheesh
2019-08-17 18:12:30 -07:00
Rob Walker
a252acf539
move netutil ( #5552 )
2019-08-17 15:52:12 -07:00
Rob Walker
01eb7600d9
use stake config to defeat warmup in local_cluster ( #5549 )
...
* use stake config to defeat warmup in local_cluster
* fixups
2019-08-17 12:28:36 -07:00
Michael Vines
ccee6241a6
Revert "publish fixes"
...
This reverts commit 4d13d3871d
.
2019-08-16 17:28:07 -07:00
Michael Vines
4d13d3871d
publish fixes
2019-08-16 17:03:57 -07:00
Michael Vines
bb0c9d6145
Log more info at the start of PoH ( #5550 )
2019-08-16 16:20:20 -07:00
Tyera Eulberg
8d105042ea
Update getEpochVoteAccounts to getVoteAccounts ( #5543 )
...
* Rework getEpochVoteAccounts into getVoteAccounts
* Update client apis
* Update docs
* Review comments
2019-08-16 17:02:19 -06:00
Michael Vines
84304cb0fc
Display vote pubkey at startup ( #5548 )
2019-08-16 15:56:06 -07:00
Rob Walker
99eeb63f71
move the rest of cluster to local_cluster ( #5535 )
2019-08-16 00:00:38 -07:00
Sagar Dhawan
e73cbdda61
Reduce log level for known issue ( #5536 )
...
automerge
2019-08-15 19:42:27 -07:00
Rob Walker
94f1132fb6
fix single node testnet, remove bootstrap vote ( #5534 )
2019-08-15 18:58:46 -07:00
Sagar Dhawan
4ee212ae4c
Coalesce gossip pull requests and serve them in batches ( #5501 )
...
* Coalesce gossip pull requests and serve them in batches
* batch all filters and immediately respond to messages in gossip
* Fix tests
* make download_from_replicator perform a greedy recv
2019-08-15 17:04:45 -07:00
carllin
d5fb493aa4
Change recv to try_recv ( #5533 )
2019-08-15 15:17:46 -07:00
Greg Fitzgerald
471bc73a23
Fix Rust 1.37.0 compiler warnings ( #5530 )
...
Looks like most usages of trait objects should have introduced
a type variable instead.
2019-08-15 14:00:09 -06:00
dependabot-preview[bot]
a948c9b7f9
Bump libc from 0.2.61 to 0.2.62 ( #5527 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.61 to 0.2.62.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.61...0.2.62 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-15 09:49:14 -06:00
carllin
4688f9821f
Snapshot optimizations ( #5525 )
...
* Change serializing snapshot tar to use shell command
2019-08-14 23:14:40 -07:00
Michael Vines
9f6c9c428b
Move genesis/snapshot archive download into Rust ( #5515 )
2019-08-14 19:25:22 -07:00
Michael Vines
b4f0f4abcc
Disable rocksdb bzip2 compression
2019-08-14 15:39:30 -07:00
Rob Walker
d22848f9b1
use live stakes for consensus ( #5426 )
...
* use live stakes for consensus
* lint
* re-enable leader_failure_4
* fixups
* re-ignore leader_failure_4
2019-08-14 13:30:21 -07:00
carllin
d791c70d90
Snapshot optimizations ( #5518 )
...
* Limit slots_since_snapshot size, only package latest snapshot, refactor tests
* Add test checking status_cache.roots == bank_forks.slots_since_snapshot after bank_forks.set_root()
2019-08-13 22:39:29 -07:00
Sagar Dhawan
1d0608200c
Restore blob size fix ( #5516 )
...
* Revert "Revert "Fix gossip messages growing beyond blob size (#5460 )" (#5512 )"
This reverts commit 97d57d168b
.
* Fix Crds filters
2019-08-13 18:04:14 -07:00
carllin
cd14a940d8
Allow process_blocktree() to start processing from any root ( #5484 )
...
* Remove unnecessary entry_height from BankInfo
* Refactor process_blocktree to support process_blocktree_from_root
* Refactor to process blocktree after loading from snapshot
* On restart make sure bank_forks contains all the banks between the root and the tip of each fork, not just the head of each fork
* Account for 1 tick_per_slot in bank 0 so that blockhash of bank0 matches the tick
2019-08-13 17:20:14 -07:00
carllin
58d4e32c97
Remove serialization of future AppendVecs and serialize AccountStorage correctly ( #5510 )
2019-08-13 16:05:37 -07:00
Michael Vines
08f6a2ea3e
debash: Add `solana-gossip get-rpc-url` command to avoid hard coding ( #5513 )
2019-08-13 10:49:48 -07:00
Sagar Dhawan
97d57d168b
Revert "Fix gossip messages growing beyond blob size ( #5460 )" ( #5512 )
...
This reverts commit a8eb0409b7
.
2019-08-13 10:29:26 -07:00
Rob Walker
07d11be6ab
add global stake warmup ( #5483 )
...
* add global stake warmup
* integrate stake history into runtime
* fixup core tests
* fixup
* remove existing cooldown tests for now
2019-08-12 20:59:57 -07:00
Greg Fitzgerald
a43922ccbf
Boot hashbrown ( #5505 )
...
As of Rust 1.36.0, hashbrown now implements the HashMap in std (which
implements HashSet).
https://blog.rust-lang.org/2019/07/04/Rust-1.36.0.html#a-new-hashmapk,-v%3E-implementation
2019-08-12 16:46:49 -06:00
Pankaj Garg
b7a5136136
Helper functions for shreds ( #5493 )
2019-08-12 15:27:58 -07:00
Justin Starry
0fde19239b
Rate limit counter metrics points to one per second ( #5496 )
...
* Rate limit counter metrics points to one per second
* Remove old env var
* Test that metrics counter is incrementing
* Fix typo
2019-08-12 18:15:34 -04:00
dependabot-preview[bot]
771d1a78fd
Bump libc from 0.2.60 to 0.2.61 ( #5491 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.60 to 0.2.61.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.60...0.2.61 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-12 15:39:26 -06:00
Sagar Dhawan
a8eb0409b7
Fix gossip messages growing beyond blob size ( #5460 )
...
* fixed bloom filter math
* Add split each pull request into multiple pulls with different filters
* Rework CrdsFilter to generate all possible masks to cover the keyspace
* Limit the bloom sizes such that each pull request is no larger than mtu
2019-08-12 13:51:29 -07:00
carllin
1b84092b94
Fix slots_since_snapshot in BankForks.add_root() ( #5489 )
2019-08-12 11:56:03 -07:00
Pankaj Garg
b1d43ace14
Add columns for data and code shreds ( #5461 )
2019-08-12 10:03:57 -07:00
Michael Vines
54f4d13350
Validator log filter may now be reconfigured at runtime ( #5473 )
...
* Log filter may now be reconfigured at runtime
* Add RPC API and bash script to reconfigure the log filter
2019-08-10 22:54:46 -07:00
dependabot-preview[bot]
799d3b1575
Bump nix from 0.14.1 to 0.15.0 ( #5488 )
...
Bumps [nix](https://github.com/nix-rust/nix ) from 0.14.1 to 0.15.0.
- [Release notes](https://github.com/nix-rust/nix/releases )
- [Changelog](https://github.com/nix-rust/nix/blob/master/CHANGELOG.md )
- [Commits](https://github.com/nix-rust/nix/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-10 18:48:36 -06:00
Rob Walker
5884469d11
count commitable in banking_stage ( #5477 )
2019-08-09 21:14:20 -07:00
Rob Walker
ed093f86f9
harmonize percentage members ( #5459 )
...
* harmonize percentage members
* update tests
* update capitalization when burning fees
* verify capitalization in fee burn
* fixup
2019-08-09 13:58:46 -07:00
Michael Vines
5b4ee36cfd
Log more socket addresses at validator startup ( #5471 )
2019-08-08 15:38:23 -07:00
Justin Starry
4f86c0b74a
Rate limit transaction counters ( #5447 )
...
* Rate limit transaction counters
* @sakridge feedback
* Set default high metrics rate for multinode demo
* Fix tests
* Swap defaults and fix env var tests
* Only set metrics rate if not already set
2019-08-08 17:05:06 -04:00
sakridge
238aa2133d
Move local_cluster tests into own crate ( #5465 )
2019-08-08 11:04:33 -07:00
Michael Vines
8c15214923
Add --dev-halt-at-slot option ( #5453 )
2019-08-08 09:14:30 -07:00
Tyera Eulberg
5b51bb27b6
Rpc to return software version ( #5456 )
...
* Add getSoftwareVersion rpc
* Add getSoftwareVersion to doc
* Rename to getVersion and return object
* Update jsonrpc-api.md
2019-08-07 20:06:27 -06:00
Pankaj Garg
6597c71e23
Implement shred erasure recovery and reassembly ( #5444 )
...
* Implement shred erasure recovery and reassembly
* fixes and unit test
* clippy
* review comments, additional tests, and some fixes
* address review comments
* more tests and cleanup
2019-08-07 17:02:49 -07:00
carllin
8aa7a851ca
Fix hardlinking across filesystem boundaries ( #5449 )
...
* Fix hardlinking across filesystem boundaries
* create output dir for snapshot tar
2019-08-07 13:12:53 -07:00
dependabot-preview[bot]
be9fa22db7
Bump hashbrown from 0.3.1 to 0.5.0 ( #5450 )
...
Bumps [hashbrown](https://github.com/rust-lang/hashbrown ) from 0.3.1 to 0.5.0.
- [Release notes](https://github.com/rust-lang/hashbrown/releases )
- [Changelog](https://github.com/rust-lang/hashbrown/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/hashbrown/compare/v0.3.1...v0.5.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-07 08:35:54 -06:00
carllin
b72c5689c9
Blow away snapshots directory on start ( #5446 )
2019-08-06 21:41:38 -07:00
Sagar Dhawan
9dcf3347f5
Refactor status cache and remove complex serialize/deserialize ( #5335 )
...
automerge
2019-08-06 18:47:30 -07:00
dependabot-preview[bot]
3ae9357a36
Bump hashbrown from 0.2.2 to 0.3.1 ( #5381 )
...
Bumps [hashbrown](https://github.com/rust-lang/hashbrown ) from 0.2.2 to 0.3.1.
- [Release notes](https://github.com/rust-lang/hashbrown/releases )
- [Changelog](https://github.com/rust-lang/hashbrown/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/hashbrown/compare/v0.2.2...v0.3.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-06 10:16:18 -06:00
carllin
1dbb5c8647
Deserialize snapshots ( #5417 )
...
* Deserialize snapshots
2019-08-05 22:53:19 -07:00
Pankaj Garg
c524d62ce0
Implement coding shred generation ( #5415 )
...
* Implemenet coding shred generation
* address review comments
2019-08-05 16:32:34 -07:00
Michael Vines
dd4640e1ed
Revert "Revert "Bump version to 0.18.0-pre1""
...
This reverts commit 42c7d57fc0
.
2019-08-05 15:55:13 -07:00
Michael Vines
42c7d57fc0
Revert "Bump version to 0.18.0-pre1"
...
This reverts commit 14f6d5c82b
.
2019-08-05 15:53:55 -07:00
Tyera Eulberg
efd09ecd37
Revert fork metrics ( #5427 )
...
* Revert "Remove duplicate row (#5419 )"
This reverts commit a81dd80d60
.
* Revert "Log fork stake-percentage in metrics, and display (#5406 )"
This reverts commit 92e419f1c7
.
2019-08-05 15:53:36 -07:00
Michael Vines
14f6d5c82b
Bump version to 0.18.0-pre1
2019-08-05 15:11:44 -07:00
Tyera Eulberg
92e419f1c7
Log fork stake-percentage in metrics, and display ( #5406 )
...
* Log fork stake percentage data
* Add fork stake percentage to dashboard
* Call out parent slot
2019-08-02 19:16:23 -06:00
Pankaj Garg
80bb0158b7
Initial implementation of packet shredder ( #5401 )
...
* Initial implementation of packet shredder
* tests
* clippy
* review comments
2019-08-02 15:53:42 -07:00
Michael Vines
eb3991b9ba
Replay stage log message nits ( #5408 )
2019-08-02 10:08:42 -07:00
Michael Vines
aee63f15c2
Rename state.tgz to snapshot.tgz to match rpc service
2019-08-02 10:07:29 -07:00
dependabot-preview[bot]
f03e066ec5
Bump log from 0.4.7 to 0.4.8 ( #5382 )
...
Bumps [log](https://github.com/rust-lang/log ) from 0.4.7 to 0.4.8.
- [Release notes](https://github.com/rust-lang/log/releases )
- [Changelog](https://github.com/rust-lang-nursery/log/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-lang/log/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-08-01 14:31:18 -07:00
Rob Walker
f7d3f55566
fix epoch_stakes again ( #5396 )
2019-08-01 14:27:47 -07:00
carllin
6cb2040a1b
Snapshot Packaging Service ( #5262 )
...
* Snapshot serialization and packaging
2019-07-31 17:58:10 -07:00
sakridge
c2fc0f2418
Plumb libra accounts to genesis ( #5333 )
...
* Plumb move_loader to genesis
* Remove core dependency on genesis-programs
2019-07-31 16:10:55 -07:00
Rob Walker
9278201198
fix epoch_stakes ( #5355 )
...
* fix epoch_stakes
* fix stake_state to use stakers_epoch
* don't allow withdrawal before deactivation
2019-07-31 15:13:26 -07:00
Jack May
d09afdbefe
Synchronize and cleanup instruction processor lists ( #5356 )
2019-07-31 14:28:14 -07:00
dependabot-preview[bot]
01d2b4e952
Bump jsonrpc-http-server from 12.1.0 to 13.0.0 ( #5361 )
...
* Bump jsonrpc-http-server from 12.1.0 to 13.0.0
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 12.1.0 to 13.0.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v12.1.0...v13.0.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* Update all jsonrpc crates to v13.0.0
2019-07-31 14:30:47 -06:00
Jack May
6d7cb23c61
Add command to create genesis accounts ( #5343 )
2019-07-30 23:43:12 -07:00
Michael Vines
bd7e269280
Kill rsync ( #5336 )
...
automerge
2019-07-30 22:43:47 -07:00
Pankaj Garg
b05b42d74d
Reduce max blob size ( #5345 )
...
* Reduce max blob size
* ignore test_star_network_push_rstar_200
2019-07-30 22:15:07 -07:00
dependabot-preview[bot]
af733a678a
Bump serde_derive from 1.0.97 to 1.0.98 ( #5314 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.97 to 1.0.98.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.97...v1.0.98 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-30 21:45:34 -07:00
Michael Vines
4a336eb5ff
ValidatorConfig path reform: use Path/PathBuf for paths ( #5353 )
2019-07-30 19:47:24 -07:00
dependabot-preview[bot]
b7e08052ae
Bump serde from 1.0.97 to 1.0.98 ( #5315 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.97 to 1.0.98.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.97...v1.0.98 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-30 19:46:50 -07:00
Michael Vines
c78db6a94b
ledger path reform: use Path/PathBuf instead of strings ( #5344 )
2019-07-30 15:53:41 -07:00
carllin
7dc5cc26a6
Make max_epoch check in next_leader_at in leader schedule ( #5342 )
2019-07-30 15:51:02 -07:00
Sagar Dhawan
d7a2b790dc
Limit the size of gossip push and gossip pull response ( #5348 )
...
* Limit the size of gossip push and gossip pull response
* Remove Default::default
* Rename var
2019-07-30 15:43:17 -07:00
Pankaj Garg
a7a10e12c7
Forward transactions as packets instead of blobs ( #5334 )
...
* Forward transactions as packets instead of blobs
* clippy
2019-07-30 14:50:02 -07:00
sakridge
8d243221f0
Ignore flaky local cluster tests ( #5347 )
...
* Add logging to local_cluster tests
* Ignore flaky test_leader_failure_4, test_repairman_catchup
And crashing banking benchmarks.
2019-07-30 13:48:46 -07:00
Justin Starry
84368697af
Fix metrics when leader does not report metrics ( #5291 )
2019-07-30 16:18:33 -04:00
sakridge
a642168369
Add move to bench-tps ( #5250 )
2019-07-27 15:28:00 -07:00
Dan Albert
b8835312bb
Update cargo.toml files to 0.18.0-pre0 ( #5303 )
2019-07-27 11:42:06 -06:00
Pankaj Garg
aef7bae60d
Let grace ticks to roll over into multiple leader slots ( #5268 )
...
* Let grace ticks to roll over into multiple leader slots
* address review comments
2019-07-26 11:33:51 -07:00
Tyera Eulberg
dab7de7496
Add confidence cache to BankForks ( #5066 )
...
* Add confidence cache to BankForks
* Include stake-weighted lockouts in cache
* Add cache test
* Move confidence cache updates to handle_votable_bank
* Prune confidence cache on prune_non_root()
* Spin thread to process aggregate_stake_lockouts
* Add long-running thread for stake_weighted_lockouts computation
2019-07-26 11:27:57 -06:00
dependabot-preview[bot]
349ebec629
Bump serde from 1.0.94 to 1.0.97 ( #5285 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.94 to 1.0.97.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.94...v1.0.97 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-07-26 07:22:25 -06:00
Sagar Dhawan
a233a1c822
Fix poh recorder not flushing virtual ticks immediately ( #5277 )
...
* Fix poh not flushing virtual ticks immediately
* Fix test_would_be_leader_soon
2019-07-25 11:08:44 -07:00