blockworks-foundation
/
solana
mirror of https://github.com/blockworks-foundation/solana.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
8,323 Commits 168 Branches 497 Tags 539 MiB
Commit Graph

1382 Commits

Author SHA1 Message Date
Pankaj Garg d32a072190
Use ticks_per_slot to calculate maximum grace ticks (#7024) 
* Use ticks_per_slot to calculate maximum grace ticks

* fix test

* fix votable candidate ordering

* fixes to pick_best_fork() and a unit test

* fixes
 2019-11-19 17:55:42 -08:00
Sagar Dhawan f2badf2c5d
Fix a bug where gossip loops forever while splitting messages (#7032) 
* Fix a bug where gossip loops forever while splitting messages

* Get rid of while loop

* Minor clean up and rename
 2019-11-19 11:51:51 -08:00
Tyera Eulberg ea656b1a3f
Add parent slot to getConfirmedBlock (#7038) 
* Add parent slot to getConfirmedBlock

* Fix bad text-replace

* Use camelCase in getConfirmedBlock
 2019-11-19 09:39:55 -07:00
Dan Albert b958bf9086
Fix confirmation metrics (#7035) 2019-11-19 09:51:50 -05:00
carllin 43144cfe8b
Make banks that fail threshhold check resettable (#7027) 2019-11-19 02:36:30 -08:00
carllin 11d2d2eccd
Fix progress map losing banks and recomputing stats (#7026) 
* Fix progress map missing banks

* Fix confirmations

* Fix test

* Initialiize progress with frozen banks atartup
 2019-11-19 02:36:00 -08:00
Sagar Dhawan 6bfe0fca1f
Add a version field to shreds (#7023) 
* Add a version field to shreds

* Clippy

* Fix Chacha Golden

* Fix shredder bench compile

* Fix blocktree bench compile
 2019-11-18 18:05:02 -08:00
Tyera Eulberg e0a2bb9d86
Legitimately map transactions to statuses in blocktree (#7011) 
* Refactor rocksdb TransactionStatus to store/return struct; hook up map_transactions_to_statuses

* Cleanup use statements
 2019-11-18 09:12:42 -07:00
Tyera Eulberg 3bc8d78801
Add ConfirmedBlock struct, and rework Blocktree apis to include block… (#7004) 
* Add RpcConfirmedBlock struct, and rework Blocktree apis to include blockhash info and dummy tx statuses

* Remove unused lifetime
 2019-11-17 20:17:15 -07:00
carllin b66c03667c
Log for threshold failure (#7008) 2019-11-17 17:10:16 -08:00
Michael Vines c3926e6af0
|solana-gossip spy| no longer requires an entrypoint (#6999) 2019-11-16 14:16:28 -07:00
carllin 70322d1ff8
Add error logging to dead slots (#7000) 2019-11-16 02:54:51 -08:00
anatoly yakovenko 0ca943f49b RecyclerCache for shred_sigverify (#6986) 
automerge
 2019-11-15 12:16:56 -08:00
sakridge 36e3ccfc68
Remvoe pinned memory (#6976) 2019-11-15 10:58:25 -08:00
anatoly yakovenko 59413b3124 Fix rules for fork selection (#6906) 
automerge
 2019-11-15 08:36:33 -08:00
Michael Vines 006c39380a
Display 'none' instead of 0.0.0.0 (#6973) 2019-11-14 20:24:35 -07:00
Tyera Eulberg 852a2146ab
Add Blocktree api to get transactions by slot (#6966) 
* Add blocktree method to get confirmed-block txs

* Clean up use statements

* Add test, and fmt

* Plumb new blocktree method into getConfirmedBlock
 2019-11-14 16:34:39 -07:00
sakridge 99b42f210c Remove unused sha2 dep (#6964) 
automerge
 2019-11-14 14:01:11 -08:00
Tyera Eulberg 03f7f0d18c Rename getBlock to getConfirmedBlock; remove getBlocksSince (#6961) 
automerge
 2019-11-14 13:14:42 -08:00
Sagar Dhawan 79d7090867
Remove obsolete references to Blob (#6957) 
* Remove the name "blob" from archivers

* Remove the name "blob" from broadcast

* Remove the name "blob" from Cluset Info

* Remove the name "blob" from Repair

* Remove the name "blob" from a bunch more places

* Remove the name "blob" from tests and book
 2019-11-14 11:49:31 -08:00
Michael Vines e7f63cd336
Upgrade to rust 1.39.0 (#6939) 
* Upgrade to rust 1.39.0

* 1.39.0 clippy
 2019-11-14 12:27:01 -07:00
Sagar Dhawan f108f483b7
Remove Blobs and switch to Packets (#6937) 
* Remove Blobs and switch to Packets

* Fix some gossip messages not respecting MTU size

* Failure to serialize is not fatal

* Add log macros

* Remove unused extern

* Apparently macro use is required

* Explicitly scope macro

* Fix test compile
 2019-11-14 10:24:53 -08:00
Sunny Gleason 42af8b199f
feat: add tests for invalid/failure cases (#6951) 2019-11-14 11:41:26 -05:00
carllin 43e2301e2c
Fix roots overrunning broadcast (#6884) 
* Add trusted pathway for insert_shreds to avoid checks
 2019-11-14 00:32:07 -08:00
Parth 7b05b3dbb3
rent collector improvments (#6888) 
* avoid account copying + pre-empt rent

* adding support for base rent
 2019-11-14 10:56:49 +05:30
Ryo Onodera 4fc767b3f6
Move version! from core:: to clap_utils:: (#6944) 
* Move version! from core to clap-utils

* Completely move version! from core:: to clap_utils::

* rustfmt

* Do remaining transition after rebase
 2019-11-14 13:10:38 +09:00
Greg Fitzgerald a3a830e1ab
Delete Service trait (#6921) 2019-11-13 11:12:09 -07:00
Michael Vines fcc2874591
Remove/address some TODOs (#6923) 2019-11-13 09:43:15 -07:00
Greg Fitzgerald 30a08f4282 Cleanup ledger macros (#6916) 
automerge
 2019-11-13 07:14:09 -08:00
Michael Vines 86faa3f995
Properly type RpcClient::get_version() (#6919) 2019-11-12 22:01:04 -07:00
Ryo Onodera 148a58865e Make creating new snapshot.tar.bz2 truly-atomic (#6902) 2019-11-12 14:21:56 -07:00
Ryo Onodera 3faeb7fa79 Rename solana-netutil to solana-net-utils for consistency (#6895) 
* sed -i -e 's/netutil/net_utils/g' $(git grep --files-with-matches netutil :**.rs)

* sed -i -e 's/netutil/net-utils/g' $(git grep --files-with-matches netutil)

* git mv netutil/ net-utils

* Tweak a bit

* Fix rustfmt & clippy
 2019-11-12 13:37:13 -07:00
Rob Walker bb00904fc8
add rent reserve for bootstrap stakes (#6876) 
* genesis investor stakes

* assert rent is sufficient for these bootstrappers
 2019-11-12 12:33:40 -08:00
Sunny Gleason 5903339c17
feat: return bank/block info with block-related results (#6716) 2019-11-12 14:49:41 -05:00
Michael Vines c6b108ef4f
Don't panic in sdk/ when genesis fails to load (#6892) 2019-11-12 10:24:49 -07:00
Tyera Eulberg 7e82450d7b
Serialize transaction in proper wire format instead of json (#6889) 2019-11-12 10:45:10 -05:00
Sagar Dhawan 95d6586dd7
Remove debug datapoint that isn't being plotted (#6873) 2019-11-11 14:25:25 -08:00
Sagar Dhawan 816b2d7ff8
Tune repair to be less aggressive (#6868) 2019-11-11 13:12:22 -08:00
Michael Vines 4be646c695
discover() by gossip sockaddr instead of just by gossip ip address (#6865) 2019-11-11 12:42:58 -07:00
Tyera Eulberg cc6e1ea200
Stub out `getBlocksSince` and `getBlock` methods (#6853) 
* Add getBlocksSince rpc method, and initial stub of getBlock method

* Return test transactions from getBlock method

* clippy

* Add comment on get_block method
 2019-11-11 13:18:34 -05:00
Michael Vines cfab36cb1d
Include channel and commit info in the version of pre-release builds (#6819) 2019-11-10 22:39:13 -07:00
Justin Starry 5835b3b8eb
Increase timeout when confirming airdrop for max commitment (#6858) 
* Increase timeout when confirming airdrop for max commitment

* Add commitment to airdrop rpc trace

* Flip commitment check
 2019-11-10 12:20:52 -05:00
Michael Vines 1ddf90ed08
Compress contact_info_trace() output to improve CI log rendering (#6852) 2019-11-09 01:12:18 -07:00
Justin Starry 9807f47d4e
Rename genesis block to genesis config (#6816) 2019-11-08 23:56:57 -05:00
Justin Starry 02058ea699
Reject blocks with invalid last ticks in replay stage (#6833) 
* Reject blocks with invalid last ticks in replay stage

* slot_full
 2019-11-08 20:21:54 -05:00
Michael Vines d1daeb44e6
Remove custom stack_size() (#6844) 2019-11-08 17:11:07 -07:00
Michael Vines efdfc5c327
Remove TODOs (#6843) 2019-11-08 16:43:18 -07:00
Michael Vines 9c00ad9ff2
Remove some low-hanging TODOs (#6839) 2019-11-08 16:41:36 -07:00
Pankaj Garg da425cc225
Don't insert coding shreds into blocktree on leader (#6831) 2019-11-08 13:54:23 -08:00
Michael Vines b800642fa4
Add new fork log message for when the node is leader for consistency (#6808) 2019-11-08 12:30:25 -07:00
Parth 5bd05fba09
require `to` account signature (#6658) 
* require to signature

* fixing invocation to create_account

* fix create_account references

* address review comment

* whacking bugs in tests

* fixing stake program tests
 2019-11-08 15:57:35 +05:30
sakridge 8e81bc1b49
Fix pinning (#6604) 
Remove Deref implementations and add more pass-throughs to the PinnedVec
wrapper.
Warm recyclers
set_pinnable
 2019-11-07 19:48:33 -08:00
Rob Walker b64b54f48f
unfork dalek ed25519 (#6776) 2019-11-07 17:08:10 -08:00
Sagar Dhawan 67d1e2903c
Upgrade Repair be more intelligent and agressive (#6789) 
* Upgrade Repair be more intelligent and agressive

* Fix u64 casts

* Fix missing bracket

* Add 1 second delay to test to allow repair to kick in
 2019-11-07 11:08:09 -08:00
Sunny Gleason a684984f8b
feat: add confirm_transaction, add rpc client test (#6778) 2019-11-06 22:08:03 -05:00
Jack May 65de227520
Don't panic on packet data (#6769) 2019-11-06 14:32:37 -08:00
Pankaj Garg 0ace79939b
Add reference tick to data shreds (#6772) 
* Add reference tick to data shreds

* fix tests
 2019-11-06 13:27:58 -08:00
Tyera Eulberg b3a75a60a4
Use rooted bank by default in rpc bank selection (#6759) 
* Name anonymous parameters for clarity

* Add CommitmentConfig to select bank for rpc

* Add commitment information to jsonrpc docs

* Update send_and_confirm retries as per commitment defaults

* Pass CommitmentConfig into client requests; also various 'use' cleanup

* Use _with_commitment methods to speed local_cluster tests

* Pass CommitmentConfig into Archiver in order to enable quick confirmations in local_cluster tests

* Restore solana ping speed

* Increase wallet-sanity timeout to account for longer confirmation time
 2019-11-06 14:15:00 -07:00
anatoly yakovenko 5e8668799c Fewer recyclers. (#6770) 
automerge
 2019-11-06 12:35:51 -08:00
anatoly yakovenko 67f636545a Refactor sigverify to stage for signing shreds on the GPU (#6635) 
automerge
 2019-11-06 10:52:30 -08:00
carllin 7ff2a44a63 Make last shred for an interrupted slot signed + typed (#6760) 2019-11-06 08:25:17 -07:00
Michael Vines b5074d8577
Enable JSON RPC request/response logging by default (#6758) 2019-11-06 08:23:13 -07:00
carllin 24102a7435
Allow voting on empty banks (#6719) 
* Allow votes on empty banks

* Remove making first bank is_delta true, no longer necessary for idling

* Remove votable from ledger tool
 2019-11-06 01:02:26 -08:00
Jack May 9614d17024
Limit deserialization of data coming off the wire (#6751) 
* Limit deserialization of data coming off the wire

* Feedback and cleanup
 2019-11-06 00:07:57 -08:00
Michael Vines 09e648f957
ledger-tool/: Include full validator voting history in fork-graph (#6756) 2019-11-05 19:40:00 -07:00
carllin 8f91b5aab3
Add threshold to repairman for same slot (#6728) 2019-11-05 12:48:45 -08:00
sakridge c312d4fba0
Calculate proofs collected and don't encrypt if there are none (#6698) 2019-11-05 11:38:50 -08:00
Michael Vines 7203036e3e Adjust nofiles within Blocktree::open() for all ledger/ users (#6737) 
automerge
 2019-11-05 11:18:49 -08:00
Tyera Eulberg c6931dcb07
Remove credit-only account handling (#6726) 
* Renaming
- credit-only/credit-debit to read-only/read-write
- debitable to writable

* Remove credit handling, making credit-only accounts read-only

* Update programs to remove deprecated credit-only account designation

* Use readonly and writable instead of underscored types
 2019-11-05 09:38:35 -07:00
Michael Vines fba1af6ea9
ledger-tool can now load a ledger snapshot (#6729) 2019-11-04 22:14:55 -07:00
anatoly yakovenko b825d04597 Pull perf into a separate module. (#6718) 
automerge
 2019-11-04 20:13:43 -08:00
Michael Vines 4d52f47f87
Move get_bank_forks() into ledger/ so its available for use by ledger-tool/ (#6720) 2019-11-04 19:10:06 -07:00
anatoly yakovenko f54cfcdb8f
Store and persists full stack of tower votes in gossip (#6695) 
* vote array

wip

wip

wip

update

gossip index should match tower index

tests build

clippy

test index after expired vote

test

bank specific last vote sync time

* verify

* we are likely to see many more warnings about old votes now
 2019-11-04 16:19:54 -08:00
sakridge 57983980a7 Lower verify-batch-size to debug (#6722) 
automerge
 2019-11-04 16:00:59 -08:00
Tyera Eulberg 33f4aaf3fd
Rename confidence to commitment (#6714) 2019-11-04 16:44:27 -07:00
Pankaj Garg c138d692b1
Show all ports for nodes in gossip table (#6717) 
* Show all ports for nodes in gossip table

* review comments
 2019-11-04 15:05:08 -08:00
Michael Vines 5e3697807c
Fail gracefully if AVX support is missing (#6705) 2019-11-04 11:03:39 -07:00
Sagar Dhawan 568475e2db
Fix incorrectly signed CrdsValues (#6696) 2019-11-03 10:07:51 -08:00
anatoly yakovenko 9ea398416e
Sign shreds on the GPU (#6595) 
* sign gpu shreds

* wip

* checks

* tests build

* test

* tests

* test

* nits

* sign cpu test

* write out the sigs in parallel

* clippy

* cpu test

* prepare secret for gpu

* woot!

* update

* bump perf libs
 2019-11-02 06:23:14 -07:00
Michael Vines 50a17fc00b Use Slot and Epoch type aliases instead of raw u64 (#6693) 
automerge
 2019-11-02 00:38:30 -07:00
Sagar Dhawan a57f6b70da Fix swapped repair and forwards addrs (#6691) 
automerge
 2019-11-01 16:01:42 -07:00
anatoly yakovenko 385b4ce959
Get rid of verified packets and use the Meta::discard flag (#6674) 
* get rid of verified packets and use the disabled meta field everywhere
 2019-11-01 14:23:03 -07:00
Sagar Dhawan 2d67962c2f
Send repairman shreds to the repair socket (#6671) 2019-10-31 18:23:50 -07:00
Justin Starry e8e5ddc55d
Verify number of hashes for each block of entries (#6262) 
* Verify number of hashes for each block of entries

* Fix blocktree processor tick check

* Rebase once more
 2019-10-31 16:38:50 -04:00
carllin 59f3dc3b6b
Fix PohRecorder Metrics (#6644) 
* Update Poh Recorder Dashboard

* Update PohRecorder logging
 2019-10-30 18:55:29 -07:00
Rob Walker fa12a5f70b
kill rent calculator (#6625) 2019-10-30 16:25:12 -07:00
sakridge 38491c8c4b
Reduce verify-batch-size log (#6623) 2019-10-30 13:41:11 -07:00
Sagar Dhawan 801337a422 Refactor Weighted Shuffle (#6614) 
automerge
 2019-10-29 21:02:11 -07:00
TristanDebrunner b4dc1a7263 Remove move feature (#6605) 
automerge
 2019-10-29 17:14:07 -07:00
Sagar Dhawan ef3aa2731c Fix Weighted Best calculation (#6606) 
automerge
 2019-10-29 17:04:11 -07:00
dependabot-preview[bot] 029a2837e4 Bump jsonrpc-http-server from 14.0.1 to 14.0.3 (#6597) 
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc) from 14.0.1 to 14.0.3.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.1...v14.0.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-29 10:30:06 -07:00
anatoly yakovenko 34a9619806
SigVerify stage for shreds. (#6563) 2019-10-28 16:07:51 -07:00
Sagar Dhawan 579a02529d
Fix unnecessarily copying shreds in broadcast stage (#6588) 
* Optimize coalesce_shreds to not explictly clone

* Remove Coalesce Shreds altogether

* fn no longer needs clippy exception
 2019-10-28 14:58:27 -07:00
anatoly yakovenko 243fa6cf63
Shred gpu sigverify (#6520) 
Implement APIs for verifying shred signatures on the GPU.
 2019-10-28 10:29:38 -07:00
dependabot-preview[bot] 30c0a7d069 Bump serde from 1.0.101 to 1.0.102 (#6581) 
automerge
 2019-10-28 09:19:39 -07:00
dependabot-preview[bot] 71b4e765c8 Bump itertools from 0.8.0 to 0.8.1 (#6583) 
Bumps [itertools](https://github.com/bluss/rust-itertools) from 0.8.0 to 0.8.1.
- [Release notes](https://github.com/bluss/rust-itertools/releases)
- [Commits](https://github.com/bluss/rust-itertools/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-28 08:26:15 -07:00
dependabot-preview[bot] 73dd5aa2d1 Bump serde_derive from 1.0.101 to 1.0.102 (#6582) 
Bumps [serde_derive](https://github.com/serde-rs/serde) from 1.0.101 to 1.0.102.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.101...v1.0.102)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-28 08:24:13 -07:00
carllin 6efaaa9d7a
Blocktree metrics (#6527) 
* Add metrics for blocktree performance
* Plumb metrics through window service
 2019-10-26 16:15:59 -07:00
Dan Albert 73c31d873e
Update Cargo.toml versions from 0.20.0 to 0.21.0 (#6568) 2019-10-25 17:40:49 -06:00
dependabot-preview[bot] 8a37b1e742 Bump jsonrpc-ws-server from 14.0.1 to 14.0.3 (#6553) 
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc) from 14.0.1 to 14.0.3.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-25 09:40:42 -07:00
dependabot-preview[bot] 0cf4eb2ee4 Bump jsonrpc-core from 14.0.1 to 14.0.3 (#6552) 
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc) from 14.0.1 to 14.0.3.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-25 09:40:25 -07:00
dependabot-preview[bot] 5496f85dbc Bump crc from 1.8.1 to 1.9.0 (#6511) 
Bumps [crc](https://github.com/mrhooray/crc-rs) from 1.8.1 to 1.9.0.
- [Release notes](https://github.com/mrhooray/crc-rs/releases)
- [Commits](https://github.com/mrhooray/crc-rs/compare/1.8.1...v1.9.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-25 09:40:17 -07:00
dependabot-preview[bot] 1738632822 Bump jsonrpc-pubsub from 14.0.1 to 14.0.3 (#6551) 
Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc) from 14.0.1 to 14.0.3.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-25 07:41:09 -07:00
dependabot-preview[bot] bbd5dde66d Bump jsonrpc-derive from 14.0.1 to 14.0.3 (#6554) 
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc) from 14.0.1 to 14.0.3.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.1...v14.0.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-25 07:41:03 -07:00
sakridge 53c7be32b6
Add more retransmit and streamer stats (#6534) 2019-10-24 19:27:19 -07:00
Michael Vines 397ea05aa7
spy nodes are now gossip entrypoints (#6532) 2019-10-24 15:35:33 -07:00
Rob Walker b4119c454a
credit_only credits forwarding (#6509) 
* credit_only_credits_forwarding

* whack transfer_now()

* fixup

* bench should retry the airdrop TX

* fixup

* try to make bench-exchange a bit more robust, informative
 2019-10-23 22:01:22 -07:00
sakridge 03d29a8311
Async poh verify (#6353) 
* Async poh verify

* Up ticks_per_s to 160

GPU poh verify needs shorter poh sequences or it takes forever to
verify. Keep slot time the same at 400ms.

* Fix stats

* Don't halt on ticks

* Increase retries for local_cluster tests and make repairman test serial
 2019-10-23 12:11:04 -07:00
Michael Vines 35cc74ef25
Add GenesisBlock::OperatingMode to control how cluster features are activated (#6430) 2019-10-23 11:50:10 -07:00
Sunny Gleason 0b2d4f32fa
feat: get epoch schedule rpc, update cli (#6500) 2019-10-22 16:41:18 -04:00
sakridge e6438098e1 Increase archiver polling timeout (#6501) 
automerge
 2019-10-22 12:15:55 -07:00
carllin b38bf90de7
Deshred blocks in parallel (#6461) 
* Deshred in parallel

* Add tests for corrupt slots and parallel deshred

* Rename load_blocktree_entries to load_blocktree_entries_with_shred_count
 2019-10-21 16:15:10 -07:00
Pankaj Garg 84e911361a
Use constants instead of lazy_static for shred header sizes (#6472) 2019-10-21 12:46:16 -07:00
Sagar Dhawan 364583ea5c
Fix copying packets in Window Service (#6429) 
* Fix copying packets in Window Service

* Parallelize over batches instead of within batches
 2019-10-21 12:04:52 -07:00
Greg Fitzgerald 9232057e95
Rename replicator to archiver (#6464) 
* Rename replicator to archiver

* cargo fmt

* Fix grammar
 2019-10-21 11:29:37 -06:00
dependabot-preview[bot] 91920cc390 Bump jsonrpc-pubsub from 14.0.0 to 14.0.1 (#6465) 
Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc) from 14.0.0 to 14.0.1.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.0...v14.0.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-21 07:48:28 -07:00
dependabot-preview[bot] cc1cc7be94 Bump jsonrpc-derive from 14.0.0 to 14.0.1 (#6466) 
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc) from 14.0.0 to 14.0.1.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.0...v14.0.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-21 07:48:14 -07:00
Greg Fitzgerald 2636418659
Move blocktree_processor to solana_ledger (#6460) 
* Drop core::result dependency in bank_forks

* Move blocktree_processor into solana_ledger
 2019-10-20 09:54:38 -06:00
Justin Starry 31e9074ae5
Rename leader_after_slots to leader_after_n_slots (#6459) 2019-10-19 23:28:33 -04:00
Rob Walker e2c316d2d0
system_instruction_processor updates (#6448) 
* zero lamport account creation

* whack create_user_account, take 2

* target->to

* ..

* ..

* update chacha golden

* update chacha golden

* ..

* ..
 2019-10-19 18:23:27 -07:00
sakridge 74ee88d9bc
Add storage stage and bank_forks tests to integration (#6458) 2019-10-19 12:09:45 -07:00
Pankaj Garg badeb4d31a
Rework shred headers to fix position of signature (#6451) 
* Rework shred headers to fix position of signature

* fix clippy
 2019-10-18 22:55:59 -07:00
Tyera Eulberg 785c2574cd Check that transaction fee-payer is a debitable account (#6454) 
automerge
 2019-10-18 20:39:05 -07:00
sakridge 1a77f7ce3b Change to 0x7f which is a valid short_vec len (#6455) 
automerge
 2019-10-18 19:56:48 -07:00
Greg Fitzgerald 6e7dccbbfb
Add an error enum to snapshot_utils (#6453) 2019-10-18 19:16:06 -06:00
sakridge 32bfced6a4
Add offset checks for sigverify (#6452) 
* Add offset checks for sigverify

* decode_len returning error instead of unwrap
 2019-10-18 17:52:59 -07:00
Greg Fitzgerald e81ba8e79f Split snapshot_package module (#6447) 
automerge
 2019-10-18 14:58:16 -07:00
Greg Fitzgerald a19ffb353d Don't hide serialization errors (#6443) 
automerge
 2019-10-18 13:35:05 -07:00
dependabot-preview[bot] 171c0d5421 Bump jsonrpc-core from 14.0.0 to 14.0.1 (#6439) 
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc) from 14.0.0 to 14.0.1.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-18 11:17:25 -07:00
dependabot-preview[bot] c01bc4afbd Bump jsonrpc-http-server from 14.0.0 to 14.0.1 (#6437) 
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc) from 14.0.0 to 14.0.1.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-18 11:04:30 -07:00
dependabot-preview[bot] c404008743 Bump jsonrpc-ws-server from 14.0.0 to 14.0.1 (#6438) 
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc) from 14.0.0 to 14.0.1.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-18 11:03:58 -07:00
Ryo Onodera 193c9a08e0 Reject TXs when there is a mismatch (#6236) 
automerge
 2019-10-18 09:48:35 -07:00
Greg Fitzgerald 5468be2ef9 Add solana-ledger crate (#6415) 
automerge
 2019-10-18 09:28:51 -07:00
TristanDebrunner 9cf9de6044 Remove the Cursor struct (#6426) 2019-10-18 09:18:36 -06:00
dependabot-preview[bot] 51dad397ed Bump libc from 0.2.64 to 0.2.65 
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.64 to 0.2.65.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.64...0.2.65)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-18 08:05:49 -07:00
carllin 27c0d30a07
Fix logging (#6417) 2019-10-18 02:06:41 -07:00
Pankaj Garg 6c33c3a5ba Update shred tests to use specific error codes (#6428) 
automerge
 2019-10-17 22:50:38 -07:00
Sagar Dhawan 298ba34c3c
Add flag to mark a packet as discarded (#6427) 2019-10-17 16:26:29 -07:00
Greg Fitzgerald 24846b7b61 Don't use BlocktreeError from Shredder (#6423) 
automerge
 2019-10-17 15:44:15 -07:00
TristanDebrunner 9e52d11ad0
Remove Backend trait (#6407) 2019-10-17 15:19:27 -06:00
Greg Fitzgerald d3068c3918
Remove circular dependencies in core (#6408) 
* Remove core::result dependency from blocktree

* Remove core::result dependency from shred

* Move Packet from core::packet to sdk::packet

This way we don't need to split perf_libs yet.

* Disable packet when compiling BPF programs
 2019-10-17 11:37:30 -06:00
Greg Fitzgerald a931ad40c8 Remove unused code in entry (#6414) 
automerge
 2019-10-17 09:59:40 -07:00
Pankaj Garg 83c1831a01
Fix replay stage test (#6406) 2019-10-16 15:41:43 -07:00
carllin ccb4e32ee0
ReplayStage metrics (#6358) 
* ReplayStage metrics

* Add more metrics

* Refactor get_slot_entries_with_shred_count() to detect wasted work

* Update dashboard

* Update broadcast slots to micros

* Add broadcast dashboard
 2019-10-16 14:32:18 -07:00
Justin Starry 7e6e7e8406
Remove special handling of first ledger tick (#6263) 
* Remove special handling of first ledger tick

* Fix subtraction overflow

* @garious feedback

* Back to height

* More tick_height name changes

* Fix off-by-one

* Fix leader tick error

* Fix merge conflict

* Fix recently added test
 2019-10-16 15:53:11 -04:00
Ryo Onodera e267dfacdd Stabilize some banking stage tests (#6251) 
* Stabilize some banking stage tests

Fixes #5660

* Fix CI...

* clean up

* Fix ci

* Address review nits

* Use bank.max_tick_height due to off-by-one for no PohRecord's clearing bank

* Fix CI...

* Use bank.max_tick_height() instead for clarity
 2019-10-16 12:37:27 -07:00
Ryo Onodera f4c5da3c72 Fix unaligned read of short_vec pubkey_size in sigverify (#6388) 
automerge
 2019-10-16 11:09:17 -07:00
Pankaj Garg a258e1e0b3 Fix flaky test_recv_mmsg_batch_size (#6399) 
automerge
 2019-10-16 11:01:41 -07:00
dependabot-preview[bot] f6b48b0a67 Bump libc from 0.2.62 to 0.2.64 
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.62 to 0.2.64.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.62...0.2.64)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-16 10:03:06 -07:00
Pankaj Garg 33052c1dd2 Cleanup shred header structures (#6378) 
automerge
 2019-10-15 20:48:45 -07:00
Pankaj Garg 20e800230f
Don't deserialize coding header for data shreds (#6367) 
* Don't deserialize coding hdr for data shreds

* review comments

* fix tests
 2019-10-15 15:18:23 -07:00
sakridge 1afc527919
Lower cluster_info-num_nodes datapoint (#6368) 2019-10-15 14:42:19 -07:00
sakridge dfca2b510b
Lower shred/receiver stats (#6365) 
too many messages
 2019-10-15 11:43:52 -07:00
Tyera Eulberg f8ccd90eeb Add ForkConfidenceCache methods (#6359) 
automerge
 2019-10-14 22:14:20 -07:00
Michael Vines 88bb55ffd2 Add get_vote_accounts() to RPC client 2019-10-14 20:38:51 -07:00
Michael Vines 5508ac6272 Add root slot to getVoteAccounts 2019-10-14 20:38:51 -07:00
dependabot-preview[bot] 2be03ca631 Bump reqwest from 0.9.21 to 0.9.22 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.9.21 to 0.9.22.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/v0.9.22/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.21...v0.9.22)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-14 16:33:16 -07:00
Tyera Eulberg 5d99853502 Add getBlockConfidence rpc endpoint (#6350) 
automerge
 2019-10-14 15:24:10 -07:00
Pankaj Garg 3313b2ff58 Fetch stage batching of forwarded txs (#6349) 
automerge
 2019-10-14 13:32:29 -07:00
Greg Fitzgerald 322fcea6e5
More fullnode to validator renaming (#6337) 2019-10-11 13:30:52 -06:00
Pankaj Garg 5650231df3
Increase buffer size for erasure meta DB column (#6335) 2019-10-11 12:18:11 -07:00
Justin Starry 78b2e4df9f
Revert "Revert "Bump jsonrpc-core from 13.2.0 to 14.0.0 (#6287)" (#6328)" (#6336) 
This reverts commit 578aa439be.
 2019-10-11 13:19:13 -04:00
carllin bf9c815b9e
Increase Index column buffers (#6268) 2019-10-10 23:17:39 -07:00
Justin Starry 578aa439be
Revert "Bump jsonrpc-core from 13.2.0 to 14.0.0 (#6287)" (#6328) 
This reverts commit c2761a1259.
 2019-10-11 00:32:06 -04:00
Pankaj Garg 364781366a
Use sendmmsg for broadcasting shreds (#6325) 
* Replace packet with slice of data in sendmmsg

* fixes

* fix bench
 2019-10-10 19:38:48 -07:00
Greg Fitzgerald c6e4641781
Remove many uses of legacy term 'fullnode' (#6324) 2019-10-10 17:33:00 -06:00
Pankaj Garg 753bd77b41
Use multicast to send retransmit packets (#6319) 2019-10-10 15:02:36 -07:00
carllin 1960ea8ed7
Add benches for shredding and poh (#6307) 
* Add benches for shredding and poh

* ignore poh bench

* Factor out Poh bench as separate function
 2019-10-10 14:00:24 -07:00
sakridge 1b775044f7
Use multiple retransmit stage threads/sockets (#6279) 2019-10-10 13:24:03 -07:00
Pankaj Garg 570b98c7bc
Multicast same packet to multiple destinations via sendmmg (#6316) 
* Implement multicast same packet to multiple destinations using sendmmsg()
 2019-10-10 13:09:15 -07:00
dependabot-preview[bot] c2761a1259 Bump jsonrpc-core from 13.2.0 to 14.0.0 (#6287) 
* Bump jsonrpc-core from 13.2.0 to 14.0.0

Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc) from 13.2.0 to 14.0.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.2.0...v14.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump all jsonrpc versions
 2019-10-10 10:32:38 -06:00
carllin 1f345ce2d9
Don't grab keypair from cluster info on every iteration of broadccast (#6303) 2019-10-09 17:36:45 -07:00
Pankaj Garg ed85aa43a4
Implement sendmmsg() API (#6304) 
* Implement sendmmsg()

* fixes
 2019-10-09 17:06:56 -07:00
Sagar Dhawan 4b0250192a Remove remnants of the cuda feature flag (#6298) 
automerge
 2019-10-09 16:09:36 -07:00
carllin dd66d16fdb
Broadcast final shred for slots that are interrupted (#6269) 
* Broadcast final shred for slots that are interrupted
 2019-10-09 16:07:18 -07:00
Sagar Dhawan 32312f3c16
Do not retransmit Repair responses (#6284) 
* Do not retransmit Repair responses

* Add a test

* Refactor neighboring functionality
 2019-10-09 13:11:19 -07:00
Pankaj Garg 2db83e1a21
Remove greedy fetch in shred_fetch stage (#6278) 
* Remove greedy fetch in shred_fetch stage

* cleanup
 2019-10-09 10:36:05 -07:00
dependabot-preview[bot] cfbfcb5734 Bump dir-diff from 0.3.1 to 0.3.2 (#6265) 
Bumps [dir-diff](https://github.com/steveklabnik/dir-diff) from 0.3.1 to 0.3.2.
- [Release notes](https://github.com/steveklabnik/dir-diff/releases)
- [Changelog](https://github.com/assert-rs/dir-diff/blob/master/CHANGELOG.md)
- [Commits](https://github.com/steveklabnik/dir-diff/compare/v0.3.1...v0.3.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-09 11:12:15 -06:00
Rob Walker 7cf90766a3
add epoch_schedule sysvar (#6256) 
* add epoch_schedule sysvar

* book sheesh!
 2019-10-08 22:34:26 -07:00
Justin Starry f2ee01ace3
Fix blocktree processor entry callback test (#6285) 2019-10-08 20:38:05 -04:00
Justin Starry 5e31565574
Expand blocktree processor options (#6248) 
* Refactor blocktree processor args and support full leader cache

* Add entry callback option

* Rename num_threads to override_num_threads

* Add test for entry callback

* Refactor cached leader schedule changes

* Add tests for blocktree process options

* Refactor test

* @mvines feedback
 2019-10-08 17:58:49 -04:00
Sagar Dhawan 723f9a9b81
Remove unnecessary locking in retransmit stage (#6276) 
* Add more detailed metrics to retransmit

* Remove unnecessary locking and add more metrics
 2019-10-08 14:41:16 -07:00
sakridge c5e5342325
Rearrange broadcast stats (#6274) 2019-10-08 12:50:59 -07:00
Pankaj Garg 788296047a
Increase batch size for recvmmsg() (#6260) 
* Increase batch size for recvmmsg()

* fix tests

* new test
 2019-10-08 09:54:49 -07:00
carllin 9dceb8ac74 Broadcast/Shredding Metrics (#6270) 
automerge
 2019-10-08 01:42:42 -07:00
carllin ac2374e9a1
Shred entries in parallel (#6180) 
* Make shredding more parallel

* Fix erasure tests

* Fix replicator test

* Remove UnfinishedSlotInfo
 2019-10-08 00:42:51 -07:00
carllin e12c577b16
remove verify_hash_internal_state (#6261) 2019-10-07 16:38:54 -07:00
sakridge ba7efbb136
Retransmit stage optimization, don't copy packets (#6250) 2019-10-07 15:33:22 -07:00
Pankaj Garg 17f169f446
BlobFetchStage cleanup post shred work (#6254) 2019-10-07 11:08:01 -07:00
Michael Vines 4870a2cbac Panic when a snapshot fails to verify 2019-10-07 08:12:18 +09:00
sakridge da7d94d0f0
Retransmit stage benchmark (#6249) 2019-10-06 12:56:17 -07:00
carllin cdef065cca
Broadcast Metrics (#6166) 
* Add timing logigng to broadcast

* Shred metrics

* Fixes
 2019-10-05 22:51:47 -07:00
sakridge 5ef012b2c1
Tweak debug to remove unreadable datapoints (#6060) 2019-10-04 16:25:22 -07:00
Tyera Eulberg 0c3ff6b75c Cli refactor: vote and storage program functionalities (#6242) 
automerge
 2019-10-04 14:18:19 -07:00
Michael Vines 7f53737000
Periodically pull from the entrypoint if it's no longer in Crdt (#6240) 2019-10-04 14:18:07 -07:00
Sagar Dhawan 23ea8ae56b
Optimize retransmit stage (#6231) 
* Optimize retransmit stage

* Remove comment

* Fix test

* Skip iteration to fixup 0 stakes
 2019-10-04 11:52:02 -07:00
dependabot-preview[bot] d759a447be Bump serde_json from 1.0.40 to 1.0.41 (#6226) 
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.40 to 1.0.41.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.40...v1.0.41)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-03 21:03:05 -06:00
dependabot-preview[bot] 7ac4ce637f Bump reqwest from 0.9.20 to 0.9.21 (#6221) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.9.20 to 0.9.21.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/v0.9.21/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.20...v0.9.21)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-10-02 22:52:48 -07:00
Michael Vines f9f5bc2eb5
More clippy 2019-10-02 21:21:07 -07:00
Michael Vines 9fe8c98047
Switch to solana-reed-solomon-erasure temporarily to fix windows build (#6211) 2019-10-02 19:01:55 -07:00
Pankaj Garg f331f1d1e9
Don't forward transaction to self (#6218) 2019-10-02 14:07:34 -07:00
sakridge 211cae5811
Remove dead constants (#6207) 2019-10-01 18:22:57 -07:00
Pankaj Garg 774e9df2e5
Finish unfininished slot before processing new slots (#6197) 2019-10-01 11:46:14 -07:00
sakridge ae7700296d
broadcast_shreds opt (#6175) 
* Don't clone/copy/sort ContactInfo vec
 2019-10-01 09:38:29 -07:00
Jack May 520f7c3e18
Optimize BPF logs (#6186) 2019-09-30 14:21:29 -07:00
Parth 2c8c2029d8
cli: enforce rent-exemption balance for stake, vote and program accounts in cli (#6118) 
* require minimum balance for stake, vote and program accounts
 2019-10-01 01:14:49 +05:30
Rob Walker 4f4618441c
split wallet staking commands (#6168) 
* split wallet staking commands

* elide real home

* unit->UNIT for usage

* unit->UNIT, don't try to run SUBCOMMANDS: ;)

* more fixup

* fixups

* actually check

* shellcheck

* preserve #6158 after rebase

* fixup

* test

* too hard

* remove test
 2019-09-29 21:18:15 -07:00
Michael Vines e5a7d08966 Add --expected-genesis-blockhash validator argument (#6174) 
automerge
 2019-09-29 19:09:24 -07:00
Michael Vines d50aef8404 Add get-epoch-info command (#6161) 
automerge
 2019-09-27 22:00:30 -07:00
Pankaj Garg 5637f88aff Don't try signging coding shred if fec rate is 0 (#6171) 
automerge
 2019-09-27 21:58:53 -07:00
sakridge 75a92d58cb
Featureize move (#5897) 
* Featureize move

* Add move featured test
 2019-09-27 12:19:06 -07:00
Tyera Eulberg c9e58743e7
Prevent subtract overflow panic when slot < MAX_LOCKOUT_HISTORY (#6135) 2019-09-26 19:40:18 -06:00
Michael Vines b4da83a3ab
Remove CUDA feature (#6094) 2019-09-26 13:36:51 -07:00
Rob Walker a964570b1a
add authorities to stake init (#6104) 
* add authorities to stake init

* fixups

* code review
 2019-09-26 13:29:29 -07:00
Rob Walker 50bbe34b66
rename locktower to tower (#6120) 2019-09-26 13:29:05 -07:00
Parth 67d07254c2
Add rent estimation rpc (#6109) 
* server side new rpc endpoint

* client side rpc

* take data_len as usize

Co-Authored-By: Tyera Eulberg <teulberg@gmail.com>

* add test and documentation
 2019-09-26 23:27:13 +05:30
carllin 701d90a41d
Remove some AccountStorage Serialization (#6047) 
* Remove serialization of AccountStorageEntry fields

* Add metric for evaluating BankRc serialization time

* Serialize AppendVec current len

* Add dashboard metrics

* Move flush of AppendVecs to packaging thread
 2019-09-25 18:07:41 -07:00
Rob Walker 43795193c4
add authorized parameters to vote api (#6072) 
* add authorized parameters to vote api

* code review
 2019-09-25 13:53:49 -07:00
dependabot-preview[bot] 62429585ba Bump bincode from 1.1.4 to 1.2.0 (#6065) 
Bumps [bincode](https://github.com/servo/bincode) from 1.1.4 to 1.2.0.
- [Release notes](https://github.com/servo/bincode/releases)
- [Commits](https://github.com/servo/bincode/compare/v1.1.4...v1.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-25 14:44:29 -06:00
Sagar Dhawan e987d0094f
Move status cache serialization to the Snapshot Packager service (#6081) 
* Move status cache serialization to the Snapshot Packager service

* Minor comment updates

* use ok_or_else instead of ok_or

* satus cache

* Remove assert when snapshot format is wrong

* Fix compile

* Remove slots_to_snapshot from bank forks

* Address review comment

* Remove unused imports
 2019-09-25 13:42:19 -07:00
Pankaj Garg de3765ab70 Add erasure recovery stats to dashboard (#6079) 
automerge
 2019-09-24 19:59:42 -07:00
Michael Vines 5f079137e5 Remove kvstore (#6075) 
automerge
 2019-09-24 19:59:32 -07:00
Sagar Dhawan 374b776a3e
Fix using temp file for archive (#6058) 
* Fix using temp file for archive

* Rename the temp archive instead of hardlinking it
 2019-09-24 15:24:54 -07:00
Pankaj Garg 5763d63737 Additional tests for should_retransmit_and_persist (#6062) 
automerge
 2019-09-24 14:54:10 -07:00
Tyera Eulberg 7babfd00c1
Revert back to reqwest, using rustls feature (#6041) 
* Revert back to reqwest, using rustls feature

* Cargo.lock and crate-features

* Ignore test
 2019-09-24 14:10:59 -06:00
Pankaj Garg 3ed34b571c
Window service is filtering out coding shreds (#6052) 
* Window service is filtering out coding shreds

* update erasure stats to indicate recovery count

* filter out outdated coding shreds

* address review comments
 2019-09-24 12:25:25 -07:00
Pankaj Garg 57e90948a8
Remove dead code from cluster_info (#6051) 2019-09-24 10:27:59 -07:00
Rob Walker 26a20a7e62
nits (#6032) 2019-09-24 10:10:49 -07:00
Michael Vines 7fa809c16d
Avoid hardlinking as that confuses tar (#6042) 2019-09-23 20:12:16 -07:00
Sagar Dhawan 84f74807d4 Skip considering banks older than the latest vote slot (#6037) 
automerge
 2019-09-23 19:40:03 -07:00
Pankaj Garg 3a9c03cc89
Don't recover coding shreds (#6034) 
* Don't recover coding shreds

* cleanup
 2019-09-23 16:24:21 -07:00
Michael Vines f055d2f0cc
' => " (#6035) 2019-09-23 16:03:38 -07:00
Sagar Dhawan 62c22c6cb1
Fix really old banks triggering log spam (#6025) 2019-09-23 13:59:16 -07:00
Pankaj Garg dbd337c616
Upgrade to ReedSolomon 4.0 release (#6026) 2019-09-23 13:53:52 -07:00
Michael Vines eeda7338cc
Dump tar stdout/err on failure for better debug (#6024) 2019-09-23 13:05:09 -07:00
Dan Albert 9c9991db1d
Update cargo toml and lock files to v0.20.0 (#6016) 2019-09-22 21:45:56 -04:00
carllin 8240d1fe0a
Confidence implementation (#5993) 
* Change confidence parameters

* Add status_cache_ancestors to get all relevant ancestors of a bank including roots from status cache

* Fix and add tests

* Clippy
 2019-09-20 19:38:56 -07:00
carllin fd6e7020eb
Fix bank overlapping another bank's broadcast (#6012) 2019-09-20 19:37:40 -07:00
dependabot-preview[bot] 22e807c212 Bump jsonrpc-ws-server from 13.1.0 to 13.2.0 (#5976) 
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc) from 13.1.0 to 13.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.1.0...v13.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-20 15:16:59 -06:00
Michael Vines a60a3efc1a
Revert "require stake, vote and executable accounts to be rent exempt (#5928)" (#6005) 
This reverts commit 11e6197a83.
 2019-09-20 14:10:39 -07:00
sakridge 19ae556857
hash account state on store (#5573) 2019-09-20 13:21:12 -07:00
Michael Vines 3d44cffcda
✨ Beautify metrics datapoint logging (#5998) 2019-09-20 12:00:43 -07:00
carllin c9be9acd14
log snapshot time (#5996) 2019-09-20 08:03:00 -07:00
dependabot-preview[bot] 8eab673b1c Bump serde from 1.0.100 to 1.0.101 (#5994) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.100 to 1.0.101.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.100...v1.0.101)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-20 07:05:16 -06:00
dependabot-preview[bot] e5806d07a6 Bump jsonrpc-pubsub from 13.1.0 to 13.2.0 (#5995) 
Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc) from 13.1.0 to 13.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.1.0...v13.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-20 07:04:14 -06:00
Parth 11e6197a83
require stake, vote and executable accounts to be rent exempt (#5928) 
* require vote account to be exempt

* make stake account rent exempt

* add rent exempted system instruction

* use rent exemption instruction in vote and stake api

* use rent exempted account while creating executable account

* updating chacha golden hash as instruction data has changed

* rent will be initialized for genesis bank too
 2019-09-20 16:52:17 +05:30
Michael Vines 1d0be265d9
Add explicit validator-cuda crate (#5985) 2019-09-19 20:50:34 -07:00
Sagar Dhawan d379786c90
Fix bind errors (#5986) 
* Add ability to bind to a common tcp/udp port

* Extend port range for local-net sanity and fix validator executable
 2019-09-19 17:16:22 -07:00
Pankaj Garg ca9d4e34df
Broadcast stage tuning (#5989) 2019-09-19 16:29:52 -07:00
dependabot-preview[bot] 5157bdd8ce Bump jsonrpc-http-server from 13.1.0 to 13.2.0 (#5975) 
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc) from 13.1.0 to 13.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.1.0...v13.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-19 13:10:54 -06:00
Rob Walker 5cbd1190b2
transaction batch (#5962) 
* transaction batch

* fixup
 2019-09-19 10:06:08 -07:00
dependabot-preview[bot] 1a71804ef2 Bump bs58 from 0.2.5 to 0.3.0 (#5974) 
Bumps [bs58](https://github.com/mycorrhiza/bs58-rs) from 0.2.5 to 0.3.0.
- [Release notes](https://github.com/mycorrhiza/bs58-rs/releases)
- [Commits](https://github.com/mycorrhiza/bs58-rs/compare/0.2.5...0.3.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-19 10:39:37 -06:00
dependabot-preview[bot] e83f6332bf Bump serde_derive from 1.0.100 to 1.0.101 (#5945) 
Bumps [serde_derive](https://github.com/serde-rs/serde) from 1.0.100 to 1.0.101.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.100...v1.0.101)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-18 21:29:40 -07:00
Pankaj Garg 0dbf7995b5
Remove unnecessary serialize of shred data (#5967) 
* Remove unnecessary serialize of shred data

* remove obsolete code

* fix golden hash
 2019-09-18 20:08:27 -07:00
Sagar Dhawan e0858cfe06
Add parallel shred signing to shredder (#5964) 2019-09-18 18:00:07 -07:00
Pankaj Garg 783e8672e7
Removed Shred enum (#5963) 
* Remove shred enum and it's references

* rename ShredInfo to Shred

* clippy
 2019-09-18 16:24:30 -07:00
Pankaj Garg 6c4e656795
Remove obsoleted code from shred (#5954) 
* Remove obsoleted code from shred

* fix broken test
 2019-09-18 13:56:44 -07:00
Sagar Dhawan b757294864
Add minor performance bump to shredding (#5956) 2019-09-18 12:35:52 -07:00
Rob Walker 0d4a2c5eb0
simplify poh recorder => broadcast channel (#5940) 
* simplify poh recorder broadcast channel

* fixup

* fixup
 2019-09-18 12:16:22 -07:00
dependabot-preview[bot] 31a276b628 Bump jsonrpc-core from 13.1.0 to 13.2.0 (#5894) 
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc) from 13.1.0 to 13.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.1.0...v13.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-18 11:44:47 -06:00
dependabot-preview[bot] 75c0a268e0 Bump jsonrpc-derive from 13.1.0 to 13.2.0 (#5893) 
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc) from 13.1.0 to 13.2.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/compare/v13.1.0...v13.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-18 10:48:37 -06:00
carllin 2f50d0e145
Refactor confidence from replay stage (#5938) 2019-09-17 19:43:40 -07:00
Pankaj Garg ff608992ee
Replace Shred usage with ShredInfo (#5939) 
* Replace Shred usage with ShredInfo

* Fix tests

* fix clippy
 2019-09-17 18:22:46 -07:00
Rob Walker a2595b44c6
test randomize with error (#5916) 
* test randomize with error

* update magic numbers

* fixup

* fixup

* fixup

* no more blobs

* fixup
 2019-09-17 15:11:29 -07:00
Sagar Dhawan 14cb6353c0
Change erasure ratio to 0.25 and increase data shreds to 16 (#5931) 
* Change erasure ratio to 0.25 and increase data shreds to 16

* Fix case where no coding shreds are requested
 2019-09-17 11:59:14 -07:00
Michael Vines e26f68fe62
Get transactions from LockedAccountsResults when possible (#5923) 2019-09-17 08:41:56 -07:00
Michael Vines f10438d530
Respect randomized transaction order when unlocking accounts (#5918) 2019-09-16 21:45:16 -07:00
Pankaj Garg 7459eb15c3
A new data-structure in shreds for partial deserialization (#5915) 
* A new datastructure in shreds for partial deserialization

* fix chacha golden hash

* fix clippy and address review comments
 2019-09-16 20:28:54 -07:00
Sagar Dhawan c44e7ce184
Leaders should not broadcast to replicators (#5917) 2019-09-16 17:56:34 -07:00
Sagar Dhawan 82615c703b
Switch erasure to solana-reed-solomon-erasure (#5913) 
* Switch to solana-reed-solomon-erasure

* Disable Rayon for solana-reed-solomon-erasure
 2019-09-16 16:14:55 -07:00
dependabot-preview[bot] bc2141fbe0 Bump ureq from 0.11.0 to 0.11.1 (#5905) 
Bumps [ureq](https://github.com/algesten/ureq) from 0.11.0 to 0.11.1.
- [Release notes](https://github.com/algesten/ureq/releases)
- [Commits](https://github.com/algesten/ureq/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-16 16:51:45 -06:00
carllin d5ba90d375
Don't verify blobs that are less than root in window service (#5901) 2019-09-16 13:13:53 -07:00
Pankaj Garg 5f54573613
More shred related cleanup (#5909) 
* More shred related cleanup

* fix uncle
 2019-09-16 10:28:28 -07:00
Pankaj Garg c1880e3f3e
Reduce number of shreds per FEC block (#5908) 2019-09-15 10:37:12 -07:00
Pankaj Garg ee791e2e3e
Optimizations to shred writing and signing (#5890) 
* Optimizations to shred writing and signing

* fix broken tests

* fixes
 2019-09-14 21:05:54 -07:00
sakridge ceacc42126
Call gpu init earlier to force compilation. (#5902) 2019-09-14 12:32:57 -07:00
Michael Vines 84c8a5bbec
Add replay-stage-mark_dead_slot datapoint (#5907) 2019-09-14 08:50:53 -07:00
Pankaj Garg 8135279335
Reduce serialize/deserialize in shred recovery (#5887) 2019-09-12 21:52:13 -07:00
Sagar Dhawan c1d788880d
Limit Rayon threadpool threads (#5871) 2019-09-12 11:39:39 -07:00
Pankaj Garg 385086359c
Reduce serializations/deserializations of shreds (#5879) 2019-09-12 10:10:25 -07:00
dependabot-preview[bot] a85604b2ba Bump sys-info from 0.5.7 to 0.5.8 (#5877) 
Bumps [sys-info](https://github.com/FillZpp/sys-info-rs) from 0.5.7 to 0.5.8.
- [Release notes](https://github.com/FillZpp/sys-info-rs/releases)
- [Commits](https://github.com/FillZpp/sys-info-rs/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-11 10:53:23 -07:00
Jack May 1853771930
Add support for SDK sysvar types (#5876) 2019-09-10 18:53:02 -07:00
carllin ee4266bc59
Remove banks in locktower not in bank_forks (#5837) 
* Remove unnecessary calculations from collect_vote_lockouts

* Add test for locktower startup from snapshot
 2019-09-10 13:58:27 -07:00
dependabot-preview[bot] 294d531e0b Bump serde_derive from 1.0.99 to 1.0.100 (#5864) 
automerge
 2019-09-10 13:31:11 -07:00
dependabot-preview[bot] 0d7efe5176 Bump serde from 1.0.99 to 1.0.100 (#5862) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.99 to 1.0.100.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.99...v1.0.100)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-10 12:27:41 -07:00
Pankaj Garg b426dfb2c0
Change tx batching in banking process and record (#5832) 
* Change tx batching in banking process and record

* Change batching to reduce impact on replay stage
 2019-09-10 11:04:03 -07:00
Pankaj Garg fd33b27af1
Fix coding shred generator (#5865) 2019-09-10 09:35:07 -07:00
Pankaj Garg 7682db4826
Generate coding shreds on the fly based on erasure limits (#5852) 
* Generate coding shreds on the fly based on erasure limits

* fix uncle
 2019-09-09 17:26:51 -07:00
carllin 7607800d47
Refactor restart function in local cluster to support separate exit and restart functions (#5845) 2019-09-08 17:53:34 -07:00
Michael Vines df205f8752
Use ureq instead of influx_db_client (#5839) 2019-09-07 12:48:45 -07:00
Jack May e8d88f3237
Split SDK's timing.rs (#5823) 2019-09-06 14:30:56 -07:00
dependabot-preview[bot] f28782cb84 Bump chrono from 0.4.8 to 0.4.9 (#5775) 
Bumps [chrono](https://github.com/chronotope/chrono) from 0.4.8 to 0.4.9.
- [Release notes](https://github.com/chronotope/chrono/releases)
- [Changelog](https://github.com/chronotope/chrono/blob/master/CHANGELOG.md)
- [Commits](https://github.com/chronotope/chrono/commits/v0.4.9)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-09-06 13:55:36 -06:00
Michael Vines 1f9fde5f7b
ThinClient internal name grooming (#5800) 2019-09-06 09:07:40 -07:00
Sagar Dhawan a452249bf3
Use retain on Packets instead of creating new ones (#5804) 
* Use remove on Packets instead of creating a new one

* Fix compile after rebase
 2019-09-05 19:16:18 -07:00
Pankaj Garg 3d3b03a123
Verify signature of recovered shred before adding them to blocktree (#5811) 
* Verify signature of recovered shred before adding them to blocktree

* fix failing tests, and review comments
 2019-09-05 18:20:30 -07:00
Pankaj Garg 05d2eec45c
Remove unnecessary erasure config references (#5809) 2019-09-05 14:46:41 -07:00
Pankaj Garg 3237e897d7
Adjust packet batching post-decoupling from blobs (#5783) 2019-09-05 11:22:39 -07:00
carllin bd74e63702
Offload remaining confidence cache computation to separate thread (#5792) 
* Move remaining confidence cache computation to separate thread

* Move confidence cache out of bank forks
 2019-09-04 23:10:25 -07:00
Pankaj Garg f78b865cba
Cleanup shreds to remove FirstShred data structure (#5789) 
* Cleanup shreds to remove FirstShred data structure

* Also reduce size used by parent slot information in shred header

* clippy

* fixes

* fix chacha test
 2019-09-04 21:06:47 -07:00
carllin 7062fe4b47
Refactor Blocktree for clarity and correctness (#5700) 
* Refactor shreds to prevent insertion of any metadata on bad shreds

* Refactor fetching Index in blocktree

* Refactor get_slot_meta_entry

* Re-enable local cluster test

* cleanup

* Add tests for success/fail insertion of coding/data shreds

* Remove assert

* Fix and add tests for should_insert coding and data blobs
 2019-09-04 17:14:42 -07:00