67f636545a
Refactor sigverify to stage for signing shreds on the GPU ( #6635 )
...
automerge
2019-11-06 10:52:30 -08:00
7ff2a44a63
Make last shred for an interrupted slot signed + typed ( #6760 )
2019-11-06 08:25:17 -07:00
b5074d8577
Enable JSON RPC request/response logging by default ( #6758 )
2019-11-06 08:23:13 -07:00
24102a7435
Allow voting on empty banks ( #6719 )
...
* Allow votes on empty banks
* Remove making first bank is_delta true, no longer necessary for idling
* Remove votable from ledger tool
2019-11-06 01:02:26 -08:00
9614d17024
Limit deserialization of data coming off the wire ( #6751 )
...
* Limit deserialization of data coming off the wire
* Feedback and cleanup
2019-11-06 00:07:57 -08:00
09e648f957
ledger-tool/: Include full validator voting history in fork-graph ( #6756 )
2019-11-05 19:40:00 -07:00
8f91b5aab3
Add threshold to repairman for same slot ( #6728 )
2019-11-05 12:48:45 -08:00
c312d4fba0
Calculate proofs collected and don't encrypt if there are none ( #6698 )
2019-11-05 11:38:50 -08:00
7203036e3e
Adjust nofiles within Blocktree::open() for all ledger/ users ( #6737 )
...
automerge
2019-11-05 11:18:49 -08:00
c6931dcb07
Remove credit-only account handling ( #6726 )
...
* Renaming
- credit-only/credit-debit to read-only/read-write
- debitable to writable
* Remove credit handling, making credit-only accounts read-only
* Update programs to remove deprecated credit-only account designation
* Use readonly and writable instead of underscored types
2019-11-05 09:38:35 -07:00
fba1af6ea9
ledger-tool can now load a ledger snapshot ( #6729 )
2019-11-04 22:14:55 -07:00
b825d04597
Pull perf into a separate module. ( #6718 )
...
automerge
2019-11-04 20:13:43 -08:00
4d52f47f87
Move get_bank_forks() into ledger/ so its available for use by ledger-tool/ ( #6720 )
2019-11-04 19:10:06 -07:00
f54cfcdb8f
Store and persists full stack of tower votes in gossip ( #6695 )
...
* vote array
wip
wip
wip
update
gossip index should match tower index
tests build
clippy
test index after expired vote
test
bank specific last vote sync time
* verify
* we are likely to see many more warnings about old votes now
2019-11-04 16:19:54 -08:00
57983980a7
Lower verify-batch-size to debug ( #6722 )
...
automerge
2019-11-04 16:00:59 -08:00
33f4aaf3fd
Rename confidence to commitment ( #6714 )
2019-11-04 16:44:27 -07:00
c138d692b1
Show all ports for nodes in gossip table ( #6717 )
...
* Show all ports for nodes in gossip table
* review comments
2019-11-04 15:05:08 -08:00
5e3697807c
Fail gracefully if AVX support is missing ( #6705 )
2019-11-04 11:03:39 -07:00
568475e2db
Fix incorrectly signed CrdsValues ( #6696 )
2019-11-03 10:07:51 -08:00
9ea398416e
Sign shreds on the GPU ( #6595 )
...
* sign gpu shreds
* wip
* checks
* tests build
* test
* tests
* test
* nits
* sign cpu test
* write out the sigs in parallel
* clippy
* cpu test
* prepare secret for gpu
* woot!
* update
* bump perf libs
2019-11-02 06:23:14 -07:00
50a17fc00b
Use Slot and Epoch type aliases instead of raw u64 ( #6693 )
...
automerge
2019-11-02 00:38:30 -07:00
a57f6b70da
Fix swapped repair and forwards addrs ( #6691 )
...
automerge
2019-11-01 16:01:42 -07:00
385b4ce959
Get rid of verified packets and use the Meta::discard flag ( #6674 )
...
* get rid of verified packets and use the disabled meta field everywhere
2019-11-01 14:23:03 -07:00
2d67962c2f
Send repairman shreds to the repair socket ( #6671 )
2019-10-31 18:23:50 -07:00
e8e5ddc55d
Verify number of hashes for each block of entries ( #6262 )
...
* Verify number of hashes for each block of entries
* Fix blocktree processor tick check
* Rebase once more
2019-10-31 16:38:50 -04:00
59f3dc3b6b
Fix PohRecorder Metrics ( #6644 )
...
* Update Poh Recorder Dashboard
* Update PohRecorder logging
2019-10-30 18:55:29 -07:00
fa12a5f70b
kill rent calculator ( #6625 )
2019-10-30 16:25:12 -07:00
38491c8c4b
Reduce verify-batch-size log ( #6623 )
2019-10-30 13:41:11 -07:00
801337a422
Refactor Weighted Shuffle ( #6614 )
...
automerge
2019-10-29 21:02:11 -07:00
ef3aa2731c
Fix Weighted Best calculation ( #6606 )
...
automerge
2019-10-29 17:04:11 -07:00
34a9619806
SigVerify stage for shreds. ( #6563 )
2019-10-28 16:07:51 -07:00
579a02529d
Fix unnecessarily copying shreds in broadcast stage ( #6588 )
...
* Optimize coalesce_shreds to not explictly clone
* Remove Coalesce Shreds altogether
* fn no longer needs clippy exception
2019-10-28 14:58:27 -07:00
243fa6cf63
Shred gpu sigverify ( #6520 )
...
Implement APIs for verifying shred signatures on the GPU.
2019-10-28 10:29:38 -07:00
6efaaa9d7a
Blocktree metrics ( #6527 )
...
* Add metrics for blocktree performance
* Plumb metrics through window service
2019-10-26 16:15:59 -07:00
53c7be32b6
Add more retransmit and streamer stats ( #6534 )
2019-10-24 19:27:19 -07:00
397ea05aa7
spy nodes are now gossip entrypoints ( #6532 )
2019-10-24 15:35:33 -07:00
b4119c454a
credit_only credits forwarding ( #6509 )
...
* credit_only_credits_forwarding
* whack transfer_now()
* fixup
* bench should retry the airdrop TX
* fixup
* try to make bench-exchange a bit more robust, informative
2019-10-23 22:01:22 -07:00
03d29a8311
Async poh verify ( #6353 )
...
* Async poh verify
* Up ticks_per_s to 160
GPU poh verify needs shorter poh sequences or it takes forever to
verify. Keep slot time the same at 400ms.
* Fix stats
* Don't halt on ticks
* Increase retries for local_cluster tests and make repairman test serial
2019-10-23 12:11:04 -07:00
35cc74ef25
Add GenesisBlock::OperatingMode to control how cluster features are activated ( #6430 )
2019-10-23 11:50:10 -07:00
0b2d4f32fa
feat: get epoch schedule rpc, update cli ( #6500 )
2019-10-22 16:41:18 -04:00
e6438098e1
Increase archiver polling timeout ( #6501 )
...
automerge
2019-10-22 12:15:55 -07:00
b38bf90de7
Deshred blocks in parallel ( #6461 )
...
* Deshred in parallel
* Add tests for corrupt slots and parallel deshred
* Rename load_blocktree_entries to load_blocktree_entries_with_shred_count
2019-10-21 16:15:10 -07:00
84e911361a
Use constants instead of lazy_static for shred header sizes ( #6472 )
2019-10-21 12:46:16 -07:00
364583ea5c
Fix copying packets in Window Service ( #6429 )
...
* Fix copying packets in Window Service
* Parallelize over batches instead of within batches
2019-10-21 12:04:52 -07:00
9232057e95
Rename replicator to archiver ( #6464 )
...
* Rename replicator to archiver
* cargo fmt
* Fix grammar
2019-10-21 11:29:37 -06:00
2636418659
Move blocktree_processor to solana_ledger ( #6460 )
...
* Drop core::result dependency in bank_forks
* Move blocktree_processor into solana_ledger
2019-10-20 09:54:38 -06:00
31e9074ae5
Rename leader_after_slots to leader_after_n_slots ( #6459 )
2019-10-19 23:28:33 -04:00
e2c316d2d0
system_instruction_processor updates ( #6448 )
...
* zero lamport account creation
* whack create_user_account, take 2
* target->to
* ..
* ..
* update chacha golden
* update chacha golden
* ..
* ..
2019-10-19 18:23:27 -07:00
74ee88d9bc
Add storage stage and bank_forks tests to integration ( #6458 )
2019-10-19 12:09:45 -07:00
badeb4d31a
Rework shred headers to fix position of signature ( #6451 )
...
* Rework shred headers to fix position of signature
* fix clippy
2019-10-18 22:55:59 -07:00
785c2574cd
Check that transaction fee-payer is a debitable account ( #6454 )
...
automerge
2019-10-18 20:39:05 -07:00
1a77f7ce3b
Change to 0x7f which is a valid short_vec len ( #6455 )
...
automerge
2019-10-18 19:56:48 -07:00
6e7dccbbfb
Add an error enum to snapshot_utils ( #6453 )
2019-10-18 19:16:06 -06:00
32bfced6a4
Add offset checks for sigverify ( #6452 )
...
* Add offset checks for sigverify
* decode_len returning error instead of unwrap
2019-10-18 17:52:59 -07:00
e81ba8e79f
Split snapshot_package module ( #6447 )
...
automerge
2019-10-18 14:58:16 -07:00
a19ffb353d
Don't hide serialization errors ( #6443 )
...
automerge
2019-10-18 13:35:05 -07:00
193c9a08e0
Reject TXs when there is a mismatch ( #6236 )
...
automerge
2019-10-18 09:48:35 -07:00
5468be2ef9
Add solana-ledger crate ( #6415 )
...
automerge
2019-10-18 09:28:51 -07:00
9cf9de6044
Remove the Cursor struct ( #6426 )
2019-10-18 09:18:36 -06:00
27c0d30a07
Fix logging ( #6417 )
2019-10-18 02:06:41 -07:00
6c33c3a5ba
Update shred tests to use specific error codes ( #6428 )
...
automerge
2019-10-17 22:50:38 -07:00
298ba34c3c
Add flag to mark a packet as discarded ( #6427 )
2019-10-17 16:26:29 -07:00
24846b7b61
Don't use BlocktreeError from Shredder ( #6423 )
...
automerge
2019-10-17 15:44:15 -07:00
9e52d11ad0
Remove Backend trait ( #6407 )
2019-10-17 15:19:27 -06:00
d3068c3918
Remove circular dependencies in core ( #6408 )
...
* Remove core::result dependency from blocktree
* Remove core::result dependency from shred
* Move Packet from core::packet to sdk::packet
This way we don't need to split perf_libs yet.
* Disable packet when compiling BPF programs
2019-10-17 11:37:30 -06:00
a931ad40c8
Remove unused code in entry ( #6414 )
...
automerge
2019-10-17 09:59:40 -07:00
83c1831a01
Fix replay stage test ( #6406 )
2019-10-16 15:41:43 -07:00
ccb4e32ee0
ReplayStage metrics ( #6358 )
...
* ReplayStage metrics
* Add more metrics
* Refactor get_slot_entries_with_shred_count() to detect wasted work
* Update dashboard
* Update broadcast slots to micros
* Add broadcast dashboard
2019-10-16 14:32:18 -07:00
7e6e7e8406
Remove special handling of first ledger tick ( #6263 )
...
* Remove special handling of first ledger tick
* Fix subtraction overflow
* @garious feedback
* Back to height
* More tick_height name changes
* Fix off-by-one
* Fix leader tick error
* Fix merge conflict
* Fix recently added test
2019-10-16 15:53:11 -04:00
e267dfacdd
Stabilize some banking stage tests ( #6251 )
...
* Stabilize some banking stage tests
Fixes #5660
* Fix CI...
* clean up
* Fix ci
* Address review nits
* Use bank.max_tick_height due to off-by-one for no PohRecord's clearing bank
* Fix CI...
* Use bank.max_tick_height() instead for clarity
2019-10-16 12:37:27 -07:00
f4c5da3c72
Fix unaligned read of short_vec pubkey_size in sigverify ( #6388 )
...
automerge
2019-10-16 11:09:17 -07:00
a258e1e0b3
Fix flaky test_recv_mmsg_batch_size ( #6399 )
...
automerge
2019-10-16 11:01:41 -07:00
33052c1dd2
Cleanup shred header structures ( #6378 )
...
automerge
2019-10-15 20:48:45 -07:00
20e800230f
Don't deserialize coding header for data shreds ( #6367 )
...
* Don't deserialize coding hdr for data shreds
* review comments
* fix tests
2019-10-15 15:18:23 -07:00
1afc527919
Lower cluster_info-num_nodes datapoint ( #6368 )
2019-10-15 14:42:19 -07:00
dfca2b510b
Lower shred/receiver stats ( #6365 )
...
too many messages
2019-10-15 11:43:52 -07:00
f8ccd90eeb
Add ForkConfidenceCache methods ( #6359 )
...
automerge
2019-10-14 22:14:20 -07:00
88bb55ffd2
Add get_vote_accounts() to RPC client
2019-10-14 20:38:51 -07:00
5508ac6272
Add root slot to getVoteAccounts
2019-10-14 20:38:51 -07:00
5d99853502
Add getBlockConfidence rpc endpoint ( #6350 )
...
automerge
2019-10-14 15:24:10 -07:00
3313b2ff58
Fetch stage batching of forwarded txs ( #6349 )
...
automerge
2019-10-14 13:32:29 -07:00
322fcea6e5
More fullnode to validator renaming ( #6337 )
2019-10-11 13:30:52 -06:00
5650231df3
Increase buffer size for erasure meta DB column ( #6335 )
2019-10-11 12:18:11 -07:00
bf9c815b9e
Increase Index column buffers ( #6268 )
2019-10-10 23:17:39 -07:00
364781366a
Use sendmmsg for broadcasting shreds ( #6325 )
...
* Replace packet with slice of data in sendmmsg
* fixes
* fix bench
2019-10-10 19:38:48 -07:00
c6e4641781
Remove many uses of legacy term 'fullnode' ( #6324 )
2019-10-10 17:33:00 -06:00
753bd77b41
Use multicast to send retransmit packets ( #6319 )
2019-10-10 15:02:36 -07:00
1960ea8ed7
Add benches for shredding and poh ( #6307 )
...
* Add benches for shredding and poh
* ignore poh bench
* Factor out Poh bench as separate function
2019-10-10 14:00:24 -07:00
1b775044f7
Use multiple retransmit stage threads/sockets ( #6279 )
2019-10-10 13:24:03 -07:00
570b98c7bc
Multicast same packet to multiple destinations via sendmmg ( #6316 )
...
* Implement multicast same packet to multiple destinations using sendmmsg()
2019-10-10 13:09:15 -07:00
1f345ce2d9
Don't grab keypair from cluster info on every iteration of broadccast ( #6303 )
2019-10-09 17:36:45 -07:00
ed85aa43a4
Implement sendmmsg() API ( #6304 )
...
* Implement sendmmsg()
* fixes
2019-10-09 17:06:56 -07:00
4b0250192a
Remove remnants of the cuda feature flag ( #6298 )
...
automerge
2019-10-09 16:09:36 -07:00
dd66d16fdb
Broadcast final shred for slots that are interrupted ( #6269 )
...
* Broadcast final shred for slots that are interrupted
2019-10-09 16:07:18 -07:00
32312f3c16
Do not retransmit Repair responses ( #6284 )
...
* Do not retransmit Repair responses
* Add a test
* Refactor neighboring functionality
2019-10-09 13:11:19 -07:00
2db83e1a21
Remove greedy fetch in shred_fetch stage ( #6278 )
...
* Remove greedy fetch in shred_fetch stage
* cleanup
2019-10-09 10:36:05 -07:00
7cf90766a3
add epoch_schedule sysvar ( #6256 )
...
* add epoch_schedule sysvar
* book sheesh!
2019-10-08 22:34:26 -07:00
f2ee01ace3
Fix blocktree processor entry callback test ( #6285 )
2019-10-08 20:38:05 -04:00
5e31565574
Expand blocktree processor options ( #6248 )
...
* Refactor blocktree processor args and support full leader cache
* Add entry callback option
* Rename num_threads to override_num_threads
* Add test for entry callback
* Refactor cached leader schedule changes
* Add tests for blocktree process options
* Refactor test
* @mvines feedback
2019-10-08 17:58:49 -04:00
723f9a9b81
Remove unnecessary locking in retransmit stage ( #6276 )
...
* Add more detailed metrics to retransmit
* Remove unnecessary locking and add more metrics
2019-10-08 14:41:16 -07:00
anatoly yakovenko
carllin
Michael Vines
Jack May
sakridge
Tyera Eulberg
sakridge
Pankaj Garg
Sagar Dhawan
Justin Starry
Rob Walker
Sunny Gleason
Greg Fitzgerald
Ryo Onodera
TristanDebrunner
TristanDebrunner