blockworks-foundation
/
solana
mirror of https://github.com/blockworks-foundation/solana.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
17,337 Commits 168 Branches 497 Tags 539 MiB
Commit Graph

35 Commits

Author SHA1 Message Date
behzad nouri 01a096adc8 adds bitflags to Packet.Meta 
Instead of a separate bool type for each flag, all the flags can be
encoded in a type-safe bitflags encoded in a single u8:
https://github.com/solana-labs/solana/blob/d6ec103be/sdk/src/packet.rs#L19-L31
 2022-01-04 13:53:40 +00:00
Justin Starry b1d9a2e60e
Don't forward packets received from TPU forwards port (#22078) 
* Don't forward packets received from TPU forwards port

* Add banking stage test
 2021-12-29 19:34:31 +01:00
behzad nouri 65d59f4ef0
tracks erasure coding shreds' indices explicitly (#21822) 
The indices for erasure coding shreds are tied to data shreds:
https://github.com/solana-labs/solana/blob/90f41fd9b/ledger/src/shred.rs#L921

However with the upcoming changes to erasure schema, there will be more
erasure coding shreds than data shreds and we can no longer infer coding
shreds indices from data shreds.

The commit adds constructs to track coding shreds indices explicitly.
 2021-12-19 22:37:55 +00:00
Justin Starry 254ef3e7b6
Rename Packets to PacketBatch (#21794) 2021-12-11 09:44:15 -05:00
Michael Vines b8837c04ec Reformat imports to a consistent style for imports 
rustfmt.toml configuration:
  imports_granularity = "One"
  group_imports = "One"
 2021-12-03 09:19:13 -08:00
Michael Vines 7027d56064 Resolve nightly-2021-10-05 clippy complaints 2021-10-06 10:37:58 -07:00
Alexander Meißner 6514096a67 chore: cargo +nightly clippy --fix -Z unstable-options 2021-06-18 10:42:46 -07:00
sakridge eeee75c5be
Don't use pinned memory when unnecessary (#17832) 
Reports of excessive GPU memory usage and errors
from cudaHostRegister. There are some cases where pinning is
not required.
 2021-06-14 16:10:04 +02:00
behzad nouri 37b8587d4e
expands number of erasure coding shreds in the last batch in slots (#16484) 
Number of parity coding shreds is always less than the number of data
shreds in FEC blocks:
https://github.com/solana-labs/solana/blob/6907a2366/ledger/src/shred.rs#L719

Data shreds are batched in chunks of 32 shreds each:
https://github.com/solana-labs/solana/blob/6907a2366/ledger/src/shred.rs#L714

However the very last batch of data shreds in a slot can be small, in
which case the loss rate can be exacerbated.

This commit expands the number of coding shreds in the last FEC block in
slots to: 64 - number of data shreds; so that FEC blocks are always 64
data and parity coding shreds each.

As a consequence of this, the last FEC block has more parity coding
shreds than data shreds. So for some shred indices we will have a coding
shred but no data shreds. This should not cause any kind of overlapping
FEC blocks as in:
https://github.com/solana-labs/solana/pull/10095
since this is done only for the very last batch in a slot, and the next
slot will reset the shred index.
 2021-04-21 12:47:50 +00:00
behzad nouri e405747409 Revert "Add limit and shrink policy for recycler (#15320)" 
This reverts commit c2e8814dce.
 2021-04-18 19:29:24 +00:00
behzad nouri 4f82b897bc
buffers data shreds to make larger erasure coded sets (#15849) 
Broadcast stage batches up to 8 entries:
https://github.com/solana-labs/solana/blob/79280b304/core/src/broadcast_stage/broadcast_utils.rs#L26-L29
which will be serialized into some number of shreds and chunked into FEC
sets of at most 32 shreds each:
https://github.com/solana-labs/solana/blob/79280b304/ledger/src/shred.rs#L576-L597
So depending on the size of entries, FEC sets can be small, which may
aggravate loss rate.
For example 16 FEC sets of 2:2 data/code shreds each have higher loss
rate than one 32:32 set.

This commit broadcasts data shreds immediately, but also buffers them
until it has a batch of 32 data shreds, at which point 32 coding shreds
are generated and broadcasted.
 2021-03-23 14:52:38 +00:00
sakridge 05409e51ce
Increase tpu coalescing and add parameter (#15536) 
Should create larger entries on average
 2021-02-26 09:15:45 -08:00
carllin c2e8814dce
Add limit and shrink policy for recycler (#15320) 2021-02-24 00:15:58 -08:00
sakridge d4a174fb7c
Partial shred deserialize cleanup and shred type differentiation (#14094) 
* Partial shred deserialize cleanup and shred type differentiation in retransmit

* consolidate packet hashing logic
 2020-12-15 16:50:40 -08:00
sakridge 5c95d8e963
Shred filter (#14030) 2020-12-10 07:54:15 -08:00
sakridge c5fe076432
Better dupe detection (#13992) 2020-12-09 23:14:31 -08:00
sakridge f6600810d7
Use LRU cache and blake3 hash of shreds to filter duplicates (#13976) 2020-12-07 16:42:39 -08:00
Greg Fitzgerald 6ee222363e
Move BankForks to solana_runtime (#10637) 
* Move BankForks to solana_runtime

* Update imports
 2020-06-17 15:27:03 +00:00
carllin 439fd30840
Fix erasure (#10095) 
* Fix bad FEC blocks

* Add test

Co-authored-by: Carl <carl@solana.com>
 2020-05-19 16:13:12 -07:00
sakridge f562ed4cc8 Distinguish between shred type in shred fetch stage duplicate filter (#10068) 
* Shred type check

* Test
 2020-05-15 13:23:56 -07:00
sakridge 1a47b1cd86
Retransmit and shred fetch metrics (#9965) 
* Retransmit stats

* Shred fetch stats
 2020-05-10 21:37:05 -07:00
sakridge 909321928c
Shred fetch comment and debug message tweak (#8980) 
automerge
 2020-03-20 11:00:48 -07:00
sakridge 453f5ce8f2
Shred filter (#8975) 
Thread bank_forks into shred fetch
 2020-03-20 07:49:48 -07:00
anatoly yakovenko 9cedeb0a8d
Pull streamer out into its own module. (#8917) 
automerge
 2020-03-17 23:30:23 -07:00
Greg Fitzgerald b5dba77056 Rename blocktree to blockstore (#7757) 
automerge
 2020-01-13 13:13:52 -08:00
Pankaj Garg 87b2525e03
Limit maximum number of shreds in a slot to 32K (#7584) 
* Limit maximum number of shreds in a slot to 32K

* mark dead slot replay as fatal error
 2019-12-30 07:42:09 -08:00
Rob Walker a7040896f0
Update to rust 1.40.0 (#7572) 
* Update to rust 1.40.0

* fixups
 2019-12-19 23:27:54 -08:00
Greg Fitzgerald a3a830e1ab
Delete Service trait (#6921) 2019-11-13 11:12:09 -07:00
sakridge 8e81bc1b49
Fix pinning (#6604) 
Remove Deref implementations and add more pass-throughs to the PinnedVec
wrapper.
Warm recyclers
set_pinnable
 2019-11-07 19:48:33 -08:00
anatoly yakovenko 67f636545a Refactor sigverify to stage for signing shreds on the GPU (#6635) 
automerge
 2019-11-06 10:52:30 -08:00
anatoly yakovenko b825d04597 Pull perf into a separate module. (#6718) 
automerge
 2019-11-04 20:13:43 -08:00
Sagar Dhawan 32312f3c16
Do not retransmit Repair responses (#6284) 
* Do not retransmit Repair responses

* Add a test

* Refactor neighboring functionality
 2019-10-09 13:11:19 -07:00
Pankaj Garg 2db83e1a21
Remove greedy fetch in shred_fetch stage (#6278) 
* Remove greedy fetch in shred_fetch stage

* cleanup
 2019-10-09 10:36:05 -07:00
Pankaj Garg 788296047a
Increase batch size for recvmmsg() (#6260) 
* Increase batch size for recvmmsg()

* fix tests

* new test
 2019-10-08 09:54:49 -07:00
Pankaj Garg 17f169f446
BlobFetchStage cleanup post shred work (#6254) 2019-10-07 11:08:01 -07:00