solana/docs/src/proposals/optimistic-transaction-prop...

110 lines
3.8 KiB
Markdown
Raw Normal View History

---
title: Optimistic Transaction Propagation Signal
---
## Current Retransmit behavior
The retransmission tree currently considers:
1. epoch staked nodes
2. tvu peers (filtered by contact info and shred version)
3. current validator
concatenating (1), (2), and (3)
deduplicating this list of entries by pubkey favoring entries with contact info
filtering this list by entries with contact info
This list is then is randomly shuffled by stake weight.
Shreds are then retransmitted to up to FANOUT neighbors and up to FANOUT
children.
## Deterministic retransmission tree
`weighted_shuffle` will use a deterministic seed when
`enable_deterministic_seed` has been enabled based on the triple (shred slot,
shred index, leader pubkey):
```
if enable_deterministic_seed(self.slot(), root_bank) {
hashv(&[
&self.slot().to_le_bytes(),
&self.index().to_le_bytes(),
&leader_pubkey.to_bytes(),
])
```
First, only epoch staked nodes will be considered regardless of presence of
contact info (and possibly including the validator node itself).
A deterministic ordering of the epoch staked nodes will be created based on the
derministic shred seed using weighted_shuffle.
Let `neighbor_set` be selected from up to FANOUT neighbors of the current node.
Let `child_set` be selected from up to FANOUT children of the current node.
Filter `neighbor_set` by contact info.
Filter `child_set` by contact info.
Let `epoch_set` be the union of `neighbor_set` and `child_set`.
Let `remaining_set` be all other nodes with contact info not contained in
`epoch_set`.
If `epoch_set.len < 2*FANOUT` then we may randomly select up to
`2*FANOUT - epoch_set.len` nodes to to retransmit to from `remaining_set`.
## Receiving retransmitted shred
If the current validator node is not in the set of epoch staked nodes for the
shred epoch then no early retransmission information can be obtained.
Compute the deterministic shred seed.
Run the deterministic epoch_stakes shuffle.
Find position of self in the neighbor or child sets.
Calculate the sum of the stakes of all nodes in the current and prior
distribution levels.
### Stake summation considerations:
- Stake sum could include stakes of nodes which had been skipped in prior
distribution levels because of lack of contact info.
- Current node was part of original epoch staked shuffle from retransmitter
but was filtered out because of missing contact info. Current node subsequently
receives retransmisison of shred and assumes that the retransmit was a result
of the deterministic tree calculation and not from subsequent random selection.
This should be benign because the current node will underestimate prior stake
weight in the retransmission tree.
### General considerations:
attack by leader (level 0):
- transmits shred for distribution through the tree as normal
- additionally transmits shred (or fake shred) directly to node(s) at level >=2
leading the node(s) to believe a greater percentage of the tree retransmission
tree had been processed
attack by node at level n:
- retransmits shred to node(s) at level >=n+2 leading the node(s) to believe a
greater percentage of the tree retransmission tree had been processed
### Questions
- Should receiving nodes attempt to verify that the origin of the shred was
retransmitted from the expected node? If so, consideration of spoofing?
- How is this information consumed?
## Notes
Practically, signals should fall into the following buckets:
1. current leader (can signal layer 1 when broadcast is sent)
2. layer 1
1.1. can signal layer 1 when shred is received
1.2. can signal layer 1 + subset of layer 2 when retransmit is sent
3. layer 2
3.1. can signal layer 2 when shred is received
3.2. can signal layer 2 + subset of layer 3 when retrnasmit is sent
4. current node not a member of epoch staked nodes, no signal can be sent