gagliardetto
f6a9e60f31
shred: improve DataShredsToEntries performance
...
* Don't use reflection for shred decoding
* Add shred decoding benchmark
2022-09-19 13:46:29 +02:00
Richard Patel
41b9449a99
verify-data: decrease log verbosity of skipped slots
2022-09-18 01:55:51 +02:00
Richard Patel
13bbff84f3
cmd/blockstore/verify-data: add rate gauges
2022-09-18 01:39:02 +02:00
Richard Patel
907e65fb6c
fixtures: make shred sort order natural
...
Sorry for the `git pull` jumpscare!
2022-09-18 01:21:42 +02:00
Richard Patel
0f7098a795
shred: support recent legacy shred
...
Some time along Solana mainnet-beta history,
the legacy data shred header was extended
from 86 bytes to 88 bytes.
We don't know when exactly this change has happened.
Or whether the shred version is self-describing.
For now, add a simple switch by slot number.
2022-09-18 01:21:42 +02:00
Richard Patel
dfd7be865c
cmd/blockstore/verify-data: add --dump-sigs flag
...
Add flag to print sigs for scientific purposes
2022-09-17 23:36:42 +02:00
Richard Patel
64f4cbec93
cmd/blockstore/verify-data: log txn and byte count
2022-09-17 20:26:16 +02:00
Richard Patel
7eae6ce5ad
cmd/blockstore/verify-data: fix result output in tty mode
...
Fixes bug where results don't get printed
after progress bar finishes
2022-09-17 20:15:07 +02:00
Richard Patel
3405d76a1a
cmd/blockstore/verify-data: add progress bar, bug fixes
...
Adds fancy progress bar :3
Fixes deadlock bug
Fixes bug where workers read past their task end
2022-09-17 20:11:00 +02:00
Richard Patel
493c87d0da
cmd/blockstore: fix minor RocksDB iterator leak
...
Closes iterators after finishing.
Doesn't matter anyways because app exit drops the entire DB handle.
2022-09-17 18:54:48 +02:00
Richard Patel
047585136b
cmd/blockstore: add verify-data tool
...
Adds tool that scans over the ledger entries in a blockstore.
2022-09-17 18:51:24 +02:00
Richard Patel
3e87b452bd
cmd/blockstore/yaml: print first and last slot
2022-09-12 14:04:07 +02:00
Richard Patel
0773c47d05
cmd/blockstore/yaml: accept --slots=all
...
Adds option to dump all slots
2022-09-11 09:07:16 +02:00
Richard Patel
d7cd878bc9
blockstore: accurately encode entry batches as YAML
...
Updates blockstore dump YAML schema to reflect that
slices of shreds map to slices of entries.
Adds a new "entry_batches" wrapper list that annotates
each slice of entries with shred range and encoded size.
2022-09-11 08:56:03 +02:00
Richard Patel
b902a03a05
cmd/radiance: add blockstore yaml command
2022-09-10 19:57:10 +02:00
Richard Patel
3c69cf0eea
blockstore: decode mainnet genesis shreds
2022-09-10 19:56:59 +02:00
Richard Patel
02237cd4c5
cmd/radiance: add blockstore dumpshreds command
2022-09-10 14:30:49 +02:00
Richard Patel
be154eae0f
cmd: add IntRange parser util
2022-09-10 14:29:37 +02:00
Richard Patel
46f6563f6d
cmd: merge to radiance command, add ledger subcommand
2022-09-10 14:29:37 +02:00