8bbc0f1a75
Remove Git LFS
2022-09-19 16:21:37 +02:00
f6a9e60f31
shred: improve DataShredsToEntries performance
...
* Don't use reflection for shred decoding
* Add shred decoding benchmark
2022-09-19 13:46:29 +02:00
869f92e798
build(deps): bump github.com/klauspost/compress from 1.15.9 to 1.15.10
...
Bumps [github.com/klauspost/compress](https://github.com/klauspost/compress ) from 1.15.9 to 1.15.10.
- [Release notes](https://github.com/klauspost/compress/releases )
- [Changelog](https://github.com/klauspost/compress/blob/master/.goreleaser.yml )
- [Commits](https://github.com/klauspost/compress/compare/v1.15.9...v1.15.10 )
---
updated-dependencies:
- dependency-name: github.com/klauspost/compress
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-09-19 12:34:27 +02:00
8db4cbffeb
go mod tidy
2022-09-18 17:07:12 +02:00
41b9449a99
verify-data: decrease log verbosity of skipped slots
2022-09-18 01:55:51 +02:00
bb6d4ce6f6
shred: skip empty shreds
...
Encountered in mainnet slot 102763321 data shred index 484
2022-09-18 01:49:01 +02:00
13bbff84f3
cmd/blockstore/verify-data: add rate gauges
2022-09-18 01:39:02 +02:00
907e65fb6c
fixtures: make shred sort order natural
...
Sorry for the `git pull` jumpscare!
2022-09-18 01:21:42 +02:00
0f7098a795
shred: support recent legacy shred
...
Some time along Solana mainnet-beta history,
the legacy data shred header was extended
from 86 bytes to 88 bytes.
We don't know when exactly this change has happened.
Or whether the shred version is self-describing.
For now, add a simple switch by slot number.
2022-09-18 01:21:42 +02:00
dfd7be865c
cmd/blockstore/verify-data: add --dump-sigs flag
...
Add flag to print sigs for scientific purposes
2022-09-17 23:36:42 +02:00
b2c06c4509
build(deps): bump github.com/twmb/franz-go from 1.6.0 to 1.7.1
...
Bumps [github.com/twmb/franz-go](https://github.com/twmb/franz-go ) from 1.6.0 to 1.7.1.
- [Release notes](https://github.com/twmb/franz-go/releases )
- [Changelog](https://github.com/twmb/franz-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/twmb/franz-go/compare/v1.6.0...v1.7.1 )
---
updated-dependencies:
- dependency-name: github.com/twmb/franz-go
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-09-17 22:40:03 +02:00
85a3cdde16
build(deps): bump github.com/coreos/go-systemd/v22 from 22.3.2 to 22.4.0
...
Bumps [github.com/coreos/go-systemd/v22](https://github.com/coreos/go-systemd ) from 22.3.2 to 22.4.0.
- [Release notes](https://github.com/coreos/go-systemd/releases )
- [Commits](https://github.com/coreos/go-systemd/compare/v22.3.2...v22.4.0 )
---
updated-dependencies:
- dependency-name: github.com/coreos/go-systemd/v22
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-09-17 22:39:48 +02:00
0585231e9f
blockstore: add genesis deshred test
2022-09-17 20:42:34 +02:00
64f4cbec93
cmd/blockstore/verify-data: log txn and byte count
2022-09-17 20:26:16 +02:00
7eae6ce5ad
cmd/blockstore/verify-data: fix result output in tty mode
...
Fixes bug where results don't get printed
after progress bar finishes
2022-09-17 20:15:07 +02:00
3405d76a1a
cmd/blockstore/verify-data: add progress bar, bug fixes
...
Adds fancy progress bar :3
Fixes deadlock bug
Fixes bug where workers read past their task end
2022-09-17 20:11:00 +02:00
493c87d0da
cmd/blockstore: fix minor RocksDB iterator leak
...
Closes iterators after finishing.
Doesn't matter anyways because app exit drops the entire DB handle.
2022-09-17 18:54:48 +02:00
047585136b
cmd/blockstore: add verify-data tool
...
Adds tool that scans over the ledger entries in a blockstore.
2022-09-17 18:51:24 +02:00
b1052fb69a
genesis: support genesis.bin
...
Adds handwritten serde for mainnet genesis config.
(Binary doesn't properly support bincode-fixedint-le)
2022-09-17 16:47:47 +02:00
fd64bc1d6a
runtime: add core ledger data structures
...
Adds structs that appear in the GenesisConfig object
Adds handwritten serde for runtime structs because
binary doesn't properly support bincode-fixedint-le
2022-09-17 16:46:26 +02:00
07c1b166a4
fixtures: add Open() function
...
Adds a method for streaming fixture files
2022-09-17 16:43:19 +02:00
452d388b5c
archiveutil: add OpenTar() for `.tar`, `.tar.gz`, `.tar.bz2`
...
Adds utility function that reads tar streams
with optional compression handling.
2022-09-17 16:39:47 +02:00
c78470ade9
fixtures: add mainnet genesis
2022-09-17 16:27:42 +02:00
e7ea00c4dc
Be a little more explicit about lack of warranties
2022-09-15 20:30:36 +02:00
6e85173a43
Make README radiant again
2022-09-15 20:25:20 +02:00
684184f1ee
gitignore: add missing newline to EOF
2022-09-15 09:45:53 -05:00
ffd44286a8
pkg/util: Schroeder wants testify/assert
...
This will come in handy for sure very soon
2022-09-15 09:45:53 -05:00
1c6b3857a0
cmd/solrays: remove pubsub RPC from allow list
2022-09-15 09:45:53 -05:00
200fb932b7
readme: normalize Markdown headers syntax
2022-09-15 09:45:53 -05:00
6db3220d26
cmd/solrays: move IsValidHostname to pkg/util
2022-09-15 09:45:53 -05:00
9b3f35d416
cmd/solrays: validate provided TLS hostname, if any.
2022-09-15 09:45:53 -05:00
ff647037a8
cmd/solrays: remove bogus comment
...
`solrays` doesn't support multiple backends, yet. And I would argue that
if/when it does, the health of the proxy shouldn't be tied to the pool of RPC
nodes.
2022-09-15 09:45:53 -05:00
0a8d064997
docs: introduce generic build instructions
...
Also, minimally document `solrays`.
2022-09-15 09:45:53 -05:00
16a24848e6
cmd/solrays: revisit supported RPC list
2022-09-15 09:45:53 -05:00
a54c60d889
cmd/solrays: fix go-systemd/v22 import
2022-09-15 09:45:53 -05:00
c023c423b5
fixtures: add shreds for slot 102815960
2022-09-12 14:04:29 +02:00
3e87b452bd
cmd/blockstore/yaml: print first and last slot
2022-09-12 14:04:07 +02:00
22cd485d9c
cmd/solrays: import from internal repo
2022-09-11 21:06:23 +02:00
0773c47d05
cmd/blockstore/yaml: accept --slots=all
...
Adds option to dump all slots
2022-09-11 09:07:16 +02:00
d7cd878bc9
blockstore: accurately encode entry batches as YAML
...
Updates blockstore dump YAML schema to reflect that
slices of shreds map to slices of entries.
Adds a new "entry_batches" wrapper list that annotates
each slice of entries with shred range and encoded size.
2022-09-11 08:56:03 +02:00
b902a03a05
cmd/radiance: add blockstore yaml command
2022-09-10 19:57:10 +02:00
3c69cf0eea
blockstore: decode mainnet genesis shreds
2022-09-10 19:56:59 +02:00
860db15ff7
build(deps): bump k8s.io/klog/v2 from 2.60.1 to 2.80.1
2022-09-10 15:07:49 +02:00
a2fa83c01b
fixtures: add shreds from slots 0 and 1
2022-09-10 14:31:24 +02:00
02237cd4c5
cmd/radiance: add blockstore dumpshreds command
2022-09-10 14:30:49 +02:00
62357507ff
blockstore: add shreds, slot meta client
2022-09-10 14:30:49 +02:00
816ab66d28
blockstore: add package, add RocksDB client
2022-09-10 14:30:49 +02:00
3172d5b4af
shred: initial shred package, handle data shreds
2022-09-10 14:29:37 +02:00
be154eae0f
cmd: add IntRange parser util
2022-09-10 14:29:37 +02:00
46f6563f6d
cmd: merge to radiance command, add ledger subcommand
2022-09-10 14:29:37 +02:00
Leo
gagliardetto
dependabot[bot]
Richard Patel
Leo
Pires
Richard Patel