Commit Graph

59 Commits

Author SHA1 Message Date
Richard Patel 6f2b12fd00 cmd: add blockstore tar-blocks command 2024-02-11 18:07:39 +00:00
Richard Patel 4be17ecefb radiance: fix blockstore compact subcommand registration 2023-06-10 19:10:47 +00:00
Richard Patel 903436132a Remove BigTable support 2023-06-10 12:58:30 -05:00
Richard Patel dc8921485a upgrade quic-go 2023-06-10 16:19:12 +00:00
Richard Patel f5c050b8c3 radiance: add compact command 2023-06-10 16:05:06 +00:00
Richard Patel ddf48545d2 remove ipld, car packages
The Solana IPLD project has moved to
https://github.com/rpcpool/yellowstone-faithful
2023-06-10 15:51:46 +00:00
Richard Patel 921629e0e6 radiance: add blockstore stat-data-rate 2023-06-08 05:02:35 +00:00
Richard Patel 20f92516b5 radiance: add blockstore stat-entries 2023-06-07 23:09:42 -05:00
Richard Patel 8741985d13 cmd: fix tpu_udp 2023-05-25 22:57:40 +00:00
Richard Patel 843c6db0b1 unify tools into monobinary 2023-04-10 13:08:45 +02:00
Richard Patel 8f27f10358 ipld: improve schema
- use generic multicodec IDs
- serialize IPLD wire representations, not user schemas
2023-03-09 04:15:09 +00:00
Richard Patel 144f13b465 build with Cgo by default 2023-03-05 18:04:37 +00:00
Richard Patel 4770d3aca0 chore: update deps 2023-03-04 21:05:37 +00:00
Richard Patel 713c1e5a81 treewide: remove bazel
Change-Id: Ia45fc0d797dbec1ebcb199b6711dcb66ac10ff3a
2023-03-04 10:35:05 -06:00
Richard Patel d766afc409 replay: fix PoH on txn with multiple sig
Change-Id: I89879551bf499b577cd47c1d71efd95be3bdf6eb
2023-03-04 14:41:39 +00:00
Richard Patel ed80b028d3 cmd: various improvements
Change-Id: I8fec330c37fbc44d3028296b4ef82fd07b865d74
2023-03-04 12:49:35 +00:00
Richard Patel a4b5063ff0 radiance: use new shred API
Change-Id: Idd8f51b45561cfe6b9230d5a3555119efe14f867
2023-01-24 13:53:19 +00:00
Richard Patel ec8deb7ac2 blockstore: use new shred API
Change-Id: I4dcdfe94e3d72342698828880656161ab12d60c8
2023-01-24 13:53:19 +00:00
Richard Patel 2742cd8867 fix Go tests
- merkletree: fix broken test case
- fixtures: fix compatibility with Bazel
2022-10-30 08:19:30 +01:00
Richard Patel 4ddc64e2c0 bazel: add Go rules 2022-10-30 08:17:36 +01:00
Richard Patel ba4e9d4b0d radiance: add car dump command
Adds command to dump the first signature of all txs in a CAR.
2022-10-29 15:00:50 +02:00
Richard Patel 2f5954278c blockstore: simplify BlockWalkI.Entries()
Shredding is already implied by SlotMeta,
thus no need to return shreds and entries in the iterator.
2022-10-29 13:50:25 +02:00
Richard Patel 776c1e88f1 sort Go imports 2022-10-29 13:30:26 +02:00
Richard Patel 8e6cbec8d2 radiance: only build car create if RocksDB enabled 2022-10-28 20:24:46 +00:00
Richard Patel dc8246dcfd poh: move package from runtime/poh to poh, add tests 2022-10-20 01:02:47 +00:00
Richard Patel 5d7f351484 replay: mainnet epoch 0 PoH 🏁
- Implements transaction mixin
- Replays fine for a few thousand slots so far
2022-10-19 01:44:30 +00:00
Richard Patel 14594ded1b
replay: mainnet block 0 🏁 2022-10-18 16:48:39 -05:00
Leo 55c6b113af Make rocksdb optional and document build 2022-09-26 14:07:11 +02:00
Leo 0d5dd26722 radiance: optional build tag for rocksdb commands
Compiling the rocksdb binding isn't as straight-forward
as installing rocksdb headers:

$ go build ./...
# github.com/linxGnu/grocksdb
../../go/pkg/mod/github.com/linx!gnu/grocksdb@v1.7.7/cache.go:84:2: could not determine kind of name for C.rocksdb_lru_cache_options_set_num_shard_bits

Adding an optional build tag to compile radiance with rocksdb
support, otherwise remove the blockstore command. This keeps
everything else working with CGO_ENABLED=0.
2022-09-26 13:29:59 +02:00
Richard Patel 480c66c744
cmd/car: add profiling support 2022-09-26 00:32:04 +02:00
Richard Patel 2d8b42f33a
cargen: improve godoc 2022-09-25 15:35:04 +02:00
Richard Patel 5fb1dfa576
car: refactor into cargen 2022-09-25 15:35:03 +02:00
Richard Patel dd176b872c
car: write blocks, not just transactions 2022-09-25 15:35:03 +02:00
Richard Patel 6b5feeba9a
ipldgen: add IPLD ledger stream generator 2022-09-25 15:35:03 +02:00
Richard Patel 2aaf87d454
cmd/blockstore: add yaml --roots flag 2022-09-24 18:40:08 +02:00
Richard Patel 34df1a0fd7
car: write transaction blocks 2022-09-24 17:40:57 +02:00
Richard Patel 119cef0fd1 car: add CARv1 writer 2022-09-24 15:01:17 +00:00
Richard Patel 7aea7df6fd car: allow multiplexer to seek to a slot 2022-09-24 13:43:54 +00:00
Richard Patel 31e05eec91 cmd/car: add blockstore multiplexer
Adds iterator that fuses multiple blockstores into a contiguous chain.
2022-09-23 21:04:19 +00:00
Richard Patel 758ede5690 Move Go module to go.firedancer.io/radiance
Change-Id: I76845d19e864d6c7cd0fff77dbe63fc722bbf808
Reviewed-on: https://git.firedancer.io/c/radiance/+/131
2022-09-21 23:40:06 +00:00
gagliardetto f6a9e60f31
shred: improve DataShredsToEntries performance
* Don't use reflection for shred decoding
* Add shred decoding benchmark
2022-09-19 13:46:29 +02:00
Richard Patel 41b9449a99
verify-data: decrease log verbosity of skipped slots 2022-09-18 01:55:51 +02:00
Richard Patel 13bbff84f3
cmd/blockstore/verify-data: add rate gauges 2022-09-18 01:39:02 +02:00
Richard Patel 907e65fb6c fixtures: make shred sort order natural
Sorry for the `git pull` jumpscare!
2022-09-18 01:21:42 +02:00
Richard Patel 0f7098a795 shred: support recent legacy shred
Some time along Solana mainnet-beta history,
the legacy data shred header was extended
from 86 bytes to 88 bytes.

We don't know when exactly this change has happened.
Or whether the shred version is self-describing.

For now, add a simple switch by slot number.
2022-09-18 01:21:42 +02:00
Richard Patel dfd7be865c
cmd/blockstore/verify-data: add --dump-sigs flag
Add flag to print sigs for scientific purposes
2022-09-17 23:36:42 +02:00
Richard Patel 64f4cbec93
cmd/blockstore/verify-data: log txn and byte count 2022-09-17 20:26:16 +02:00
Richard Patel 7eae6ce5ad
cmd/blockstore/verify-data: fix result output in tty mode
Fixes bug where results don't get printed
after progress bar finishes
2022-09-17 20:15:07 +02:00
Richard Patel 3405d76a1a
cmd/blockstore/verify-data: add progress bar, bug fixes
Adds fancy progress bar :3

Fixes deadlock bug
Fixes bug where workers read past their task end
2022-09-17 20:11:00 +02:00
Richard Patel 493c87d0da
cmd/blockstore: fix minor RocksDB iterator leak
Closes iterators after finishing.
Doesn't matter anyways because app exit drops the entire DB handle.
2022-09-17 18:54:48 +02:00