Commit Graph

122 Commits

Author SHA1 Message Date
Richard Patel 6f2b12fd00 cmd: add blockstore tar-blocks command 2024-02-11 18:07:39 +00:00
Richard Patel 4be17ecefb radiance: fix blockstore compact subcommand registration 2023-06-10 19:10:47 +00:00
Richard Patel 903436132a Remove BigTable support 2023-06-10 12:58:30 -05:00
Richard Patel dc8921485a upgrade quic-go 2023-06-10 16:19:12 +00:00
Richard Patel f5c050b8c3 radiance: add compact command 2023-06-10 16:05:06 +00:00
Richard Patel ddf48545d2 remove ipld, car packages
The Solana IPLD project has moved to
https://github.com/rpcpool/yellowstone-faithful
2023-06-10 15:51:46 +00:00
Richard Patel 921629e0e6 radiance: add blockstore stat-data-rate 2023-06-08 05:02:35 +00:00
Richard Patel 20f92516b5 radiance: add blockstore stat-entries 2023-06-07 23:09:42 -05:00
Richard Patel 8741985d13 cmd: fix tpu_udp 2023-05-25 22:57:40 +00:00
Richard Patel 843c6db0b1 unify tools into monobinary 2023-04-10 13:08:45 +02:00
Richard Patel 6ad68d9a28 minor fixes 2023-04-10 12:44:11 +02:00
Richard Patel 382e723242 Remove Kafka, Clickhouse-related tools
To be readded when we find a maintainer.

#frühjahrsputz
2023-04-10 11:24:25 +02:00
Richard Patel 8f27f10358 ipld: improve schema
- use generic multicodec IDs
- serialize IPLD wire representations, not user schemas
2023-03-09 04:15:09 +00:00
Richard Patel 144f13b465 build with Cgo by default 2023-03-05 18:04:37 +00:00
Richard Patel 4770d3aca0 chore: update deps 2023-03-04 21:05:37 +00:00
Richard Patel 713c1e5a81 treewide: remove bazel
Change-Id: Ia45fc0d797dbec1ebcb199b6711dcb66ac10ff3a
2023-03-04 10:35:05 -06:00
Richard Patel d766afc409 replay: fix PoH on txn with multiple sig
Change-Id: I89879551bf499b577cd47c1d71efd95be3bdf6eb
2023-03-04 14:41:39 +00:00
Richard Patel ed80b028d3 cmd: various improvements
Change-Id: I8fec330c37fbc44d3028296b4ef82fd07b865d74
2023-03-04 12:49:35 +00:00
Richard Patel a4b5063ff0 radiance: use new shred API
Change-Id: Idd8f51b45561cfe6b9230d5a3555119efe14f867
2023-01-24 13:53:19 +00:00
Richard Patel ec8deb7ac2 blockstore: use new shred API
Change-Id: I4dcdfe94e3d72342698828880656161ab12d60c8
2023-01-24 13:53:19 +00:00
Leo 2a0c056310 cmd/quictpu: tx sending WIP 2022-11-11 23:52:39 +01:00
Leo 8e40390fbf cmd/quictpu: tx sending WIP 2022-11-11 20:37:29 +01:00
Leo 45883c17c5 cmd/quictpu: source port 2022-11-11 18:47:11 +01:00
Leo 2eae60aefc cmd/quictpu: ALPN 2022-11-11 18:34:19 +01:00
Richard Patel 2742cd8867 fix Go tests
- merkletree: fix broken test case
- fixtures: fix compatibility with Bazel
2022-10-30 08:19:30 +01:00
Richard Patel 4ddc64e2c0 bazel: add Go rules 2022-10-30 08:17:36 +01:00
Richard Patel ba4e9d4b0d radiance: add car dump command
Adds command to dump the first signature of all txs in a CAR.
2022-10-29 15:00:50 +02:00
Richard Patel 2f5954278c blockstore: simplify BlockWalkI.Entries()
Shredding is already implied by SlotMeta,
thus no need to return shreds and entries in the iterator.
2022-10-29 13:50:25 +02:00
Richard Patel 776c1e88f1 sort Go imports 2022-10-29 13:30:26 +02:00
Richard Patel 8e6cbec8d2 radiance: only build car create if RocksDB enabled 2022-10-28 20:24:46 +00:00
Richard Patel dc8246dcfd poh: move package from runtime/poh to poh, add tests 2022-10-20 01:02:47 +00:00
Richard Patel 5d7f351484 replay: mainnet epoch 0 PoH 🏁
- Implements transaction mixin
- Replays fine for a few thousand slots so far
2022-10-19 01:44:30 +00:00
Richard Patel 14594ded1b
replay: mainnet block 0 🏁 2022-10-18 16:48:39 -05:00
Leo 55c6b113af Make rocksdb optional and document build 2022-09-26 14:07:11 +02:00
Leo 0d5dd26722 radiance: optional build tag for rocksdb commands
Compiling the rocksdb binding isn't as straight-forward
as installing rocksdb headers:

$ go build ./...
# github.com/linxGnu/grocksdb
../../go/pkg/mod/github.com/linx!gnu/grocksdb@v1.7.7/cache.go:84:2: could not determine kind of name for C.rocksdb_lru_cache_options_set_num_shard_bits

Adding an optional build tag to compile radiance with rocksdb
support, otherwise remove the blockstore command. This keeps
everything else working with CGO_ENABLED=0.
2022-09-26 13:29:59 +02:00
Leo a7ce08b6fe Unfork quic-go and update it for Go 1.19 compat
Solana is now properly doing ALPN, so we no longer need the fork.
2022-09-26 13:27:23 +02:00
Richard Patel 480c66c744
cmd/car: add profiling support 2022-09-26 00:32:04 +02:00
Richard Patel 2d8b42f33a
cargen: improve godoc 2022-09-25 15:35:04 +02:00
Richard Patel 5fb1dfa576
car: refactor into cargen 2022-09-25 15:35:03 +02:00
Richard Patel dd176b872c
car: write blocks, not just transactions 2022-09-25 15:35:03 +02:00
Richard Patel 6b5feeba9a
ipldgen: add IPLD ledger stream generator 2022-09-25 15:35:03 +02:00
Richard Patel 2aaf87d454
cmd/blockstore: add yaml --roots flag 2022-09-24 18:40:08 +02:00
Richard Patel 34df1a0fd7
car: write transaction blocks 2022-09-24 17:40:57 +02:00
Richard Patel 119cef0fd1 car: add CARv1 writer 2022-09-24 15:01:17 +00:00
Richard Patel 7aea7df6fd car: allow multiplexer to seek to a slot 2022-09-24 13:43:54 +00:00
Richard Patel 31e05eec91 cmd/car: add blockstore multiplexer
Adds iterator that fuses multiple blockstores into a contiguous chain.
2022-09-23 21:04:19 +00:00
Richard Patel 758ede5690 Move Go module to go.firedancer.io/radiance
Change-Id: I76845d19e864d6c7cd0fff77dbe63fc722bbf808
Reviewed-on: https://git.firedancer.io/c/radiance/+/131
2022-09-21 23:40:06 +00:00
gagliardetto f6a9e60f31
shred: improve DataShredsToEntries performance
* Don't use reflection for shred decoding
* Add shred decoding benchmark
2022-09-19 13:46:29 +02:00
Richard Patel 41b9449a99
verify-data: decrease log verbosity of skipped slots 2022-09-18 01:55:51 +02:00
Richard Patel 13bbff84f3
cmd/blockstore/verify-data: add rate gauges 2022-09-18 01:39:02 +02:00