Commit Graph

176 Commits

Author SHA1 Message Date
godmodegalactus 85fcb6097e
Adding some more metrics for quic tpu, and changing some parameters 2024-03-18 17:25:52 +01:00
godmodegalactus f0442ce50d
Implementing prioritiztion heap, and using it to sort transactions by priority 2024-03-16 15:38:05 +01:00
godmodegalactus 374777cabc
minor optimizations, checking blockheight and confirmation status at replay 2024-03-09 19:18:33 +01:00
godmodegalactus 3e01ebb7cc
Fixing perofmrance issues after checking last block height 2024-03-08 17:58:49 +01:00
galactus 73973ba0f5
Check blockhash is expired or not (#351) 2024-03-08 11:27:37 +01:00
galactus 60388667f5
Main into production 01/02/2024 (#312)
* Production into main (#303)

* fix: panic on geyser close, multiplex bug

https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3

* update Cargo.lock

* reverting cargo.lock

* Fix issues with grpc and postgres

* Solving merge issues

* Fixing cargo fmt

* Increase finish quic timeout (#280) (#281)

* integrate geyser slot subscription (#283)

* Increase finish quic timeout (#280)

* Moving geyser slot subscription from stream to channels (#282)

* Moving geyser slot subscription from stream to channels

* Closing all the slot subscription tasks incase of restart

* Making slot channel unbounded (bug)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* Update cargolock file

* Fixing clippy removing grpc_inspect

* merging main with production (#290)

* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>

* Merging MTU changes and setting up transportation config (#293)

* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

* Updating the transport config to match with solana endpoint (#292)

* Updating the transport config to match with solana endpoint

* Setting max MTU after groovies comments

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>

* Making block subscription processed and moving confirmed block subscr… (#291)

* Making block subscription processed and moving confirmed block subscription to meta

* Sending both processed and confirmed blocks, if block has already been confirmed

* Minor bug, subscribing to processed blocks instead of confirmed (#295)

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>

* Restart connection if any stream fails

* Updating to version 0.2.4

* Updating the change logs

* Fixing all the sub overflows by using saturating sub (#309)

* Fixing by cu computation adding more tests to check by CU (#311)

* Fixing by cu computation adding more tests to check by CU

* Adding more tests

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
2024-02-01 15:08:47 +01:00
galactus 6cbccd0341
Merging MTU changes and setting up transportation config (#293)
* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

* Updating the transport config to match with solana endpoint (#292)

* Updating the transport config to match with solana endpoint

* Setting max MTU after groovies comments

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
2024-01-19 22:28:25 +01:00
galactus 4ed7eead8b
Adding prometheus metrics to follow quic states (#277) 2024-01-16 11:30:40 +01:00
galactus bea39d8c6a
Migrating to solana v1.17.15 (#273) 2024-01-15 18:43:48 +01:00
Godmode Galactus 92fda9f6bb
fixing issue with confusion of blockheight and slot 2023-10-25 20:58:50 +02:00
Godmode Galactus e65ef4558b
restoring block polling with semaphore, some more changes related to processed slots and tpu manager 2023-10-25 20:54:19 +02:00
Godmode Galactus e025f91650
Adding some optimization 2023-10-25 10:37:20 +02:00
Steve 12c97b88d1
Merge pull request #228 from grooviegermanikus/groovie/disable-gso-flag
disable gso (generic segmentation offload)
2023-10-13 23:22:50 +02:00
GroovieGermanikus 7dd891f63a
remove unused import 2023-10-10 11:36:46 +02:00
GroovieGermanikus 617f7511ce
refactor flag propagation 2023-10-09 17:58:43 +02:00
GroovieGermanikus 7f7a931b5f
log GSO enable/disable 2023-10-09 17:40:02 +02:00
GroovieGermanikus e8edcee127
rework flag method 2023-10-04 21:01:07 +02:00
GroovieGermanikus d353569dbb
WIP: add DISABLE_GSO env flag 2023-10-04 20:44:52 +02:00
godmodegalactus 53fc6b482a
Update counters only if transactions are sent by literpc 2023-10-04 17:29:12 +02:00
godmodegalactus 2730ea504e
changing name blockhash to recent_blockhash 2023-10-03 12:51:18 +02:00
godmodegalactus 480631de72
Save all transactions in the cache, save transaction messages too, Increase transaction store size 2023-10-03 11:36:38 +02:00
godmodegalactus 886c80faa6
adding previous blockhash and renaming txs to transactions 2023-09-21 16:08:41 +02:00
godmodegalactus 7ef29e1af6
implementing history, block storage method
changes after groovies review
2023-09-21 15:39:25 +02:00
godmodegalactus 255b9de7f5
fixing tests, cargo fmt 2023-09-20 17:01:23 +02:00
godmodegalactus 7f3d3303b7
checking for transaction confirmation and blockheight before sending the transaction 2023-09-20 16:57:01 +02:00
Godmode Galactus 7ce00a2642
changes after groovies review 2023-09-19 16:49:46 +02:00
Godmode Galactus 5c84163138
removing unwanted test code 2023-09-19 13:39:00 +02:00
Godmode Galactus 4b51dc0460
establish connection before using QuicConnection 2023-09-19 13:35:58 +02:00
galactus 41ae03e8f5
Merge pull request #196 from blockworks-foundation/improve_tx_replayer
improve the algorithm to schedule transaction replays
2023-09-15 13:56:40 +02:00
Godmode Galactus 3e4c6ed933
creating task counters per quic connection 2023-09-15 11:06:45 +02:00
Godmode Galactus dcc640f80a
using semaphore in tpu connection manager and removing unwanted code 2023-09-15 11:06:45 +02:00
Godmode Galactus 5f48f21cd9
Changes after groovies review 2023-09-15 11:05:36 +02:00
Godmode Galactus 8c795345dd
Cargo fmt 2023-09-15 09:27:31 +02:00
Godmode Galactus c50537eec4
improve the algorithm to schedule transaction replays 2023-09-14 16:11:25 +02:00
Godmode Galactus 73242ce9a6
changes after groovies review 2023-09-14 12:05:13 +02:00
Godmode Galactus aff1c78d12
restructuring core library into multiple directories 2023-09-13 17:15:28 +02:00
Godmode Galactus 2f4cb1f839
Revert "disable prometheus to check performance impact of prometheus on fly"
This reverts commit 2945153bd2.
2023-09-09 17:43:51 +02:00
riordanp 9b4778373b
Deploy QUIC Proxy (#187)
* Load listen addr from env

* Add deployment config for quic-forward-proxy

* ipv6 support

* Read QUIC_PROXY_ADDR from env
2023-09-08 14:13:20 +01:00
Godmode Galactus d025d957a6
Some more optimizations in tpu client 2023-09-08 12:56:16 +02:00
Godmode Galactus 2945153bd2
disable prometheus to check performance impact of prometheus on fly 2023-09-07 12:30:46 +02:00
Godmode Galactus 7a9ae44241
Update rust verion to 1.70.0 2023-09-06 22:09:24 +02:00
GroovieGermanikus e86e750736 remove literpc_tpu_quic_server_integrationtest - focus on quic-forward-proxy-integration-test instead 2023-09-05 11:49:45 +02:00
GroovieGermanikus 335bd05aba tests: use solana streamer 1.16 2023-09-04 15:36:34 +02:00
Godmode Galactus 50c3b43a8b
cargo fmt 2023-09-01 16:53:55 +02:00
Godmode Galactus 260a2f104b
readding few prometheus counters 2023-09-01 16:40:59 +02:00
Godmode Galactus a418fe7fc7
Refactoring the code from gyser branch and merging into master 2023-08-31 12:34:13 +02:00
GroovieGermanikus 1fb85729ad Revert "cleanup/consolidate tests"
This reverts commit 50907f36ed.
2023-08-29 17:16:48 +02:00
GroovieGermanikus 9263b11e8c code fmt 2023-08-29 01:13:08 +02:00
GroovieGermanikus 50907f36ed cleanup/consolidate tests
- remove redundant integration test (literpc_tpu_quic_server_integrationtest.rs) and use the quic_proxy_tpu_integrationtest.rs for everything
- remove some commands from test.bash
2023-08-21 16:56:40 +02:00
GroovieGermanikus 0aebd7b362 MAN-59 disable flaky tests 2023-08-11 17:45:36 +02:00