galactus
087cc7f204
Merge prod main 2024 03 25 ( #369 )
...
* Use jemalloc
* Solving issue of finalized meta after processed block (#365 )
* Solving issue of finalized meta after processed block
* Fixing the broken test
* Removing unwanted logs
* Add logs on block queues and reception time
* reduce level of block reception log
* Revert "Solving issue of finalized meta after processed block (#365 )"
This reverts commit c09700fd79
.
Production runs show more stable memory use but worse performance on
landing transactions.
* use yellowstone grpc with hacked-windowsize
* upgraded geyser-grpc-connector + increased timeout
* Fix block stream throughput problems
By temporarily pasting in a function to connect to block streams via a
more generously configured endpoint.
* Enabling unstable tokio on fly
* update to v0.10.3+yellowstone.1.12+solana.1.17.15-hacked-windowsize3
---------
Co-authored-by: Christian Kamm <mail@ckamm.de>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
2024-03-25 17:44:57 +01:00
GroovieGermanikus
ae495bed53
Merge branch 'production'
...
using 1.17.15 geyser
2024-03-22 10:57:20 +01:00
galactus
7e6a1a4003
Reverting back the geyser version ( #364 )
2024-03-22 09:55:46 +01:00
godmodegalactus
50b81135c3
Merge branch 'production'
2024-03-18 20:01:02 +01:00
godmodegalactus
85fcb6097e
Adding some more metrics for quic tpu, and changing some parameters
2024-03-18 17:25:52 +01:00
godmodegalactus
9be86919ba
Merge branch 'production'
2024-03-16 16:18:01 +01:00
GroovieGermanikus
1e3a9cdcbe
update geyser-grpc-connector with attempt fix
2024-03-11 18:26:59 +01:00
godmodegalactus
c59f3f8f38
Updating docker file with correct version info
2024-03-08 11:40:55 +01:00
galactus
8ef1b56cdb
account_subscription_into_multiple_channels_and_merge_them ( #344 )
...
* account_subscription_into_multiple_channels_and_merge_them
* Removing unecessary changes
* Minor fix after groovies comments
2024-03-01 14:45:28 +01:00
Groovie | Mango
855c0190eb
prepare new "util" crate ( #333 )
...
prepare new "util" crate
2024-02-22 16:54:42 +01:00
Groovie | Mango
2c42a536b6
Improve/geyser replace streams ( #330 )
...
* add env ENABLE_INSTRUMENT_TRACING to enable tracing
* add tracing dependency
* example tracings
* log recent_processed_blocks.len
* bound channels
* replace fastestwins with task version
* revert fake error
* fix meta stream
* disble almost all
* disable more
* keep slot channel up
* log memory usage using CAP
* log CAP memory usage
* add span tracing to mutliplex tasks
* merge
* fix import
* remove useless spans
* fix span logger
* log emitted data from multiplexer
* improve naming of mpsc from autoconnection task
* WIP: use task/mpsc autoconnect for full blocks
* use task/mpsc autoconnect for block meta too
* tag the channels
* add spans
* bump to use updated geyser-grpc-connector with mpsc
* remove unused functions
* extract constant
* split plugger for one and many downstreams
* clippy+fmt
* use task for slots too
* remove broadcast intermediate channel
2024-02-15 21:49:15 +01:00
Groovie | Mango
38da1ed987
Improvement/check block sequencing ( #299 )
...
use grpc multiplex and improve sequencing
2024-02-07 15:51:22 +01:00
galactus
196b400e15
Adding support for address lookup tables ( #319 )
...
* Initial implementation of address lookup tables
* Implementing fetching of address lookup tables
* Use address lookup tables to calculate account prio fees
* Adding some logs and renaming classes
* preloading all the alts correctly
* Changes after groovies review
* Fixing issues after rebase
2024-02-06 17:59:46 +01:00
galactus
60388667f5
Main into production 01/02/2024 ( #312 )
...
* Production into main (#303 )
* fix: panic on geyser close, multiplex bug
https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3
* update Cargo.lock
* reverting cargo.lock
* Fix issues with grpc and postgres
* Solving merge issues
* Fixing cargo fmt
* Increase finish quic timeout (#280 ) (#281 )
* integrate geyser slot subscription (#283 )
* Increase finish quic timeout (#280 )
* Moving geyser slot subscription from stream to channels (#282 )
* Moving geyser slot subscription from stream to channels
* Closing all the slot subscription tasks incase of restart
* Making slot channel unbounded (bug)
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* Update cargolock file
* Fixing clippy removing grpc_inspect
* merging main with production (#290 )
* remove block_debug_listen (#286 )
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
* Fixing message too long and overflow panics (#288 )
* Update geyser grpc connector commit (#289 )
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
* Merging MTU changes and setting up transportation config (#293 )
* remove block_debug_listen (#286 )
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
* Fixing message too long and overflow panics (#288 )
* Update geyser grpc connector commit (#289 )
* Updating the transport config to match with solana endpoint (#292 )
* Updating the transport config to match with solana endpoint
* Setting max MTU after groovies comments
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
* Making block subscription processed and moving confirmed block subscr… (#291 )
* Making block subscription processed and moving confirmed block subscription to meta
* Sending both processed and confirmed blocks, if block has already been confirmed
* Minor bug, subscribing to processed blocks instead of confirmed (#295 )
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
* Restart connection if any stream fails
* Updating to version 0.2.4
* Updating the change logs
* Fixing all the sub overflows by using saturating sub (#309 )
* Fixing by cu computation adding more tests to check by CU (#311 )
* Fixing by cu computation adding more tests to check by CU
* Adding more tests
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
2024-02-01 15:08:47 +01:00
godmodegalactus
a44923c334
Updating to version 0.2.4
2024-01-29 13:11:54 +01:00
galactus
bea39d8c6a
Migrating to solana v1.17.15 ( #273 )
2024-01-15 18:43:48 +01:00
GroovieGermanikus
ef5716932f
fix: panic on geyser close, multiplex bug
...
https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3
2024-01-07 20:08:20 +01:00
Groovie | Mango
5cfb6de72a
grpc multiplexing integrate ( #255 )
...
allow multiple GRPC sources
2023-12-22 14:42:20 +01:00
Godmode Galactus
e025f91650
Adding some optimization
2023-10-25 10:37:20 +02:00
Godmode Galactus
7a9ae44241
Update rust verion to 1.70.0
2023-09-06 22:09:24 +02:00
Godmode Galactus
a418fe7fc7
Refactoring the code from gyser branch and merging into master
2023-08-31 12:34:13 +02:00