4d5a21530c
Adding CLI argument to set the max number of connections with the leader ( #317 )
...
* Adding CLI argument to set the max number of connections with the leader
* Fixing env variable name
2024-02-05 14:06:24 +01:00
9e031902e3
Implementing missing endpoints ( #316 )
...
* Implementing missing endpoints
* Adding slot subscription, and implementing prio fee method
* Changes after groovie and anikets review
2024-02-02 16:42:42 +01:00
27b1e6ad16
Calculating prio fees by account ( #310 )
...
* Calculating readable and writable accounts for transaction and saving in transaction info, declaration of primary strutures
Implementing calculation of prioritization by accounts
Optimize calculation of prioritization fees stats (#301 )
* Optimize calculation of prioritization fees stats
* comment on arrays in response
* Fix the calculation of supp
* Fix fmt
---------
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
Implementing calculation of prioritization by accounts
Adding endpoint methods for prioritization fees by account
* Implement account stats subscription
* Fixing the serialization and deserialization of last
* Changes after groovies review
2024-02-01 18:49:51 +01:00
bc7d89ce4e
Production ( #313 )
...
* fix: panic on geyser close, multiplex bug
https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3
* update Cargo.lock
* reverting cargo.lock
* Fix issues with grpc and postgres
* Solving merge issues
* Fixing cargo fmt
* Increase finish quic timeout (#280 ) (#281 )
* integrate geyser slot subscription (#283 )
* Increase finish quic timeout (#280 )
* Moving geyser slot subscription from stream to channels (#282 )
* Moving geyser slot subscription from stream to channels
* Closing all the slot subscription tasks incase of restart
* Making slot channel unbounded (bug)
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* Update cargolock file
* Fixing clippy removing grpc_inspect
* merging main with production (#290 )
* remove block_debug_listen (#286 )
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
* Fixing message too long and overflow panics (#288 )
* Update geyser grpc connector commit (#289 )
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
* Merging MTU changes and setting up transportation config (#293 )
* remove block_debug_listen (#286 )
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
* Fixing message too long and overflow panics (#288 )
* Update geyser grpc connector commit (#289 )
* Updating the transport config to match with solana endpoint (#292 )
* Updating the transport config to match with solana endpoint
* Setting max MTU after groovies comments
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
* Making block subscription processed and moving confirmed block subscr… (#291 )
* Making block subscription processed and moving confirmed block subscription to meta
* Sending both processed and confirmed blocks, if block has already been confirmed
* Minor bug, subscribing to processed blocks instead of confirmed (#295 )
* reduce log
* Restart connection if any stream fails (#306 )
* Main into production 01/02/2024 (#312 )
* Production into main (#303 )
* fix: panic on geyser close, multiplex bug
https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3
* update Cargo.lock
* reverting cargo.lock
* Fix issues with grpc and postgres
* Solving merge issues
* Fixing cargo fmt
* Increase finish quic timeout (#280 ) (#281 )
* integrate geyser slot subscription (#283 )
* Increase finish quic timeout (#280 )
* Moving geyser slot subscription from stream to channels (#282 )
* Moving geyser slot subscription from stream to channels
* Closing all the slot subscription tasks incase of restart
* Making slot channel unbounded (bug)
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* Update cargolock file
* Fixing clippy removing grpc_inspect
* merging main with production (#290 )
* remove block_debug_listen (#286 )
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
* Fixing message too long and overflow panics (#288 )
* Update geyser grpc connector commit (#289 )
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
* Merging MTU changes and setting up transportation config (#293 )
* remove block_debug_listen (#286 )
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
* Fixing message too long and overflow panics (#288 )
* Update geyser grpc connector commit (#289 )
* Updating the transport config to match with solana endpoint (#292 )
* Updating the transport config to match with solana endpoint
* Setting max MTU after groovies comments
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
* Making block subscription processed and moving confirmed block subscr… (#291 )
* Making block subscription processed and moving confirmed block subscription to meta
* Sending both processed and confirmed blocks, if block has already been confirmed
* Minor bug, subscribing to processed blocks instead of confirmed (#295 )
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
* Restart connection if any stream fails
* Updating to version 0.2.4
* Updating the change logs
* Fixing all the sub overflows by using saturating sub (#309 )
* Fixing by cu computation adding more tests to check by CU (#311 )
* Fixing by cu computation adding more tests to check by CU
* Adding more tests
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
2024-02-01 15:16:24 +01:00
36458aefe7
Fixing by cu computation adding more tests to check by CU ( #311 )
...
* Fixing by cu computation adding more tests to check by CU
* Adding more tests
2024-02-01 14:56:37 +01:00
118f5435e3
Fixing all the sub overflows by using saturating sub ( #309 )
2024-01-30 15:24:35 +01:00
8334b2b48c
Updating the change logs
2024-01-29 13:20:32 +01:00
a44923c334
Updating to version 0.2.4
2024-01-29 13:11:54 +01:00
6c61e64948
Restart connection if any stream fails
2024-01-26 22:25:19 +01:00
6f762f0384
Production into main ( #303 )
...
* fix: panic on geyser close, multiplex bug
https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3
* update Cargo.lock
* reverting cargo.lock
* Fix issues with grpc and postgres
* Solving merge issues
* Fixing cargo fmt
* Increase finish quic timeout (#280 ) (#281 )
* integrate geyser slot subscription (#283 )
* Increase finish quic timeout (#280 )
* Moving geyser slot subscription from stream to channels (#282 )
* Moving geyser slot subscription from stream to channels
* Closing all the slot subscription tasks incase of restart
* Making slot channel unbounded (bug)
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* Update cargolock file
* Fixing clippy removing grpc_inspect
* merging main with production (#290 )
* remove block_debug_listen (#286 )
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
* Fixing message too long and overflow panics (#288 )
* Update geyser grpc connector commit (#289 )
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
* Merging MTU changes and setting up transportation config (#293 )
* remove block_debug_listen (#286 )
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
* Fixing message too long and overflow panics (#288 )
* Update geyser grpc connector commit (#289 )
* Updating the transport config to match with solana endpoint (#292 )
* Updating the transport config to match with solana endpoint
* Setting max MTU after groovies comments
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
* Making block subscription processed and moving confirmed block subscr… (#291 )
* Making block subscription processed and moving confirmed block subscription to meta
* Sending both processed and confirmed blocks, if block has already been confirmed
* Minor bug, subscribing to processed blocks instead of confirmed (#295 )
---------
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
2024-01-26 13:56:33 +01:00
7821d29975
Optimize calculation of prioritization fees stats ( #301 )
...
* Optimize calculation of prioritization fees stats
* comment on arrays in response
* Fix the calculation of supp
* Fix fmt
---------
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
2024-01-25 16:06:38 +01:00
7171b524f0
Feature/block priofees ( #274 )
...
* boilerplate
* add dummy endpoint
* simple logic with highes block
* endpoint works
* remove cu calculus
* log get_latest_block startup timing
* websocket subscription basics
* WIP
* propagate fees via channel
* cleanup
* use broadcast sender
* proper handling of broadcast channel issues
* rename stuff
* move to dedicated crate
* cleanup deps
* move data definition
* hide private types
* percentile math
* code format
* integrated stats by cu
* add cu stats
* restart inline asserts
* warn about DashMap access
* switch to BTreeMap
* remove vote transactions from calculus
* return vec
* array
* flat format
* reformat
* split arrays
* rename keys
* enable experimental tag
* code format
* more logging
* reset log level
* rename websocket method to blockPrioritizationFeesSubscribe
* HACK: use processed blocks
* add is_vote_transaction
* do not fail if fees goes down
* udp message size example
* imrpove 100 handling
* simplify inital sort
* Revert "HACK: use processed blocks"
This reverts commit ff17d9475c
2024-01-25 10:29:14 +01:00
705a08c2c6
fix some namings ( #298 )
...
* fix some namings
* clipp
* make run_clippy_fmt.sh executable
2024-01-23 08:17:48 +01:00
de26490e9c
Squash and merging all the commits from groovies branch groovie/post… ( #300 )
...
* Squash and merging all the commits from groovies branch groovie/postgres_saving_blocksII
* Ingore tests which require postgres
2024-01-22 15:22:11 +01:00
0c5aa196c1
Minor bug, subscribing to processed blocks instead of confirmed ( #295 )
2024-01-22 10:54:39 +01:00
33cca71d49
Making block subscription processed and moving confirmed block subscr… ( #291 )
...
* Making block subscription processed and moving confirmed block subscription to meta
* Sending both processed and confirmed blocks, if block has already been confirmed
2024-01-21 13:56:40 +01:00
86e7f91cec
Updating the transport config to match with solana endpoint ( #292 )
...
* Updating the transport config to match with solana endpoint
* Setting max MTU after groovies comments
2024-01-19 22:08:03 +01:00
e00683884a
Update geyser grpc connector commit ( #289 )
2024-01-18 15:53:02 +01:00
4d4019264e
Fixing message too long and overflow panics ( #288 )
2024-01-18 15:11:29 +01:00
e3bfaac726
remove block_debug_listen ( #286 )
...
* remove block_debug_listen
caused a panic - need more time to investigate
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
* clippy
2024-01-18 13:57:57 +01:00
ba77b0b389
Updating cargo file ( #287 )
...
* Updating cargo file
* Updating tag for grpc connector
2024-01-18 11:28:35 +01:00
d589d90999
Moving geyser slot subscription from stream to channels ( #284 )
...
Closing all the slot subscription tasks incase of restart
Making slot channel unbounded because of errors
2024-01-17 19:45:10 +01:00
cfb5e1ac66
Moving geyser slot subscription from stream to channels ( #282 )
...
* Moving geyser slot subscription from stream to channels
* Closing all the slot subscription tasks incase of restart
2024-01-17 15:17:49 +01:00
1209a8ae4d
Increase finish quic timeout ( #280 )
2024-01-17 13:10:11 +01:00
4ed7eead8b
Adding prometheus metrics to follow quic states ( #277 )
2024-01-16 11:30:40 +01:00
36c62763c0
Fixing merging of confirmed block streams ( #276 )
2024-01-16 10:13:12 +01:00
6f61d89743
Fixing the performance issue with geyser multiplexing ( #275 )
2024-01-15 20:22:59 +01:00
bea39d8c6a
Migrating to solana v1.17.15 ( #273 )
2024-01-15 18:43:48 +01:00
338b20f687
minor changes
2024-01-12 17:47:13 +01:00
78e1bb2b79
More clippy changes
2024-01-12 16:39:19 +01:00
1acc71d51d
Fix fmt
2024-01-12 16:19:00 +01:00
1923cb9fef
Fix clippy
2024-01-12 16:12:20 +01:00
9e1c36771a
Fix CI
2024-01-12 15:57:09 +01:00
c3da6ad1b6
cargo fmt and clippy issues
2024-01-12 14:40:48 +01:00
2498950583
Reconnecing to block stream and slot stream incase of error
2024-01-12 14:33:00 +01:00
3f69de5247
Resarting geyser slot and block stream in case they disconnect
2024-01-12 14:21:54 +01:00
d91e2e9316
disable geyser stakes and votes for refactoring ( #268 )
2024-01-11 14:37:06 +01:00
f910587553
fix prioritization_fees overflow ( #245 )
...
* fix prioritization_fees overflow
* suggest inline
* Cargo fmt
---------
Co-authored-by: galactus <96341601+godmodegalactus@users.noreply.github.com>
Co-authored-by: godmodegalactus <godmodegalactus@gmail.com>
2024-01-11 14:16:32 +01:00
1055d2bb0d
Merge pull request #262 from blockworks-foundation/fix/grpc-multiplex-logging
...
update connector to log the connection problems
2024-01-11 14:05:11 +01:00
7f55e5b361
Merge branch 'main' into fix/grpc-multiplex-logging
2024-01-11 13:18:41 +01:00
185cbd379b
Merge pull request #267 from blockworks-foundation/reducing_network_usage_by_fetching_only_finalized_blockmeta-groovie
...
Reduce network by only fetching block meta instead of whole block
2024-01-11 13:16:52 +01:00
b49e51da9c
Merge pull request #266 from blockworks-foundation/bootstrap_leader_schedule_from_rpc
...
Bootstrap leader schedule from rpc
2024-01-08 16:14:35 +01:00
e39a2f5f02
Merge pull request #265 from blockworks-foundation/reducing_network_usage_by_fetching_only_finalized_blockmeta
...
Reduce network by only fetching block meta instead of whole block
2024-01-08 15:07:32 +01:00
079ff113c4
fix cleanup logic
2024-01-08 14:51:32 +01:00
8996a97424
change .send error handling on broadcast channel
2024-01-08 14:21:05 +01:00
dc0c60ff05
rename count
2024-01-08 14:18:43 +01:00
e5e7545553
->32
2024-01-08 14:15:42 +01:00
9ef773c129
refactoring
2024-01-08 14:14:59 +01:00
21d0cee332
set initial rpc schedule parameters
2024-01-08 13:19:23 +01:00
e42db51d21
Reduce network by only fetching block meta instead of whole block
2024-01-08 12:11:48 +01:00
galactus
godmodegalactus
Groovie | Mango
GroovieGermanikus
musitdev