blockworks-foundation
/
lite-rpc
mirror of https://github.com/blockworks-foundation/lite-rpc.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,054 Commits 175 Branches 108 Tags 18 MiB
Commit Graph

1054 Commits

Author SHA1 Message Date
galactus 73973ba0f5
Check blockhash is expired or not (#351) 2024-03-08 11:27:37 +01:00
galactus 60388667f5
Main into production 01/02/2024 (#312) 
* Production into main (#303)

* fix: panic on geyser close, multiplex bug

https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3

* update Cargo.lock

* reverting cargo.lock

* Fix issues with grpc and postgres

* Solving merge issues

* Fixing cargo fmt

* Increase finish quic timeout (#280) (#281)

* integrate geyser slot subscription (#283)

* Increase finish quic timeout (#280)

* Moving geyser slot subscription from stream to channels (#282)

* Moving geyser slot subscription from stream to channels

* Closing all the slot subscription tasks incase of restart

* Making slot channel unbounded (bug)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* Update cargolock file

* Fixing clippy removing grpc_inspect

* merging main with production (#290)

* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>

* Merging MTU changes and setting up transportation config (#293)

* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

* Updating the transport config to match with solana endpoint (#292)

* Updating the transport config to match with solana endpoint

* Setting max MTU after groovies comments

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>

* Making block subscription processed and moving confirmed block subscr… (#291)

* Making block subscription processed and moving confirmed block subscription to meta

* Sending both processed and confirmed blocks, if block has already been confirmed

* Minor bug, subscribing to processed blocks instead of confirmed (#295)

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>

* Restart connection if any stream fails

* Updating to version 0.2.4

* Updating the change logs

* Fixing all the sub overflows by using saturating sub (#309)

* Fixing by cu computation adding more tests to check by CU (#311)

* Fixing by cu computation adding more tests to check by CU

* Adding more tests

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
 2024-02-01 15:08:47 +01:00
galactus 64e86862c1
Restart connection if any stream fails (#306) 2024-01-26 22:49:10 +01:00
GroovieGermanikus 847ce74ab6
reduce log 2024-01-26 19:46:51 +01:00
godmodegalactus cb3647cec5
Merge branch 'main' into production 2024-01-26 12:05:51 +01:00
galactus 7821d29975
Optimize calculation of prioritization fees stats (#301) 
* Optimize calculation of prioritization fees stats

* comment on arrays in response

* Fix the calculation of supp

* Fix fmt

---------

Co-authored-by: GroovieGermanikus <groovie@mango.markets>
 2024-01-25 16:06:38 +01:00
Groovie | Mango 7171b524f0
Feature/block priofees (#274) 
* boilerplate

* add dummy endpoint

* simple logic with highes block

* endpoint works

* remove cu calculus

* log get_latest_block startup timing

* websocket subscription basics

* WIP

* propagate fees via channel

* cleanup

* use broadcast sender

* proper handling of broadcast channel issues

* rename stuff

* move to dedicated crate

* cleanup deps

* move data definition

* hide private types

* percentile math

* code format

* integrated stats by cu

* add cu stats

* restart inline asserts

* warn about DashMap access

* switch to BTreeMap

* remove vote transactions from calculus

* return vec

* array

* flat format

* reformat

* split arrays

* rename keys

* enable experimental tag

* code format

* more logging

* reset log level

* rename websocket method to blockPrioritizationFeesSubscribe

* HACK: use processed blocks

* add is_vote_transaction

* do not fail if fees goes down

* udp message size example

* imrpove 100 handling

* simplify inital sort

* Revert "HACK: use processed blocks"

This reverts commit ff17d9475c.

* add percentile test case

* add per block cu_consumed+tx_count(nonvote)

* fix supid cleanup bug

* add TxAggregateStats

* add by_cu test

* add alternative cu percentlie impl

* cleanup cu tests

* add check for step

* saturating_sub

* remove useless file

* add is_vote to history crate

* fix fmt+clippy (nightly)

* clippy

* clippy

* clippy

* clippy
 2024-01-25 10:29:14 +01:00
Groovie | Mango 705a08c2c6
fix some namings (#298) 
* fix some namings

* clipp

* make run_clippy_fmt.sh executable
 2024-01-23 08:17:48 +01:00
galactus de26490e9c
Squash and merging all the commits from groovies branch groovie/post… (#300) 
* Squash and merging all the commits from  groovies branch groovie/postgres_saving_blocksII

* Ingore tests which require postgres
 2024-01-22 15:22:11 +01:00
galactus 0fa22d6d0e Minor bug, subscribing to processed blocks instead of confirmed (#295) 2024-01-22 11:17:22 +01:00
galactus 3139970863 Making block subscription processed and moving confirmed block subscr… (#291) 
* Making block subscription processed and moving confirmed block subscription to meta

* Sending both processed and confirmed blocks, if block has already been confirmed
 2024-01-22 11:17:22 +01:00
galactus 0c5aa196c1
Minor bug, subscribing to processed blocks instead of confirmed (#295) 2024-01-22 10:54:39 +01:00
galactus 33cca71d49
Making block subscription processed and moving confirmed block subscr… (#291) 
* Making block subscription processed and moving confirmed block subscription to meta

* Sending both processed and confirmed blocks, if block has already been confirmed
 2024-01-21 13:56:40 +01:00
galactus 6cbccd0341
Merging MTU changes and setting up transportation config (#293) 
* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

* Updating the transport config to match with solana endpoint (#292)

* Updating the transport config to match with solana endpoint

* Setting max MTU after groovies comments

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
 2024-01-19 22:28:25 +01:00
galactus 86e7f91cec
Updating the transport config to match with solana endpoint (#292) 
* Updating the transport config to match with solana endpoint

* Setting max MTU after groovies comments
 2024-01-19 22:08:03 +01:00
galactus 392ffe3103
merging main with production (#290) 
* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
 2024-01-18 16:05:07 +01:00
galactus e00683884a
Update geyser grpc connector commit (#289) 2024-01-18 15:53:02 +01:00
galactus 4d4019264e
Fixing message too long and overflow panics (#288) 2024-01-18 15:11:29 +01:00
Groovie | Mango e3bfaac726
remove block_debug_listen (#286) 
* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy
 2024-01-18 13:57:57 +01:00
godmodegalactus c828a35602
Fixing clippy removing grpc_inspect 2024-01-18 11:40:36 +01:00
godmodegalactus f102eac512
Merge branch 'main' into production 2024-01-18 11:37:50 +01:00
galactus ba77b0b389
Updating cargo file (#287) 
* Updating cargo file

* Updating tag for grpc connector
 2024-01-18 11:28:35 +01:00
godmodegalactus f5d78ca24d
Update cargolock file 2024-01-18 10:57:32 +01:00
GroovieGermanikus 9d9f8f8942
remove block_debug_listen 
caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])
 2024-01-17 23:04:14 +01:00
godmodegalactus c923f3a18a
Making slot channel unbounded (bug) 2024-01-17 19:56:53 +01:00
galactus d589d90999
Moving geyser slot subscription from stream to channels (#284) 
Closing all the slot subscription tasks incase of restart

Making slot channel unbounded because of errors
 2024-01-17 19:45:10 +01:00
galactus f77a89eaed
integrate geyser slot subscription (#283) 
* Increase finish quic timeout (#280)

* Moving geyser slot subscription from stream to channels (#282)

* Moving geyser slot subscription from stream to channels

* Closing all the slot subscription tasks incase of restart
 2024-01-17 16:34:54 +01:00
galactus cfb5e1ac66
Moving geyser slot subscription from stream to channels (#282) 
* Moving geyser slot subscription from stream to channels

* Closing all the slot subscription tasks incase of restart
 2024-01-17 15:17:49 +01:00
galactus 60c4fdcbcb
Increase finish quic timeout (#280) (#281) 2024-01-17 13:53:16 +01:00
galactus 1209a8ae4d
Increase finish quic timeout (#280) 2024-01-17 13:10:11 +01:00
godmodegalactus f076d1143b
Merge remote-tracking branch 'origin/main' into production 2024-01-16 11:37:31 +01:00
godmodegalactus 18e48bba7d
Fixing cargo fmt 2024-01-16 11:37:21 +01:00
galactus 4ed7eead8b
Adding prometheus metrics to follow quic states (#277) 2024-01-16 11:30:40 +01:00
godmodegalactus c193f2f2fc
Merge remote-tracking branch 'origin/main' into production 2024-01-16 10:14:32 +01:00
galactus 36c62763c0
Fixing merging of confirmed block streams (#276) 2024-01-16 10:13:12 +01:00
godmodegalactus ab9511ccb1
Solving merge issues 2024-01-15 20:49:00 +01:00
godmodegalactus 9369c0f03b
Merge remote-tracking branch 'ssh/main' into production 2024-01-15 20:24:48 +01:00
galactus 6f61d89743
Fixing the performance issue with geyser multiplexing (#275) 2024-01-15 20:22:59 +01:00
galactus bea39d8c6a
Migrating to solana v1.17.15 (#273) 2024-01-15 18:43:48 +01:00
godmodegalactus 10be5de5c4
Fix issues with grpc and postgres 2024-01-12 23:07:45 +01:00
godmodegalactus ee66d062e8
reverting cargo.lock 2024-01-12 21:31:19 +01:00
godmodegalactus e436625b53
Merging main into prod 12/01/2024 2024-01-12 18:01:24 +01:00
godmodegalactus 338b20f687
minor changes 2024-01-12 17:47:13 +01:00
godmodegalactus 78e1bb2b79
More clippy changes 2024-01-12 16:39:19 +01:00
godmodegalactus 1acc71d51d
Fix fmt 2024-01-12 16:19:00 +01:00
godmodegalactus 1923cb9fef
Fix clippy 2024-01-12 16:12:20 +01:00
godmodegalactus 9e1c36771a
Fix CI 2024-01-12 15:57:09 +01:00
godmodegalactus c3da6ad1b6
cargo fmt and clippy issues 2024-01-12 14:40:48 +01:00
godmodegalactus 2498950583
Reconnecing to block stream and slot stream incase of error 2024-01-12 14:33:00 +01:00
godmodegalactus 3f69de5247
Resarting geyser slot and block stream in case they disconnect 2024-01-12 14:21:54 +01:00