blockworks-foundation
/
lite-rpc
mirror of https://github.com/blockworks-foundation/lite-rpc.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,034 Commits 171 Branches 103 Tags 18 MiB
Commit Graph

65 Commits

Author SHA1 Message Date
galactus bc7d89ce4e
Production (#313) 
* fix: panic on geyser close, multiplex bug

https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3

* update Cargo.lock

* reverting cargo.lock

* Fix issues with grpc and postgres

* Solving merge issues

* Fixing cargo fmt

* Increase finish quic timeout (#280) (#281)

* integrate geyser slot subscription (#283)

* Increase finish quic timeout (#280)

* Moving geyser slot subscription from stream to channels (#282)

* Moving geyser slot subscription from stream to channels

* Closing all the slot subscription tasks incase of restart

* Making slot channel unbounded (bug)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* Update cargolock file

* Fixing clippy removing grpc_inspect

* merging main with production (#290)

* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>

* Merging MTU changes and setting up transportation config (#293)

* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

* Updating the transport config to match with solana endpoint (#292)

* Updating the transport config to match with solana endpoint

* Setting max MTU after groovies comments

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>

* Making block subscription processed and moving confirmed block subscr… (#291)

* Making block subscription processed and moving confirmed block subscription to meta

* Sending both processed and confirmed blocks, if block has already been confirmed

* Minor bug, subscribing to processed blocks instead of confirmed (#295)

* reduce log

* Restart connection if any stream fails (#306)

* Main into production 01/02/2024 (#312)

* Production into main (#303)

* fix: panic on geyser close, multiplex bug

https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3

* update Cargo.lock

* reverting cargo.lock

* Fix issues with grpc and postgres

* Solving merge issues

* Fixing cargo fmt

* Increase finish quic timeout (#280) (#281)

* integrate geyser slot subscription (#283)

* Increase finish quic timeout (#280)

* Moving geyser slot subscription from stream to channels (#282)

* Moving geyser slot subscription from stream to channels

* Closing all the slot subscription tasks incase of restart

* Making slot channel unbounded (bug)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* Update cargolock file

* Fixing clippy removing grpc_inspect

* merging main with production (#290)

* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>

* Merging MTU changes and setting up transportation config (#293)

* remove block_debug_listen (#286)

* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy

* Fixing message too long and overflow panics (#288)

* Update geyser grpc connector commit (#289)

* Updating the transport config to match with solana endpoint (#292)

* Updating the transport config to match with solana endpoint

* Setting max MTU after groovies comments

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>

* Making block subscription processed and moving confirmed block subscr… (#291)

* Making block subscription processed and moving confirmed block subscription to meta

* Sending both processed and confirmed blocks, if block has already been confirmed

* Minor bug, subscribing to processed blocks instead of confirmed (#295)

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>

* Restart connection if any stream fails

* Updating to version 0.2.4

* Updating the change logs

* Fixing all the sub overflows by using saturating sub (#309)

* Fixing by cu computation adding more tests to check by CU (#311)

* Fixing by cu computation adding more tests to check by CU

* Adding more tests

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>

---------

Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
 2024-02-01 15:16:24 +01:00
galactus 118f5435e3
Fixing all the sub overflows by using saturating sub (#309) 2024-01-30 15:24:35 +01:00
godmodegalactus a44923c334
Updating to version 0.2.4 2024-01-29 13:11:54 +01:00
godmodegalactus 6c61e64948
Restart connection if any stream fails 2024-01-26 22:25:19 +01:00
Groovie | Mango 7171b524f0
Feature/block priofees (#274) 
* boilerplate

* add dummy endpoint

* simple logic with highes block

* endpoint works

* remove cu calculus

* log get_latest_block startup timing

* websocket subscription basics

* WIP

* propagate fees via channel

* cleanup

* use broadcast sender

* proper handling of broadcast channel issues

* rename stuff

* move to dedicated crate

* cleanup deps

* move data definition

* hide private types

* percentile math

* code format

* integrated stats by cu

* add cu stats

* restart inline asserts

* warn about DashMap access

* switch to BTreeMap

* remove vote transactions from calculus

* return vec

* array

* flat format

* reformat

* split arrays

* rename keys

* enable experimental tag

* code format

* more logging

* reset log level

* rename websocket method to blockPrioritizationFeesSubscribe

* HACK: use processed blocks

* add is_vote_transaction

* do not fail if fees goes down

* udp message size example

* imrpove 100 handling

* simplify inital sort

* Revert "HACK: use processed blocks"

This reverts commit ff17d9475c.

* add percentile test case

* add per block cu_consumed+tx_count(nonvote)

* fix supid cleanup bug

* add TxAggregateStats

* add by_cu test

* add alternative cu percentlie impl

* cleanup cu tests

* add check for step

* saturating_sub

* remove useless file

* add is_vote to history crate

* fix fmt+clippy (nightly)

* clippy

* clippy

* clippy

* clippy
 2024-01-25 10:29:14 +01:00
Groovie | Mango 705a08c2c6
fix some namings (#298) 
* fix some namings

* clipp

* make run_clippy_fmt.sh executable
 2024-01-23 08:17:48 +01:00
galactus de26490e9c
Squash and merging all the commits from groovies branch groovie/post… (#300) 
* Squash and merging all the commits from  groovies branch groovie/postgres_saving_blocksII

* Ingore tests which require postgres
 2024-01-22 15:22:11 +01:00
galactus 0c5aa196c1
Minor bug, subscribing to processed blocks instead of confirmed (#295) 2024-01-22 10:54:39 +01:00
galactus 33cca71d49
Making block subscription processed and moving confirmed block subscr… (#291) 
* Making block subscription processed and moving confirmed block subscription to meta

* Sending both processed and confirmed blocks, if block has already been confirmed
 2024-01-21 13:56:40 +01:00
Groovie | Mango e3bfaac726
remove block_debug_listen (#286) 
* remove block_debug_listen

caused a panic - need more time to investigate

2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] thread 'tokio-runtime-worker' panicked at cluster-endpoints/src/grpc_inspect.rs:59:21:
2024-01-17T20:31:42.913 app[683d392fd45368] ams [info] Error receiving block: Closed
2024-01-17T20:31:42.922 app[683d392fd45368] ams [info] 2024-01-17T20:31:42.912597Z ERROR lite_rpc: Services quit unexpectedly Err(cluster endpoint failure (Err(JoinError::Panic(Id(20), ...)), 1, [JoinHandle { id: Id(19) }, JoinHandle { id: Id(23) }])

* clippy
 2024-01-18 13:57:57 +01:00
galactus d589d90999
Moving geyser slot subscription from stream to channels (#284) 
Closing all the slot subscription tasks incase of restart

Making slot channel unbounded because of errors
 2024-01-17 19:45:10 +01:00
galactus cfb5e1ac66
Moving geyser slot subscription from stream to channels (#282) 
* Moving geyser slot subscription from stream to channels

* Closing all the slot subscription tasks incase of restart
 2024-01-17 15:17:49 +01:00
galactus 36c62763c0
Fixing merging of confirmed block streams (#276) 2024-01-16 10:13:12 +01:00
galactus 6f61d89743
Fixing the performance issue with geyser multiplexing (#275) 2024-01-15 20:22:59 +01:00
galactus bea39d8c6a
Migrating to solana v1.17.15 (#273) 2024-01-15 18:43:48 +01:00
godmodegalactus 78e1bb2b79
More clippy changes 2024-01-12 16:39:19 +01:00
godmodegalactus c3da6ad1b6
cargo fmt and clippy issues 2024-01-12 14:40:48 +01:00
godmodegalactus 3f69de5247
Resarting geyser slot and block stream in case they disconnect 2024-01-12 14:21:54 +01:00
galactus 185cbd379b
Merge pull request #267 from blockworks-foundation/reducing_network_usage_by_fetching_only_finalized_blockmeta-groovie 
Reduce network by only fetching block meta instead of whole block
 2024-01-11 13:16:52 +01:00
galactus b49e51da9c
Merge pull request #266 from blockworks-foundation/bootstrap_leader_schedule_from_rpc 
Bootstrap leader schedule from rpc
 2024-01-08 16:14:35 +01:00
GroovieGermanikus 079ff113c4
fix cleanup logic 2024-01-08 14:51:32 +01:00
GroovieGermanikus 8996a97424
change .send error handling on broadcast channel 2024-01-08 14:21:05 +01:00
GroovieGermanikus dc0c60ff05
rename count 2024-01-08 14:18:43 +01:00
GroovieGermanikus e5e7545553
->32 2024-01-08 14:15:42 +01:00
GroovieGermanikus 9ef773c129
refactoring 2024-01-08 14:14:59 +01:00
godmodegalactus e42db51d21
Reduce network by only fetching block meta instead of whole block 2024-01-08 12:11:48 +01:00
GroovieGermanikus ef5716932f
fix: panic on geyser close, multiplex bug 
https://github.com/blockworks-foundation/geyser-grpc-connector/issues/3
 2024-01-07 20:08:20 +01:00
musitdev 032232f6f3 add rpc leader shedule loading if the bootstrap file is not present 2024-01-05 15:58:25 +01:00
musitdev 402ebd69b1 correct from PR remarks 2024-01-04 13:36:13 +01:00
musitdev 5a24c2bb4d set stake_vote optional and integrate leader schedule and vote in send Tx 2024-01-03 10:25:45 +01:00
vuittont60 95a3f7d66c
Fix some typos (#260) 
* fix typos in benches/

* fix typos in cluster-endpoints/

* fix typos in quic-forward-proxy/

* fix typo in README.md
 2024-01-02 20:52:46 +05:30
Groovie | Mango 5cfb6de72a
grpc multiplexing integrate (#255) 
allow multiple GRPC sources
 2023-12-22 14:42:20 +01:00
Aniket Prajapati a4fdc1554a
-D clippy (#252) 
* -D clippy

* scripts

* fmt

* commented out

* diff clippy and build

* fix

* push -> main
 2023-12-08 03:26:41 +05:30
godmodegalactus 7113046d66
Resubscribing grpc block subsciption on failure, get vote accounts every 10 minutes instead of 1s 2023-12-01 11:12:54 +01:00
Godmode Galactus e6d2ab897e
Update grpc version to 0.11.0 so that we can use the latest triton service 2023-11-14 10:42:58 +01:00
Arrowana 15ffb44f6e allow x-token 2023-11-07 21:04:17 +11:00
Godmode Galactus a78866dc25
reverting logic of block polling 2023-10-25 18:49:38 +02:00
Godmode Galactus 4838912c2e
avoid fetching whole finalized block 2023-10-25 16:07:46 +02:00
Godmode Galactus aee33215c7
fixing prometheus metrics name 2023-10-25 11:41:04 +02:00
Godmode Galactus e025f91650
Adding some optimization 2023-10-25 10:37:20 +02:00
godmodegalactus fc1810cc89
Removing postgres_session and moving it to history, start to implement saving blocks 2023-10-04 15:25:06 +02:00
godmodegalactus 2730ea504e
changing name blockhash to recent_blockhash 2023-10-03 12:51:18 +02:00
godmodegalactus 480631de72
Save all transactions in the cache, save transaction messages too, Increase transaction store size 2023-10-03 11:36:38 +02:00
godmodegalactus 886c80faa6
adding previous blockhash and renaming txs to transactions 2023-09-21 16:08:41 +02:00
godmodegalactus 7ef29e1af6
implementing history, block storage method 
changes after groovies review
 2023-09-21 15:39:25 +02:00
Godmode Galactus 7ce00a2642
changes after groovies review 2023-09-19 16:49:46 +02:00
Godmode Galactus 73242ce9a6
changes after groovies review 2023-09-14 12:05:13 +02:00
Godmode Galactus aff1c78d12
restructuring core library into multiple directories 2023-09-13 17:15:28 +02:00
Godmode Galactus fc33b6bf06
Replacing last_processing_slot with processed slot 2023-09-08 14:05:54 +02:00
Godmode Galactus 797ed8d556
Minor compilation changes 2023-09-08 13:57:55 +02:00