Commit Graph

113 Commits

Author SHA1 Message Date
Christian Kamm 2d614365e7
experiment: reduce number of source endpoints to 1 (#386)
Prediction is that this has no negative effect but reduces memory use a
lot.
2024-04-03 21:06:29 +02:00
godmodegalactus 06373c0844
Closing QUIC connection correctly, changing some QUIC params 2024-04-03 10:25:30 +02:00
godmodegalactus 12a6832c56
Swapping notify channel with broadcast channel 2024-04-02 15:07:01 +02:00
galactus 681334197f
Adding custom tpu send transaction example (#380)
* Adding an example for custom tpu send transaction

* Fixing the custom tpu example

* Optimizing SentTransactionInfo, and calculating TPS

* Reverting unwanted changes

* After groovies review
2024-04-02 14:26:54 +02:00
godmodegalactus 1e956a2b4f
Revert "Replacing notify by cancellation token to correctly shutdown tasks"
This reverts commit d1abc345cf.
2024-03-28 11:49:20 +01:00
godmodegalactus d1abc345cf
Replacing notify by cancellation token to correctly shutdown tasks 2024-03-28 09:09:42 +01:00
galactus 79748c5a58
Merge production main 2024 03 27 (#374)
* Use jemalloc

* Solving issue of finalized meta after processed block (#365)

* Solving issue of finalized meta after processed block

* Fixing the broken test

* Removing unwanted logs

* Add logs on block queues and reception time

* reduce level of block reception log

* Revert "Solving issue of finalized meta after processed block (#365)"

This reverts commit c09700fd79.

Production runs show more stable memory use but worse performance on
landing transactions.

* use yellowstone grpc with hacked-windowsize

* upgraded geyser-grpc-connector + increased timeout

* Fix block stream throughput problems

By temporarily pasting in a function to connect to block streams via a
more generously configured endpoint.

* Enabling unstable tokio on fly

* Fixing prioritization heap metrics (#370)

* Fixing prioritization heap metrics

* Fixing transaction sizes tests

* Correctly ending the block streams instead of aborting them

* Replacing exit signal with exit notification (#372)

* Replacing exit signal with exit notification

* Deprecitating nightly version

* Increase connection size

* Fixing issue with multiple notify channels

* Joining heap task instead of aborting

* fix postgres ssl algo issue - RC2-40-CBC  (#373)

* fix 373: openssl-legacy.cnf

* Remove replace console subscriber with tracing subscriber

---------

Co-authored-by: Christian Kamm <mail@ckamm.de>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
2024-03-27 17:09:38 +01:00
Godmode Galactus d917a3a5c9
Merge branch 'production' 2024-03-20 15:28:35 +01:00
godmodegalactus 9fabdab32b
Bugfix number of active connections never dropping 2024-03-20 11:28:09 +01:00
godmodegalactus 35d13a25de
Merge branch 'production' 2024-03-19 18:09:59 +01:00
godmodegalactus 6802852bbe
Minor optimization while creating quic connection 2024-03-19 16:08:27 +01:00
godmodegalactus 73d0b069be
Fixing memory leak, and metrics 2024-03-19 10:35:29 +01:00
godmodegalactus 596957f65e
Priority fee related statistics 2024-03-18 21:57:32 +01:00
godmodegalactus 9be86919ba
Merge branch 'production' 2024-03-16 16:18:01 +01:00
godmodegalactus f0442ce50d
Implementing prioritiztion heap, and using it to sort transactions by priority 2024-03-16 15:38:05 +01:00
galactus ce215e0239
After fanatids review (#356)
* After fanatids review

* After fanatids updated comments
2024-03-12 14:02:57 +01:00
godmodegalactus 374777cabc
minor optimizations, checking blockheight and confirmation status at replay 2024-03-09 19:18:33 +01:00
godmodegalactus 3e01ebb7cc
Fixing perofmrance issues after checking last block height 2024-03-08 17:58:49 +01:00
galactus 73973ba0f5
Check blockhash is expired or not (#351) 2024-03-08 11:27:37 +01:00
galactus 3f7130335a
Check blockhash is expired or not (#351) 2024-03-07 16:09:22 +01:00
galactus 4ed7eead8b
Adding prometheus metrics to follow quic states (#277) 2024-01-16 11:30:40 +01:00
galactus bea39d8c6a
Migrating to solana v1.17.15 (#273) 2024-01-15 18:43:48 +01:00
Godmode Galactus e65ef4558b
restoring block polling with semaphore, some more changes related to processed slots and tpu manager 2023-10-25 20:54:19 +02:00
Godmode Galactus e025f91650
Adding some optimization 2023-10-25 10:37:20 +02:00
GroovieGermanikus 7dd891f63a
remove unused import 2023-10-10 11:36:46 +02:00
GroovieGermanikus 617f7511ce
refactor flag propagation 2023-10-09 17:58:43 +02:00
GroovieGermanikus 7f7a931b5f
log GSO enable/disable 2023-10-09 17:40:02 +02:00
GroovieGermanikus e8edcee127
rework flag method 2023-10-04 21:01:07 +02:00
GroovieGermanikus d353569dbb
WIP: add DISABLE_GSO env flag 2023-10-04 20:44:52 +02:00
godmodegalactus 255b9de7f5
fixing tests, cargo fmt 2023-09-20 17:01:23 +02:00
godmodegalactus 7f3d3303b7
checking for transaction confirmation and blockheight before sending the transaction 2023-09-20 16:57:01 +02:00
Godmode Galactus 5c84163138
removing unwanted test code 2023-09-19 13:39:00 +02:00
Godmode Galactus 4b51dc0460
establish connection before using QuicConnection 2023-09-19 13:35:58 +02:00
Godmode Galactus 3e4c6ed933
creating task counters per quic connection 2023-09-15 11:06:45 +02:00
Godmode Galactus dcc640f80a
using semaphore in tpu connection manager and removing unwanted code 2023-09-15 11:06:45 +02:00
Godmode Galactus 73242ce9a6
changes after groovies review 2023-09-14 12:05:13 +02:00
Godmode Galactus aff1c78d12
restructuring core library into multiple directories 2023-09-13 17:15:28 +02:00
Godmode Galactus 2f4cb1f839
Revert "disable prometheus to check performance impact of prometheus on fly"
This reverts commit 2945153bd2.
2023-09-09 17:43:51 +02:00
riordanp 9b4778373b
Deploy QUIC Proxy (#187)
* Load listen addr from env

* Add deployment config for quic-forward-proxy

* ipv6 support

* Read QUIC_PROXY_ADDR from env
2023-09-08 14:13:20 +01:00
Godmode Galactus d025d957a6
Some more optimizations in tpu client 2023-09-08 12:56:16 +02:00
Godmode Galactus 2945153bd2
disable prometheus to check performance impact of prometheus on fly 2023-09-07 12:30:46 +02:00
Godmode Galactus a418fe7fc7
Refactoring the code from gyser branch and merging into master 2023-08-31 12:34:13 +02:00
GroovieGermanikus 4982325e67 direct test - wait in loop 2023-08-10 14:50:42 +02:00
GroovieGermanikus 10e4ea925a clarify test naming 2023-08-10 14:38:15 +02:00
GroovieGermanikus 7df7f271a5 properly drain channel on agent shutdown 2023-08-10 13:50:47 +02:00
GroovieGermanikus e246aa9d38 check for missing tx in test 2023-08-10 13:04:30 +02:00
GroovieGermanikus 5a07037087 cleanups 2023-08-10 10:44:24 +02:00
GroovieGermanikus e08969357f remove useless serialization to VersionedTransaction 2023-08-10 10:43:03 +02:00
GroovieGermanikus e0f3538923 move broadcast receiver 2023-08-10 10:31:31 +02:00
GroovieGermanikus 414216e585 handle 0 tpu case 2023-08-09 17:29:42 +02:00