Commit Graph

31 Commits

Author SHA1 Message Date
galactus 79748c5a58
Merge production main 2024 03 27 (#374)
* Use jemalloc

* Solving issue of finalized meta after processed block (#365)

* Solving issue of finalized meta after processed block

* Fixing the broken test

* Removing unwanted logs

* Add logs on block queues and reception time

* reduce level of block reception log

* Revert "Solving issue of finalized meta after processed block (#365)"

This reverts commit c09700fd79.

Production runs show more stable memory use but worse performance on
landing transactions.

* use yellowstone grpc with hacked-windowsize

* upgraded geyser-grpc-connector + increased timeout

* Fix block stream throughput problems

By temporarily pasting in a function to connect to block streams via a
more generously configured endpoint.

* Enabling unstable tokio on fly

* Fixing prioritization heap metrics (#370)

* Fixing prioritization heap metrics

* Fixing transaction sizes tests

* Correctly ending the block streams instead of aborting them

* Replacing exit signal with exit notification (#372)

* Replacing exit signal with exit notification

* Deprecitating nightly version

* Increase connection size

* Fixing issue with multiple notify channels

* Joining heap task instead of aborting

* fix postgres ssl algo issue - RC2-40-CBC  (#373)

* fix 373: openssl-legacy.cnf

* Remove replace console subscriber with tracing subscriber

---------

Co-authored-by: Christian Kamm <mail@ckamm.de>
Co-authored-by: GroovieGermanikus <groovie@mango.markets>
Co-authored-by: Groovie | Mango <95291500+grooviegermanikus@users.noreply.github.com>
2024-03-27 17:09:38 +01:00
Groovie | Mango 3c994597b4
benchrunner service (#363)
benchrunner service
+ minor changes in bench code
2024-03-26 13:41:46 +01:00
Groovie | Mango 7171b524f0
Feature/block priofees (#274)
* boilerplate

* add dummy endpoint

* simple logic with highes block

* endpoint works

* remove cu calculus

* log get_latest_block startup timing

* websocket subscription basics

* WIP

* propagate fees via channel

* cleanup

* use broadcast sender

* proper handling of broadcast channel issues

* rename stuff

* move to dedicated crate

* cleanup deps

* move data definition

* hide private types

* percentile math

* code format

* integrated stats by cu

* add cu stats

* restart inline asserts

* warn about DashMap access

* switch to BTreeMap

* remove vote transactions from calculus

* return vec

* array

* flat format

* reformat

* split arrays

* rename keys

* enable experimental tag

* code format

* more logging

* reset log level

* rename websocket method to blockPrioritizationFeesSubscribe

* HACK: use processed blocks

* add is_vote_transaction

* do not fail if fees goes down

* udp message size example

* imrpove 100 handling

* simplify inital sort

* Revert "HACK: use processed blocks"

This reverts commit ff17d9475c.

* add percentile test case

* add per block cu_consumed+tx_count(nonvote)

* fix supid cleanup bug

* add TxAggregateStats

* add by_cu test

* add alternative cu percentlie impl

* cleanup cu tests

* add check for step

* saturating_sub

* remove useless file

* add is_vote to history crate

* fix fmt+clippy (nightly)

* clippy

* clippy

* clippy

* clippy
2024-01-25 10:29:14 +01:00
godmodegalactus 338b20f687
minor changes 2024-01-12 17:47:13 +01:00
godmodegalactus 78e1bb2b79
More clippy changes 2024-01-12 16:39:19 +01:00
godmodegalactus 9e1c36771a
Fix CI 2024-01-12 15:57:09 +01:00
musitdev 4fb8df5b7b correct CI 2024-01-04 14:44:07 +01:00
aniketfuryrocks 079a25b071 -D warning 2024-01-03 10:22:41 +01:00
riordanp 66bf77ee3d
Merge branch 'production' into main 2023-12-22 14:25:19 +00:00
GroovieGermanikus b91f054a48
ping 2023-12-19 07:13:26 +01:00
Aniket Prajapati a4fdc1554a
-D clippy (#252)
* -D clippy

* scripts

* fmt

* commented out

* diff clippy and build

* fix

* push -> main
2023-12-08 03:26:41 +05:30
riordanp 55ff9c8f4d
CI Updates (#251)
* Deploy QUIC Proxy (#210)

* Load listen addr from env

* Add deployment config for quic-forward-proxy

* ipv6 support

* Fix rpc_tester

* Read QUIC_PROXY_ADDR from env

* Add traces for debugging

* Add timeout for writing to SendStream

* disable GSO (Generic Segmentation Offload) for all outgoing QUIC-connects

should fix https://github.com/blockworks-foundation/lite-rpc/issues/199

* disable GSO (Generic Segmentation Offload) for all outgoing QUIC-connects (#200)

should fix https://github.com/blockworks-foundation/lite-rpc/issues/199

Co-authored-by: GroovieGermanikus <groovie@mango.markets>

* Add staging config, remove traces

* cargo fmt

* delete fly.toml - was split+renamed - see cd/

* remove misleading line

* comment on quic proxy

* revert some files

* Deploy dev from main, prod from production

---------

Co-authored-by: GroovieGermanikus <groovie@mango.markets>
Co-authored-by: Steve <95291500+grooviegermanikus@users.noreply.github.com>

* Update job names

* Fix launch params

---------

Co-authored-by: GroovieGermanikus <groovie@mango.markets>
Co-authored-by: Steve <95291500+grooviegermanikus@users.noreply.github.com>
2023-12-01 13:56:02 +00:00
Riordan Panayides 67a2d30405 Update job names 2023-12-01 12:04:18 +00:00
riordanp c63a212e57
Deploy QUIC Proxy (#210)
* Load listen addr from env

* Add deployment config for quic-forward-proxy

* ipv6 support

* Fix rpc_tester

* Read QUIC_PROXY_ADDR from env

* Add traces for debugging

* Add timeout for writing to SendStream

* disable GSO (Generic Segmentation Offload) for all outgoing QUIC-connects

should fix https://github.com/blockworks-foundation/lite-rpc/issues/199

* disable GSO (Generic Segmentation Offload) for all outgoing QUIC-connects (#200)

should fix https://github.com/blockworks-foundation/lite-rpc/issues/199

Co-authored-by: GroovieGermanikus <groovie@mango.markets>

* Add staging config, remove traces

* cargo fmt

* delete fly.toml - was split+renamed - see cd/

* remove misleading line

* comment on quic proxy

* revert some files

* Deploy dev from main, prod from production

---------

Co-authored-by: GroovieGermanikus <groovie@mango.markets>
Co-authored-by: Steve <95291500+grooviegermanikus@users.noreply.github.com>
2023-12-01 12:02:41 +00:00
GroovieGermanikus d12e354a6e spit validator test 2023-09-19 12:57:38 +02:00
GroovieGermanikus fd26b56ddf ci: update validator to 1.16.13 2023-09-19 11:05:23 +02:00
GroovieGermanikus 99b6bd7ccc rework CI 2023-09-19 11:03:12 +02:00
Godmode Galactus ffef824dce
removing quic forward proxy from the fly 2023-09-09 17:55:37 +02:00
riordanp 9b4778373b
Deploy QUIC Proxy (#187)
* Load listen addr from env

* Add deployment config for quic-forward-proxy

* ipv6 support

* Read QUIC_PROXY_ADDR from env
2023-09-08 14:13:20 +01:00
GroovieGermanikus 3902dcca33 improve loggin 2023-08-08 11:50:02 +02:00
GroovieGermanikus 0ad0563a65 Merge remote-tracking branch 'origin/main' into groovie/tpu-proxy-as-module-with-integration-test 2023-08-02 13:32:01 +02:00
GroovieGermanikus 19ddc6e680 CI: run fmt+clippy 2023-07-25 14:15:43 +02:00
aniketfuryrocks 2323b8d1a1
bash script for testing 2023-04-14 18:24:15 +05:30
riordanp f7f4ab9069
Update fly-deploy.yml 2023-04-05 04:17:53 +01:00
aniketfuryrocks ab4d8cd4f4
install yarn deps 2023-03-18 16:36:42 +05:30
aniketfuryrocks 17cba6f4bc
don't run release version 2023-03-18 16:36:42 +05:30
aniketfuryrocks cfc49a5dee
wip: linker error un resolved 2023-03-18 16:36:41 +05:30
aniketfuryrocks af9b709676
wip: coi 2023-03-18 16:36:41 +05:30
aniketfuryrocks 3b0a64f199
WIP test.yml 2023-03-18 16:36:41 +05:30
aniketfuryrocks 2ff6c75fdf
WIP test.yml 2023-03-18 16:36:38 +05:30
Riordan Panayides 902e2cbb01 Add fly deployment action 2023-01-13 19:27:05 +00:00