Commit Graph

35 Commits

Author SHA1 Message Date
GroovieGermanikus a1946f59ba
CAUTION: temp disabled accounts_map_transaction_latest 2024-04-24 12:17:12 +02:00
Groovie | Mango bab25959f6
postgres schema fixes after moving to self-operated PostgreSQL (#57)
* remove indices from migration.sql which here never created

* BREAKING: make transaction_id the primary key in transactions lookup table

* use varchar in postgres.rs

* add "NOT NULL" constraint wherever possible

* fix small accounts lookup table naming

* fly app for migration

see https://github.com/blockworks-foundation/BankingStageErrorsTrackingSidecar/issues/56

* autovacuum settings

* databse init script

* explain query_user role

* tune toast_tuple_target and comment on page size

* minor fixes

* dba queries

* jot down the fly machine config

* restore create schema

* tweak storage param for postgres 15
2024-02-24 18:29:52 +01:00
godmodegalactus 99427a9253
Revert "partition accounts_map_transaction_latest table (#47)"
This reverts commit 7a577a43fa.
2024-02-01 17:56:20 +01:00
godmodegalactus a065914e62
Revert "build amt_latest tx array with latest at leftmost position (#51)"
This reverts commit a981ff4b2b.
2024-02-01 17:55:38 +01:00
Groovie | Mango 7a577a43fa
partition accounts_map_transaction_latest table (#47) 2024-01-31 10:49:16 +01:00
Groovie | Mango a981ff4b2b
build amt_latest tx array with latest at leftmost position (#51) 2024-01-31 10:39:29 +01:00
Groovie | Mango 566a107145
removed FK contraint on error_code (#49) 2024-01-27 09:35:10 +01:00
Groovie | Mango fbfef4db06
slow sqlfunction (#42)
* rework array_dedup_append function

* array_dedup_append: implemented faster version

uses nested array remove for merge+deduplication
2024-01-11 17:39:44 +01:00
Groovie | Mango 5c3edc836f
add table with latest 1000 txs per acc_id (#38)
* wip

* use fancy postgres method

* cleanup

* fix logs

* format

* simpler function

* Revert "simpler function"

This reverts commit 57120b9ce8.

* fix sql function which did not deduplicate

* fix initial tx array being null
2024-01-09 15:12:03 +01:00
godmodegalactus c8c59135f8
Reverting sigature to char(88) and account key to char(44) 2024-01-05 17:08:23 +01:00
godmodegalactus 31da6d2b5b
Reverting ATLs and changing signature and account key to text 2023-12-24 10:07:49 +01:00
godmodegalactus 921dce82bd
Changing back signature type to char(88) and account_key to char(44) 2023-12-22 21:42:48 +01:00
Groovie | Mango c51d8f87b5
Improve/use text insteadof varchar char (#33)
* clippy+fmt

* use varchar for signature+account_address

* cluster amt table

* Postgres: use TEXT everywhere
2023-12-22 15:24:06 +01:00
galactus 1076e22523
Adding support for address lookup tables (#26)
* Adding support for address lookup tables

* Updating code for ATLS

* Changes after groovies comments
2023-12-21 11:20:55 +01:00
Groovie | Mango a862c18da5
add index transaction_slot(slot) (#21) 2023-12-13 14:12:02 +01:00
Groovie | Mango 30a640434a
fix migration (#19)
- add missing schema prefix
- add missing index on blockhash
2023-12-13 10:01:42 +01:00
galactus 49f519df0b
Changing schema and adding accounts data (#10)
* chaning schema

fixing the schema

updating postgres code

Adding transaction slots into postgres

saving account used by transactions

saving block data

* Saving all the block info

completing block save

Optimizing postgres saving of data

fixing schema after groovies review

Schema changes after groovies review

Fixing that is_writable is always true

* adding a new index on slot
2023-12-12 09:58:56 +01:00
galactus f6608e5c1c
filtering transactions without status (#12) 2023-12-05 22:17:46 +01:00
galactus 63edab3060
chaning primary key on transaction infos table (#11) 2023-12-05 19:11:18 +01:00
galactus fbf2e16988
Adding supp info (#5)
* adding prioritization fees with write lock accounts

* adding supplimentary infos

* moving to multiple geyser endpoints, using copyin instead of insert

* mincor changes

* adding missing column in transaction info

* minor bug fixes and fmt

* restart block subscription on geyser

* resubsribing to banking errors notification on failure
2023-12-01 11:08:27 +00:00
godmodegalactus 3ec0a4372d
Saving accounts used in json format 2023-11-24 13:39:48 +01:00
godmodegalactus c1a61ab0a6
get banking blocks from rpc 2023-11-24 11:41:19 +01:00
godmodegalactus 2e994bd2dc
Some fixes, saving read account, serializing data in json format 2023-11-23 16:23:55 +01:00
godmodegalactus d8646f65d6
Adding postgres certificates and grpc token 2023-11-23 11:24:16 +01:00
Godmode Galactus 127f6ae364
Merge branch 'grpc_v1.16.17' 2023-10-26 13:48:57 +02:00
galactus 365b0f4c2a
Merge pull request #2 from grooviegermanikus/groovie/postgres-index-on-error-blocks
add index idx_blocks_slot_errors
2023-10-26 13:28:14 +02:00
Godmode Galactus 070c3264ba
moving from custom types to text 2023-10-24 13:30:34 +02:00
Godmode Galactus fd8fa7fe05
making proper types 2023-10-21 18:40:19 +02:00
GroovieGermanikus 6cb552a8b4
add index idx_blocks_slot_errors 2023-10-21 10:56:14 +02:00
Godmode Galactus 5136b09c89
adding clap cli 2023-10-20 20:14:33 +02:00
GroovieGermanikus 98a05f4ee0
add index + cluster index to blocks + transaction_info 2023-10-18 12:44:11 +02:00
Godmode Galactus 0e151a75ec
renaming timestamp and using changing timestamp type 2023-10-17 15:13:42 +02:00
Godmode Galactus 3cb4a874b9
saving some more transaction data and block_info 2023-10-17 12:11:54 +02:00
Godmode Galactus 29616a19c9
fixing error for first request 2023-10-16 15:53:44 +02:00
Godmode Galactus 8c029c19f3
Adding postgres 2023-10-02 10:51:38 +02:00