Commit Graph

49 Commits

Author SHA1 Message Date
Riordan Panayides 190528b722 Add process name label, fix some metric types 2022-10-08 12:57:47 +01:00
Riordan Panayides 2881378b7f Refactor metrics 2022-10-07 11:44:53 +01:00
Riordan Panayides 269f9db762 Merge remote-tracking branch 'rpcpool/v1.10' 2022-08-24 20:07:25 +01:00
Riordan Panayides 6b280445cc Try 1.10.35 2022-08-24 17:19:40 +01:00
Pedro bb66b37914 bump to .35 2022-08-24 19:29:59 +07:00
Riordan Panayides 495b5371ec Update solana and mango deps 2022-08-24 12:56:50 +01:00
Daniel Camargo cc5300bd10 bump version to v1.10.34 2022-08-08 17:45:45 +01:00
Linus Kendall fb68dde543
Version bump to 1.10.32 2022-08-02 10:00:54 +01:00
Linus Kendall fd1654b416 Version bump 1.10.31 2022-07-22 11:54:57 +01:00
Linus Kendall a80d62f1fb Upgraded solana version 2022-06-20 12:18:23 +01:00
Christian Kamm 1be0cc8fb6 pnl-service: first working version 2022-03-23 18:39:42 +01:00
Christian Kamm cdf6d54156 Config: Separate out source config
We want to be able to not have a postgres target
2022-03-23 08:51:17 +01:00
Christian Kamm 42f07d58a6 Keep slot, write_version etc as u64, convert only for postgres
This makes the conversion to i64 something that's local to the postgres
target, and doesn't affect unrelated code.
2022-03-23 08:18:02 +01:00
Linus Kendall b6cefddef2 Compatibility fixes for 1.9
- Renamed to geyser everywhere and updated the crates
- Changed FullRpcClient to AccountsDataClient
2022-03-22 08:36:59 +00:00
Christian Kamm f25c49d983 Configurable max account write queue size 2022-03-16 11:04:30 +01:00
Christian Kamm 80423fdac9 Track "is_selected" to denote closed/reused accounts 2022-01-28 10:12:01 +01:00
Christian Kamm 66266a3469 Update solana version to 1.8.14 2022-01-26 10:08:53 +01:00
Christian Kamm 685dd75bfc Minor index fixes 2022-01-24 13:08:36 +01:00
Christian Kamm e4e3fb2cac Update example config files 2022-01-20 16:20:16 +01:00
Christian Kamm 08b99875c2 Postgres: Add an index to account write tables
This index matches exactly the most frequent query type of
SELECT DISTINCT(pubkey) ...
    ORDER BY pubkey, slot DESC, write_version DESC
2022-01-20 11:23:02 +01:00
Christian Kamm cf26557f7d Update to solana 1.8.12 2022-01-12 12:00:06 +01:00
Christian Kamm afc08d8266 Fix metadata 2022-01-07 08:21:00 +01:00
Christian Kamm 7d8fd45de4 Add support for updating a monitoring table
That way connector interruptions can be seen directly form the target
database.
2022-01-06 12:54:35 +01:00
Christian Kamm fb7e0d14e2 Update to solana 1.8.11 2022-01-04 18:39:48 +01:00
Christian Kamm 5b5eaba4ff Pipeline SQL inserts for better performance
Previously insert speed was primarily limited by roundtrip time to the
database since they were fully sequential in each connection. Now a full
batch of inserts is done per connection in parallel.

This could still be improved a lot. Currently each connection will fully
wait for all inserts to be done in the current batch before starting
another one.
2022-01-04 10:15:57 +01:00
Christian Kamm d5395a3b75 Add config flag for deleting old data
Keeping it is very useful for testing.
2022-01-03 10:36:11 +01:00
Christian Kamm 17d6787bf1 Add TLS domain name argument 2021-11-30 17:15:41 +01:00
Christian Kamm a941f486ed Fix bug introduced by deleting older slots
Deleting older slots meant that older (but still most recent) account
writes that had their slot deleted would no longer show up in views.

Now the guarantee is that an account write for a missing slot that is
smaller than the top slot in the slots table is rooted.

To guarantee that, account writes for non-rooted slots that preceed
rooted slots are deleted now.
2021-11-25 10:38:55 +01:00
Christian Kamm 3cdbeddf8e Update solana version to 1.8.5 2021-11-19 11:59:59 +01:00
Christian Kamm e34ee0489c Update solana version to 1.8.3 2021-11-19 11:57:47 +01:00
Christian Kamm b65815e4d4 gRPC: Optionally use TLS 2021-11-18 14:21:17 +01:00
Christian Kamm 4c9b782d1f Mango: Drop all views in drop_views.sql 2021-11-15 16:18:27 +01:00
Christian Kamm 5ef1a19300 Mango: Update views and PnL query 2021-11-15 16:15:18 +01:00
Christian Kamm dde006243b Minor clippy fixes 2021-11-15 15:37:29 +01:00
Christian Kamm 8f6bd7bc22 Postgres: Allow parallel slot update connections
It would be nicer if many of the writes could happen on the same
connection. Separate connections are only necessary if transactions are
used.
2021-11-15 15:28:18 +01:00
Christian Kamm 343b5408bc Postgres: Add option to allow invalid certificates 2021-11-14 13:14:19 +01:00
Christian Kamm f1608409ca Documentation 2021-11-09 15:07:42 +01:00
Christian Kamm 456b19ea06 Add example SQL script for computing mango PnL 2021-11-09 14:50:08 +01:00
Christian Kamm d889b5ff5b Move postgres numeric support to separate file 2021-11-09 14:32:58 +01:00
Christian Kamm 3a0e2535f0 Use anyhow::Result over Result<T, anyhow::Error> 2021-11-09 14:27:09 +01:00
Christian Kamm 4d5f0c5d10 Basic metrics 2021-11-09 09:00:00 +01:00
Christian Kamm 029cbd2fb5 Allow multiple grpc sources 2021-11-08 15:48:50 +01:00
Christian Kamm 11f4d6bd67 Use separate pubkey table 2021-11-08 14:10:48 +01:00
Christian Kamm a17f142875 Use enum for slot status 2021-11-08 12:44:01 +01:00
Christian Kamm 0424c3c9d6 grpc configurability 2021-11-08 11:42:22 +01:00
Christian Kamm d366581826 Make more postgres settings configurable 2021-11-08 11:30:17 +01:00
Christian Kamm d9cb30c2b3 Make parallel postgres connections configurable 2021-11-08 10:05:17 +01:00
Christian Kamm cbe9e16b62 Configurable program id 2021-11-08 09:57:56 +01:00
Christian Kamm e67dd6c235 Split into connector library, and raw and mango binaries 2021-11-08 09:45:41 +01:00