Commit Graph

56 Commits

Author SHA1 Message Date
Fernando Torres b638aaafd7
wip 2024-04-24 11:00:30 -03:00
ftocal 67d0e970f0
Increment observation tx hash cache expiration (#1184)
* Increment observation tx hash cache expiration

* Add cache dedup for pyth vaas

* Increment observation dedup cache

* wip
2024-03-12 12:23:29 -03:00
ftocal 2bec07b037
Add improvements in fly (#1183)
Add metrics for observation by guardian
Configurable cache
Add metrics for cache
Fallback for vaas publication
2024-03-06 11:59:09 -03:00
ftocal 408851ff1f
Save observation in mongo as fallback when the publishing fails in sqs queue (#1106)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-02-07 17:02:57 -03:00
ftocal 7d5a3bbe52
Improve fly reliability (#1094)
Add sqs queue for observations
Add tx hash strategy for vaas
Refactoring to organize the construction
2024-02-06 21:00:45 -03:00
ftocal fbf5809241
Increase vaa splitter buffer channel (#985)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-01-12 20:31:56 -03:00
ftocal 076338f63c
Add quic-v1 support in testnet (#927)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-12-20 15:10:30 -03:00
ftocal 1c075e3745
Add worker pool to process observations from gossip network (#909)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-12-18 10:41:07 -03:00
ftocal 7c467f5267
Integrating blockchain watcher data into mongodb (#820)
* Handle log-message-published generated by blockchain-watcher in parser, tx-tracker y analytics

* Add deployment for staging-testnet environment
Improve logs

* Add operation endpoints

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2023-11-27 12:31:35 -03:00
ftocal 91bf42971b
Use Redis channel in spy and fly (#753) 2023-10-18 11:18:32 -03:00
walker-16 217c6f28be
Fix [api] get transactions by address and add mongo query monitor (#707)
Fix api endpoint get transactions by address, add mongo query monitor
2023-09-25 16:50:16 -03:00
ftocal 8b74d76f30
Update wormhole node dependency version in fly (#654)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-08-24 15:16:43 -03:00
ftocal 503a9da5d3
UDP buffer configuration in fly (#660)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-08-23 10:19:16 -03:00
ftocal be7e6670b0
Add alert for guardain no activity (#609)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-08-08 11:11:35 -03:00
agodnic 3c7bab3f8a
Remove duplicated code: MongoDB connection handling (#590)
### Description

This pull request removes duplicated code related to MongoDB connection/disconnection attempts. This code was copied across all 8 microservices.

The functionality is now unified under the `common/dbutil` package.
2023-08-07 16:05:08 -03:00
walker-16 75fffe3ef6
add warning alert and metrics to fly component (#576)
* Add unknown guardian set index alert

* Add prometheus metrics to check if exists observations without txhash

* Add max sequence cache error prometheus metrics
2023-07-25 15:39:27 -03:00
ftocal 94307b849a
[fly] Missing observations (#570)
Add environment variables for buffer channels (observations y vaas)
Increment size of buffer channels for observations and vaas
Align k8s resources in fly

Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-07-24 11:24:39 -03:00
walker-16 c4a55bd6e2
Fix alert prefix with new enviroment values (#509) 2023-07-06 11:20:18 -03:00
ftocal fc28528e0d
Fix cache and metrics environments in fly (#490) 2023-07-03 15:10:52 -03:00
walker-16 b07d569edf
Add pipeline prometheus metrics and opsgenie alerts (#471)
* Add pipeline prometheus metrics

* Add alerts & metrics env vars for pipeline

* fix pipeline env vars

* Fix enviroment in fly and pipeline

* Add alert client to pipeline

* Add critical alerts to pipeline component

* fix pipeline deploy

* fix ALERTS_ENABLED env var

* Add prometheus annotation metrics

* configurate prometheus in fiber

* fix vaaSendNotifications metrics counter

* Fix NewWatcher
2023-07-03 11:42:44 -03:00
gipsh 2306d103d8
321 replace redis to elasticcache (#467)
* redis prefix support for caches

* fly support for prefix

* unit tests

* redis prefix for notional cache updater

* fix test

* fix tests

* use redis-prfix from config map
2023-06-28 15:04:36 -03:00
walker-16 1ba76b5c85
Fix METRIC_ENABLED to METRICS_ENABLED in fly component (#469) 2023-06-28 13:07:45 -03:00
walker-16 737405054a
446 create prometheus metrics (#457)
* Add vaa metrics

* Add dummy metrics and observations metrics

* Add heartbeat, governorConfig, governorStatus metrics

* fix go.sum

* Add deploy en vars METRICS_ENABLED to fly component

Co-authored-by: ftocal <fert1335@gmail.com>

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2023-06-26 12:47:22 -03:00
walker-16 25b891f6d2
Add opsgenie client + error saving vaa alert in fly component (#442) 2023-06-22 18:59:23 -03:00
ftocal 7fb3857a97
297 contract watchertx trackeranalyticfly change access to use iam role (#306)
* Use aws role to access sqs

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Add ServiceAccount in deployment

Co-authored-by: walker-16 <agpazos85@gmail.com>

---------

Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-05-10 15:49:40 -03:00
ftocal 58e2879068
Filter vaa and observation for pyth message in testnet (#263) 2023-04-25 16:23:07 -03:00
ftocal e1298f54ee
logging as json (#208) 2023-03-23 15:36:50 -03:00
ftocal 824ba3c7f9
Add contract watcher component (#190)
* init contract-watcher

* Add processor and blockain watchers

* Add pagination and save last blocknumber procesed by chain

* Add processing by blocks

* Add contract-watcher deploy manifest

* Add endpoint to get globalTransactions by Id

* Add originTX to get globalTransactionById endpoint

* Add wait time for new blocks

* Add initial block for evm watcher

* Add rate limit for evm watcher

* Handle testnet environment and small fixes

* Update wormhole dependencies

* Fix api documentation for swagger

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2023-03-15 16:52:50 -03:00
agodnic d51695999a
[FLY] Remove duplicated code (#172)
Remove duplicated constants, use the definitions in the `common` package instead.
2023-03-06 14:36:40 -03:00
agodnic f169af3d37
[FLY] Fix an issue related to `.env` files (#173)
Fix an issue in which fly was not correctly populating the `P2P_NETWORK`
variable from an `.env` file.
2023-03-06 14:36:14 -03:00
ftocal 33440225a7
fix guardian healtcheck in fly (#160) 2023-02-16 13:23:50 -03:00
walker-16 e40154bf01
Improve healthcheck process to check guardian heartbeats (#156)
Co-authored-by: ftocal <fert1335@gmail.com>
2023-02-13 17:28:34 -03:00
walker-16 7506ff0bf5
Add pprof all components (#134)
* Fix Config pprof in fly

* Refactor pprof explorer parser component

* Add pprof to spy component

* Add pprof to api [api/v1, /v1]
2023-02-03 15:18:44 -03:00
agodnic a6cb972eb1
[FLY] Improve VAA signature verification (#121)
### Summary

Before this PR, when validating a VAA, we were always using the latest guardian set index to verify the signatures.
With this PR, we're making the signature verification against `vaa.guardianSetIndex` instead.

Context: https://github.com/wormhole-foundation/wormhole-explorer/issues/104

### Testing plan
* Added unit test cases
* Also tested manually
2023-02-02 10:17:42 -03:00
walker-16 cd29aaeb4d
Add filter methods vaa/observations testnet (#117) 2023-02-01 09:20:10 -03:00
walker-16 1c7e58a27a
Handle guardianSet by p2p enviroment in fly/api (#112) 2023-01-31 11:38:17 -03:00
walker-16 f65796b0fc
Get p2p network configuration by env vars (#109) 2023-01-30 15:51:13 -03:00
walker-16 f23f9f78ab
Enabled pprof fly and enable cors at app group in explorer api (#99) 2023-01-26 14:55:27 -03:00
ftocal 70bf3f1059
update sdk wormhole (#82) 2023-01-23 16:13:59 -03:00
walker-16 7255b214ca
18 fly api cache most recent data for most frequent queries (#51)
* Add use of sequence cache in API

* Add sequence cache in fly

* Deploy for API

* Improve use cache in API

* Remove sequence cache in fly for pythnet

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2023-01-05 16:40:24 -03:00
walker-16 e245d7a8b0
Add index collections and health/ready kubernetes (#37) 2022-12-05 17:41:37 -03:00
ftocal d7e2cd55fe
Fly: Deduplicate & use persistent queue for incoming VAAs (#28)
* Deduplication of vaas messages
Use persistent queue for vaas messages (except for pyth)
Add local flag for local execution (use a memory queue)

* Improve names for consumers
Add deduplication in memory for all vaas messages and tests
Split incoming vaas (pyth and non pyth) into different channels and tests

* Check if queue message is expired

* Code review updates
2022-11-21 11:18:33 -03:00
MTJMP ff4f7f4ee7 adjust module name to be canonical 2022-11-17 16:06:41 -05:00
Gabriel Zimmermann 3f09b66f59
10 - Adds multiple guardian set support (#24)
* Adds multiple guardian set support

* Add guardian set validation

* Removes unnecessary comment
2022-11-08 16:03:43 -03:00
ftocal e1e31548ff
Fly: handling for pyth message from pythnet (#23)
* Add support to pyth message without migration

* Refactor MongoDB migration

* Add vaa count collection for quantity of vaa per chainId

* Refactor for code review request

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2022-11-08 14:58:22 -03:00
ckeun 5ccd3f9139
Fly: upgrade wormhole dependency & add governor p2p channels (#22)
* Testing new storage changes

* Fixed vaa module dependency

* Added govcfg & gov status upserts

* Update main.go

* Removed unnessarily hack arounds in go.mod
2022-11-08 08:53:12 -06:00
Gabriel Zimmermann 51892ec5b6 adds early exit if obs verification failed, styling fixes, early exit if db connection failed; changes based on code review 2022-11-07 15:18:52 -03:00
Gabriel Zimmermann c37b3c6564 remove invalid vaa storage 2022-11-07 15:18:52 -03:00
Gabriel Zimmermann 2860f34cff refactors storage into separate layer 2022-11-07 15:18:52 -03:00
Evan Gray edb69f13e2 server: add comments for guardian names 2022-09-28 16:47:14 -04:00