Commit Graph

190 Commits

Author SHA1 Message Date
Julian 6958d5b78b
[Blockchain Watcher] (FIX - MAYAN) Add mayan with payload address (#1242)
Add mayan with payload address

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-25 13:01:04 -03:00
ftocal e98d98fda5
Increase memory in api testnet (#1241)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-22 14:49:59 -03:00
Julian 677b3d729a
[Blockchain Watcher] (FIX - JOBS) Fix jobs (#1227)
* Fix jobs

* Add arbitrum-sepolia

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-19 17:01:13 -03:00
Mariano a2039d70b8
Remove deprecated k8 cronjobs: protocols-activity and protocols-stats (#1226)
remove deprecated k8 cronjobs: protocols-activity and protocols-stats
2024-03-19 15:59:06 -03:00
walker-16 bc3110f3d4
Modify intialize to support fallback url and rate limit (#1093)
* Modify intialize to support fallback url and rate limit

* Add fallback and rate limit config for all the chains

* remove unused WormchainTxDetail struct

* Add pool of items to common

* Add rpc pool to tx-tracker

* Rename chain url to baseUrl

* add fallback to wormchain chains

* update tx-tracker fetchone to use rpc pool

* Modify backfiller to use rpc pool

* fix merge to main run files

* Add rpc pool to controller

* remove comments

* fix pool sort function

* Add rpc pool to all the chains

* Fix algorand, aptos, sui integrations

* Fix pool solana

* remove api_sei3 old implementation

* Add metrics to get success/error rpc call

* Add rpc field in call rpc metric

* Fix common go.mod and remove unused if condition

* Update go.mod tx-tracker

* Create rpc count prometheus metrics

* Add fallback to insert originTx if rcp fail

* Check if the transaction doesn't exists

* Modify in tx-tracker already processed method

* fix wormchain rpc

* Add rpc settings as json file

* Enable overwrite to stress test

* Add rpc provider as k8s secret

* Add metrics to get vaa retry processing
Co-authored-by: ftocal fert1335@gmail.com

* Add worker pool in consumer for tx-tracker

* fix config by env

* Set consumer workers in 1

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-03-19 15:47:43 -03:00
Mariano faa8e38b2e
[ISSUE-1213] Refactor of top-contributors stats and activity job (#1215)
* start refactor of stats and activity job

 change approach for collecting stats and activity metrics

 multiple stuff

fix unfinished merging conflicts

 changes

 update

Delete .run/wormhole-explorer-api.run.xml

 add unit-tesdt

 add unit-test for mayan and allbrdige

add protocols-stats-1h job

 add new job

 change stats query

fix query

 start refactor of stats and activity job

 change approach for collecting stats and activity metrics

 multiple stuff

fix unfinished merging conflicts

 changes

 update

Delete .run/wormhole-explorer-api.run.xml

 add unit-tesdt

 add unit-test for mayan and allbrdige

add protocols-stats-1h job

 add new job

 change stats query

fix query

* remove temp backfiller

* fix unit-tests

* remove useless dbconsts

* remove useless consts

* fix some renaming

* fix unit-tests

* fix tvl portal_token_bridge
2024-03-18 10:21:42 -03:00
Julian 10d683da64
[Blockchain Watcher] (FIX - APTOS) Fix aptos job (#1222)
* Fix job

* Improve solana log

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-15 17:52:55 -03:00
ftocal a6cbcc7c55
Add backfiller for pipeline (#1221) 2024-03-15 16:44:24 -03:00
Martin Picco 277373bf57
[Blockchain Watcher] Add redeem tracking for native token transfers (NTT) for Solana (#1200)
* Ntt redeem tracking for solana

* Update NTT redeem addresses

* Update NTT target event addresses

* Update NTT methods config

* Add NTT method mapping for solana. Fix tests
2024-03-15 16:26:27 -03:00
Julian 8a23a69c57
[Blockchain Watcher] (APTOS) Integrate aptos source and redeemed events (#1174)
* First version

* Improve index

* Improve repository and mapper

* Resolve issues and add new pod for target events

* Resolve test and improve code

* Add test

* Resolve test

* Improve source event implementation

* Improve implementations and create test

* Remove hardcode params

* Change completed status

* Merge to main

* Improve code style

* Change current cursor value

* Improve comments

* improve domain event

* Add validation about differents blocks number

* Improve transaction and sequence implementation

* Set batches

* Resolve comment in PR

* Improve code

* Resolve comment in PR

* Integrate rpc poll for aptos

* Improve code

* Remove instrumented aptos client

* Improve test

* Improve errors message

* Improve transaction domain and test

* Remove block name in variables

* Resolved comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-15 15:38:27 -03:00
Julian 071dc12296
[Blockchain Watcher] (STANDARD-RELAYER) Mapped standard relayer txs (#1216)
* Update env files

* Mapped contracts

* Mapped contracts

* Change commitment in base for latest, and mapped eth env

* Incrise attempts for retries

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-15 15:38:14 -03:00
Sebastian Cavedale 605b883b1e
Changed api container settings in order to reduce the startup time (#1199)
* Changed api-deployment container settings in order to reduce the startup time

* Set staging-mainnet CPU/MEMORY requests/limits

* Upgrade production-mainnet CPU requests/limits
2024-03-13 14:54:23 -03:00
ftocal 67d0e970f0
Increment observation tx hash cache expiration (#1184)
* Increment observation tx hash cache expiration

* Add cache dedup for pyth vaas

* Increment observation dedup cache

* wip
2024-03-12 12:23:29 -03:00
ftocal 5cc4dca96e
Increase rate limit for API (#1210) 2024-03-11 18:03:51 -03:00
Julian 59f669abfe
[Blockchain Watcher] (FIX - OPTIMISM) Remove goerli optimism (#1203)
Remove goerli optimism

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-08 16:18:28 -03:00
Martin Picco 90fe8f29a1
Update NTT addresses for the testnet deploy (#1202)
Update NTT addresses for testnet
2024-03-08 15:49:12 -03:00
Martin Picco 847b8686d0
[Blockchain Watcher] Add redeem tracking for native token transfers (NTT) on EVM (#1178)
* Add redeem tracking for native token transfers (NTT)

* Add redeem tracking for native token transfers (NTT) through standard relaying

* Allow configuring the get evm transactions action to match multiple topics on one transactions by defining an array instead of a single string entry on the topics array

* Fill in mainnet and testnet standard relayers

* Remove filter field from HandleEvmTransactions filter

* Address some review comments

* Add ntt testnet contracts for both ethereum and arbitrum sepolia
2024-03-08 14:08:09 -03:00
ftocal 2bec07b037
Add improvements in fly (#1183)
Add metrics for observation by guardian
Configurable cache
Add metrics for cache
Fallback for vaas publication
2024-03-06 11:59:09 -03:00
Julian fa6196b02c
[Blockchain Watcher] (FIX ARBITRUM) Export environment variable to validate env (#1181)
* Export environment

* Resolve test

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-05 16:10:49 -03:00
Julian a55dbc6ccc
[Blockchain Watcher] (ARBITRUM) Improve arbitrum process (#1168)
* Improve arbitrum process

* Add comments

* Set final block for arbitrum

* Improve names

* Resolve comment

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-05 13:51:23 -03:00
Mariano 8d6165153a
add protocols to prod-mainnet.env (#1179) 2024-03-05 11:43:40 -03:00
ftocal 13eaa69cc1
Enable metrics for pipeline in production-mainnet (#1176) 2024-03-04 18:19:25 -03:00
Mariano 6bbfa7bf23
Add cache to protocols stats endpoints (/protocols/stats) (#1149)
* add cache to protocols stats endpoint

 add mock for cache

add unit test case for cache miss

 change from to current

* add configs

* add missing config for api-service.yaml

* add cache ttl for staging-mainnet
2024-03-04 15:55:53 -03:00
Julian 54cf6c7e54
[Blockchain Watcher] (FIX) Move labels to json config (#1170)
* Move labels to json config

* Move labels to json config

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-01 11:56:09 -03:00
ftocal 98a6264739
Changes to support ci/cd workflow in staging environment (#1166)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-02-29 11:14:31 -03:00
Julian 11867a125d
[Blockchain Watcher] (FIX) Remove rpcs (#1163)
* Remove rpcs

* Remove one rpc for eth and moonbeam

* Change arbitrum interval

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-28 17:39:19 -03:00
Julian 161878b15b
[Blockchain Watcher] (ENV) Add more rpcs (#1160)
* Add more rpcs for testnet and mainnet

* Add more RESOURCES_LIMITS_MEMORY in production-testnet env

* Remove sui RPC

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-28 15:16:28 -03:00
ftocal a882355c05
Add transfer prices backfiller in analytics (#1153)
* Add transfer prices backfiller in analytics
Save notional prices in s3 bucket

* Code review updates
2024-02-27 15:17:59 -03:00
Julian 91ce905768
[Blockchain Watcher] (FIX) Mapped sui protocol (#1157)
* Mapped sui protocol

* Mapped protocol in handler

* Add more eth rpcs

* Resolve comment in PR

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-27 12:04:33 -03:00
Julian 3a6dafb9e5
[Blockchain Watcher] (MAYAN) Mapped mayan events (#1150)
* Mapped evm mayan events

* Mapped evm mayan events

* Improve imports

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-26 15:50:57 -03:00
walker-16 4760c820c3
808 enhance operationsaddress to provide information for all address formats (#1145)
* Add index in globalTransactions by originTx.attribute.value.originAddress

* Add in the operation by address endpoint support to wormchain chains
2024-02-23 10:32:26 -03:00
Julian ea231c5b86
[Blockchain Watcher] (FIX) Mapped custom variables (#1148)
* Mapped custom variables

* Mapped custom variables

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-22 16:56:44 -03:00
Mariano 175abbb11a
[Issue:1052] Create job for fetching contributor stats and storing in db (#1144)
* [Issue:1052] Create job for fetching contributor stats and storing in db

revert unnecessary changes on api/handlers/stats

revert changes in go.mod and go.sum

revert change in go.work

add schedule for contributors stats job

change response parsing order

changes due to draft-pr review

 move on with contributors activity implementation

change to every hour

fix typo

 change contributor stats implementation to do a single write transaction

 normalize to UTC contributors activity timestamp

 add cronjob schedule for contributors

[Issue:1052][Part 2] Create endpoint to expose contributors stats and activities  (#1123)

* add endpoint for retrieving stats and activity

* remove model.go file and move types to service file

* add unit tests to contributors service

* integrate new contributors controller

* fix more stuff

 fix unit-tests

 changes due to pr review

 fix query

 fix unit-tests

fix total_value_secure

 move constantes to common pkg

remove extra changes

rename contributor to protocols

 finish renames

Changes for deployment

adjust different response types from different protocols contributors

 fix controller test

 big refactor in activty job and stats job since protocols are returning different formats

api responding fine

 remove uneccessary generics

 target dbconsts

 fix

Delete deploy/common/env/staging-mainnet.env

undo unwanted changes

 readd staging-mainnet.env

 fix unit-tests

add missing protocols_stats/activity_version

 remove property protocols_json

fix JOB_ID env var in protocols-activity.yaml

fix typos in env vars configs

 change tu numbers

 changes due to own review

 add new line

* add swagger docs
2024-02-22 14:58:45 -03:00
Julian a834f3d44e
[Blockchain Watcher] (ETH HOLSKY) Add eth holesky for testnet (#1140)
* Add eth holesky for testnet

* Add network for holesky

* Remove ethereum goerli

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-22 12:48:13 -03:00
Julian ff1961d495
[Blockchain Watcher] (SUI) Mapped sui source event (#1141)
* Mapped sui source event

* Resolve comment in PR

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-21 15:16:23 -03:00
sebastian-xlabs 528d862fdf
Maintenance/update blockchain watcher dockerfile (#1133)
* Updated SHA256 from images & added authToken to .npmrc

* Updated blockchain-watcher env files names
2024-02-19 10:32:58 -03:00
Julian 024c29d67d
[Blockchain Watcher] (PORTICO) Add portico in mainnet (#1127)
* Add portico in mainnet

* Improve contract mapper

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-15 15:33:31 -03:00
sebastian-xlabs 8e48bec75b
Standardized environmental variables files (#1126)
* Standardized environmental variables files

* Updataed resources limits for prod-mainnet env
2024-02-15 12:16:06 -03:00
ftocal c0e233fc75
Remove solana watcher from contract-watcher (#1087) 2024-02-14 15:06:09 -03:00
Julian 9c06a6e91d
[Blockchain Watcher] (FIX) Divided solana pods (#1105)
Divided solana pods

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-07 16:56:04 -03:00
ftocal 7d5a3bbe52
Improve fly reliability (#1094)
Add sqs queue for observations
Add tx hash strategy for vaas
Refactoring to organize the construction
2024-02-06 21:00:45 -03:00
Julian 61c5f3e29d
[Blockchain Watcher] (FIX) Rename pods files (#1082)
* Rename pods

* Improve solana log

* Fix pods

* Resolve comment in PR

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-06 18:10:12 -03:00
Martin Picco e2025ee6ee
[Blockchain Watcher] (SUI) Initial implementation for Sui through polling (#1054)
* Initial implementation for Sui through block polling

* PollSui: add check for when the cursor reaches the latest (no new checkpoints to process)

* Change types for poll sui config from/to range

* coverage for sui rpc repo

* Add test for PollSui batchSize param

* Apply prettier

* Upgrade typescript and tsx dev deps

* Remove commented code

* Address some review comments

* Add SuiPollTransactions source

* Fix divideIntoBatches types

* Apply prettier

* Fix cursor issue when no configured range. Add test to mapper

* Remove PollSuiCheckpoints

* Query transactions by event instead of by called module in order to catch both transfers with and without payload

* Remove unusued GetSuiTransactions action

* Address some review comments

* Address review comments. Go back to using queryTransactions instead of events (querying by events would mean losing failed redeems)

* Allow undefined filter

* Add sui job to deployments

* Fix job target

* Split sui job into two with different filters: one for complete_transfer and another for complete_transfer_with_payload. This will speed up the processing of both cases

* Fix sui jobs mainnet/testnet mix up

* Fix prometheus issue

* run prettier

* Fix message blockTime for sui transfer-redeemed event

* Add asyncdoc entry for new event transfer-redeemed

* Add missing channel to asyncapi
2024-02-02 12:35:52 -03:00
Julian faa4a8db33
[Blockchain Watcher] (ALL) Add metrics (#1074)
* Add metrics

* Resolve test

* Resolve test

* Mapped source and target event for solana

* Resolve comment in PR

* Improve metric name

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-02 12:23:00 -03:00
Julian 760b7925d6
[Blockchain Watcher] (SOLANA) Enable solana redeem for token bridge (#1075)
* Enable solana redeem

* Resolve test

* Remove log

* Add CompleteNativeWithPayloadInstruction and CompleteWrappedWithPayloadInstruction methods

* Resolve test

* Improve asyncapi docs

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-02 10:33:55 -03:00
ftocal 278cd50dcb
Fix txHash in solana with job (#1076)
* Remove filter solanas and aptos from method getVaasToMigrate

* Fix origin tx in solana
Add k8s service for tx-tracker

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2024-01-31 19:41:41 -03:00
Julian 5e6b96417a
[Blockchain Watcher] (CHAINS) Create config json for contracts and protocols (#1056)
* Create contractsMapperConfig json

* Create contracts json mapper

* Change method name in solana redeem

* Improve mapper validations

* Resolve solana test

* Set up config inside solana tx

* Resolve solana test

* Resolve solana test

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-30 12:19:44 -03:00
walker-16 fb0573c160
migrate vaa to globaltransaction origintx (#940)
* migrate vaa to globaltransaction origintx

* Add deploy configuration for job to migrate vaas to originTx

* Add option to run migration process by range of date

* Update go dependencies for jobs

* Fix kind of job in deployment

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-01-30 12:19:31 -03:00
Julian 63819a6e42
[Blockchain Watcher] (POD) Config private varibles in pods (#1037)
Config private varibles in pods

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-25 10:05:06 -03:00
Julian c6b77d0bf3
[Blockchain Watcher] (EVM) Add sepolia support for testnet env (#1016)
* Add sepolia support for testnet env

* Add test

* Pull to main branch

* Change interval value for arbitrum

* Improve network name

* Mapped url correctly

* Resolve comment in Pr

* Mapped base-sepolia address

* Set public rpc in default url

* Mapped correctly base address

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-24 11:12:26 -03:00