Commit Graph

662 Commits

Author SHA1 Message Date
Martin Picco 29d47197f5
Add W token NTT redeem tracking for solana (#1336) 2024-04-19 16:17:57 -03:00
Julian 550b7b1d54
[Blockchain Watcher] (W) Map evm NTT redeem (#1334)
Map evm NTT redeem

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-19 15:28:37 -03:00
Julian 2686bea37e
[Blockchain Watcher] (FIX - SOLANA) Map config for solana (#1331)
Map config for solana

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-18 18:04:02 -03:00
Julian 10df6821c0
[Blockchain Watcher] (FIX) Add logs for evm source events (#1316)
* Add chain in EvmLog entity

* Add new log for evm source events

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-17 17:09:33 -03:00
ftocal b34beb63df
Add new version of guardian set in fly (#1311)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-16 19:49:08 -03:00
Julian 36d205c37b
[Blockchain Watcher] (STANDARD RELAYER) Map new chains (#1309)
Map new chains

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 17:26:04 -03:00
Julian 674e542306
[Blockchain Watcher] (ARBITRUM) Remove arbitrum goerli in testnet (#1307)
Remove arbitrum

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 17:19:46 -03:00
Julian 408a297b63
[Blockchain Watcher] (WORMCHAIN) Mapped wormchain source events (#1238)
* Mapped source events

* Set chainId for wormchain

* Add test

* Mapped testnet rpc

* Change blockBatchSize for 10 times per execution

* Improve log

* Improve code

* Remove console.log

* Resolved issue mapping tx hash

* Mapped txs array

* Add new test with 2 txs mapped

* Adapt endpoints implementation

* Improve log

* Resolve comment in PR

* Invert params in mapper

* Resolve test

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 11:02:13 -03:00
Sebastian Cavedale c41ffccf39
Update fly-keda.yaml
Replaced KEDA-fly trigger type, cpu > memory.
2024-04-16 10:38:28 -03:00
Sebastian Cavedale 97ac266bed
Feat/add keda autoscaler (#1306)
* Analytics KEDA based on SQS

* Parser KEDA based on SQS

* Tx-Tracker KEDA based on SQS

* Api KEDA based on Memory

* Fly KEDA based on CPU
2024-04-15 18:05:26 -03:00
Julian 6b67bf859e
[Blockchain Watcher] (SCROLL) Mapped scroll source and target events (#1304)
* Mapped scroll source and target events

* Remove jobs for mainnet

* Remove jobs for mainnet

* Mapped redeem contract

* Add aptos custom env

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-15 16:48:56 -03:00
Julian af4b03d1c3
[Blockchain Watcher] (NFT) Mapped contracts (#1282)
* Mapped contracts

* Mapped mainnet contracts

* Mapped protocol in sui log

* Adapt aptos process to allow multiply filters

* Mapped methodId for NFT aptos

* Improve filter name

* Improve source events filter

* Resolve test

* Add aptos custom variable

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-10 20:39:19 -03:00
Mariano e06057acfd
[ISSUE-1220] Add filters to /operations endpoint (#1262)
* start

 add search by chain

 change chainId query param handling

 change condition

 only from chain

change query

 add filter by appId

 add payload type for operations query

add logs

 add log for error in mongodb call

 add more logs and recover to find possible panic

change type to float64

add more logs for troubleshooting

 add more logs for troubleshooting payloadType query param

add another defer

* change query

* add exclusiveAppId,sourceChain and targetChain

* unify search criteria

* change queryies

* combine query params filters

* change implementation of sourceChain and targetChain

* insert filtering by chain and by appid as stages in aggregation pipeline

* fix appIds matching condition

* move query to a separate pipeline which starts from parsedVAA

* adjust query by appId

* add matching also for standardizedProperties

* change

* try using  instead of

* simplify query

* add queryLoggging and remove other parts of the query to troubleshooting

* working

* add index creation

* update swagger docs

* tweak index performance and fix timestamp on parsedVaa collection

* start

 add search by chain

 change chainId query param handling

 change condition

 only from chain

change query

 add filter by appId

 add payload type for operations query

add logs

 add log for error in mongodb call

 add more logs and recover to find possible panic

change type to float64

add more logs for troubleshooting

 add more logs for troubleshooting payloadType query param

add another defer

* change query

* add exclusiveAppId,sourceChain and targetChain

* unify search criteria

* change queryies

* combine query params filters

* change implementation of sourceChain and targetChain

* insert filtering by chain and by appid as stages in aggregation pipeline

* fix appIds matching condition

* move query to a separate pipeline which starts from parsedVAA

* adjust query by appId

* add matching also for standardizedProperties

* change

* try using  instead of

* simplify query

* add queryLoggging and remove other parts of the query to troubleshooting

* working

* add index creation

* update swagger docs

* tweak index performance and fix timestamp on parsedVaa collection

* add lookup for globaltransactions
2024-04-09 09:57:08 -03:00
Julian bc0014885e
[Blockchain Watcher] (NTT - FANTOM and ETH) Integrate support NTT for fantom (#1281)
* Integrate support NTT for fantom

* Integrate support NTT for ethereum

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-08 16:38:56 -03:00
walker-16 8dc2b5ac5f
Normalize txHash destination in tx-tracker component (#1274)
Co-authored-by: ftocal <fert1335@gmail.com>
2024-04-08 14:05:48 -03:00
Julian 11ecb6eb6d
[Blockchain Watcher] (TOKEN BRIDGE) Mapped token bridge chains (#1261)
* Mapped all evm chains

* Mapped topic for mainnet contracts

* Mapped testnet chains

* Mapped standar relayer topic for bnb

* Remove some contracts in config

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-08 12:47:53 -03:00
Julian 0e487dcdfa
[Blockchain Watcher] (FIX - APTOS) Improve aptos request (#1251)
* Improve aptos request

* Resolve comment in PR

* Improve httpClient and create constants

* Add start params

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-08 12:41:46 -03:00
walker-16 04da0b3e4d
Add wormchain injective integration (#1260)
* Add wormchain injective integration

* Add metrics and logger for unknown wormchain

* Add wormchain rpc config
Co-authored-by: ftocal <fert1335@gmail.com>

* Add evmos, kujira, osmosis to wormchainRpcProviders
Co-authored-by: ftocal <fert1335@gmail.com>

* Add backfiller for tx-tracker with emitterChainId, emitterAddress and range time parameters

Co-authored-by: walker-16 <agpazos85@gmail.com>

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-04-05 15:24:21 -03:00
ftocal aabad70e4d
Add cache to governor endpoints (#1271) 2024-04-03 14:58:04 -03:00
ftocal 3d60517757
Update list of available tokens (#1269)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-02 15:56:34 -03:00
ftocal 451c48a670
Add ip and query params in fiber logger (#1268)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-01 16:06:43 -03:00
ftocal f635f1d785
Increase instances for api in production-mainnet (#1265)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-29 15:31:41 -03:00
ftocal 36e6c0a715
Add api key for coingecko api in notional jobs (#1259)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-27 14:42:04 -03:00
ftocal e55f6e35e3
Fix operations query by txHash when the vaa was processed correctly (#1255)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-27 10:58:50 -03:00
Julian 3830d288e2
[Blockchain Watcher] (FIX - MAYAN) Mapped new address (#1254)
Mapped new address

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-27 09:40:18 -03:00
ftocal f4390b8436
Handle unproccessable response from vaa-payload-parser (#1250)
Add retry in analytics metrics

Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-26 11:53:11 -03:00
ftocal adb7231074
Add processed message metrics in pipeline components (#1239)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-25 15:21:10 -03:00
ftocal b19bc16dfb
Update list of available tokens (#1246)
* Update list of available tokens

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Handle too many requests in notional jobs

---------

Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-25 15:17:26 -03:00
Julian 6958d5b78b
[Blockchain Watcher] (FIX - MAYAN) Add mayan with payload address (#1242)
Add mayan with payload address

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-25 13:01:04 -03:00
ftocal e98d98fda5
Increase memory in api testnet (#1241)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-22 14:49:59 -03:00
walker-16 cc2ca592e2
Add metrics in tx-tracker to count destination tx inserted (#1233) 2024-03-22 11:30:46 -03:00
walker-16 e843100678
Add processed metrics to analytics component (#1237)
Co-authored-by: ftocal <fert1335@gmail.com>
2024-03-22 11:30:21 -03:00
David Hyland-Wood 2980347e00
Added legal disclaimers 2024-03-22 06:48:39 +08:00
Julian 677b3d729a
[Blockchain Watcher] (FIX - JOBS) Fix jobs (#1227)
* Fix jobs

* Add arbitrum-sepolia

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-19 17:01:13 -03:00
Mariano a2039d70b8
Remove deprecated k8 cronjobs: protocols-activity and protocols-stats (#1226)
remove deprecated k8 cronjobs: protocols-activity and protocols-stats
2024-03-19 15:59:06 -03:00
walker-16 bc3110f3d4
Modify intialize to support fallback url and rate limit (#1093)
* Modify intialize to support fallback url and rate limit

* Add fallback and rate limit config for all the chains

* remove unused WormchainTxDetail struct

* Add pool of items to common

* Add rpc pool to tx-tracker

* Rename chain url to baseUrl

* add fallback to wormchain chains

* update tx-tracker fetchone to use rpc pool

* Modify backfiller to use rpc pool

* fix merge to main run files

* Add rpc pool to controller

* remove comments

* fix pool sort function

* Add rpc pool to all the chains

* Fix algorand, aptos, sui integrations

* Fix pool solana

* remove api_sei3 old implementation

* Add metrics to get success/error rpc call

* Add rpc field in call rpc metric

* Fix common go.mod and remove unused if condition

* Update go.mod tx-tracker

* Create rpc count prometheus metrics

* Add fallback to insert originTx if rcp fail

* Check if the transaction doesn't exists

* Modify in tx-tracker already processed method

* fix wormchain rpc

* Add rpc settings as json file

* Enable overwrite to stress test

* Add rpc provider as k8s secret

* Add metrics to get vaa retry processing
Co-authored-by: ftocal fert1335@gmail.com

* Add worker pool in consumer for tx-tracker

* fix config by env

* Set consumer workers in 1

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-03-19 15:47:43 -03:00
ftocal f98d8f28ba
Add backfiller for parser with more parameters (#1197) 2024-03-19 12:28:10 -03:00
Mariano faa8e38b2e
[ISSUE-1213] Refactor of top-contributors stats and activity job (#1215)
* start refactor of stats and activity job

 change approach for collecting stats and activity metrics

 multiple stuff

fix unfinished merging conflicts

 changes

 update

Delete .run/wormhole-explorer-api.run.xml

 add unit-tesdt

 add unit-test for mayan and allbrdige

add protocols-stats-1h job

 add new job

 change stats query

fix query

 start refactor of stats and activity job

 change approach for collecting stats and activity metrics

 multiple stuff

fix unfinished merging conflicts

 changes

 update

Delete .run/wormhole-explorer-api.run.xml

 add unit-tesdt

 add unit-test for mayan and allbrdige

add protocols-stats-1h job

 add new job

 change stats query

fix query

* remove temp backfiller

* fix unit-tests

* remove useless dbconsts

* remove useless consts

* fix some renaming

* fix unit-tests

* fix tvl portal_token_bridge
2024-03-18 10:21:42 -03:00
Julian 10d683da64
[Blockchain Watcher] (FIX - APTOS) Fix aptos job (#1222)
* Fix job

* Improve solana log

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-15 17:52:55 -03:00
ftocal a6cbcc7c55
Add backfiller for pipeline (#1221) 2024-03-15 16:44:24 -03:00
Martin Picco 277373bf57
[Blockchain Watcher] Add redeem tracking for native token transfers (NTT) for Solana (#1200)
* Ntt redeem tracking for solana

* Update NTT redeem addresses

* Update NTT target event addresses

* Update NTT methods config

* Add NTT method mapping for solana. Fix tests
2024-03-15 16:26:27 -03:00
Julian 960a8ed29e
[Blockchain Watcher] (MAYAN) Mapped MethodRedeemAndUnwrap method (#1219)
Mapped method

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-15 15:49:49 -03:00
Julian 8a23a69c57
[Blockchain Watcher] (APTOS) Integrate aptos source and redeemed events (#1174)
* First version

* Improve index

* Improve repository and mapper

* Resolve issues and add new pod for target events

* Resolve test and improve code

* Add test

* Resolve test

* Improve source event implementation

* Improve implementations and create test

* Remove hardcode params

* Change completed status

* Merge to main

* Improve code style

* Change current cursor value

* Improve comments

* improve domain event

* Add validation about differents blocks number

* Improve transaction and sequence implementation

* Set batches

* Resolve comment in PR

* Improve code

* Resolve comment in PR

* Integrate rpc poll for aptos

* Improve code

* Remove instrumented aptos client

* Improve test

* Improve errors message

* Improve transaction domain and test

* Remove block name in variables

* Resolved comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-15 15:38:27 -03:00
Julian 071dc12296
[Blockchain Watcher] (STANDARD-RELAYER) Mapped standard relayer txs (#1216)
* Update env files

* Mapped contracts

* Mapped contracts

* Change commitment in base for latest, and mapped eth env

* Incrise attempts for retries

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-15 15:38:14 -03:00
Sebastian Cavedale 605b883b1e
Changed api container settings in order to reduce the startup time (#1199)
* Changed api-deployment container settings in order to reduce the startup time

* Set staging-mainnet CPU/MEMORY requests/limits

* Upgrade production-mainnet CPU requests/limits
2024-03-13 14:54:23 -03:00
ftocal 67d0e970f0
Increment observation tx hash cache expiration (#1184)
* Increment observation tx hash cache expiration

* Add cache dedup for pyth vaas

* Increment observation dedup cache

* wip
2024-03-12 12:23:29 -03:00
ftocal 83a64b758a
Ignore vaa older than 30 days for vaa_count metric (#1212) 2024-03-12 12:21:13 -03:00
ftocal 5cc4dca96e
Increase rate limit for API (#1210) 2024-03-11 18:03:51 -03:00
Mariano 4009482dcc
[ISSUE-1089] Collect CCTP - Metrics (#1165)
Add cctp and portal_token_bridge stats to protocols-stats endpoint

changes

 indent

more changes on the script

 new working approach on influx task

 indent script

 tested insert

 add 2 versions of the script

multiple changes

 add 1day task

 add logic to retrieve internal protocols

 remove unecessary code

 readd empty script

fix  unit-tests and measurement namings

 fix queries

 fix alignment

rename function task

fix names

improvements on influx task

 add .run config to gitignore

add .run to gitignore

fix task and rename

working api

 multiple things

Delete .run/wormscan api.run.xml

Delete analytics/scripts/test_query.flux

wip

 multiple fixes

 fix test

wip

 fix queries

fix unit-test due to query changes
2024-03-11 17:33:36 -03:00
walker-16 2d61225ac2
remove aptos from contract-watcher (#1177) 2024-03-11 14:21:15 -03:00