Commit Graph

575 Commits

Author SHA1 Message Date
ftocal 9d280f7d5f
Add W token for ethereum, arbitrum, optimism and base (#1358)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-25 17:06:14 -03:00
Julian 0cde483c95
[Blockchain Watcher] (tBTC) Map contracts for mainnet (#1353)
* Map contracts for mainnet

* Map contracts for mainnet

* Remove duplicated key

* Map testnet contracts

* Map testnet contracts in contatsMapperConfig

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-24 16:55:00 -03:00
Julian f0799cdd67
[Blockchain Watcher] (POLYGON AMOY) Map polygon amoy (#1350)
* Map polygon amoy

* Map polygon amoy

* Map env for yaml

* Map polygon goerli job

* Map contractsMapperConfig

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-24 15:06:41 -03:00
Sebastian Cavedale eb3a0a10dc
Pod's resources requirements improvements (production) (#1347)
* Push changes to analytics pod's resources (production-testnet)
* Push changes to api pod's resources (production-testnet)
* Push changes to blockchain-watcher pod's resources (production-testnet)
* Push changes to contract-watcher pod's resources (production-testnet)
* Push changes to fly pod's resources (production-testnet)
* Push changes to notional pod's resources (production-testnet)
* Push changes to parser pod's resources (production-testnet)
* Push changes to pipeline pod's resources (production-testnet)
* Push changes to spy pod's resources (production-testnet)
* Push changes to tx-tracker pod's resources (production-testnet)

* Push changes to analytics pod's resources (production-mainnet)
* Push changes to api pod's resources (production-mainnet)
* Push changes to blockchain-watcher pod's resources (production-mainnet)
* Push changes to contract-watcher pod's resources (production-mainnet)
* Push changes to fly pod's resources (production-mainnet)
* Push changes to notional pod's resources (production-mainnet)
* Push changes to parser pod's resources (production-mainnet)
* Push changes to pipeline pod's resources (production-mainnet)
* Push changes to spy pod's resources (production-mainnet)
* Push changes to tx-tracker pod's resources (production-mainnet)
2024-04-24 11:38:38 -03:00
walker-16 8f3b57ee89
Fix hardcode guardian set index api (#1352)
Co-authored-by: ftocal <fert1335@gmail.com>
2024-04-24 10:32:16 -03:00
Julian e013f14968
[Blockchain Watcher] (FIX - SUI) Fix currentCheckpoint value for report metrics on grafana (#1345)
Fix currentCheckpoint value

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-23 14:51:52 -03:00
Sebastian Cavedale 0cd38590ce
Manifest and pod's resources requirements improvements (staging) (#1332)
* Push changes to analytics manifest and pod's resources

* Push changes to api manifest and pod's resources/scaler

* Push changes to contract-watcher manifest and pod's resources

* Push changes to fly manifest and pod's resources/scaler

* Push changes to notional manifest and pod's resources

* Push changes to parser manifest and pod's resources/scaler

* Push changes to pipeline manifest and pod's resources

* Push changes to spy manifest and pod's resources

* Push changes to tx-tracker manifest and pod's resources/scaler

* Push changes to blockchain-watcher manifest and pod's resources

* Added a new serviceAccount named 'blockchain-watcher'
2024-04-23 14:40:56 -03:00
walker-16 5ac4701b37
Fix not found responde in vaa duplicate endpoint (#1346)
Co-authored-by: ftocal <fert1335@gmail.com>
2024-04-23 11:50:03 -03:00
ftocal 28a24db1f1
Fix go dependencies in api and pipeline (#1344)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-23 11:41:06 -03:00
ftocal d8e25cc3b5
Fix dependencies in contract watcher (#1343)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-23 10:44:48 -03:00
walker-16 980316bb2d
Remove ethereum and base token bridge in contract-watcher (#1327)
* Remove ethereum and base token bridge in contract-watcher
Co-authored-by: ftocal <fert1335@gmail.com>

* Remove moonbeam and oasis token bridge in contract-watcher

Co-authored-by: ftocal <fert1335@gmail.com>

* Update contract-watcher memory resource production-mainnet

Co-authored-by: ftocal <fert1335@gmail.com>

* Remove avalanche and fantom token bridge in contract-watcher

Co-authored-by: ftocal <fert1335@gmail.com>

* Remove polygon, bsc and celo token bridge contract-watcher

Co-authored-by: ftocal <fert1335@gmail.com>

---------

Co-authored-by: ftocal <fert1335@gmail.com>
2024-04-23 10:27:32 -03:00
ftocal 688a0d0f71
Store duplicate vaas on a secondary collection (#1308)
* Add support to scroll in tx-tracker

* Handle duplicated vaa in fly

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Modify tx-tracker and pipeline to support duplicated vaas
Co-authored-by: ftocal <fert1335@gmail.com>

* Add isDuplicated flag in vaas and operations endpoints
Add new endpoint to find duplicated vaas by vaa id
Co-authored-by: walker-16 <agpazos85@gmail.com>

* Add metrics for duplicated vaas

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Update node dependencies in spy

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Fix promethes metrics for missing tx-hash in tx-tracker

Co-authored-by: walker-16 <agpazos85@gmail.com>

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2024-04-22 14:26:07 -03:00
Julian 83987793ef
[Blockchain Watcher] (CCTP) Remove CCTP contracts (#1340)
Remove CCTP contracts

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-22 11:52:25 -03:00
Martin Picco 29d47197f5
Add W token NTT redeem tracking for solana (#1336) 2024-04-19 16:17:57 -03:00
Julian 550b7b1d54
[Blockchain Watcher] (W) Map evm NTT redeem (#1334)
Map evm NTT redeem

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-19 15:28:37 -03:00
Julian 2686bea37e
[Blockchain Watcher] (FIX - SOLANA) Map config for solana (#1331)
Map config for solana

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-18 18:04:02 -03:00
Julian 10df6821c0
[Blockchain Watcher] (FIX) Add logs for evm source events (#1316)
* Add chain in EvmLog entity

* Add new log for evm source events

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-17 17:09:33 -03:00
ftocal b34beb63df
Add new version of guardian set in fly (#1311)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-16 19:49:08 -03:00
Julian 36d205c37b
[Blockchain Watcher] (STANDARD RELAYER) Map new chains (#1309)
Map new chains

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 17:26:04 -03:00
Julian 674e542306
[Blockchain Watcher] (ARBITRUM) Remove arbitrum goerli in testnet (#1307)
Remove arbitrum

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 17:19:46 -03:00
Julian 408a297b63
[Blockchain Watcher] (WORMCHAIN) Mapped wormchain source events (#1238)
* Mapped source events

* Set chainId for wormchain

* Add test

* Mapped testnet rpc

* Change blockBatchSize for 10 times per execution

* Improve log

* Improve code

* Remove console.log

* Resolved issue mapping tx hash

* Mapped txs array

* Add new test with 2 txs mapped

* Adapt endpoints implementation

* Improve log

* Resolve comment in PR

* Invert params in mapper

* Resolve test

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 11:02:13 -03:00
Sebastian Cavedale c41ffccf39
Update fly-keda.yaml
Replaced KEDA-fly trigger type, cpu > memory.
2024-04-16 10:38:28 -03:00
Sebastian Cavedale 97ac266bed
Feat/add keda autoscaler (#1306)
* Analytics KEDA based on SQS

* Parser KEDA based on SQS

* Tx-Tracker KEDA based on SQS

* Api KEDA based on Memory

* Fly KEDA based on CPU
2024-04-15 18:05:26 -03:00
Julian 6b67bf859e
[Blockchain Watcher] (SCROLL) Mapped scroll source and target events (#1304)
* Mapped scroll source and target events

* Remove jobs for mainnet

* Remove jobs for mainnet

* Mapped redeem contract

* Add aptos custom env

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-15 16:48:56 -03:00
Julian af4b03d1c3
[Blockchain Watcher] (NFT) Mapped contracts (#1282)
* Mapped contracts

* Mapped mainnet contracts

* Mapped protocol in sui log

* Adapt aptos process to allow multiply filters

* Mapped methodId for NFT aptos

* Improve filter name

* Improve source events filter

* Resolve test

* Add aptos custom variable

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-10 20:39:19 -03:00
Mariano e06057acfd
[ISSUE-1220] Add filters to /operations endpoint (#1262)
* start

 add search by chain

 change chainId query param handling

 change condition

 only from chain

change query

 add filter by appId

 add payload type for operations query

add logs

 add log for error in mongodb call

 add more logs and recover to find possible panic

change type to float64

add more logs for troubleshooting

 add more logs for troubleshooting payloadType query param

add another defer

* change query

* add exclusiveAppId,sourceChain and targetChain

* unify search criteria

* change queryies

* combine query params filters

* change implementation of sourceChain and targetChain

* insert filtering by chain and by appid as stages in aggregation pipeline

* fix appIds matching condition

* move query to a separate pipeline which starts from parsedVAA

* adjust query by appId

* add matching also for standardizedProperties

* change

* try using  instead of

* simplify query

* add queryLoggging and remove other parts of the query to troubleshooting

* working

* add index creation

* update swagger docs

* tweak index performance and fix timestamp on parsedVaa collection

* start

 add search by chain

 change chainId query param handling

 change condition

 only from chain

change query

 add filter by appId

 add payload type for operations query

add logs

 add log for error in mongodb call

 add more logs and recover to find possible panic

change type to float64

add more logs for troubleshooting

 add more logs for troubleshooting payloadType query param

add another defer

* change query

* add exclusiveAppId,sourceChain and targetChain

* unify search criteria

* change queryies

* combine query params filters

* change implementation of sourceChain and targetChain

* insert filtering by chain and by appid as stages in aggregation pipeline

* fix appIds matching condition

* move query to a separate pipeline which starts from parsedVAA

* adjust query by appId

* add matching also for standardizedProperties

* change

* try using  instead of

* simplify query

* add queryLoggging and remove other parts of the query to troubleshooting

* working

* add index creation

* update swagger docs

* tweak index performance and fix timestamp on parsedVaa collection

* add lookup for globaltransactions
2024-04-09 09:57:08 -03:00
Julian bc0014885e
[Blockchain Watcher] (NTT - FANTOM and ETH) Integrate support NTT for fantom (#1281)
* Integrate support NTT for fantom

* Integrate support NTT for ethereum

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-08 16:38:56 -03:00
walker-16 8dc2b5ac5f
Normalize txHash destination in tx-tracker component (#1274)
Co-authored-by: ftocal <fert1335@gmail.com>
2024-04-08 14:05:48 -03:00
Julian 11ecb6eb6d
[Blockchain Watcher] (TOKEN BRIDGE) Mapped token bridge chains (#1261)
* Mapped all evm chains

* Mapped topic for mainnet contracts

* Mapped testnet chains

* Mapped standar relayer topic for bnb

* Remove some contracts in config

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-08 12:47:53 -03:00
Julian 0e487dcdfa
[Blockchain Watcher] (FIX - APTOS) Improve aptos request (#1251)
* Improve aptos request

* Resolve comment in PR

* Improve httpClient and create constants

* Add start params

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-08 12:41:46 -03:00
walker-16 04da0b3e4d
Add wormchain injective integration (#1260)
* Add wormchain injective integration

* Add metrics and logger for unknown wormchain

* Add wormchain rpc config
Co-authored-by: ftocal <fert1335@gmail.com>

* Add evmos, kujira, osmosis to wormchainRpcProviders
Co-authored-by: ftocal <fert1335@gmail.com>

* Add backfiller for tx-tracker with emitterChainId, emitterAddress and range time parameters

Co-authored-by: walker-16 <agpazos85@gmail.com>

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-04-05 15:24:21 -03:00
ftocal aabad70e4d
Add cache to governor endpoints (#1271) 2024-04-03 14:58:04 -03:00
ftocal 3d60517757
Update list of available tokens (#1269)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-02 15:56:34 -03:00
ftocal 451c48a670
Add ip and query params in fiber logger (#1268)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-01 16:06:43 -03:00
ftocal f635f1d785
Increase instances for api in production-mainnet (#1265)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-29 15:31:41 -03:00
ftocal 36e6c0a715
Add api key for coingecko api in notional jobs (#1259)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-27 14:42:04 -03:00
ftocal e55f6e35e3
Fix operations query by txHash when the vaa was processed correctly (#1255)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-27 10:58:50 -03:00
Julian 3830d288e2
[Blockchain Watcher] (FIX - MAYAN) Mapped new address (#1254)
Mapped new address

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-27 09:40:18 -03:00
ftocal f4390b8436
Handle unproccessable response from vaa-payload-parser (#1250)
Add retry in analytics metrics

Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-26 11:53:11 -03:00
ftocal adb7231074
Add processed message metrics in pipeline components (#1239)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-25 15:21:10 -03:00
ftocal b19bc16dfb
Update list of available tokens (#1246)
* Update list of available tokens

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Handle too many requests in notional jobs

---------

Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-25 15:17:26 -03:00
Julian 6958d5b78b
[Blockchain Watcher] (FIX - MAYAN) Add mayan with payload address (#1242)
Add mayan with payload address

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-25 13:01:04 -03:00
ftocal e98d98fda5
Increase memory in api testnet (#1241)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-22 14:49:59 -03:00
walker-16 cc2ca592e2
Add metrics in tx-tracker to count destination tx inserted (#1233) 2024-03-22 11:30:46 -03:00
walker-16 e843100678
Add processed metrics to analytics component (#1237)
Co-authored-by: ftocal <fert1335@gmail.com>
2024-03-22 11:30:21 -03:00
David Hyland-Wood 2980347e00
Added legal disclaimers 2024-03-22 06:48:39 +08:00
Julian 677b3d729a
[Blockchain Watcher] (FIX - JOBS) Fix jobs (#1227)
* Fix jobs

* Add arbitrum-sepolia

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-19 17:01:13 -03:00
Mariano a2039d70b8
Remove deprecated k8 cronjobs: protocols-activity and protocols-stats (#1226)
remove deprecated k8 cronjobs: protocols-activity and protocols-stats
2024-03-19 15:59:06 -03:00
walker-16 bc3110f3d4
Modify intialize to support fallback url and rate limit (#1093)
* Modify intialize to support fallback url and rate limit

* Add fallback and rate limit config for all the chains

* remove unused WormchainTxDetail struct

* Add pool of items to common

* Add rpc pool to tx-tracker

* Rename chain url to baseUrl

* add fallback to wormchain chains

* update tx-tracker fetchone to use rpc pool

* Modify backfiller to use rpc pool

* fix merge to main run files

* Add rpc pool to controller

* remove comments

* fix pool sort function

* Add rpc pool to all the chains

* Fix algorand, aptos, sui integrations

* Fix pool solana

* remove api_sei3 old implementation

* Add metrics to get success/error rpc call

* Add rpc field in call rpc metric

* Fix common go.mod and remove unused if condition

* Update go.mod tx-tracker

* Create rpc count prometheus metrics

* Add fallback to insert originTx if rcp fail

* Check if the transaction doesn't exists

* Modify in tx-tracker already processed method

* fix wormchain rpc

* Add rpc settings as json file

* Enable overwrite to stress test

* Add rpc provider as k8s secret

* Add metrics to get vaa retry processing
Co-authored-by: ftocal fert1335@gmail.com

* Add worker pool in consumer for tx-tracker

* fix config by env

* Set consumer workers in 1

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-03-19 15:47:43 -03:00
ftocal f98d8f28ba
Add backfiller for parser with more parameters (#1197) 2024-03-19 12:28:10 -03:00