Commit Graph

598 Commits

Author SHA1 Message Date
Mariano 1244de170b fix indents 2024-04-25 10:26:48 -03:00
Mariano 427527c780 update endpoint name 2024-04-25 09:49:55 -03:00
Mariano 47719ce654 change endpoint signature 2024-04-25 09:40:06 -03:00
Mariano e39843a24f start using the new measurement 2024-04-25 09:40:06 -03:00
Mariano f782a48748 fix W 2024-04-25 09:40:06 -03:00
Mariano 6b1c97b009 fix W 2024-04-25 09:40:06 -03:00
Mariano 97c55bbe95 optimize new tasks 2024-04-25 09:40:06 -03:00
Mariano d3b24c8f97 update swagger docs 2024-04-25 09:40:06 -03:00
Mariano bf5c7a6cc9 add app_id 2024-04-25 09:40:06 -03:00
Mariano 432d9199eb add a second group of tasks for downsampling 2024-04-25 09:40:06 -03:00
Mariano e86cef932a fix per year query 2024-04-25 09:40:06 -03:00
Mariano 183387d697 making more progress 2024-04-25 09:40:06 -03:00
Mariano 3fd4156eef changes on query 2024-04-25 09:40:06 -03:00
Mariano 96aa6cde0f change the way the query is executed 2024-04-25 09:40:06 -03:00
Mariano b25e923459 adjust queryies 2024-04-25 09:40:06 -03:00
Mariano e84cba2755 fix query 2024-04-25 09:40:06 -03:00
Mariano 2480a4b61a add 1d 2024-04-25 09:40:06 -03:00
Mariano d27f2365b7 change to 1d 2024-04-25 09:40:06 -03:00
Mariano 5882e68fef more changes 2024-04-25 09:40:06 -03:00
Mariano eaf46d3646 changes on task 2024-04-25 09:40:06 -03:00
Mariano 35a677ac12 add query by month and year 2024-04-25 09:40:05 -03:00
Mariano aa63a5de1e change query 2 2024-04-25 09:40:05 -03:00
Mariano 383b23c458 making progress 2024-04-25 09:40:05 -03:00
Mariano 094020b46f add 2 new tasks for collecting chain activity every day and hour 2024-04-25 09:40:05 -03:00
Julian 0cde483c95
[Blockchain Watcher] (tBTC) Map contracts for mainnet (#1353)
* Map contracts for mainnet

* Map contracts for mainnet

* Remove duplicated key

* Map testnet contracts

* Map testnet contracts in contatsMapperConfig

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-24 16:55:00 -03:00
Julian f0799cdd67
[Blockchain Watcher] (POLYGON AMOY) Map polygon amoy (#1350)
* Map polygon amoy

* Map polygon amoy

* Map env for yaml

* Map polygon goerli job

* Map contractsMapperConfig

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-24 15:06:41 -03:00
Sebastian Cavedale eb3a0a10dc
Pod's resources requirements improvements (production) (#1347)
* Push changes to analytics pod's resources (production-testnet)
* Push changes to api pod's resources (production-testnet)
* Push changes to blockchain-watcher pod's resources (production-testnet)
* Push changes to contract-watcher pod's resources (production-testnet)
* Push changes to fly pod's resources (production-testnet)
* Push changes to notional pod's resources (production-testnet)
* Push changes to parser pod's resources (production-testnet)
* Push changes to pipeline pod's resources (production-testnet)
* Push changes to spy pod's resources (production-testnet)
* Push changes to tx-tracker pod's resources (production-testnet)

* Push changes to analytics pod's resources (production-mainnet)
* Push changes to api pod's resources (production-mainnet)
* Push changes to blockchain-watcher pod's resources (production-mainnet)
* Push changes to contract-watcher pod's resources (production-mainnet)
* Push changes to fly pod's resources (production-mainnet)
* Push changes to notional pod's resources (production-mainnet)
* Push changes to parser pod's resources (production-mainnet)
* Push changes to pipeline pod's resources (production-mainnet)
* Push changes to spy pod's resources (production-mainnet)
* Push changes to tx-tracker pod's resources (production-mainnet)
2024-04-24 11:38:38 -03:00
walker-16 8f3b57ee89
Fix hardcode guardian set index api (#1352)
Co-authored-by: ftocal <fert1335@gmail.com>
2024-04-24 10:32:16 -03:00
Julian e013f14968
[Blockchain Watcher] (FIX - SUI) Fix currentCheckpoint value for report metrics on grafana (#1345)
Fix currentCheckpoint value

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-23 14:51:52 -03:00
Sebastian Cavedale 0cd38590ce
Manifest and pod's resources requirements improvements (staging) (#1332)
* Push changes to analytics manifest and pod's resources

* Push changes to api manifest and pod's resources/scaler

* Push changes to contract-watcher manifest and pod's resources

* Push changes to fly manifest and pod's resources/scaler

* Push changes to notional manifest and pod's resources

* Push changes to parser manifest and pod's resources/scaler

* Push changes to pipeline manifest and pod's resources

* Push changes to spy manifest and pod's resources

* Push changes to tx-tracker manifest and pod's resources/scaler

* Push changes to blockchain-watcher manifest and pod's resources

* Added a new serviceAccount named 'blockchain-watcher'
2024-04-23 14:40:56 -03:00
walker-16 5ac4701b37
Fix not found responde in vaa duplicate endpoint (#1346)
Co-authored-by: ftocal <fert1335@gmail.com>
2024-04-23 11:50:03 -03:00
ftocal 28a24db1f1
Fix go dependencies in api and pipeline (#1344)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-23 11:41:06 -03:00
ftocal d8e25cc3b5
Fix dependencies in contract watcher (#1343)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-23 10:44:48 -03:00
walker-16 980316bb2d
Remove ethereum and base token bridge in contract-watcher (#1327)
* Remove ethereum and base token bridge in contract-watcher
Co-authored-by: ftocal <fert1335@gmail.com>

* Remove moonbeam and oasis token bridge in contract-watcher

Co-authored-by: ftocal <fert1335@gmail.com>

* Update contract-watcher memory resource production-mainnet

Co-authored-by: ftocal <fert1335@gmail.com>

* Remove avalanche and fantom token bridge in contract-watcher

Co-authored-by: ftocal <fert1335@gmail.com>

* Remove polygon, bsc and celo token bridge contract-watcher

Co-authored-by: ftocal <fert1335@gmail.com>

---------

Co-authored-by: ftocal <fert1335@gmail.com>
2024-04-23 10:27:32 -03:00
ftocal 688a0d0f71
Store duplicate vaas on a secondary collection (#1308)
* Add support to scroll in tx-tracker

* Handle duplicated vaa in fly

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Modify tx-tracker and pipeline to support duplicated vaas
Co-authored-by: ftocal <fert1335@gmail.com>

* Add isDuplicated flag in vaas and operations endpoints
Add new endpoint to find duplicated vaas by vaa id
Co-authored-by: walker-16 <agpazos85@gmail.com>

* Add metrics for duplicated vaas

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Update node dependencies in spy

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Fix promethes metrics for missing tx-hash in tx-tracker

Co-authored-by: walker-16 <agpazos85@gmail.com>

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2024-04-22 14:26:07 -03:00
Julian 83987793ef
[Blockchain Watcher] (CCTP) Remove CCTP contracts (#1340)
Remove CCTP contracts

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-22 11:52:25 -03:00
Martin Picco 29d47197f5
Add W token NTT redeem tracking for solana (#1336) 2024-04-19 16:17:57 -03:00
Julian 550b7b1d54
[Blockchain Watcher] (W) Map evm NTT redeem (#1334)
Map evm NTT redeem

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-19 15:28:37 -03:00
Julian 2686bea37e
[Blockchain Watcher] (FIX - SOLANA) Map config for solana (#1331)
Map config for solana

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-18 18:04:02 -03:00
Julian 10df6821c0
[Blockchain Watcher] (FIX) Add logs for evm source events (#1316)
* Add chain in EvmLog entity

* Add new log for evm source events

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-17 17:09:33 -03:00
ftocal b34beb63df
Add new version of guardian set in fly (#1311)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-04-16 19:49:08 -03:00
Julian 36d205c37b
[Blockchain Watcher] (STANDARD RELAYER) Map new chains (#1309)
Map new chains

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 17:26:04 -03:00
Julian 674e542306
[Blockchain Watcher] (ARBITRUM) Remove arbitrum goerli in testnet (#1307)
Remove arbitrum

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 17:19:46 -03:00
Julian 408a297b63
[Blockchain Watcher] (WORMCHAIN) Mapped wormchain source events (#1238)
* Mapped source events

* Set chainId for wormchain

* Add test

* Mapped testnet rpc

* Change blockBatchSize for 10 times per execution

* Improve log

* Improve code

* Remove console.log

* Resolved issue mapping tx hash

* Mapped txs array

* Add new test with 2 txs mapped

* Adapt endpoints implementation

* Improve log

* Resolve comment in PR

* Invert params in mapper

* Resolve test

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-16 11:02:13 -03:00
Sebastian Cavedale c41ffccf39
Update fly-keda.yaml
Replaced KEDA-fly trigger type, cpu > memory.
2024-04-16 10:38:28 -03:00
Sebastian Cavedale 97ac266bed
Feat/add keda autoscaler (#1306)
* Analytics KEDA based on SQS

* Parser KEDA based on SQS

* Tx-Tracker KEDA based on SQS

* Api KEDA based on Memory

* Fly KEDA based on CPU
2024-04-15 18:05:26 -03:00
Julian 6b67bf859e
[Blockchain Watcher] (SCROLL) Mapped scroll source and target events (#1304)
* Mapped scroll source and target events

* Remove jobs for mainnet

* Remove jobs for mainnet

* Mapped redeem contract

* Add aptos custom env

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-15 16:48:56 -03:00
Julian af4b03d1c3
[Blockchain Watcher] (NFT) Mapped contracts (#1282)
* Mapped contracts

* Mapped mainnet contracts

* Mapped protocol in sui log

* Adapt aptos process to allow multiply filters

* Mapped methodId for NFT aptos

* Improve filter name

* Improve source events filter

* Resolve test

* Add aptos custom variable

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-10 20:39:19 -03:00
Mariano e06057acfd
[ISSUE-1220] Add filters to /operations endpoint (#1262)
* start

 add search by chain

 change chainId query param handling

 change condition

 only from chain

change query

 add filter by appId

 add payload type for operations query

add logs

 add log for error in mongodb call

 add more logs and recover to find possible panic

change type to float64

add more logs for troubleshooting

 add more logs for troubleshooting payloadType query param

add another defer

* change query

* add exclusiveAppId,sourceChain and targetChain

* unify search criteria

* change queryies

* combine query params filters

* change implementation of sourceChain and targetChain

* insert filtering by chain and by appid as stages in aggregation pipeline

* fix appIds matching condition

* move query to a separate pipeline which starts from parsedVAA

* adjust query by appId

* add matching also for standardizedProperties

* change

* try using  instead of

* simplify query

* add queryLoggging and remove other parts of the query to troubleshooting

* working

* add index creation

* update swagger docs

* tweak index performance and fix timestamp on parsedVaa collection

* start

 add search by chain

 change chainId query param handling

 change condition

 only from chain

change query

 add filter by appId

 add payload type for operations query

add logs

 add log for error in mongodb call

 add more logs and recover to find possible panic

change type to float64

add more logs for troubleshooting

 add more logs for troubleshooting payloadType query param

add another defer

* change query

* add exclusiveAppId,sourceChain and targetChain

* unify search criteria

* change queryies

* combine query params filters

* change implementation of sourceChain and targetChain

* insert filtering by chain and by appid as stages in aggregation pipeline

* fix appIds matching condition

* move query to a separate pipeline which starts from parsedVAA

* adjust query by appId

* add matching also for standardizedProperties

* change

* try using  instead of

* simplify query

* add queryLoggging and remove other parts of the query to troubleshooting

* working

* add index creation

* update swagger docs

* tweak index performance and fix timestamp on parsedVaa collection

* add lookup for globaltransactions
2024-04-09 09:57:08 -03:00
Julian bc0014885e
[Blockchain Watcher] (NTT - FANTOM and ETH) Integrate support NTT for fantom (#1281)
* Integrate support NTT for fantom

* Integrate support NTT for ethereum

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-04-08 16:38:56 -03:00