Commit Graph

505 Commits

Author SHA1 Message Date
Julian fa6196b02c
[Blockchain Watcher] (FIX ARBITRUM) Export environment variable to validate env (#1181)
* Export environment

* Resolve test

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-05 16:10:49 -03:00
Julian a55dbc6ccc
[Blockchain Watcher] (ARBITRUM) Improve arbitrum process (#1168)
* Improve arbitrum process

* Add comments

* Set final block for arbitrum

* Improve names

* Resolve comment

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-05 13:51:23 -03:00
Mariano 8d6165153a
add protocols to prod-mainnet.env (#1179) 2024-03-05 11:43:40 -03:00
ftocal 13eaa69cc1
Enable metrics for pipeline in production-mainnet (#1176) 2024-03-04 18:19:25 -03:00
ftocal 08c9427606
Fix parsedPayload use as any type for different kind of messages (#1169)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-03-04 16:49:54 -03:00
Mariano 6bbfa7bf23
Add cache to protocols stats endpoints (/protocols/stats) (#1149)
* add cache to protocols stats endpoint

 add mock for cache

add unit test case for cache miss

 change from to current

* add configs

* add missing config for api-service.yaml

* add cache ttl for staging-mainnet
2024-03-04 15:55:53 -03:00
Julian 54cf6c7e54
[Blockchain Watcher] (FIX) Move labels to json config (#1170)
* Move labels to json config

* Move labels to json config

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-03-01 11:56:09 -03:00
ftocal 98a6264739
Changes to support ci/cd workflow in staging environment (#1166)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-02-29 11:14:31 -03:00
Julian 11867a125d
[Blockchain Watcher] (FIX) Remove rpcs (#1163)
* Remove rpcs

* Remove one rpc for eth and moonbeam

* Change arbitrum interval

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-28 17:39:19 -03:00
ftocal 3dba12b1f5
Fix aws-sdk dependencies (#1162)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-02-28 16:33:30 -03:00
Julian 161878b15b
[Blockchain Watcher] (ENV) Add more rpcs (#1160)
* Add more rpcs for testnet and mainnet

* Add more RESOURCES_LIMITS_MEMORY in production-testnet env

* Remove sui RPC

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-28 15:16:28 -03:00
ftocal a882355c05
Add transfer prices backfiller in analytics (#1153)
* Add transfer prices backfiller in analytics
Save notional prices in s3 bucket

* Code review updates
2024-02-27 15:17:59 -03:00
Julian 91ce905768
[Blockchain Watcher] (FIX) Mapped sui protocol (#1157)
* Mapped sui protocol

* Mapped protocol in handler

* Add more eth rpcs

* Resolve comment in PR

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-27 12:04:33 -03:00
Julian 3a6dafb9e5
[Blockchain Watcher] (MAYAN) Mapped mayan events (#1150)
* Mapped evm mayan events

* Mapped evm mayan events

* Improve imports

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-26 15:50:57 -03:00
walker-16 4760c820c3
808 enhance operationsaddress to provide information for all address formats (#1145)
* Add index in globalTransactions by originTx.attribute.value.originAddress

* Add in the operation by address endpoint support to wormchain chains
2024-02-23 10:32:26 -03:00
Julian ea231c5b86
[Blockchain Watcher] (FIX) Mapped custom variables (#1148)
* Mapped custom variables

* Mapped custom variables

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-22 16:56:44 -03:00
Mariano 175abbb11a
[Issue:1052] Create job for fetching contributor stats and storing in db (#1144)
* [Issue:1052] Create job for fetching contributor stats and storing in db

revert unnecessary changes on api/handlers/stats

revert changes in go.mod and go.sum

revert change in go.work

add schedule for contributors stats job

change response parsing order

changes due to draft-pr review

 move on with contributors activity implementation

change to every hour

fix typo

 change contributor stats implementation to do a single write transaction

 normalize to UTC contributors activity timestamp

 add cronjob schedule for contributors

[Issue:1052][Part 2] Create endpoint to expose contributors stats and activities  (#1123)

* add endpoint for retrieving stats and activity

* remove model.go file and move types to service file

* add unit tests to contributors service

* integrate new contributors controller

* fix more stuff

 fix unit-tests

 changes due to pr review

 fix query

 fix unit-tests

fix total_value_secure

 move constantes to common pkg

remove extra changes

rename contributor to protocols

 finish renames

Changes for deployment

adjust different response types from different protocols contributors

 fix controller test

 big refactor in activty job and stats job since protocols are returning different formats

api responding fine

 remove uneccessary generics

 target dbconsts

 fix

Delete deploy/common/env/staging-mainnet.env

undo unwanted changes

 readd staging-mainnet.env

 fix unit-tests

add missing protocols_stats/activity_version

 remove property protocols_json

fix JOB_ID env var in protocols-activity.yaml

fix typos in env vars configs

 change tu numbers

 changes due to own review

 add new line

* add swagger docs
2024-02-22 14:58:45 -03:00
Julian a834f3d44e
[Blockchain Watcher] (ETH HOLSKY) Add eth holesky for testnet (#1140)
* Add eth holesky for testnet

* Add network for holesky

* Remove ethereum goerli

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-22 12:48:13 -03:00
Julian ff1961d495
[Blockchain Watcher] (SUI) Mapped sui source event (#1141)
* Mapped sui source event

* Resolve comment in PR

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-21 15:16:23 -03:00
walker-16 1a5a45acac
remove portico from contract-watcher (#1128) 2024-02-21 10:25:16 -03:00
Julian e0c7124c1b
[Blockchain Watcher] (FIX) Add transactions in evm request (#1139)
Add transactions

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-20 15:47:25 -03:00
Julian bc2d98d889
[Blockchain Watcher] (RPC QUERIES) Improve rpc queries (#1131)
* Improve evm block search

* Resolve test

* Add more rpc for base

* Add new rpc for avalanche

* Improve logs

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-20 13:30:08 -03:00
Julian 140d05468a
[Blockchain Watcher] (METRICS) Mapped providerPoolRegistry provider and metrics (#1137)
* Mapped providerPoolRegistry provider

* Improve metrics name

* Resolve test

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-20 13:15:03 -03:00
ftocal dc1117f6f5
Add backfiller for tx-tracker (#1132) 2024-02-20 09:58:37 -03:00
sebastian-xlabs 528d862fdf
Maintenance/update blockchain watcher dockerfile (#1133)
* Updated SHA256 from images & added authToken to .npmrc

* Updated blockchain-watcher env files names
2024-02-19 10:32:58 -03:00
Julian 87f6383f4a
[Blockchain Watcher] (FIX) Improve evm logs (#1130)
* Improve evm log

* Mapped last cursos for sui

* Mapped last cursos for sui

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-15 16:18:53 -03:00
Julian 024c29d67d
[Blockchain Watcher] (PORTICO) Add portico in mainnet (#1127)
* Add portico in mainnet

* Improve contract mapper

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-15 15:33:31 -03:00
sebastian-xlabs 8e48bec75b
Standardized environmental variables files (#1126)
* Standardized environmental variables files

* Updataed resources limits for prod-mainnet env
2024-02-15 12:16:06 -03:00
Julian 6a0edfef48
[Blockchain Watcher] (POLL RPC) Feature 1098/add rpc retry (#1118)
* Add retry for evm and sui

* Improve names

* Remove params for client

* Add params for client

* Improve log and remove rpc for ethereum

* Remove fantom rpc

* Improve rateLimit for evm and sui

* Improve rateLimit for evm and sui

* Remove try and catch

* Improve sui name

* Resolve comment in Pr

* Merge to main

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-14 16:03:50 -03:00
ftocal c0e233fc75
Remove solana watcher from contract-watcher (#1087) 2024-02-14 15:06:09 -03:00
ftocal e7b7f358b5
Add new fields in the transfer report (#1124) 2024-02-14 14:35:52 -03:00
Julian ca8a5da9cf
[Blockchain Watcher] (FIX) Add content type header (#1114)
* Add  content type header

* Remove rcp for arbitrum

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-12 16:25:01 -03:00
ftocal c9bc9660f6
Remove redis in txHash store (#1112) 2024-02-08 12:10:13 -03:00
walker-16 a984bcb061
Add pageSize max value to 1000 in api (#1111)
Co-authored-by: ftocal fert1335@gmail.com
2024-02-08 10:54:55 -03:00
ftocal 408851ff1f
Save observation in mongo as fallback when the publishing fails in sqs queue (#1106)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-02-07 17:02:57 -03:00
Julian 9c06a6e91d
[Blockchain Watcher] (FIX) Divided solana pods (#1105)
Divided solana pods

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-07 16:56:04 -03:00
Martin Picco 59705a5bad
Implement rpc pool library (#1085)
* Add rpc-pool dependency and make the minimum changes to make the codebase compatible with it

* Implement rpc provider pools for EVMs and Sui

* Implement rpc provider pools for Solana

* Adapt tests to new repo interfaces and constructors

* Fix tests

* Modify gh action to use the xlabs registry

* Mock rpc-pool module for tests

* Set up husky and pre commit hook to run prettier

* Bump rpc-pool

* Expand default mainnet rpc configs

* Add link-staged to run prettier for staged files

* prettier config

* Address PR comments

* Add bsc rpc node

* fix rpc configs
2024-02-07 16:50:05 -03:00
walker-16 c8665d68f5
Fix globalTransactions index in fly (#1104)
Co-authored-by: ftocal fert1335@gmail.com
2024-02-07 12:30:29 -03:00
ftocal 7d5a3bbe52
Improve fly reliability (#1094)
Add sqs queue for observations
Add tx hash strategy for vaas
Refactoring to organize the construction
2024-02-06 21:00:45 -03:00
Julian 61c5f3e29d
[Blockchain Watcher] (FIX) Rename pods files (#1082)
* Rename pods

* Improve solana log

* Fix pods

* Resolve comment in PR

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-06 18:10:12 -03:00
walker-16 73a31dbbc8
Add total_message field in the scorecard endpoint (#1079)
* Add total_message field in the scorecard endpoint

* update scorecard endpoint documentation

* Add support to total_message in testnet
2024-02-05 10:42:55 -03:00
Martin Picco 49c594c5c7
[Blockchain Watcher] (SUI) Add missing metric for sui txs handler (#1080)
* Add metric for sui txs handler

* Apply prettier
2024-02-02 16:12:41 -03:00
Martin Picco e2025ee6ee
[Blockchain Watcher] (SUI) Initial implementation for Sui through polling (#1054)
* Initial implementation for Sui through block polling

* PollSui: add check for when the cursor reaches the latest (no new checkpoints to process)

* Change types for poll sui config from/to range

* coverage for sui rpc repo

* Add test for PollSui batchSize param

* Apply prettier

* Upgrade typescript and tsx dev deps

* Remove commented code

* Address some review comments

* Add SuiPollTransactions source

* Fix divideIntoBatches types

* Apply prettier

* Fix cursor issue when no configured range. Add test to mapper

* Remove PollSuiCheckpoints

* Query transactions by event instead of by called module in order to catch both transfers with and without payload

* Remove unusued GetSuiTransactions action

* Address some review comments

* Address review comments. Go back to using queryTransactions instead of events (querying by events would mean losing failed redeems)

* Allow undefined filter

* Add sui job to deployments

* Fix job target

* Split sui job into two with different filters: one for complete_transfer and another for complete_transfer_with_payload. This will speed up the processing of both cases

* Fix sui jobs mainnet/testnet mix up

* Fix prometheus issue

* run prettier

* Fix message blockTime for sui transfer-redeemed event

* Add asyncdoc entry for new event transfer-redeemed

* Add missing channel to asyncapi
2024-02-02 12:35:52 -03:00
Julian faa4a8db33
[Blockchain Watcher] (ALL) Add metrics (#1074)
* Add metrics

* Resolve test

* Resolve test

* Mapped source and target event for solana

* Resolve comment in PR

* Improve metric name

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-02 12:23:00 -03:00
Julian 760b7925d6
[Blockchain Watcher] (SOLANA) Enable solana redeem for token bridge (#1075)
* Enable solana redeem

* Resolve test

* Remove log

* Add CompleteNativeWithPayloadInstruction and CompleteWrappedWithPayloadInstruction methods

* Resolve test

* Improve asyncapi docs

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-02 10:33:55 -03:00
ftocal c4707fbb69
Fix vaa parse endpoint (#1078) 2024-02-01 12:01:24 -03:00
ftocal d8aeb72cb6
Fix token address from native token address in vaa-payload-parser response (#1066)
Update supported tokens

Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-02-01 11:26:51 -03:00
walker-16 90f615dd0d
modify boostrap to fix quic-v1 version (#996) 2024-02-01 11:23:30 -03:00
walker-16 8c5e9e5353
Feature/improve operation endpoint performance (#1064)
* Change query to sort by timestamp and id

* Add maximun size to pageSize in operation endpoint

* Add missing indexes for mongodb

* improve search txHash for nested wormchain txHash

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-02-01 11:21:34 -03:00
ftocal 278cd50dcb
Fix txHash in solana with job (#1076)
* Remove filter solanas and aptos from method getVaasToMigrate

* Fix origin tx in solana
Add k8s service for tx-tracker

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2024-01-31 19:41:41 -03:00