Commit Graph

589 Commits

Author SHA1 Message Date
Mariano 175abbb11a
[Issue:1052] Create job for fetching contributor stats and storing in db (#1144)
* [Issue:1052] Create job for fetching contributor stats and storing in db

revert unnecessary changes on api/handlers/stats

revert changes in go.mod and go.sum

revert change in go.work

add schedule for contributors stats job

change response parsing order

changes due to draft-pr review

 move on with contributors activity implementation

change to every hour

fix typo

 change contributor stats implementation to do a single write transaction

 normalize to UTC contributors activity timestamp

 add cronjob schedule for contributors

[Issue:1052][Part 2] Create endpoint to expose contributors stats and activities  (#1123)

* add endpoint for retrieving stats and activity

* remove model.go file and move types to service file

* add unit tests to contributors service

* integrate new contributors controller

* fix more stuff

 fix unit-tests

 changes due to pr review

 fix query

 fix unit-tests

fix total_value_secure

 move constantes to common pkg

remove extra changes

rename contributor to protocols

 finish renames

Changes for deployment

adjust different response types from different protocols contributors

 fix controller test

 big refactor in activty job and stats job since protocols are returning different formats

api responding fine

 remove uneccessary generics

 target dbconsts

 fix

Delete deploy/common/env/staging-mainnet.env

undo unwanted changes

 readd staging-mainnet.env

 fix unit-tests

add missing protocols_stats/activity_version

 remove property protocols_json

fix JOB_ID env var in protocols-activity.yaml

fix typos in env vars configs

 change tu numbers

 changes due to own review

 add new line

* add swagger docs
2024-02-22 14:58:45 -03:00
Julian a834f3d44e
[Blockchain Watcher] (ETH HOLSKY) Add eth holesky for testnet (#1140)
* Add eth holesky for testnet

* Add network for holesky

* Remove ethereum goerli

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-22 12:48:13 -03:00
Julian ff1961d495
[Blockchain Watcher] (SUI) Mapped sui source event (#1141)
* Mapped sui source event

* Resolve comment in PR

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-21 15:16:23 -03:00
walker-16 1a5a45acac
remove portico from contract-watcher (#1128) 2024-02-21 10:25:16 -03:00
Julian e0c7124c1b
[Blockchain Watcher] (FIX) Add transactions in evm request (#1139)
Add transactions

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-20 15:47:25 -03:00
Julian bc2d98d889
[Blockchain Watcher] (RPC QUERIES) Improve rpc queries (#1131)
* Improve evm block search

* Resolve test

* Add more rpc for base

* Add new rpc for avalanche

* Improve logs

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-20 13:30:08 -03:00
Julian 140d05468a
[Blockchain Watcher] (METRICS) Mapped providerPoolRegistry provider and metrics (#1137)
* Mapped providerPoolRegistry provider

* Improve metrics name

* Resolve test

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-20 13:15:03 -03:00
ftocal dc1117f6f5
Add backfiller for tx-tracker (#1132) 2024-02-20 09:58:37 -03:00
sebastian-xlabs 528d862fdf
Maintenance/update blockchain watcher dockerfile (#1133)
* Updated SHA256 from images & added authToken to .npmrc

* Updated blockchain-watcher env files names
2024-02-19 10:32:58 -03:00
Julian 87f6383f4a
[Blockchain Watcher] (FIX) Improve evm logs (#1130)
* Improve evm log

* Mapped last cursos for sui

* Mapped last cursos for sui

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-15 16:18:53 -03:00
Julian 024c29d67d
[Blockchain Watcher] (PORTICO) Add portico in mainnet (#1127)
* Add portico in mainnet

* Improve contract mapper

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-15 15:33:31 -03:00
sebastian-xlabs 8e48bec75b
Standardized environmental variables files (#1126)
* Standardized environmental variables files

* Updataed resources limits for prod-mainnet env
2024-02-15 12:16:06 -03:00
Julian 6a0edfef48
[Blockchain Watcher] (POLL RPC) Feature 1098/add rpc retry (#1118)
* Add retry for evm and sui

* Improve names

* Remove params for client

* Add params for client

* Improve log and remove rpc for ethereum

* Remove fantom rpc

* Improve rateLimit for evm and sui

* Improve rateLimit for evm and sui

* Remove try and catch

* Improve sui name

* Resolve comment in Pr

* Merge to main

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-14 16:03:50 -03:00
ftocal c0e233fc75
Remove solana watcher from contract-watcher (#1087) 2024-02-14 15:06:09 -03:00
ftocal e7b7f358b5
Add new fields in the transfer report (#1124) 2024-02-14 14:35:52 -03:00
Julian ca8a5da9cf
[Blockchain Watcher] (FIX) Add content type header (#1114)
* Add  content type header

* Remove rcp for arbitrum

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-12 16:25:01 -03:00
ftocal c9bc9660f6
Remove redis in txHash store (#1112) 2024-02-08 12:10:13 -03:00
walker-16 a984bcb061
Add pageSize max value to 1000 in api (#1111)
Co-authored-by: ftocal fert1335@gmail.com
2024-02-08 10:54:55 -03:00
ftocal 408851ff1f
Save observation in mongo as fallback when the publishing fails in sqs queue (#1106)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-02-07 17:02:57 -03:00
Julian 9c06a6e91d
[Blockchain Watcher] (FIX) Divided solana pods (#1105)
Divided solana pods

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-07 16:56:04 -03:00
Martin Picco 59705a5bad
Implement rpc pool library (#1085)
* Add rpc-pool dependency and make the minimum changes to make the codebase compatible with it

* Implement rpc provider pools for EVMs and Sui

* Implement rpc provider pools for Solana

* Adapt tests to new repo interfaces and constructors

* Fix tests

* Modify gh action to use the xlabs registry

* Mock rpc-pool module for tests

* Set up husky and pre commit hook to run prettier

* Bump rpc-pool

* Expand default mainnet rpc configs

* Add link-staged to run prettier for staged files

* prettier config

* Address PR comments

* Add bsc rpc node

* fix rpc configs
2024-02-07 16:50:05 -03:00
walker-16 c8665d68f5
Fix globalTransactions index in fly (#1104)
Co-authored-by: ftocal fert1335@gmail.com
2024-02-07 12:30:29 -03:00
ftocal 7d5a3bbe52
Improve fly reliability (#1094)
Add sqs queue for observations
Add tx hash strategy for vaas
Refactoring to organize the construction
2024-02-06 21:00:45 -03:00
Julian 61c5f3e29d
[Blockchain Watcher] (FIX) Rename pods files (#1082)
* Rename pods

* Improve solana log

* Fix pods

* Resolve comment in PR

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-06 18:10:12 -03:00
walker-16 73a31dbbc8
Add total_message field in the scorecard endpoint (#1079)
* Add total_message field in the scorecard endpoint

* update scorecard endpoint documentation

* Add support to total_message in testnet
2024-02-05 10:42:55 -03:00
Martin Picco 49c594c5c7
[Blockchain Watcher] (SUI) Add missing metric for sui txs handler (#1080)
* Add metric for sui txs handler

* Apply prettier
2024-02-02 16:12:41 -03:00
Martin Picco e2025ee6ee
[Blockchain Watcher] (SUI) Initial implementation for Sui through polling (#1054)
* Initial implementation for Sui through block polling

* PollSui: add check for when the cursor reaches the latest (no new checkpoints to process)

* Change types for poll sui config from/to range

* coverage for sui rpc repo

* Add test for PollSui batchSize param

* Apply prettier

* Upgrade typescript and tsx dev deps

* Remove commented code

* Address some review comments

* Add SuiPollTransactions source

* Fix divideIntoBatches types

* Apply prettier

* Fix cursor issue when no configured range. Add test to mapper

* Remove PollSuiCheckpoints

* Query transactions by event instead of by called module in order to catch both transfers with and without payload

* Remove unusued GetSuiTransactions action

* Address some review comments

* Address review comments. Go back to using queryTransactions instead of events (querying by events would mean losing failed redeems)

* Allow undefined filter

* Add sui job to deployments

* Fix job target

* Split sui job into two with different filters: one for complete_transfer and another for complete_transfer_with_payload. This will speed up the processing of both cases

* Fix sui jobs mainnet/testnet mix up

* Fix prometheus issue

* run prettier

* Fix message blockTime for sui transfer-redeemed event

* Add asyncdoc entry for new event transfer-redeemed

* Add missing channel to asyncapi
2024-02-02 12:35:52 -03:00
Julian faa4a8db33
[Blockchain Watcher] (ALL) Add metrics (#1074)
* Add metrics

* Resolve test

* Resolve test

* Mapped source and target event for solana

* Resolve comment in PR

* Improve metric name

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-02 12:23:00 -03:00
Julian 760b7925d6
[Blockchain Watcher] (SOLANA) Enable solana redeem for token bridge (#1075)
* Enable solana redeem

* Resolve test

* Remove log

* Add CompleteNativeWithPayloadInstruction and CompleteWrappedWithPayloadInstruction methods

* Resolve test

* Improve asyncapi docs

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-02-02 10:33:55 -03:00
ftocal c4707fbb69
Fix vaa parse endpoint (#1078) 2024-02-01 12:01:24 -03:00
ftocal d8aeb72cb6
Fix token address from native token address in vaa-payload-parser response (#1066)
Update supported tokens

Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-02-01 11:26:51 -03:00
walker-16 90f615dd0d
modify boostrap to fix quic-v1 version (#996) 2024-02-01 11:23:30 -03:00
walker-16 8c5e9e5353
Feature/improve operation endpoint performance (#1064)
* Change query to sort by timestamp and id

* Add maximun size to pageSize in operation endpoint

* Add missing indexes for mongodb

* improve search txHash for nested wormchain txHash

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-02-01 11:21:34 -03:00
ftocal 278cd50dcb
Fix txHash in solana with job (#1076)
* Remove filter solanas and aptos from method getVaasToMigrate

* Fix origin tx in solana
Add k8s service for tx-tracker

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2024-01-31 19:41:41 -03:00
ftocal e63a7a12e4
Add top-100-corridors endpoint (#1065)
Improve handling token in volume metrics
2024-01-30 15:27:48 -03:00
Julian 54c5d34a6e
[Blockchain Watcher] (FIX) Add lowecasse in contracts addresses (#1063)
* Add lowecasse

* Improve transaction filter

* Run prettier

* Resolve test

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-30 14:22:41 -03:00
Julian 5e6b96417a
[Blockchain Watcher] (CHAINS) Create config json for contracts and protocols (#1056)
* Create contractsMapperConfig json

* Create contracts json mapper

* Change method name in solana redeem

* Improve mapper validations

* Resolve solana test

* Set up config inside solana tx

* Resolve solana test

* Resolve solana test

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-30 12:19:44 -03:00
walker-16 fb0573c160
migrate vaa to globaltransaction origintx (#940)
* migrate vaa to globaltransaction origintx

* Add deploy configuration for job to migrate vaas to originTx

* Add option to run migration process by range of date

* Update go dependencies for jobs

* Fix kind of job in deployment

---------

Co-authored-by: Fernando Torres <fert1335@gmail.com>
2024-01-30 12:19:31 -03:00
Julian 59c2de9d0c
[Blockchain Watcher] (SOLANA) Mapped new attributes in solana redeem (#997)
* Rename and add new attributes

* Remove comment

* Resolve comment in PR

* Run prettier

* Resolve solana test

* Remove name in method mapper

* Run prettier

* Improve mapper method

* Remove toString in method mapper

* Resolve test error

* Resolve comment in PR

* Resolve comment in PR

* Revert name changes

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-29 09:16:04 -03:00
Julian 13ec7846c0
[Blockchain Watcher] (FIX) Fix quantity logs process per block (#1044)
* Add divided blocks method in getBlocks

* Run prettier

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-26 09:04:04 -03:00
Julian 63819a6e42
[Blockchain Watcher] (POD) Config private varibles in pods (#1037)
Config private varibles in pods

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-25 10:05:06 -03:00
ftocal 6145453fd8
Fix enable transer redeemed (#1040) 2024-01-24 15:56:43 -03:00
ftocal 49f9bedd29
Handle transfer-redeemed event from blockchain-watcher (#1039) 2024-01-24 14:51:04 -03:00
Julian 5744e25495
[Blockchain Watcher] (EVM) Change evm redeemed transaction mapper (#1034)
* Change evm redeemed transaction mapper

* Run prettier

* Create batch for getTransactionReceipt

* Run prettier

* Move batches logic inside repository

* Resolve comment in PR

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-24 12:29:23 -03:00
Julian c6b77d0bf3
[Blockchain Watcher] (EVM) Add sepolia support for testnet env (#1016)
* Add sepolia support for testnet env

* Add test

* Pull to main branch

* Change interval value for arbitrum

* Improve network name

* Mapped url correctly

* Resolve comment in Pr

* Mapped base-sepolia address

* Set public rpc in default url

* Mapped correctly base address

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-24 11:12:26 -03:00
Julian 3d347ac84e
[Blockchain Watcher] (EVM)[FIX] Mapped all blocks inside transactions for (#1019)
Mapped all blocks

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-23 11:08:37 -03:00
Julian 2be52daa6f
[Blockchain Watcher] (EVM) Replace public url in mainnet (#1017)
Replace mainnet url

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-23 09:00:36 -03:00
Julian 3a715d7e29
[Blockchain Watcher] (ARBITRUM AND OPTIMISM) Mapped token bridge redeemed (#999)
* Add job and map methodName

* Run prettier

* Add check time, change job execution time and logs

* Rename log

* tolowercase address

* Rename populateTransactions name

* Reformat code, remove VAA information inside origin tx

* Add log in mapper

* Resolve comment in PR

* Improve mappedVaaInformation name

* Add log about transaction

* Resolve comment in PR

* Improve mappedVaaInformation code

* Run prettier

---------

Co-authored-by: julian merlo <julianmerlo@julians-MacBook-Pro.local>
2024-01-22 11:04:02 -03:00
ftocal d3c1c52b79
Add support to sepolia chains (#1001)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2024-01-22 11:01:18 -03:00
Ben Guidarelli 00d88a38dc
Docs: Modify comments to provide consistent argument documentation (#811)
tweak comments to provide consistent argument documentation
2024-01-22 10:58:28 -03:00