Commit Graph

422 Commits

Author SHA1 Message Date
matias martinez 2cb071d9fb pr updates 2023-12-13 12:28:10 -03:00
matias martinez 5737b73949 Merge remote-tracking branch 'origin/main' into blockchain-watcher/multi-instance 2023-12-13 09:54:38 -03:00
matias martinez 2f2b64c21e adding runtime job lookup 2023-12-12 19:25:41 -03:00
Matías Martínez e2884690e1
[Blockchain watcher] TransferRedeemed/Delivery events for evm (#844)
* adding more overrides via env var

* simplifying default cfg files

* shared evm repo

* move get evm logs to new action

* move get solana txs to new action

* minor folder cleanup

* smaller docker image

* add evm transfer redeemed parsing

* adding standard relayers delivery event

* adding to runtime

* remove redeem job handlers for now

* [Blockchain watcher] Transfer redeemed events for Solana (#855)

* solana transfer redeemed evt

* pr comments

* missine prop in evt example

* support for complete transfers with payload

* add solana redeem example

* fixing err message
2023-12-12 16:55:09 -03:00
kev1n-peters 33319a7800
Added Portico contracts to watchers (#884)
Co-authored-by: Kevin Peters <kevin@wormholelabs.xyz>
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-12-12 16:12:53 -03:00
matias martinez 794db66933 Merge remote-tracking branch 'origin/main' into blockchain-watcher/multi-instance 2023-12-12 16:11:17 -03:00
ftocal 7992f76e56
Improve tx tracker logic without internal retries (#890)
* Improve tx tracker logic without internal retries

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Add message attribute in pipeline sns

Co-authored-by: walker-16 <agpazos85@gmail.com>

---------

Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-12-12 15:46:00 -03:00
Julian 04674745c2
[Blockchain Watcher] (EVM) Fix moonbeam process (#900)
Improve sleepTime and isBlockFinalized value
2023-12-12 12:29:36 -03:00
Julian a4bf43c17e
[Blockchain Watcher] (EVM) Add moonbeam chain (#886)
* feature-826/enable-evm-arbitrum-chain

* Improve arbitrum implementation

* Add removeDuplicates method and divide blocks into testnet and mainnet

* Delete findAssociatedL1Block method

* feature-826/enable-evm-moonbeam-chain

* Improve result

* Add max attempts

* Add job

* Mapped in custom-env

* Add test

* Add configMock

* Resolve comment in PR

* Resolve comment in PR

* Resolve comment in PR

* Resolve test

* Define variables inside the object

* change interval value in testnet

* Add equal attempts to maxAttempts

* Add timers/promises to sleep function

* Run prettier

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-12 10:27:30 -03:00
matias martinez 9327a371e1 Merge remote-tracking branch 'origin/main' into blockchain-watcher/multi-instance 2023-12-12 09:57:20 -03:00
Julian 9d20a63630
[Blockchain Watcher] (EVM) Add arbitrum chain (#878)
* feature-826/enable-evm-arbitrum-chain

* Improve arbitrum implementation

* Add removeDuplicates method and divide blocks into testnet and mainnet

* Delete findAssociatedL1Block method

* Resolve comment in PR

* Resolve test

* Mapped MetadaRepository

* Run prettier

* Rename test

* Resolve test

* Improve persistedBlocks instance

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-11 19:11:42 -03:00
matias martinez dc0ac9539a pseudo job leases 2023-12-11 18:26:07 -03:00
ftocal cff86e4469
Add top-symbols-by-volume endpoint and influx tasks (#887) 2023-12-11 14:32:25 -03:00
ftocal 6edd3c4711
Ignore vaa from near in tx-tracker (#883)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-12-11 10:16:06 -03:00
matias martinez 74e6b98ac5 use tx lock for migrations 2023-12-10 19:31:06 -03:00
matias martinez 770f4dc5de sql based metadata repo 2023-12-08 20:34:53 -03:00
matias martinez d12e805d30 unique run per job support 2023-12-07 18:58:11 -03:00
ftocal a4b4e90fd7
Handle missing txhHash in vaa in vaas endpoint (#880)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-12-07 14:52:20 -03:00
ftocal cbdd72ec9c
Process missing txHash in tx-tracker (#866)
Improve event processing in tx-tracker
Add new prometheus metrics
Handle vaa without txHash from gossip flow
Fix for already message processed
Change rpc endpoints and rate limit for tx-tracker

Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-12-07 11:06:48 -03:00
matias martinez 43295e3ee4 optional base url 2023-12-06 19:07:01 -03:00
Julian 630a63c3b7
[Blockchain Watcher] (EVM) Add bsc chain (#861)
* [Blockchain Watcher] feature-826/enable-evm-bsc-chain

* Add bsc test and pod

* Remove bad changes

* Resolve comment in PR

* Resolve comment in PR

* Remove supportedChains config

* [Blockchain Watcher] Retries and timeout cfg for evm (#865)

retries and timeout cfg for evm

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
Co-authored-by: Matías Martínez <131624652+mat1asm@users.noreply.github.com>
2023-12-06 13:07:14 -03:00
fulldegen1 44b818cf1c
Fix typos (#836)
docs: fix typos
2023-12-06 11:02:26 -03:00
Julian 162a9fe5d9
Update base mainnet rpcs url (#859)
* Update base mainnet rpcs url

* Rename pull request template

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-05 15:38:59 -03:00
Julian a228c28b3d
[Blockchain Watcher](EVM) Add celo chain (#856)
* feature-798/enable-evm-celo-chain

* Run prettier

* feature-798/enable-evm-oasis-chain

* Resolve comment

* [Blockchain Watcher](EVM) Add oasis chain (#857)

* feature-798/enable-evm-oasis-chain

* Change commitment value

* [Blockchain Watcher](EVM) Add Klaytn chain (#858)

* feature-798/enable-evm-klaytn-chain

* Run prettier

* Resolve comment

* Resolve comment

* Change network name

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

* Improve package runners

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-05 12:49:19 -03:00
Julian b6e3b00d54
[Blockchain Watcher](EVM) Validate undefined log map (#854)
* fix-853/validate-undefined-log-map

* Improve test name

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-05 09:34:25 -03:00
walker-16 984fb748d8
operation endpoint remove q query param, add address and txHash query… (#852)
operation endpoint remove q query param, add address and txHash query params
2023-12-04 16:33:38 -03:00
ftocal af5bd3017f
Handle native tx hash for solana when receive event from blockchain-watcher (#851) 2023-12-04 16:29:38 -03:00
ftocal 2488da74aa
Add support to handle multiple signature for an address in solana (#850)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-12-04 15:30:16 -03:00
Julian 6507c98bfb
[Blockchain Watcher](EVM) Add optimism chain (#847)
* feature-798/enable-evm-optimism-chain

* [Blockchain Watcher](EVM) Add base chain (#848)

* feature-798/enable-evm-base-chain

* Run prettier

* Add custom envs

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

* Mapped base in supportedChain

* Run prettier

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-04 15:00:48 -03:00
ftocal 3dcd21b0c4
Improve solana performance in contract-watcher (#845) 2023-12-04 10:56:56 -03:00
Matías Martínez 0e4efd6673
[Blockchain Watcher] Separating get and poll actions (#843)
* adding more overrides via env var

* simplifying default cfg files

* shared evm repo

* move get evm logs to new action

* move get solana txs to new action

* minor folder cleanup

* smaller docker image

* add chain to evm block repo logs
2023-12-04 09:47:02 -03:00
Julian b458213b0c
[Blockchain Watcher] feature-798/enable-evm-avalanche-chain (#838)
* Add fantom chain

* Mapped all chains in prod-mainnet

* Add fantom test

* feature-798/enable-evm-acala-chain

* feature-798/enable-evm-avalanche-chain

* Run prettier

* Change commitment value and interval value

* Resolve comment in PR

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-04 09:24:36 -03:00
Julian 912049a0a8
[Blockchain Watcher] Feature 798/enable evm acala chain (#837)
* Add fantom chain

* Mapped all chains in prod-mainnet

* Add fantom test

* feature-798/enable-evm-acala-chain

* Run prettier

* Resolve comment in PR

* Replace mainnet url

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-01 16:25:02 -03:00
ftocal 2836f4ffc2
Fix of an intermittent failure to obtain a solana transaction (#840) 2023-12-01 14:15:19 -03:00
Julian c001e0700c
[Blockchain Watcher] Add fantom chain (#834)
* Add fantom chain

* Mapped all chains in prod-mainnet

* Add fantom test

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-12-01 10:09:58 -03:00
Julian c15fa976a6
[Blockchain Watcher] Feature 798/enable evm karura chain (#831)
* adding gen-relayer watcher code to branch

* folder rename

* adding some new  abstract types for processor redesign

* added first cut of new process manager logic

* large refactoring to environment configuration

* Add basic default config

* prettier run

* modifying event handler interface

* abstract handler typing changes

* Blockchain watcher: adding domain and infra layers (#786)

* reorg domain-infra

* watch evm blocks action

* adding evm log parser

* wider prettier

* renaming watch action

* adding doc

* persist latest metadata

* gh action for blockchain-watcher

* adding log-message-published mapper

* deps: remove peers and nodemon

* adding handler for LogMessagePublished

* added parser for log message published

---------

Co-authored-by: chase-45 <chasemoran45@gmail.com>

* Blockchain Watcher: ethereum -> sns implementation (#790)

* evm block repo implementation

* adding sns publisher

* adding external config and initial runner

* fix: start from latest if no fromBlock configured

* feat: add dryRun option

* fix: handler filtering and eth_getLogs filter payload

* local e2e

* actual sns arns for testnet

* smaller docker image

* deployment changes

* [Blockchain Watcher] Apply missing formatting for log message published (#791)

* Apply missing formatting for log message published

* keep extracting

* emitterAddress -> emitter

* using configured default winston logger

* wait for new block

* adding basic metrics

* staging mainnet config

* send hexa block number

* simpler log format

* group entities in different files

* [Blockchain watcher] Adding light observability (#793)

* using configured default winston logger

* wait for new block

* adding basic metrics

* staging mainnet config

* send hexa block number

* simpler log format

* better error logs

* wait when no block available

* grouping watchers

* adding 429 handling http client

* abstracting polling iteration

* Load jobs dinamically

* changing deployment strategy to jobs per pod

* group actions per platform

* [Blockchain Watcher] Add StartJob action + rate limit handling (#799)

* using configured default winston logger

* wait for new block

* adding basic metrics

* staging mainnet config

* send hexa block number

* simpler log format

* group entities in different files

* grouping watchers

* adding 429 handling http client

* abstracting polling iteration

* Load jobs dinamically

* changing deployment strategy to jobs per pod

* adding poll solana txs action

* adding solana repo implementation

* solana: mapping to logmsgpublished

* fixing solana mapper test

* updating readme

* adding some metrics

* adding solana worker

* adding finality param to get solana block

* minor changes - using confirmed for solana log extraction

* updating version

* add solana env var

* [Blockchain Watcher] Feature-813/fix-coverage-report (#815)

* Fix coverage report

* Run prettier

* Rollback global coverage value

* Set global coverage value to 55

* Add github PR template

* Run prettier

* Rename github template file

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

* private solana urls as secret

* adding prod cfg files

* Change repository name and cretae error foulder (#819)

* Change repository name and cretae error foulder

* Rename SolanaFailure file

* Rename SolanaFailure file

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

* passing node_options for solana

* adding missing envs templates

* cru

* ratelimited solana client + increase coverage

* [Blockchain Watcher] Feature 817/add hexagonal prefix (#824)

* Put hexadecimal prefix

* Create id variable

* Add error log

* Add error log

* Remove bigint in getBlock params

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

* fix never ending solana jobs

* adding job counter metric

* solana: add retry handling for 429s

* cleanup

* remove duplicated tests

* [Blockchain watcher] feature-798/enable-evm-karura-chain

* [Blockchain watcher] feature-798/enable-evm-karura-chain

* Add karura job in mainnet

* Mapped karura addresses

* Improve address tesnet

* Delete from block

* Resolve comment in PR, mapped chainId into EvmLog entity

* Revert address change

* Mapped mainet address

* Create chains constants

* Imporve config mock

* Resolve comment

* Mapped chainId into repository

* Run prettier

* Change commitment status for karura

* Run prettier

---------

Co-authored-by: chase-45 <chasemoran45@gmail.com>
Co-authored-by: matias martinez <matias@xlabs.xyz>
Co-authored-by: Matías Martínez <131624652+mat1asm@users.noreply.github.com>
Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-11-30 12:43:37 -03:00
walker-16 918f09cddb
fix typo standarized properties in operation endpoint (#833) 2023-11-30 12:28:48 -03:00
Matías Martínez 0dda3e3f97
[Blockchain Watcher] Emit LogMessagePublished for Solana (#809)
* adding gen-relayer watcher code to branch

* folder rename

* adding some new  abstract types for processor redesign

* added first cut of new process manager logic

* large refactoring to environment configuration

* Add basic default config

* prettier run

* modifying event handler interface

* abstract handler typing changes

* Blockchain watcher: adding domain and infra layers (#786)

* reorg domain-infra

* watch evm blocks action

* adding evm log parser

* wider prettier

* renaming watch action

* adding doc

* persist latest metadata

* gh action for blockchain-watcher

* adding log-message-published mapper

* deps: remove peers and nodemon

* adding handler for LogMessagePublished

* added parser for log message published

---------

Co-authored-by: chase-45 <chasemoran45@gmail.com>

* Blockchain Watcher: ethereum -> sns implementation (#790)

* evm block repo implementation

* adding sns publisher

* adding external config and initial runner

* fix: start from latest if no fromBlock configured

* feat: add dryRun option

* fix: handler filtering and eth_getLogs filter payload

* local e2e

* actual sns arns for testnet

* smaller docker image

* deployment changes

* [Blockchain Watcher] Apply missing formatting for log message published (#791)

* Apply missing formatting for log message published

* keep extracting

* emitterAddress -> emitter

* using configured default winston logger

* wait for new block

* adding basic metrics

* staging mainnet config

* send hexa block number

* simpler log format

* group entities in different files

* [Blockchain watcher] Adding light observability (#793)

* using configured default winston logger

* wait for new block

* adding basic metrics

* staging mainnet config

* send hexa block number

* simpler log format

* better error logs

* wait when no block available

* grouping watchers

* adding 429 handling http client

* abstracting polling iteration

* Load jobs dinamically

* changing deployment strategy to jobs per pod

* group actions per platform

* [Blockchain Watcher] Add StartJob action + rate limit handling (#799)

* using configured default winston logger

* wait for new block

* adding basic metrics

* staging mainnet config

* send hexa block number

* simpler log format

* group entities in different files

* grouping watchers

* adding 429 handling http client

* abstracting polling iteration

* Load jobs dinamically

* changing deployment strategy to jobs per pod

* adding poll solana txs action

* adding solana repo implementation

* solana: mapping to logmsgpublished

* fixing solana mapper test

* updating readme

* adding some metrics

* adding solana worker

* adding finality param to get solana block

* minor changes - using confirmed for solana log extraction

* updating version

* add solana env var

* [Blockchain Watcher] Feature-813/fix-coverage-report (#815)

* Fix coverage report

* Run prettier

* Rollback global coverage value

* Set global coverage value to 55

* Add github PR template

* Run prettier

* Rename github template file

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

* private solana urls as secret

* adding prod cfg files

* Change repository name and cretae error foulder (#819)

* Change repository name and cretae error foulder

* Rename SolanaFailure file

* Rename SolanaFailure file

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

* passing node_options for solana

* adding missing envs templates

* cru

* ratelimited solana client + increase coverage

* [Blockchain Watcher] Feature 817/add hexagonal prefix (#824)

* Put hexadecimal prefix

* Create id variable

* Add error log

* Add error log

* Remove bigint in getBlock params

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

* fix never ending solana jobs

* adding job counter metric

* solana: add retry handling for 429s

* cleanup

* remove duplicated tests

* cru + item count

* minor readme update + do not use private solana rpc

* fix items counter

* fix solana job programID for devnet

* log basic repo info

* solana: passing finality everywhere

* delete unnecesary files

* adjusting solana cfgs

* [Blockchain Watcher]  Fix/re order some files (#828)

* fix/re-order-some-files

* run prettier

* Run prettier

* Resolve comment in PR

* Remove import

* Resolve comment

* Remove prefix in sns log

---------

Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>

---------

Co-authored-by: chase-45 <chasemoran45@gmail.com>
Co-authored-by: Julian <52217955+julianmerlo95@users.noreply.github.com>
Co-authored-by: Julian Merlo <julianmerlo@MacBook-Pro-de-Julian.local>
2023-11-30 12:05:43 -03:00
walker-16 9fce2cf645
Fix operation endpoint search wormchain txs and destinationTx (#830) 2023-11-29 16:21:28 -03:00
Matías Martínez 2d9d0533f6
[Blockchain Watcher] Initial version (#806)
- Ethereum support for LogMessagePublished extraction
2023-11-28 16:00:45 -03:00
ftocal 695fd0dcd4
Add supported tokens for testnet (#810)
Update supported tokens for mainnet
2023-11-28 10:16:40 -03:00
ftocal 7c467f5267
Integrating blockchain watcher data into mongodb (#820)
* Handle log-message-published generated by blockchain-watcher in parser, tx-tracker y analytics

* Add deployment for staging-testnet environment
Improve logs

* Add operation endpoints

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2023-11-27 12:31:35 -03:00
ftocal 54b450e86f
Fix in find relays by id (#807)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-11-16 15:57:43 -03:00
ftocal c2f02bab2f
Fix and change relays response for the relays endpoint (#805)
Co-authored-by: walker-16 <agpazos85@gmail.com>
2023-11-16 15:28:07 -03:00
ftocal 11b162ca54
Add Sei support in tx-tracker (#800)
* Add Sei support in tx-tracker

* Code review updates
2023-11-15 12:11:24 -03:00
walker-16 e5282ffb16
normalize osmosis txhash (#777)
Co-authored-by: ftocal <fert1335@gmail.com>
2023-10-30 11:23:37 -03:00
ftocal a29fbce237
Fix in address endpoint and transactions by address (#762) 2023-10-26 19:35:23 -03:00
walker-16 f4fe630623
Add methods to identify kujira & evmos (#729)
* Add methods to identify kujira & evmos

* Add fetch methods to kajira and evmos

* fix fetch kujira and evmos methods

* Add support to search vaas gateway chain txHash

* Add deploy config to tx-tracker for evmos & kujira
2023-10-26 19:34:00 -03:00
walker-16 b46ba72d6b
Update source and destination channel for osmosis testnet (#758) 2023-10-25 17:05:55 -03:00
ftocal d45addcd59
Fix csv transfer report (#764) 2023-10-24 17:11:37 -03:00