wormhole-explorer/analytics
ftocal 688a0d0f71
Store duplicate vaas on a secondary collection (#1308)
* Add support to scroll in tx-tracker

* Handle duplicated vaa in fly

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Modify tx-tracker and pipeline to support duplicated vaas
Co-authored-by: ftocal <fert1335@gmail.com>

* Add isDuplicated flag in vaas and operations endpoints
Add new endpoint to find duplicated vaas by vaa id
Co-authored-by: walker-16 <agpazos85@gmail.com>

* Add metrics for duplicated vaas

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Update node dependencies in spy

Co-authored-by: walker-16 <agpazos85@gmail.com>

* Fix promethes metrics for missing tx-hash in tx-tracker

Co-authored-by: walker-16 <agpazos85@gmail.com>

---------

Co-authored-by: Agustin Pazos <agpazos85@gmail.com>
2024-04-22 14:26:07 -03:00
..
cmd Handle unproccessable response from vaa-payload-parser (#1250) 2024-03-26 11:53:11 -03:00
config Integrating blockchain watcher data into mongodb (#820) 2023-11-27 12:31:35 -03:00
consumer Handle unproccessable response from vaa-payload-parser (#1250) 2024-03-26 11:53:11 -03:00
http Integrating blockchain watcher data into mongodb (#820) 2023-11-27 12:31:35 -03:00
internal/metrics Handle unproccessable response from vaa-payload-parser (#1250) 2024-03-26 11:53:11 -03:00
metric Ignore vaa older than 30 days for vaa_count metric (#1212) 2024-03-12 12:21:13 -03:00
parser Fix and refactor of analytics (#376) 2023-06-01 16:32:00 -03:00
prices Fix use correct date to obtain prices (#983) 2024-01-12 12:32:31 -03:00
queue Handle unproccessable response from vaa-payload-parser (#1250) 2024-03-26 11:53:11 -03:00
scripts [ISSUE-1089] Collect CCTP - Metrics (#1165) 2024-03-11 17:33:36 -03:00
support Fix and refactor of analytics (#376) 2023-06-01 16:32:00 -03:00
.env.example Fix and refactor of analytics (#376) 2023-06-01 16:32:00 -03:00
.gitignore Fix and refactor of analytics (#376) 2023-06-01 16:32:00 -03:00
Dockerfile Fix and refactor of analytics (#376) 2023-06-01 16:32:00 -03:00
Makefile Fix and refactor of analytics (#376) 2023-06-01 16:32:00 -03:00
README.md Fix and refactor of analytics (#376) 2023-06-01 16:32:00 -03:00
go.mod Store duplicate vaas on a secondary collection (#1308) 2024-04-22 14:26:07 -03:00
go.sum Store duplicate vaas on a secondary collection (#1308) 2024-04-22 14:26:07 -03:00

README.md

Config sns topic

aws --profile localstack --endpoint-url=http://localhost:4566 sns create-topic --name vaas-pipeline.fifo --attributes FifoTopic=true,ContentBasedDeduplication=false

Config SQS FIFO with dead letter queue localstack

aws --profile localstack --endpoint-url=http://localhost:4566 sqs create-queue --queue-name=wormhole-vaa-analytic-dlq-queue.fifo --attributes "FifoQueue=true"

aws --profile localstack --endpoint-url=http://localhost:4566 sqs create-queue --queue-name=wormhole-vaa-analytic-queue.fifo --attributes FifoQueue=true,MessageRetentionPeriod=3600,ReceiveMessageWaitTimeSeconds=5,VisibilityTimeout=20,RedrivePolicy=""{\"deadLetterTargetArn\":\"arn:aws:sqs:us-east-1:000000000000:wormhole-vaa-analytic-dlq-queue.fifo\",\"maxReceiveCount\":\"2\"}""

Subscribe SQS FIFO to vaas-pipeline.fifo topic

aws --profile localstack --endpoint-url=http://localhost:4566 sns subscribe --topic-arn arn:aws:sns:us-east-1:000000000000:vaas-pipeline.fifo --protocol sqs --notification-endpoint http://localhost:4566/000000000000/wormhole-vaa-analytic-queue.fifo

Check message in the dead letter queue localstack

aws --profile localstack --endpoint-url=http://localhost:4566 sqs receive-message --queue-url=http://localhost:4566/000000000000/wormhole-vaa-analytic-dlq-queue.fifo