wormhole-explorer/parser
walker-16 cbb7956f90
Feature/refactor parser to use sns sqs (#148)
* Add README to configurate SNS and subscribe with parser FIFO SQS

* Remove producer and watcher, handler new queue vaa event message
2023-02-16 10:55:54 -03:00
..
cmd Feature/refactor parser to use sns sqs (#148) 2023-02-16 10:55:54 -03:00
config Feature/refactor parser to use sns sqs (#148) 2023-02-16 10:55:54 -03:00
consumer Feature/refactor parser to use sns sqs (#148) 2023-02-16 10:55:54 -03:00
http/infrastructure Improve logs for health/ready endpoints (#133) 2023-02-03 15:58:58 -03:00
internal Feature/refactor parser to use sns sqs (#148) 2023-02-16 10:55:54 -03:00
parser Feature/add parser pipeline (#46) 2023-01-18 12:42:14 -03:00
queue Feature/refactor parser to use sns sqs (#148) 2023-02-16 10:55:54 -03:00
.env.example Feature/add parser pipeline (#46) 2023-01-18 12:42:14 -03:00
.gitignore Feature/add parser pipeline (#46) 2023-01-18 12:42:14 -03:00
Dockerfile Add k8s deployment for parser (#63) 2023-01-19 12:42:18 -03:00
Makefile create cicd pipeline for deployments to staging environment - step 1 (#71) 2023-01-23 18:41:19 -03:00
README.md Feature/refactor parser to use sns sqs (#148) 2023-02-16 10:55:54 -03:00
go.mod Change aws sdk to v2, to fix memory leak long pooling (#95) 2023-01-26 14:15:39 -03:00
go.sum Change aws sdk to v2, to fix memory leak long pooling (#95) 2023-01-26 14:15:39 -03:00

README.md

Parser

Config sns topic

aws --profile localstack --endpoint-url=http://localhost:4566 sns create-topic --name vaas-pipeline.fifo --attributes FifoTopic=true,ContentBasedDeduplication=false

Config SQS FIFO with dead letter queue localstack

aws --profile localstack --endpoint-url=http://localhost:4566 sqs create-queue --queue-name=wormhole-vaa-parser-dlq-queue.fifo --attributes "FifoQueue=true"

aws --profile localstack --endpoint-url=http://localhost:4566 sqs create-queue --queue-name=wormhole-vaa-parser-queue.fifo --attributes FifoQueue=true,MessageRetentionPeriod=3600,ReceiveMessageWaitTimeSeconds=5,VisibilityTimeout=20,RedrivePolicy=""{\"deadLetterTargetArn\":\"arn:aws:sqs:us-east-1:000000000000:wormhole-vaa-parser-dlq-queue.fifo\",\"maxReceiveCount\":\"2\"}""

Subscribe SQS FIFO to vaas-pipeline.fifo topic

aws --profile localstack --endpoint-url=http://localhost:4566 sns subscribe --topic-arn arn:aws:sns:us-east-1:000000000000:vaas-pipeline.fifo --protocol sqs --notification-endpoint http://localhost:4566/000000000000/wormhole-vaa-parser-queue.fifo

Check message in the dead letter queue localstack

aws --profile localstack --endpoint-url=http://localhost:4566 sqs receive-message --queue-url=http://localhost:4566/000000000000/wormhole-vaa-parser-dlq-queue.fifo