certusone
/
wormhole
mirror of https://github.com/certusone/wormhole.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
wormhole/event_database
History
justinschuldt 71dbe80aae BigTable historical queries 
- Add Cloud Functions:
  - "Recent" gap list, can filter and/or group by chain or address.
  - "Totals" counts 24h, 30d, rolling daily. can filter and group.
  - "Transaction" lookup row by chain-native transaction identifier.

- Pad sequence in rowkey to fixed length, for sequential row order.

- Add Cloud Function deploy instructions.

- Fix #410 Buildpack image cleanup

Change-Id: Ifa3110a3d58e2f94adb48ccb451c27ab3add0611
 		2021-10-13 16:20:10 +00:00
..
cloud_functions BigTable historical queries 2021-10-13 16:20:10 +00:00
README.md Add bigtable to devnet 2021-08-25 14:01:31 +00:00
database.go Write attestation events to BigTable 2021-08-23 09:54:28 -05:00
database_query.go Event database init script 2021-08-05 12:53:56 +00:00
database_setup.go Event database init script 2021-08-05 12:53:56 +00:00
devnet_key.json Add bigtable to devnet 2021-08-25 14:01:31 +00:00
go.mod BigTable historical queries 2021-10-13 16:20:10 +00:00
go.sum Event database init script 2021-08-05 12:53:56 +00:00

README.md

Initializing a cloud BigTable instance

Once you've created a BigTable instance and a Service Account key, these Go scripts can create the table and column families to save event data.

Pass your BigTable connection info via args:

  • the Google Cloud projectID
  • BigTable instance name
  • the path to a GCP Service Account with appropriate permissions

Invoke the script with the DB config options and -setupDB to create the table and column families, if they do not already exist. If they do already exists when the script runs, it will do nothing.

go run . \
  -project your-GCP-projectID \
  -instance your-BigTable-instance-name \
  -keyFilePath ./service-account-key.json \
  -setupDB

Querying cloud BigTable

Lookup a row by the EmitterChain:TxID:

go run . \
  -project wormhole-315720 \
  -instance wormhole \
  -keyFilePath ./bigtable-admin.json \
  -queryRowKey 2:000000000000000000000000e982e462b094850f12af94d21d470e21be9d0e9:6

Lookup all rows with a timestamp >= queryPreviousMinutes ago:

go run . \
  -project wormhole-315720 \
  -instance wormhole \
  -keyFilePath ./bigtable-admin.json \
  -queryPreviousMinutes 120