cloud-foundation-fabric/data-solutions
Julio Castillo c31764fa7e
Add lint step to check module READMEs (#154)
* Add documentation check to lint process

* Split get_variables_outputs

* Install tfdoc dependencies in linting pipeline

* doc lint variant

* use new script args in ci build config

* exit early if doc does not exist

* align README docs with variables

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2020-11-07 09:12:41 +01:00
..
cmek-via-centralized-kms Add lint step to check module READMEs (#154) 2020-11-07 09:12:41 +01:00
gcs-to-bq-with-dataflow remove version constraints from examples 2020-11-06 08:45:46 +01:00
README.md Fix 2020-06-30 16:53:41 +02:00

README.md

GCP Data Services examples

The examples in this folder implement typical data service topologies and end-to-end scenarios, that allow testing specific features like Cloud KMS to encrypt your data, or VPC-SC to mitigate data exfiltration.

They are meant to be used as minimal but complete starting points to create actual infrastructure, and as playgrounds to experiment with specific Google Cloud features.

Examples

GCE and GCS CMEK via centralized Cloud KMS

This example implements CMEK for GCS and GCE, via keys hosted in KMS running in a centralized project. The example shows the basic resources and permissions for the typical use case of application projects implementing encryption at rest via a centrally managed KMS service.

Cloud Storage to Bigquery with Cloud Dataflow

This example implements Cloud Storage to Bigquery data import using Cloud Dataflow. All resources use CMEK hosted in Cloud KMS running in a centralized project. The example shows the basic resources and permissions for the typical use case to read, transform and import data from Cloud Storage to Bigquery.