zecfoundation
/
cloud-foundation-fabric
mirror of https://github.com/ZcashFoundation/cloud-foundation-fabric.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update README 

Update README to fix commands and required roles.
This commit is contained in:
lcaggio 2022-01-19 11:34:46 +01:00 committed by GitHub
parent 13f9fdc169
commit 2f78de944c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 14 additions and 11 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

25
examples/data-solutions/gcs-to-bq-with-least-privileges/README.md
View File

@ -47,6 +47,10 @@ In this example you can also configure users or group of user to assign them vie
## Deploy your enviroment ## Deploy your enviroment
We assume the identiy running the following steps has the following role:
- `resourcemanager.projectCreator` in case a new project will be created.
- `owner` on the project in case you use an exiting project.
Run Terraform init: Run Terraform init:
``` ```
@ -56,10 +60,9 @@ $ terraform init
Configure the Terraform variable in your `terraform.tfvars` file. You need to spefify at least the following variables: Configure the Terraform variable in your `terraform.tfvars` file. You need to spefify at least the following variables:
``` ```
billing_account = "0011322-334455-667788" data_eng_principals = ["user:data-eng@domain.com"]
root_node = "folders/123456789012" project_id = "datalake-001"
project_name = "test-demo-tf-001" prefix = "prefix"
data_eng_users = ["your_email@domani.example"]
``` ```
You can run now: You can run now:
@ -105,15 +108,15 @@ gcloud --impersonate-service-account=orch-test@PROJECT.iam.gserviceaccount.com d
--region REGION \ --region REGION \
--disable-public-ips \ --disable-public-ips \
--subnetwork https://www.googleapis.com/compute/v1/projects/PROJECT/regions/REGION/subnetworks/subnet \ --subnetwork https://www.googleapis.com/compute/v1/projects/PROJECT/regions/REGION/subnetworks/subnet \
--staging-location gs://PROJECT-eu-df-tmplocation \ --staging-location gs://PREFIX-df-tmp \
--service-account-email df-test@PROJECT.iam.gserviceaccount.com \ --service-account-email df-loading@PROJECT.iam.gserviceaccount.com \
--parameters \ --parameters \
javascriptTextTransformFunctionName=transform,\ javascriptTextTransformFunctionName=transform,\
JSONPath=gs://PROJECT-eu-data/person_schema.json,\ JSONPath=gs://PREFIX-data/person_schema.json,\
javascriptTextTransformGcsPath=gs://PROJECT-eu-data/person_udf.js,\ javascriptTextTransformGcsPath=gs://PREFIX-data/person_udf.js,\
inputFilePattern=gs://PROJECT-eu-data/person.csv,\ inputFilePattern=gs://PREFIX-data/person.csv,\
outputTable=PROJECT:bq_dataset.person,\ outputTable=PROJECT:datalake.person,\
bigQueryLoadingTemporaryDirectory=gs://PROJECT-eu-df-tmplocation bigQueryLoadingTemporaryDirectory=gs://PREFIX-df-tmp
``` ```
You can check data imported into Google BigQuery using the command returned in the terraform output as `command-03-bq`. Below an example: You can check data imported into Google BigQuery using the command returned in the terraform output as `command-03-bq`. Below an example: