cloud-foundation-fabric/blueprints/data-solutions/data-playground

Data Playground

This blueprint creates a minimum viable architecture for a data experimentation project with the needed APIs enabled, VPC and Firewall set in place, BigQuesy dataset, GCS bucket and an AI notebook to get started.

This is the high level diagram:

Managed resources and services

This sample creates several distinct groups of resources:

• project
• networking
  • VPC network with a default subnet and CloudNat
  • Firewall rules for SSH access via IAP and open communication within the VPC
• Vertex AI Workbench notebook configured with a private IP and using a dedicated Service Account
• One GCS bucket
• One BigQuery dataset

Deploy your enviroment

We assume the identiy running the following steps has the following role:

• resourcemanager.projectCreator in case a new project will be created.
• owner on the project in case you use an existing project.

Run Terraform init:

$ terraform init

Configure the Terraform variable in your terraform.tfvars file. You need to spefify at least the following variables:

prefix = "prefix"
project_id      = "data-001"

You can run now:

$ terraform apply

You can now connect to the Vertex AI notbook to perform your data analysy.

Variables

name	description	type	required	default
prefix	Unique prefix used for resource names. Not used for project if 'project_create' is null.	string	✓
project_id	Project id, references existing project if project_create is null.	string	✓
location	The location where resources will be deployed.	string		"EU"
project_create	Provide values if project creation is needed, uses existing project if null. Parent format: folders/folder_id or organizations/org_id	object({…})		null
region	The region where resources will be deployed.	string		"europe-west1"
vpc_config	Parameters to create a VPC.	object({…})		{…}

Outputs

name	description	sensitive
bucket	GCS Bucket URL.
dataset	GCS Bucket URL.
notebook	Vertex AI notebook details.
project	Project id
vpc	VPC Network