Commit Graph

5188 Commits

Author SHA1 Message Date
Amela Spica 8e86f0e108
Time zone support for CloudSQL SQL Server (#2107)
* time zone for SQL Server

* removed nl

* fix line
2024-02-25 20:49:13 +01:00
Wiktor Niesiobędzki 9a95ac10ed Once again fix e2e tests 2024-02-23 19:21:39 +01:00
Wiktor Niesiobędzki 8fd8ee0541 Fix too long project names on e2e tests 2024-02-23 11:41:58 +01:00
lcaggio 1c26c8f8a3
Module Data Catalog Tag - Add support for types (#2100)
* Add support for types

* implement feedback

* Remove display name field.
2024-02-22 11:51:54 +01:00
Ludovico Magnocavallo 220ab76e40
enable shielded nodes by default on GKE mt blueprint and FAST stage (#2105) 2024-02-22 07:35:27 +00:00
Saleh Elnagar 3450cd72d8
hotfix/dataproc-variables: fix type of kubernetes_software_config.component_version and properties (#2104)
* hotfix/dataproc-variables: fix type of kubernetes_software_config.component_version and properties

* add example of provisioning dataproc cluster on GKE

* Update README.md

* Update main.tf

* Update main.tf

* Update README

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-02-22 07:23:38 +00:00
Julio Castillo 8102803d2e
Update tutorial.md 2024-02-21 15:01:23 +01:00
tamartayar ca9cd16c8e
add session affinity values to variables-backend-service.tf (#2090)
Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-02-21 10:04:09 +01:00
Julio Castillo 5197d5ca8d
Allow projects as destinations for log sinks (#2102)
* Add project log sink destination to project module

* Add project log sink destination to folder module

* Add project log sink destination to organization module

* Fix typos

* Add project log sink destination to billing-account module

* Make filter field optional

* Update READMEs

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-02-21 08:41:13 +01:00
Ludo b72f7d34b5
Merge branch 'master' of github.com:GoogleCloudPlatform/cloud-foundation-fabric 2024-02-20 21:57:21 +01:00
Ludo f7d5a3b965
update changelog 2024-02-20 21:57:15 +01:00
Julio Castillo b82f008efc
Make all project_parent_ids fields optional (#2101) 2024-02-20 15:21:56 +00:00
Ludovico Magnocavallo 621719abc6
fix cors policy type in lb app ext modules (#2098) 2024-02-20 08:17:25 +01:00
Julio Castillo 38e6517fb2
Fix #2095 for regional load balancers (#2097) 2024-02-19 21:33:24 +00:00
Julio Castillo d4e12e1751
Do not convert route rules to set (#2096) 2024-02-19 22:14:02 +01:00
Thinh Ha 81ec6e6bc9
update README to add analytics hub module (#2094) 2024-02-19 16:07:57 +00:00
Thinh Ha 82f11e7ca5
add analytics hub module (#2087) 2024-02-19 15:55:00 +00:00
Ludovico Magnocavallo a45741d5d0
accept email in service account module name (#2091) 2024-02-19 12:43:04 +00:00
Ludovico Magnocavallo eb23bb62d2
Support domainless orgs in FAST (#2086)
* bootstrap

* align org policies to domainless enforced ones

* fix #2073

* fix tests

* fix team admin attribute in resman stage
2024-02-19 08:29:37 +00:00
Wiktor Niesiobędzki bee3072568
Add support for Cloud Run v2 jobs (#1954)
Add support for Cloud Run v2 jobs

* create a separate file for service creation (service.tf) and job
  (job.tf) - for easy comparison
* add E2E tests where possibile
* remove default value for input variable `region`
* fix subnet range VPC Access Connector example
* add creation of service account for audit logs call (trigger requires
  service account)
* use provided trigger service account email in
  `local.trigger_sa_email`, so explicitly provided SA is passed to
  trigger
* set default value for vpc_connector_create.throughput.max, to match
  what is set by GCP API, as provider uses wrong default of 300 which
  results in perma-diff
* create inventory fiels for all examples

Global changes
* (tests) add input variable `project_number`, to allow assigning IAM permissions to Service Accounts in fixtures
* (tests) fix not outputting the path, when object is not found in inventory
* (tests) fix `create_e2e_sandbox.sh` - now it properly finds root of the repo

Secret Manager
* added `version_versions` output, to allow specifying versions in other modules. `versions` is sensitive and it makes it unsuitable for `for_each` values

New test fixtures
* `pubsub.tf` - creating one topic
* `secret-credential.tf` - creating Secret Manager `credential` secret
* `shared-vpc.tf` - creating two projects (host and service), and vpc in host project
* `vpc-connector.tf` - creating VPC Access Connector instance
2024-02-18 14:57:34 +01:00
lcaggio 39b713385d
Fix data catalog tag module 2024-02-17 09:56:17 +00:00
Ludo 3ffd57473d
update changelog 2024-02-17 08:03:39 +01:00
Ludovico Magnocavallo 91615e0140
VPC-SC module factories (#2081)
* factory untested

* factory example test
2024-02-17 08:02:16 +01:00
Ludovico Magnocavallo b408494a74
Update main.tf (#2082) 2024-02-16 15:15:21 +01:00
Wiktor Niesiobędzki e02d871d58 fix handling default values 2024-02-15 21:57:47 +01:00
Wiktor Niesiobędzki b1956403d0 Fix missing region 2024-02-15 21:57:47 +01:00
Wiktor Niesiobędzki 19be54a72f Use Fabric modules when possibile 2024-02-15 21:57:47 +01:00
Ben Swenka d158aecba1 Clarifying that the default path --> Producer A 2024-02-15 18:27:26 +01:00
Ben Swenka 4513d7de0a Updated path matchers to be more user friendly, added better test examples in README.md 2024-02-15 18:27:26 +01:00
simonebruzzechesse d11c380aec
Format python files in blueprints (#2079)
* format python files in blueprints
* update check on blueprints python code
* update python linter in CI workflow
2024-02-15 09:37:49 +01:00
simonebruzzechesse 946ae148f7
Add workforce_identity_federation in 0-bootstrap (#2077)
* add workforce_identity_federation in 0-bootstrap
* update tests
2024-02-15 00:10:24 +01:00
Ben Swenka 87a350db93
Bswenka/psc glb and armor 2 producers (#2071)
* Enhanced this blueprint to add a second producer, and modularized the producer.

* Fixed terraform formatting

* Updating README.md with tfdoc

* Fixed test case conditions & module variable passing
2024-02-14 16:40:51 +01:00
lcaggio aa9b1479b7
Data catalog Tag module (#2060)
* First commit

* Update README

* Add todo

* Fix required_version
2024-02-13 17:24:17 +01:00
Ludovico Magnocavallo 47c3d0cb64
Update organization.tf
fix typos
2024-02-13 08:50:05 +01:00
Wiktor Niesiobędzki 72183be254 Use less conflicting IP 2024-02-13 07:40:31 +01:00
Wiktor Niesiobędzki b902b1dab9 Fix non-empty plan after apply 2024-02-13 07:40:31 +01:00
Ludovico Magnocavallo 20c5bc8444
Update 0-domainless-iam.md 2024-02-12 14:39:21 +01:00
Ludovico Magnocavallo 5c3507aa72
Update 0-domainless-iam.md 2024-02-12 14:39:03 +01:00
Ludovico Magnocavallo 4e77193c6a
Update 0-domainless-iam.md 2024-02-12 14:38:35 +01:00
Ludovico Magnocavallo 71a64487d5
Extend FAST to support different principal types (#2064)
* add doc draft

* typos

* typo

* typo

* typos

* rewording

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* move iam variables to a separate file

* move billing-account module to iam_principals

* move data-catalog-policy-tag module to iam_principals

* move dataplex-datascan module to iam_principals

* move dataproc module to iam_principals

* move folder module to iam_principals

* copyright

* move organization module to iam_principals

* move project module to iam_principals

* move source-repository module to iam_principals

* update blueprints for iam_principals interface

* FAST bootstrap

* module READMEs fixes

* FAST bootstrap

* FAST networking stages

* FAST security stage

* FAST gke stage

* FAST multitenant bootstrap stage

* FAST multitenant resman stage

* tfdoc

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* fix module test

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Rename iam_principals to iam_by_principals

* Update IAM template to include iam_by_principals

* Update Resman README

* Fix ADR link format

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-02-12 14:35:30 +01:00
Wiktor Niesiobędzki 3397d4cd52
Fix imports of org policies (#2065) 2024-02-11 07:22:11 +01:00
Ben Swenka 89779c0d0e
Bswenka/psc glb and armor subnet fix (#2058)
* Updated ilb-subnetwork issue

* Fixed Terraform formatting issue

* Fixing merge issue

* Fixing merge issue in producer.tf

* Fixed linting issues

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-02-09 10:41:14 +00:00
Wiktor Niesiobędzki 597579fa2b
HA MySQL cluster deployment on GKE (#2061)
* MySQL pattern on GKE

* Use terraform managed password

* Use hardcoded network references

* Explain why Cloud NAT

* Rename versions_override.tf

* Fix subnet reference

* Fix password

* Fix MysQL connect commands

* Remove self-link

* Update README.md

* Add TOC and Variables table

* Fix outputs

* Fix linter

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-02-09 11:23:35 +01:00
lcaggio 50c7d3c0e9
Add Tags in project output. (#2062) 2024-02-09 10:42:18 +01:00
Julio Castillo c42c4c141f
GKE stateful blueprints (#2059)
* var definitions

* skeleton, untested

* fix errors, test with existing cluster

* test vpc creation, todo notes

* initial variables for AR and image

* initial variables for AR and image

* Add support for remote repositories to artifact-registry

* Add support for virtual repositories to artifact-registry

* Add support for extra config options to artifact-registry

* artifact registry module: add validation and precondition, fix tests

* ar module id/name

* registry

* service accoutn and roles

* fetch pods, remove image prefix

* small changes

* use additive IAM at project level

* use additive IAM at project level

* configmaps

* manifests

* fix statefulset manifest

* service manifest

* fix configmap mode

* add todo

* job (broken)

* job

* wait on manifest, endpoints datasource

* fix job

* Fix local

* sa

* Update README.md

* Restructure gke bp

* refactor tree and infra variables

* no create test

* simplify cluster SA

* test cluster and vpc creation

* project creation fixes

* use iam_members variable

* nits

* readme with examples

* readme with examples

* outputs

* variables, provider configuration

* variables, manifests

* start cluster job

* fix redis cluster creation

Co-authored-by: Julio Castillo <juliocc@users.noreply.github.com>

* Revert changes in autopilot cluster

* Default templates path, use namespace for node names

* Update readmes

* Fix IAM bindings

* Make STABLE the default release channel

* Use Cloud DNS as default DNS provider

* Allow optional Cloud NAT creation

* Allow backup agent and proxy only subnet

* Work around terraform not short-circuiting logical operators

* Rename create variables to be more consistent with other blueprints

* Add basic features

* Update variable names

* Initial kafka JS

* Move providers to a new file

* Kafka / Strimzi

* First possibily working version for MySQL (with a lot of todo's left)

* Explicitly use proxy repo + some other fixes

* Strimzi draft

* Refactor variables, use CluterIP as pointer for mysql-router for bootstraping

* Validate number of replicas, autoscale required number of running nodes to n/2+1

* Use seaprate service for bootstrap, do not recreate all resources on change of replicas count as the config is preserved in PV

* Test dual chart kafka

* Update chart for kafka

* Expose basic kafka configuration options

* Remove unused manifest

* Added batch blueprint

* Added README

* switch to kubectl_manifest

* Add README and support for static IP address

* Move namespace creation to helm

* Interpolate kafka variables

* Rename kafka-strimzi to kafka

* Added TUTORIAL for cloudshell for batch blueprint

* deleted tutorial

* Remove commented replace trigger

* Move to helm chart

* WIP of Cloud Shell tutorial for MySQL

* Rename folders

* Fix rename

* Update paths

* Unify styles

* Update paths

* Add Readme links

* Update mysql tutorial

* Fix path according to self-link

* Use relative path to cwd

* Fix service_account variable location

* Fix tfvars creation

* Restore some fixes for helm deployment

* Add cluster deletion_prevention

* Fixes for tutorial

* Update cluster docs

* Fixes to batch tutorial

* Bare bones readme for batch

* Update batch readme

* README fixes

* Fix README title for redis

* Fix Typos

* Make it easy to pass variables from autopilot-cluster to other modules

* Add connectivity test and bastion host

* updates to readme, and gpu fix

* Add versions.tf and README updates

* Fix typo

* Kafka and Redis README updates

* Update versions.tf

* Fixes

* Add boilerplate

* Fix linting

* Move mysql to separate branch

* Update cloud shell links

* Fix broken link

---------

Co-authored-by: Ludo <ludomagno@google.com>
Co-authored-by: Daniel Marzini <44803752+danielmarzini@users.noreply.github.com>
Co-authored-by: Wiktor Niesiobędzki <wiktorn@google.com>
Co-authored-by: Miren Esnaola <mirene@google.com>
2024-02-08 18:28:41 +00:00
Wiktor Niesiobędzki da11396e3a Postpone setting essential contacts until it is done through SA 2024-02-07 20:08:44 +01:00
Wiktor Niesiobędzki 29232c10c4 Fix failing tests after Terraform upgrade 2024-02-07 17:25:11 +01:00
Wiktor Niesiobędzki c58e61e98e Introduce variable to disable imports, fix tests 2024-02-07 17:25:11 +01:00
Wiktor Niesiobędzki 2c9eb5795b Bum terraform to version 1.7.0 2024-02-07 17:25:11 +01:00
Wiktor Niesiobędzki ec3f314c08 Import default policies 2024-02-07 17:25:11 +01:00