Commit Graph

1775 Commits

Author SHA1 Message Date
Saleh Elnagar 3450cd72d8
hotfix/dataproc-variables: fix type of kubernetes_software_config.component_version and properties (#2104)
* hotfix/dataproc-variables: fix type of kubernetes_software_config.component_version and properties

* add example of provisioning dataproc cluster on GKE

* Update README.md

* Update main.tf

* Update main.tf

* Update README

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-02-22 07:23:38 +00:00
tamartayar ca9cd16c8e
add session affinity values to variables-backend-service.tf (#2090)
Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-02-21 10:04:09 +01:00
Julio Castillo 5197d5ca8d
Allow projects as destinations for log sinks (#2102)
* Add project log sink destination to project module

* Add project log sink destination to folder module

* Add project log sink destination to organization module

* Fix typos

* Add project log sink destination to billing-account module

* Make filter field optional

* Update READMEs

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-02-21 08:41:13 +01:00
Ludovico Magnocavallo 621719abc6
fix cors policy type in lb app ext modules (#2098) 2024-02-20 08:17:25 +01:00
Julio Castillo 38e6517fb2
Fix #2095 for regional load balancers (#2097) 2024-02-19 21:33:24 +00:00
Julio Castillo d4e12e1751
Do not convert route rules to set (#2096) 2024-02-19 22:14:02 +01:00
Thinh Ha 81ec6e6bc9
update README to add analytics hub module (#2094) 2024-02-19 16:07:57 +00:00
Thinh Ha 82f11e7ca5
add analytics hub module (#2087) 2024-02-19 15:55:00 +00:00
Ludovico Magnocavallo a45741d5d0
accept email in service account module name (#2091) 2024-02-19 12:43:04 +00:00
Wiktor Niesiobędzki bee3072568
Add support for Cloud Run v2 jobs (#1954)
Add support for Cloud Run v2 jobs

* create a separate file for service creation (service.tf) and job
  (job.tf) - for easy comparison
* add E2E tests where possibile
* remove default value for input variable `region`
* fix subnet range VPC Access Connector example
* add creation of service account for audit logs call (trigger requires
  service account)
* use provided trigger service account email in
  `local.trigger_sa_email`, so explicitly provided SA is passed to
  trigger
* set default value for vpc_connector_create.throughput.max, to match
  what is set by GCP API, as provider uses wrong default of 300 which
  results in perma-diff
* create inventory fiels for all examples

Global changes
* (tests) add input variable `project_number`, to allow assigning IAM permissions to Service Accounts in fixtures
* (tests) fix not outputting the path, when object is not found in inventory
* (tests) fix `create_e2e_sandbox.sh` - now it properly finds root of the repo

Secret Manager
* added `version_versions` output, to allow specifying versions in other modules. `versions` is sensitive and it makes it unsuitable for `for_each` values

New test fixtures
* `pubsub.tf` - creating one topic
* `secret-credential.tf` - creating Secret Manager `credential` secret
* `shared-vpc.tf` - creating two projects (host and service), and vpc in host project
* `vpc-connector.tf` - creating VPC Access Connector instance
2024-02-18 14:57:34 +01:00
lcaggio 39b713385d
Fix data catalog tag module 2024-02-17 09:56:17 +00:00
Ludovico Magnocavallo 91615e0140
VPC-SC module factories (#2081)
* factory untested

* factory example test
2024-02-17 08:02:16 +01:00
lcaggio aa9b1479b7
Data catalog Tag module (#2060)
* First commit

* Update README

* Add todo

* Fix required_version
2024-02-13 17:24:17 +01:00
Wiktor Niesiobędzki 72183be254 Use less conflicting IP 2024-02-13 07:40:31 +01:00
Ludovico Magnocavallo 71a64487d5
Extend FAST to support different principal types (#2064)
* add doc draft

* typos

* typo

* typo

* typos

* rewording

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* move iam variables to a separate file

* move billing-account module to iam_principals

* move data-catalog-policy-tag module to iam_principals

* move dataplex-datascan module to iam_principals

* move dataproc module to iam_principals

* move folder module to iam_principals

* copyright

* move organization module to iam_principals

* move project module to iam_principals

* move source-repository module to iam_principals

* update blueprints for iam_principals interface

* FAST bootstrap

* module READMEs fixes

* FAST bootstrap

* FAST networking stages

* FAST security stage

* FAST gke stage

* FAST multitenant bootstrap stage

* FAST multitenant resman stage

* tfdoc

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* fix module test

* Update 0-domainless-iam.md

* Update 0-domainless-iam.md

* Rename iam_principals to iam_by_principals

* Update IAM template to include iam_by_principals

* Update Resman README

* Fix ADR link format

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-02-12 14:35:30 +01:00
lcaggio 50c7d3c0e9
Add Tags in project output. (#2062) 2024-02-09 10:42:18 +01:00
Wiktor Niesiobędzki 2c9eb5795b Bum terraform to version 1.7.0 2024-02-07 17:25:11 +01:00
luigi-bitonti cb9a9ab373
Added destroy_scheduled_duration variable (#2053)
* Added destroy_scheduled_duration variable

* Fix doc

* Removed default value
2024-02-07 15:47:49 +00:00
Deepak Kumar 27e503a3ac
fix: auto_provisioning_defaults is not really optional (#2051)
Due to the disk_type validation for auto provision node pool,
this module always forced to create a GKE standard cluster
with a auto provisioned node pool. This is not desirable if
you manage pools separately like using the `gke-nodepool`.
2024-02-06 07:09:13 +01:00
Harald Haas dda0250c4c
Fix dnssec_config issue on state off (#2035) 2024-02-01 06:53:32 +00:00
Ludovico Magnocavallo 01c7f806ce
Selectively enable logging in FAST and firewall policy module rules (#2032)
* use logging in firewall policy module examples

* enable logging for selected hierarchical firewall rules
2024-01-31 09:50:35 +01:00
Julio Castillo da95434308
logging for default ingress rules in FAST (#2030)
* Add default ingress deny rule with logging to FAST net stages.

Fixes #2024

* Allow firewall factory to omit rules key

* Fix tests

* Fix fast tests

* fix fast tests
2024-01-30 16:53:01 +00:00
shourya116 7b58114d65
Updated the DataQualitySpec for Dataplex Datascan (#2008)
* Updated the DataQualitySpec for Dataplex Datascan

* Fix linting

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2024-01-30 15:14:49 +00:00
lcaggio 37fc16ab42
Fix tests in README (#2027) 2024-01-30 11:04:47 +00:00
Ludovico Magnocavallo bf93b6fb4e
fix typo in logging sinks interface (#2015) 2024-01-28 10:27:28 +01:00
lcaggio 19dc6090fc
Add Tag Template module (#2013)
* Tag policy module

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-01-27 12:30:21 +01:00
Blake Corbitt 9c1afa6261
Issue #2011 - add support for target_resources in hierarchical policy for net-firewall-policy module. (#2012)
* Issue #2011 - Add support for target_resources in hierarchical firewall policy

* Removing errant character in factory.tf
2024-01-25 17:56:17 +00:00
Amela Spica 1a8400e60e
Fixes and additional support for ssl_mode for CloudSQL module (#2002)
* added ssl mode, ignore password change and maintenance fix

* validation - ssl mode can be null

* removed ignore password

* readme update

* added moved, shortened ssl_mode desc

* order fix

* fmt

* created ssl variable

* handle exceptions

* removed null from optional

* change ssl from null to empty object

* output ordered alphabetically

* readme update

* default value of require_ssl
2024-01-25 16:29:07 +01:00
Ludovico Magnocavallo 6d9b6403dd
add support for essential contacts to FAST (#2010) 2024-01-25 12:20:14 +01:00
Ludovico Magnocavallo c5416f3af1
Tighten up security of automation project (CSPR-related) (#2009)
* enforce compute/iam policies on the automation project

* tests
2024-01-24 18:40:36 +00:00
marcjwo 6b4dad01d6
Marcwo/dataform module (#2001)
* pre PR commit

* added IAM functionality

* clean up of readme

* versions.tf fix

* added separate iam.tf, facilitated existing secret manager module

* corrected optional variable defaults

* adjusted readme to new changes

* adjusted tftest line in readme for changed example

* reverted the module back to a state where it only manages one instance

* minor fix for main readme.md

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-01-24 17:13:21 +01:00
Miro Michalicka 15439c3f5b
Fix named ranges behaviour if cidr_tpl_file variable not provided. (#2005)
* Fix named ranges behaviour if cidr_tpl_file variable not provided.

* Fix and extend tests.

* fix map syntax

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-01-24 11:18:11 +00:00
Wiktor Niesiobędzki 526185fd1f
Remove default region for Cloud Function and Cloud Run (#2004)
Remove default region for Cloud Function and Cloud Run
2024-01-24 10:23:40 +00:00
Wiktor Niesiobędzki 277777d1c7
Fix DNS E2E test + add one to net-lb-app-int-cross-region (#1993)
* Fix DNS E2E test + add one to net-lb-app-int-cross-region

* Update README.md

* Fix inventory for tests

* Fix tests

* Fix number of resources

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-01-23 16:34:45 +01:00
luigi-bitonti 0ef7ee4670
Added beta apis feature (#1999) 2024-01-23 11:09:22 +00:00
Ludovico Magnocavallo 37dc48bca4
fix factory type for firewall rule ports (#1996) 2024-01-21 12:38:24 +01:00
dibaskar-google 4ed738688a
dns reponse policy e2e changes (#1994)
dns reponse policy e2e changes
2024-01-20 19:47:02 +01:00
Ludovico Magnocavallo 11d7edac64
Add example to FAST GKE stage, streamline GKE Hub module variables and usage (#1977)
* implement optionals in gke-hub module

* simplify gke hub module call in mc mesh blueprint

* simplify gke hub module call and variables in multitenant blueprint

* gke hub inventory

* provide cluster and fleet examples in stage
2024-01-20 10:06:38 +00:00
Deepak Kumar d62012cebc
Specify `docker_repository` field for google_cloudfunctions2_function (#1987)
* fix: allow configuring `docker_repository` for cloud-function2

When docker repository is not specified by default docker repository
`projects/PROJECT_ID/locations/REGION/repositories/gcf-artifacts` is used.
In such a case, terraform plan always generates a difference for `docker_repository`
field as the module passes null value but the tfstate file has the above specified
default value. This fix allows one to prevent unnecessary infrastructure change when
using the default repository as well as any user created repository.

* doc: updated README for cloud-function-v2

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-01-20 09:40:26 +00:00
Wiktor Niesiobędzki 09176feaec
Fix typo in example 2024-01-18 19:46:53 +01:00
apichick 228a4a82c3 Fixed README and test for dns module 2024-01-18 19:04:03 +01:00
apichick 4bf394a916 Added health checked targets for geo routing policy in dns module
Added health checked targets for geo routing policy in dns module
2024-01-18 16:39:56 +01:00
Tahar JEGHAM 1c99bae649
feat: enable mtls on external application application load balancer (#1979)
* feat: enable mtls on external application application load balancer

* refactor: move variable inside https_proxy_config block

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-01-17 06:24:54 +00:00
Luca Prete bc506795f2
compute-vm: add resource manager tags support for instance templates (#1982) 2024-01-16 17:40:15 +00:00
apichick 5ba54aeaf7 Added Cross-region internal application load balancer module 2024-01-16 17:54:50 +01:00
Viliam Pucik 5372361b8c
Proper validation of empty string value in identity_type (#1980) 2024-01-16 10:28:30 +01:00
Viliam Pucik 19eb247849
Fix identity_type (#1978)
* Allow empty string for 'identity_type' supported by Google provider and use correct value name for ingress 'identity_type'

* Sanitizing variables as the logical operators in Terraform do not short-circuit.
2024-01-15 20:40:06 +00:00
luigi-bitonti cec11d2d55
Add support for service_external_ips_config to GKE cluster modules (#1970)
* Added variable in gke standard and autopilot modules

* Changed variable position

* Added dynamic block
2024-01-12 11:50:53 +01:00
Julio Castillo 46f437fd5d
use provided SA for cloud function v2 trigger (#1968) 2024-01-08 16:39:01 +00:00
Jan Toth d1746b8bd1
Support for ANY_USER_ACCOUNT in module vpc-sc egress rule. (#1966) 2024-01-08 14:23:07 +01:00
Wiktor Niesiobędzki af41e0fe38 Use fixtures in net-lb-ext 2024-01-06 17:09:49 +01:00
Jason Steenblik e10664984e
Create bigtable service identity with project if api is enabled (#1958) 2024-01-06 16:38:08 +01:00
Wiktor Niesiobędzki 39822888ad Add support for subnetwork for external addresses
For IPv6 it is necessary to provide subnetwork when reserving external
address.
2024-01-06 14:02:52 +01:00
Wiktor Niesiobędzki b92135a56d Remove null address for PSC
null address results in following error:
Error creating GlobalAddress: googleapi: Error 400: Invalid value for field 'resource.address': ''. The field is not a valid IP address or does not match the given prefix length, invalid
2024-01-06 14:02:52 +01:00
Wiktor Niesiobędzki 3470661993 IPv6 address reservation not supported for ILB
Error creating Address: googleapi: Error 400: Invalid value for field 'resource.purpose': 'SHARED_LOADBALANCER_VIP'. Shared LoadBalancer VIP IPv6 address reservation is not supported., invalid
2024-01-06 14:02:52 +01:00
Wiktor Niesiobędzki 8afdf66a09 Add end-to-end tests for net-address 2024-01-06 14:02:52 +01:00
Wiktor Niesiobędzki 0e39676c99 Remove tier for internall addresses
Error creating Address: googleapi: Error 400: Invalid value for field 'resource.networkTier': 'STANDARD'. An address with type INTERNAL cannot have a network tier., invalid
2024-01-06 14:02:52 +01:00
Wiktor Niesiobędzki 2a66fcab2e Fix HTTP to HTTPS example 2024-01-06 12:05:53 +01:00
Wiktor Niesiobędzki 05dd4b89b6 Enable E2E tests for net-lb-app-ext-regional
HTTP to HTTPS needs work, now fails with:
Error: Error creating ForwardingRule: googleapi: Error 400: Invalid value for field 'resource.IPAddress': '34.160.52.156'. Invalid IP address specified., invalid

  with module.ralb-test-0-redirect.google_compute_forwarding_rule.default,
  on fabric/modules/net-lb-app-ext-regional/main.tf line 32, in resource "google_compute_forwarding_rule" "default":
  32: resource "google_compute_forwarding_rule" "default" {
2024-01-06 12:05:53 +01:00
Wiktor Niesiobędzki a6e377fad2 Rename compute-mig-bc.tf to compute-vm-group-bc.tf 2024-01-06 12:05:53 +01:00
Julio Castillo 4e6d65b466
Update README.md 2024-01-05 17:30:34 +01:00
Julio Castillo 8beb621e07
New module for external regional application load balancer (#1892)
* Initial version of regional external application load balancer.

* Fix tests

* Remove unsupported features in regional app lbs

* update readme with fixtures

* Add ssl-certificate fixture

* Switch examples to regions b c

* Remove redundant NEG examples

* Update README

* Update versions.tf

* Add missing boilerplate
2024-01-05 16:59:27 +01:00
Stefano Tribioli 0ca3203e52 Capitalize Private Network Access 2024-01-05 15:05:32 +00:00
Stefano Tribioli a4def10c19 Add PNA support to Service Directory module
Endpoints in Service Directory can be *associated* with a
VPC. In this case, they can be used by supported Google
Cloud products to send requests directly to resources inside
a VPC. This feature is called Private Network Access.

The `google_service_directory_endpoint` resource supports
this configuration with a new argument `network`.
Unfortunately, this argument has an unusual format: it
is similar to a standard VPC ID, but instead of the project ID,
it expects the project number.
2024-01-05 15:05:32 +00:00
Julio Castillo c13a192755
Use zones b and c for MIG fixture (#1961) 2024-01-05 15:02:12 +00:00
Julio Castillo cc079e3a32
net-lb-app-ext example fixes (#1959)
* Fix typos

* Small fixes net-lb-app-ext examples
2024-01-05 13:38:30 +00:00
Andy Bubune Amewuda 3edacd0aba Add e2e test for net_lb_app_ext module 2024-01-05 10:02:23 +01:00
Jason Steenblik 22e9e9e950
Support CMEK encryption on Bigtable instances. (#1956) 2024-01-05 09:29:36 +01:00
Julio Castillo fde7b76036
Allow per-module terraform fixtures (#1914)
* Allow terraform fixtures for examples

* Allow defining multiple fixtures, and named fixtures under tests/fixtures/

* Enable e2e for wiktorn

* Fix prepare_files call for e2e

* Move fixture to separate file, fix test

* Revert shallow-copying symlinks, performane penalty - 20%

* Update tfdoc.py to list used fixtures

---------

Co-authored-by: Wiktor Niesiobędzki <wiktorn@google.com>
2023-12-29 09:43:44 +00:00
Julio Diez 9a7c600b6f
Merge branch 'master' into 1849-implement-cloud-run-module-version-2 2023-12-26 11:52:42 +01:00
Julio Diez 81814c3e4e Links to the new module in READMEs 2023-12-26 11:52:13 +01:00
Wiktor Niesiobędzki a5ce58ea22 tfdoc 2023-12-25 08:42:22 +00:00
Wiktor Niesiobędzki a2a767a027 Doc fixes 2023-12-25 08:39:52 +00:00
dibaskar-google 969111f0cf
dns e2e tests (#1944) 2023-12-23 10:29:32 +00:00
Julio Diez 3b7724053b
Merge branch 'master' into 1849-implement-cloud-run-module-version-2 2023-12-22 11:45:56 +01:00
Luca Prete 44b1115b9f
Fix GCVE network policy (#1948)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-12-22 10:29:43 +00:00
Luca Prete 06b2a97291
GCVE: add network policy configuration 2023-12-22 10:02:12 +00:00
Julio Diez fd451c3451 Align with default versions file 2023-12-22 11:01:41 +01:00
Julio Diez f784f47528
Merge branch 'master' into 1849-implement-cloud-run-module-version-2 2023-12-21 22:11:20 +01:00
Julio Diez d08541159d Update README 2023-12-21 22:09:47 +01:00
Luca Prete df5c02aa1e
Minor fix to GCVE module readme (#1946)
Co-authored-by: Luca Prete <lucaprete@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>
2023-12-21 18:29:30 +01:00
Luca Prete c4123044b7
Use new resources in GCVE module, bump up provider versions (#1941) 2023-12-21 13:23:38 +00:00
Wiktor Niesiobędzki 110fd798a7
Fix always succeding test (#1937)
Co-authored-by: Julio Castillo <jccb@google.com>
2023-12-21 11:01:08 +00:00
Julio Diez a04f59852f
Merge branch 'master' into 1849-implement-cloud-run-module-version-2 2023-12-20 18:17:15 +01:00
Simone Ruffilli 0255c80e90
Move squid to __need_fixing (#1936)
* Moved `modules/cloud-config-container/squid` to __need_fixing
* Moved `blueprints/networking/filtering-proxy{,-psc}` to __need_fixing
2023-12-19 14:27:37 +00:00
Wiktor Niesiobędzki 0d486fb34e E2E tests fixes 2023-12-19 11:01:03 +01:00
Julio Castillo 01bd0b7b01
Add project-scoped secure tags (#1933) 2023-12-18 18:24:05 +01:00
Julio Castillo b6e0557bbb
Simplify organization tags.tf locals (#1932)
* Simplify organization tags.tf locals

* Fix boilerplate

* Override github provider version for tests
2023-12-18 16:09:22 +00:00
Simone Ruffilli c5da6b99c3
Fixes typo in README.md 2023-12-18 15:40:16 +01:00
Julio Diez 88b91cdaee Move VPC connector management to specific files 2023-12-18 11:53:28 +01:00
Julio Diez 4c9243017c Rename attribute secret.secret to secret.name 2023-12-18 11:42:57 +01:00
Julio Diez bc4f89d9dc Remove 'traffic' variable, the module is not intended to manage rollouts 2023-12-18 11:39:28 +01:00
simonebruzzechesse c50b732c79
Allow granting network user role on host project from project module and factory (#1930)
* Update shared vpc config for project factory and project module for more granular Shared VPC configuration

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-12-15 14:39:21 +01:00
Simone Ruffilli db31c1b8aa Fixes example in cloud-config-container/squid 2023-12-15 12:31:08 +01:00
Julio Diez c599717856 Refactor the interface 2023-12-14 08:44:51 +01:00
Ludovico Magnocavallo 537237edd6
Fix health check autocreation and id output in passthrough LB modules (#1928)
* fix health check autocreation and id output

* fix health check exclusion
2023-12-13 23:39:55 +00:00
Simone Ruffilli ca3c86cb5c
Add support for policy based routes to net-vpc (#1926)
* Add support for PBR to net-vpc
2023-12-13 15:19:40 +00:00
Thomas Colomb 201ff284f6
gke-cluster-standard : Support upgrade_settings for node auto provisioner (#1905)
* gke-cluster-standard : Support upgrade_settings for node auto provisionner

* implement suggestions

* tfdoc

---------

Co-authored-by: Ludo <ludomagno@google.com>
2023-12-12 19:17:51 +00:00
luigi-bitonti ef4095f000
Removed deprecated variable and added labels (#1923)
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-12-12 18:32:48 +00:00
Simone Ruffilli f293847077
can_ip_forward in simple-nva examples (#1922) 2023-12-12 13:09:58 +00:00