Commit Graph

766 Commits

Author SHA1 Message Date
Wiktor Niesiobędzki 526185fd1f
Remove default region for Cloud Function and Cloud Run (#2004)
Remove default region for Cloud Function and Cloud Run
2024-01-24 10:23:40 +00:00
Ludovico Magnocavallo 11d7edac64
Add example to FAST GKE stage, streamline GKE Hub module variables and usage (#1977)
* implement optionals in gke-hub module

* simplify gke hub module call in mc mesh blueprint

* simplify gke hub module call and variables in multitenant blueprint

* gke hub inventory

* provide cluster and fleet examples in stage
2024-01-20 10:06:38 +00:00
lcaggio 208902c8da
Fix Data platform foundation (#1992)
* FAST + Minimal DP

* Fix tests

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2024-01-20 08:49:46 +01:00
Aurélien Legrand eee6aaff2c
Network dashboard - fixing 2 bugs: overriden variable and page token … (#1976)
* Network dashboard - fixing 2 bugs: overriden variable and page token not handled properly

* changing pageToken in the regexp
2024-01-15 14:28:17 +01:00
Julio Diez e623fa4a66
Merge branch 'master' into jd/serverless-program 2024-01-05 21:49:12 +01:00
Julio Diez 8435ad85f3 Address some style comments 2024-01-05 21:48:02 +01:00
Wiktor Niesiobędzki 6c258e6562 Fix description 2023-12-29 12:09:16 +01:00
Wiktor Niesiobędzki 1eea077460 Add service account email to outputs to manage its permissions 2023-12-29 12:09:16 +01:00
Wiktor Niesiobędzki 724dfda09c Provider doesn't set defaults on config
Can't provide just one size (like `web_server` or `triggerrer`) because
of no defaults are taken:
module.composer.google_composer_environment.env: Modifying... [id=***]
╷
│ Error: googleapi: Error 400: Found 6 problems:
│       1) You have to specify Scheduler CPUs not lower than 0.5.
│       2) You have to specify number of schedulers larger than 0.
│       3) You have to specify Web Server CPUs not lower than 0.5.
│       4) You have to specify Worker CPUs not lower than 0.5.
│       5) You have to specify minimum number of workers larger than 0.
│       6) Triggerer memory must be between 1.00GB and 6.50GB for given vCpu

So provide the defaults as set workloads_config == null
2023-12-29 12:09:16 +01:00
Julio Diez 6bad85d758 Update related serverless READMEs 2023-12-29 11:14:16 +01:00
Julio Diez 3685eb8493 Fix tftest values 2023-12-28 20:30:10 +01:00
Julio Diez bae9845f4b Update README 2023-12-28 20:06:11 +01:00
Julio Diez 2e500c69a7 Avoid permadiff in launch_stage 2023-12-28 17:57:15 +01:00
Julio Diez 2ca24d320e Use of new module cloud-run-v2 2023-12-28 17:30:41 +01:00
Julio Diez 8889c18690
Merge branch 'master' into jd/serverless-program 2023-12-27 12:31:09 +01:00
Simone Ruffilli 87548f9739
Networking Sandbox Blueprint (#1939)
This blueprint creates a networking playground showing a number of different VPC connectivity options:

Hub and spoke via HA VPN
Hub and spoke via VPC peering
Interconnecting two networks via a network virtual appliance (aka NVA)
On top of that, this blueprint implements Policy Based Routing (aka PBR) to show how to force all traffic within a VPC to be funneled through an internal network passthrough load balancer, to implement an Intrusion Prevention System (IPS). PBR is enabled in the hub VPC, matching all traffic originating from within that VPC.
2023-12-21 17:50:38 +01:00
simonebruzzechesse 717f7ecad1
Blueprints naming convention update (#1942)
* update network-dashboard and quota-monitoring naming convention
2023-12-21 17:02:25 +01:00
Simone Ruffilli 0255c80e90
Move squid to __need_fixing (#1936)
* Moved `modules/cloud-config-container/squid` to __need_fixing
* Moved `blueprints/networking/filtering-proxy{,-psc}` to __need_fixing
2023-12-19 14:27:37 +00:00
Ludovico Magnocavallo 21562eefbe
don't fail quota fetch on deleted project (#1931) 2023-12-15 20:20:49 +01:00
simonebruzzechesse c50b732c79
Allow granting network user role on host project from project module and factory (#1930)
* Update shared vpc config for project factory and project module for more granular Shared VPC configuration

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-12-15 14:39:21 +01:00
maunope 1dc6965694
Update quota monitor blueprint to support project discovery (#1924)
* fist test

* dev complete

* update tf with permissions, enabled APIs and discovery root management

* updated readme

* moved projects discovery to a separate method

* reviewed Mauri's changes

* add missing lines from last change

* - fixed discovery page size to 100
- removed last_asset_page_reached var from discover_projects
- added cast to list for projects var in _main, to make the script work both using CLI and pub/sub

* fixed discovery_root default value to work when no value is passed

* fixed tfdoc

* fixed tftest resources #

---------

Co-authored-by: Ludo <ludomagno@google.com>
2023-12-12 19:17:01 +01:00
Ludovico Magnocavallo bba814c091
Custom role factories for organization and project modules (#1912)
* backport custom role factories

* backport from fast ci/cd branch

* indent

* tfdoc

* fix module tests
2023-12-11 14:16:39 +00:00
Wiktor Niesiobędzki 886734e1e9
Add trigger configuration for Composer (#1916) 2023-12-11 12:54:49 +01:00
Ludovico Magnocavallo f548b65b1c
Add support for subnet-level service network user grants to project module, improve docs (#1907)
* improve project factory example

* light refactor of project modules shared vpc internals and docs

* add support for subnet-level grants on host project
2023-12-07 09:07:48 +00:00
apichick 66bd9d5160 Added workstation-cluster module 2023-11-30 07:02:28 +01:00
Luca Prete bb58469292
Fixes to F5 blueprint docs (#1886)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-24 19:45:38 +01:00
luigi-bitonti 98accdb3ad
Added PSC support to CloudSQL Module (#1874)
* Added Feature

* Added PSC to CloudSQL module

* Added psc to read replica

* Changed variables

* Updated README

* Ran fmt

* Removed old variables

* Fix README

* Fixed blueprints

* Fix README

* Fixed output

* Added more outputs and bug fixes

* Changed variable structure

* Bug fix

* Added PSC example.
2023-11-24 15:47:45 +01:00
Luca Prete 56fcb4f88a
F5 deployment blueprint (#1883)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-24 14:02:34 +01:00
Luca Prete 525fc91d5c
Fixes/improvements to F5 HA blueprint (#1882)
Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-23 16:15:47 +01:00
Luca Prete 642f65b841
F5 blueprint (#1787)
---------

Co-authored-by: Luca Prete <lucaprete@google.com>
2023-11-22 19:48:13 +01:00
Wiktor Niesiobędzki 9ff67fdaf0 Add DLP Service Agent role 2023-11-20 15:34:27 +01:00
ddaluka 543ea6e7f3
Fix/dlpagent (#1868)
Create DLP Service Account on service activation.
2023-11-20 14:11:01 +01:00
Aurélien Legrand 1f344b65e6
Net dash cfv2 (#1859)
* Handling SQL IP address issue

* reverting one change

* Improving this fix based on wiktor's feedback

* formatting

* Adding supporting for Cloud Function v2 (60 minutes timeout vs 9 minutes timeout)

* Removing useless comment

* formatting

* updating inputs/outputs documentation

* feedback from Julio

* formatting

* python formatting

* formatting

* formatting

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-11-16 14:45:44 +00:00
Wiktor Niesiobędzki 63f1dfb6de end-to-end tests for Vertex blueprint 2023-11-15 11:04:12 +00:00
Francesco Spinelli 1c2f1c7b0d
Sql user features (#1856)
* added user type feature

* fix readme

* fix comment

* fix blueprint cloudsql users value + minor fix

* readme fix

* variables fix

* local var fix

* fix for in local var

* fix on readme

* fix intentations var in readme

* fix blueprint user quote

---------

Co-authored-by: Francesco Spinelli <francesco.spinelli@nttdata.com>
2023-11-13 10:27:14 +01:00
luigi-bitonti d07f8fd33d
Added CMEK for Secret auto managed (#1739)
Allow to specify custom KMS keys for Secret Manager secrets
2023-11-10 16:45:47 +01:00
Francesco Spinelli 82c74e4ab6
Dataproc module bug fix (#1848)
* bug fix

* bug fix

* fix dinamic for_each

---------

Co-authored-by: Francesco Spinelli <francesco.spinelli@nttdata.com>
2023-11-09 15:48:29 +00:00
Ludovico Magnocavallo 03937f2b6e
Support multilevel data and allow overriding project id in project factory (#1851) 2023-11-09 08:29:46 +00:00
Julio Diez 521b9c7ef2 Update README.md 2023-11-02 13:40:31 +01:00
Julio Diez c536e27945 Use CR IAM binding instead of IAM policy 2023-11-02 13:40:31 +01:00
Julio Diez 8e76e5ee05 Group default URLs output 2023-11-02 13:40:31 +01:00
Julio Diez 14cca9d1b5 Rename to ip_configs to follow same naming 2023-11-02 13:40:31 +01:00
Julio Diez 21d997c00a Refactor into image_configs variable 2023-11-02 13:40:31 +01:00
Julio Diez fd74562a41 Refactor into project_configs variable 2023-11-02 13:40:31 +01:00
Wiktor Niesiobędzki 2664161c24 Simplify #1836 fix, Avoid map-related casting errors in project factory 2023-11-02 09:12:38 +00:00
Ludovico Magnocavallo de0325b3a3
Avoid map-related casting errors in project factory (#1836)
* try to repro pf example error

* repro

* repro

* pf fix

* remove extra file

* FAST stage
2023-11-02 08:24:50 +01:00
lcaggio a0ae43fc6f
[Minimal Data Platform] Fix Landing and curated IAM (#1832)
* Fix IAM on Minimal DP

* fix
2023-11-01 17:53:06 +01:00
Aurélien Legrand d9589f56a1 Handling SQL IP address issue (#1825)
* Handling SQL IP address issue

* reverting one change

* Improving this fix based on wiktor's feedback

* formatting
2023-10-31 16:20:28 +01:00
Luca Prete 28e5c4e2da [net-address] enable ipv6 (#1821)
---------

Co-authored-by: Luca Prete <lucaprete@google.com>
2023-10-31 16:20:28 +01:00
Julio Diez 0ac7bc838f Update README tests and tfdoc 2023-10-31 16:20:27 +01:00