Commit Graph

845 Commits

Author SHA1 Message Date
Ludovico Magnocavallo 79373721df
Remove firewall policy management from resource management modules (#1581)
* rename firewall policy module, fix outputs

* add TOC to firewall policy module

* don't depend policy on parent id

* remove firewall policy from resource management modules

* remove factory conditionals

* fast net a and b

* fast stages

* fast tfdoc

* fast tfdoc

* remove unused test

* fix shielded folder blueprint

* fix shielded folder blueprint
2023-08-09 11:23:07 +00:00
Ludovico Magnocavallo 80ada0e8dd
Refactor firewall policy module (#1576)
* refactor module interface

* hierarchical attachment and example

* hierarchical rules and TODO

* split rules resources

* additional fields

* keep using a single resource for rules

* factory

* factory test

* boilerplate

* Prefix ingress and egress rule ids

* Tests for other firewall policy types

* Fix rule id and names

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-08-08 16:57:59 +00:00
Julio Castillo 959012e93e Fix cloud run tests 2023-08-07 16:46:20 +02:00
Julio Castillo 42fdd08411 Fix cloud sql tests 2023-08-07 16:23:10 +02:00
Ludovico Magnocavallo aecba0bbd0
Add support for ipv6 to net-vpc module (#1568)
* add support for ipv6

* fix test
2023-08-05 13:07:26 +02:00
Julio Castillo bbe778e095 Allow custom route descriptions in net-vpc module
Related: #1491
2023-08-04 14:13:03 +02:00
Daniel Strebel a0bd0d4414
Merge branch 'master' into feature/apigee-add-retention 2023-08-03 14:28:40 +02:00
Daniel Strebel 0906ddb8df feat(apigee): add retention variable 2023-08-02 15:13:43 +02:00
Thinh Ha 43e73aba9a
add dataplex datascan base module (#1545) 2023-08-02 11:16:32 +00:00
Miren Esnaola 3b7e62990c Added IPSEC_INTERCONNECT addresses to net-address module 2023-08-02 12:12:14 +02:00
Natalia Strelkova 4bb51a42ce renaming net-vpc-swp to net-swp 2023-08-01 16:23:12 +02:00
Natalia Strelkova f09d32a703 Merge branch 'master' into net-vpc-swp-optional-description 2023-08-01 13:05:04 +02:00
Ludovico Magnocavallo b524aa137c
Peering module refactor (#1547)
* refactor net-vpc-peering module

* hub and spoke peering blueprint

* fast stages

* boilerplate

* fast tfdoc

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-07-29 21:33:57 +02:00
Wiktor Niesiobędzki 4998f1d376
Grant IAM rights to service identities in host project (#1542)
* [module/project] Grant IAM rights to service identities based on used services in host project
* [blueprints/factories/project-factory] enable granting IAM permissions in host VPC for service identities directly or by specifying services in use
2023-07-29 20:07:21 +02:00
Thinh Ha 0415cf64f1
rename cloud-dataplex to dataplex (#1546) 2023-07-29 14:31:18 +02:00
Ludovico Magnocavallo 5a534edf5c
update and refactor artifact registry module (#1536) 2023-07-28 09:54:36 +00:00
Mikhail Filipchuk ec74f351f5
feat(cloudsql-instance): Add query insights config (#1520) 2023-07-21 20:14:34 +02:00
Natalia Strelkova fde498800c optional description attribute in variables 2023-07-20 12:14:39 +02:00
Wiktor Niesiobędzki 94daeab14b Fail if run with Python below 3.10 2023-07-19 14:18:54 +02:00
Miren Esnaola cacb0c02e2 Refactoring of dns module 2023-07-19 12:57:44 +02:00
Ludovico Magnocavallo 551dc581e8
Implement proper support for data access logs in resource manager modules (#1497)
* organization module

* rename iam_bindings_authoritative to iam_policy, fix tests

* add support for data access logs and iam policy to folder module

* test inventories

* add support for data access logs and iam policy to project module
2023-07-10 08:08:02 +00:00
Ludovico Magnocavallo d9f7cef1e7
allow using a separate resource for boot disk (#1496) 2023-07-07 15:40:13 +00:00
Aurélien Legrand 623c886e95
Peering dashboard (#1492)
* Adding dashboard to monitor VPC and VPC peering group quotas

* Adding 1 ressource to the tests (dashboard)

* Adding dashboard and tests for other networking architecture

* Update test
2023-07-05 18:25:31 +02:00
Thinh Ha 10e15356ea
Add bigquery authorized resources (#1480)
* add bq authorized views, datasets, and routines

* fmt

* add backwards compatible test case

* minor docs clarification

* add docs table and fix lint tests

* fix docs

* fix tests

* fix more lint issues

* fix lint issue

* fix tests

* fix lint

* fix tests

* alphabetical order

* add detailed example to docs and corresponding test

* clarify docs for variables

* remove unnecessary depends_on
2023-06-30 18:44:57 +02:00
Ludovico Magnocavallo 638841c8d1
Rename network load balancer modules (#1466)
* update LB modules to new names

* update LB modules names

* update test paths
2023-06-26 07:50:10 +00:00
Ludovico Magnocavallo ce647647cc
Add support for resource policies to compute vm module (#1467)
* instance schedule

* snapshot resource policy variable and resource

* tfdoc

* snapshot schedules
2023-06-26 06:49:05 +00:00
apichick f6e918ffbd
Merge branch 'master' into dns-managed-zone-iam 2023-06-20 12:19:13 +02:00
Albert Lloveras 7cacc46b4b
fixup(project-factory): Use the correct KMS Service Agents attribute … (#1446)
* fixup(project-factory): Use the correct KMS Service Agents attribute name

* Add new KMS bindings to tests

* Update test resource counts

* Update README.md resource count
2023-06-19 23:53:08 +00:00
Miren Esnaola ddfab0a0e4 Added iam for DNS managed zone to dns module 2023-06-19 12:53:38 +02:00
Ludovico Magnocavallo bd3296bc46
Split Cloud Function module in separate v1 and v2 modules (#1450)
* split v1

* v2

* blueprints

* remove _http
2023-06-19 12:50:36 +02:00
Miren Esnaola a424635221 Refactored apigee module and adjusted the blueprints accordingly 2023-06-19 09:01:32 +02:00
Taneli Leppä 81285065ca Added module for Secure Web Proxy. 2023-06-13 08:49:58 +02:00
Ludovico Magnocavallo c024eca320
Add custom tag support to FAST (#1426)
* initial implementation of custom tags

* depend org policies on tags

* fix test

* integrate default and custom org policy tags
2023-06-07 22:10:27 +00:00
lcaggio 39b27ac25e
Add support for Log Analytics on logging-bucket module and bump provider version (#1423)
* first commit

* Bump provider versions

* Fix tests
2023-06-07 23:23:28 +02:00
Ana Fernandez del Alamo 0fe3f165ed Add VPN monitoring alerts to 2-networking and VPN usage chart
The Fast stage 2-networking-* currently adds a monitoring dashboard
for VPN metrics. This change adds an additional chart to monitor the
usage of the VPN bandwidth.

This change also adds the following monitoring alerts:

* VPN tunnel established
*
[VPN bandwidth](https://cloud.google.com/network-connectivity/docs/vpn/how-to/viewing-logs-metrics#define-bandwidth-alerts)

To configure the alerts, there is a new `alert_config` variable with
defined default values.

The alerts are created in the stage `b` by default. In the stages a,
c, d, and e, the alerts are created if the user creates the On-prem
VPN.

To disable the creation of alerts, add the following to
`terraform.tfvars`:

```
alert_config = {
  vpn_tunnel_established = null
  vpn_tunnel_bandwidth = null
}
```
2023-06-06 13:49:21 +01:00
Prabha Arya f2fe406a62
add alloydb module (#1403)
* add alloydb module

* fix typos

* fix typos

* Add default googleapi route creation to net-vpc

* Reuse existing logic to create default routes

* Update net-vpc README

* Fix modules and blueprints tests

* Rename to `create_googleapis_routes`

* Fix FAST tests

* Fix nva stages tests

* update changelog

* fix typos

* fix version

* rearrange variables

* fix lint

* fix lint

* fix README

* fix README

* fix comments

* fix variables

* fix READMEs

---------

Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludo <ludomagno@google.com>
2023-06-04 10:12:32 +00:00
Wiktor Niesiobędzki 3ac6ceac1e Add trigger SA for Cloud Run 2023-05-30 17:08:37 +02:00
Julio Castillo cecbd2072c Fix modules and blueprints tests 2023-05-26 16:38:41 +02:00
Alejandro Leal 0ad21351c0
Merge branch 'master' into master 2023-05-15 14:25:42 -04:00
Alejandro Leal 87cd83f5c0 Several updates
Several updates
2023-05-13 23:51:46 -04:00
Julio Castillo d20a078134 Cloud NAT rules support 2023-05-12 16:20:38 +02:00
Julio Diez 252be12bd4 Update README showing the Shared VPC use case 2023-05-05 19:38:34 +02:00
Julio Diez 9eea6e3bbc Update pytest inventory file to meet module change 2023-05-05 19:36:46 +02:00
Prabha Arya 23299f7bd7
Add cloud dataplex module (#1308)
* Add dataplex module

* fix dataplex test

* resolve comments

* python test removed

* Change variable desc

* refactor variables

* fix typos

* fix assets & zones resources

* fix linting error

* fix tests

* fix typo
2023-05-05 09:26:46 +02:00
Ludovico Magnocavallo efb0ebe689
Switch FAST networking stages to network policies for Google domains (#1352)
* peering stage implementation

* vpn stage implementation

* tfdoc

* tests

* add most supported google domains

* align all net stages

* add support for factory to DNS response policy module

* use dns policy factory in network stages

* boilerplate
2023-05-04 07:38:40 +02:00
Julio Castillo ee4a908b10 Remove last remaining legacy fixture 2023-04-25 15:12:32 +02:00
Julio Castillo 20ccf7416f Enable parallel tests 2023-04-25 15:12:11 +02:00
Julio Castillo b097d297ff Extend tests to use lockfile if available
This commints allows the test framework to use a lockfile generated
within the tools/lockfile directory. This allows reusing the provider
cache and also running tests in parallel.
2023-04-25 15:12:11 +02:00
Julio Castillo e61df0aa3b Deprecate plan runner fixture and all its variants 2023-04-21 17:52:30 +02:00
Julio Castillo df7cf3d278 Migrate compute-mig tests 2023-04-21 17:51:20 +02:00
Julio Castillo cb13d481d6 Migrate cloud-function tests 2023-04-21 17:51:20 +02:00
Julio Castillo eab9053e16 Migrate billing-budget tests 2023-04-21 17:51:20 +02:00
Julio Castillo 1649787905 Migrate kms tests 2023-04-21 17:51:20 +02:00
Julio Castillo 1c7f8f5907 Migrate bigquery-dataset tests 2023-04-21 17:51:20 +02:00
Julio Castillo 230a1034ec Migrate net-address tests 2023-04-21 17:51:19 +02:00
Julio Castillo 924230eb12 Migrate gke-hub tests 2023-04-21 17:51:19 +02:00
Julio Castillo 4abe5e2baf Migrate net-ilb tests 2023-04-21 17:51:19 +02:00
Julio Castillo c819305a42 Migrate apigee tests 2023-04-21 17:51:19 +02:00
Avinash Jha e881537f87
Separating GKE Standard and Autopilot Modules (#1330)
* separating GKE Standard and Autopilot Modules

* Changes for Updating the terraform and provide versions

* Changes for Autopilot Readme

* Changes for Autopilot Variable

* Changes for Autopilot Readme

* Changes for Autopilot Readme

* Changes for Blueprint

* Changes for Blueprint ReadMe

* Changes for gke-standard-cluster dependency

* Changes for gke-standard-cluster in gke-fleet

* Changes for gke-standard-cluster in cluster-mesh-gke-fleet-api

* python formatting

* python formatting

* python formatting

* GKE module naming convention

* Readme Changes

* test module

* Removing comment code from Autopilot
2023-04-21 12:08:13 +00:00
Julio Castillo 4770cb06fd Migrate cloudsql-instance examples 2023-04-17 09:17:54 +02:00
Julio Castillo 461f7780c2 Migrate bigtable-instance tests 2023-04-17 09:17:54 +02:00
Julio Castillo 5f82938739 Migrate cloud-identity-group tests 2023-04-17 09:17:54 +02:00
Julio Castillo 771dd02b18 Migrate logging-bucket tests 2023-04-17 09:17:54 +02:00
Julio Castillo 0150e97e51 Migrate endpoints tests 2023-04-17 09:17:54 +02:00
Julio Castillo 3dd27b6248 Migrate container-registry tests 2023-04-17 09:17:54 +02:00
Julio Castillo 01b9921f5c Migrate PubSub tests 2023-04-17 09:17:54 +02:00
Julio Castillo 1927b138d6 Migrate secret-manager tests 2023-04-17 09:17:54 +02:00
Julio Castillo a2bffc7302 Migrate service-directory tests 2023-04-17 09:17:54 +02:00
Julio Castillo ed49f3db39 Migrate source repository tests 2023-04-17 09:17:54 +02:00
Julio Castillo f5e1717319 Migrate VPC-SC tests to examples 2023-04-17 09:17:54 +02:00
Julio Castillo 2d4bd5a244 Remove net-interconnect-attachment-direct 2023-04-14 11:01:54 +02:00
Julio Castillo eca0a9583e Add inventories to net-vpc-firewall tests 2023-04-12 14:04:58 +02:00
Fawzi 2ff0b47218 create firewall_policy_enforcement_order.yaml test 2023-04-11 23:40:05 +10:00
Ludovico Magnocavallo 865ef463bb
Support new fields in bigquery module, bump provider versions, unpin local provider (#1306)
* add support for new attributes to bigquery module

* bump provider versions
2023-04-05 14:22:52 +00:00
Luca Prete a9cba47ce8
Add FAST stage 2-networking-e-nva-bgp (NVA+NCC)
Co-authored-by: Luca Prete <lucaprete@google.com>
Co-authored-by: Simone Bruzzechesse <bruzzechesse@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>
2023-04-04 20:41:04 +02:00
Ludovico Magnocavallo bc2d9372aa
Fix urlmap in ILB L7 module (#1299)
* port tests to new format

* add test to catch error and fix urlmap

* boilerplate

* boilerplate
2023-04-03 15:47:37 +02:00
Ludovico Magnocavallo 92b71a5098
Refactor cloud run module to use optionals and support all features (#1293)
* refactor cloud run resource and variables

* vpc connector variables and resource

* refactor env variable, combine and fix env examples

* fix volume example

* fix traffic split example

* fix eventarc/pubsub example

* fix eventarc/audit log example

* fix SA examples, fix examples formatting

* refactor eventarc variable

* tfdoc

* add IAM to example

* add examples for revision annotations and serverless connector

* fix new examples

* remove legacy module tests

* blueprint tests

* Add tests to cloud-run module

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-04-01 14:06:29 +02:00
Valerio Ponza 1fb7e114fd fixing tests and refactoring default 2023-03-30 12:47:39 +02:00
Valerio Ponza 935e95de2a add Backup for GKE support 2023-03-30 12:47:39 +02:00
Wiktor Niesiobędzki 9005a51a95 Use example testing instead custom test 2023-03-27 14:13:38 +02:00
Wiktor Niesiobędzki 9a0137bcfc Add test veryfing multiple filenames are used by default 2023-03-27 14:13:38 +02:00
Ludovico Magnocavallo 28da881c3f
DNS Response Policy module (#1276)
* dns response policy module

* tfdoc
2023-03-26 17:42:57 +02:00
Ludovico Magnocavallo 3d41d01efc
FAST plugin system (#1266)
* plugin folder, gitignore, serverless connector example

* add support to fast plugin variables and outputs to tfdoc

* rename folder, READMEs

* add variable description

* show diffs

* check documentation, use multiple files

* debug check doc

* try a different glob

* debug tfdoc names

* more debug

* and even more debug

* fix gitignore

* fix links

* support extra files in tests

* fix fixture, switch stage 2 peering to new tests

* tfdoc

* Allow globs in extra files

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-03-24 12:28:32 +00:00
Ludovico Magnocavallo 5fb17cb3ac
Widen scope for prod project factory SA to dev (#1263)
* restrict storage role on outputs bucket for stage SAs

* grant prod project factory SA authority over prod and dev org policies

* network stages delegated grants on dev to prod pf SA

* security grants to prod pf SA on dev

* tfdoc

* tests
2023-03-17 16:24:55 +00:00
Ludovico Magnocavallo 8a8b7ea35f
Add support for `iam_additive` and simplify factory interface in net VPC module (#1259)
* initial implementation, no tests

* change interface, align tests

* add examples ToC

* fix variable type, test module-level variable
2023-03-17 10:12:34 +00:00
Ludovico Magnocavallo 112d9a8d9c
Allow using existing boot disk in compute-vm module (#1241)
* allow using existing boot disk in compute-vm module

* allow setting initialize params to null

* tests

* fast

* blueprints
2023-03-12 10:53:59 +01:00
Ludovico Magnocavallo 6ba0f8b0ba
allow overriding name in net-vpc subnet factory (#1239) 2023-03-11 09:30:42 +01:00
Ludovico Magnocavallo be06554bba
Simplify VPN implementation in FAST networking stages (#1228)
* peering stage

* fix link, toc

* vpn stage

* fix link

* nva stage

* fix examples and test

* separate envs stage

* tfdoc
2023-03-09 17:57:44 +01:00
Julio Castillo 165515f9fd Update contributing guide with new test framework 2023-03-09 14:41:18 +01:00
Julio Castillo e33caf0059 Fix tests 2023-03-07 17:52:00 +01:00
Ludovico Magnocavallo 8fc9549c58
add support for proxy and psc subnets to module factory (#1211) 2023-03-05 17:08:43 +01:00
Julio Castillo 67bc391b66 Add test for #1197 2023-03-01 09:58:50 +01:00
Dan Farmer 52eb83758f Fix compute-vm:CloudKMS test for provider>=4.54.0
* TF provider >= 4.54.0 now returns `rsa_encrypted_key` for
  `google_compute_disk.disks["attached-disk"]` (see
  hashicorp/terraform-provider-google#4448)
* Add this field to expected model to fix test assertion failure
* Update required TF provider to 4.55.0 (latest) since the assertion
  will now fail with <4.54.0, which do not return `rsa_encrypted_key`
  * Updated the whole repo on advice from @ludoo
2023-02-28 15:10:22 +00:00
Valerio Ponza 52c16e973b fixing workloadidentity for anthos service mesh - authority was not created 2023-02-27 14:35:49 +00:00
Julio Castillo 6be11dc013 Add empty test in blueprints folder 2023-02-25 19:26:11 +01:00
Julio Castillo be60753246 Fix failing tests 2023-02-25 19:26:11 +01:00
Julio Castillo edce6edd28 Update factories and apigee tests 2023-02-25 19:26:11 +01:00
Julio Castillo b186365cab Update data solutions tests 2023-02-25 19:26:11 +01:00
Julio Castillo 3c68780537 Update gke blueprints tests 2023-02-25 19:26:11 +01:00
Julio Castillo a25f83656f Update cloud operations tests 2023-02-25 19:26:11 +01:00
Julio Castillo d71d0c5c22 Update networking bluprints tests 2023-02-25 19:26:11 +01:00
Julio Castillo daccd803ed Update decentralized-firewall tests 2023-02-25 19:26:11 +01:00
Julio Castillo 3c88315f6e Update tests for hub and spoke blueprints 2023-02-25 19:26:11 +01:00
Julio Castillo 7c17af66aa Update asset-inventory-feed-remediation tests 2023-02-25 19:26:11 +01:00
Julio Castillo f777e97cef Update tests terraform_enterprise_wif 2023-02-25 19:26:11 +01:00
Julio Castillo 3e4b6c0639 Update iam-delegated-role-grants tests 2023-02-25 19:26:11 +01:00
Julio Castillo d114a81b08 Update packer_image_builder tests 2023-02-25 19:26:11 +01:00
Julio Castillo 23c564cb74 Update unmanaged-instances-healthcheck tests 2023-02-25 19:26:11 +01:00
Julio Castillo 99e69e319f Update data platform tests 2023-02-25 19:26:11 +01:00
Julio Castillo 3a0f69dc2d Revert examples/conftest.py 2023-02-25 19:26:11 +01:00
Julio Castillo 71e96dfdee Allow blueprints to be tested from README files without examples. 2023-02-25 19:26:11 +01:00
lcaggio 47855cb682
Merge branch 'master' into lcaggio/dp-projectcreate 2023-02-23 11:54:48 +01:00
lcaggio e39be7b01d Fix 2023-02-22 13:02:29 +01:00
lcaggio 2108b4650d Fix Tests, rely on iam additive. 2023-02-22 01:36:01 +01:00
Julio Castillo a5e905cb80 Update remaining org policies 2023-02-21 15:49:16 +01:00
Julio Castillo d3bcf625f9 Update yaml org policies 2023-02-21 15:49:16 +01:00
Julio Castillo 6b767c9035 Simplify org policies data model in resman modules. 2023-02-21 15:49:16 +01:00
Julio Castillo 3085922cea Fix tests 2023-02-20 12:19:36 +01:00
lcaggio f4c1fa6c20 Fix tests. 2023-02-20 00:56:32 +01:00
Aleksandr Averbukh 4ad30b812b Fix tests for tf-cloud-dynamic-credentials blueprint 2023-02-19 01:14:24 +01:00
Aleksandr Averbukh befc73ec12 feat: Update TFC+WIF blueprint with TFC Dynamic Credentials feature. 2023-02-19 00:51:49 +01:00
Wiktor Niesiobędzki e64e8db20d Allow additive IAM grants by robots name
Regreatablly member name will be known after apply, hence changes in the
tests
2023-02-16 14:39:21 +01:00
Julio Castillo d6e3716815 Fix gke-cluster dns config feature
Fixes #1141
2023-02-10 11:14:07 +01:00
Julio Castillo d7b88b7d0e Fix bq factory docs 2023-02-08 18:22:10 +01:00
Ludovico Magnocavallo 8708f490ce
Allow configuring regions from tfvars in FAST networking stages (#1137)
* configurable regions

* vpn, tests

* tfdoc

* separate envs

* nva

* test resources

* add new custom role for tenant network service accounts

* allow setting firewall policy name in networking stages

* fix stage links script

* set custom role to tenant networking service account

* rename tenant stage 1 provider files

* remove extra file

* fix peering and vpn

* tfdoc

* fix variable order

* tests
2023-02-08 09:59:43 +01:00
Julio Castillo bb565b72f1 Add Disk examples 2023-02-07 15:59:29 +01:00
Julio Castillo 1784dd8cad Remove unneeded __init__.py 2023-02-07 15:59:29 +01:00
Julio Castillo 04602353ce New compute-vm examples and tests 2023-02-07 15:59:29 +01:00
lcaggio dd77c2fe79
Merge branch 'master' into lcaggio/shieldedfolder 2023-02-07 07:58:00 +01:00
lcaggio d68bb4b320 Fixes 2023-02-06 21:33:04 +01:00
lcaggio 1e4499c8ab Fixes 2023-02-06 14:58:40 +01:00
Ayman Farhat 02d8d8367a
[Feature] Update data platform blue print with Dataflow Flex template (#1105)
* Add initial dataflow template code + TF infra

* Refactor the datapipeline DAG to use flex template operator, cleanup code

* Remove unneeded bash scripts, update README with manual examples

* Refactor datapipeline_dc_tags.py and include new Flex template

* Update docs to reflect changes

* Remove sub-dependencies and keep apache beam

* Add missing license headers and update tests

* Set resouces to 291 in tests

* Update outputs via tfdoc

* Update with outputs order and tfdoc

* Correct number of resources

* Fix to add region into command from var

* Enable service account impersonation for running builds

* Update example dataflow run command to use orchestrator SA

* Remove hard coded values in example

* Keep original airflow files, add new which use Flex template as example

* Update tests and doc

* Fix number of resources in plan

* Run tfdoc remove files section in README

* Fix number of modules in tfdoc

* Update number of resources

* Add missin service account

* Update DF demo README

* Quick rename

---------

Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-02-06 07:35:40 +01:00
lcaggio 39ffdcf184
Merge branch 'master' into lcaggio/shieldedfolder 2023-02-05 22:45:14 +01:00
lcaggio 47c75f8862 Implement project_config variable 2023-02-05 21:12:46 +01:00
lcaggio 38fc9e8b9b First commit 2023-02-05 07:52:33 +01:00
lcaggio ce1cc5f75a
Merge branch 'master' into lcaggio/shieldedfolder 2023-02-04 19:42:19 +01:00
Ludovico Magnocavallo 5453c585e0
FAST multitenant bootstrap and resource management, rename org-level FAST stages (#1052)
* rename stages

* remove support for external org billing, rename output files

* resman: make groups optional, align on new billing account variable

* bootstrap: multitenant outputs

* tenant bootstrap stage, untested

* fix folder name

* fix stage 0 output names

* optional creation for tag keys in organization module

* single tenant bootstrap minus tag

* rename output files, add tenant tag key

* fix organization module tag values output

* test skipping creation for tags in organization module

* single tenant bootstrap plan working

* multitenant bootstrap

* tfdoc

* fix check links error messages

* fix links

* tfdoc

* fix links

* rename fast tests, fix bootstrap tests

* multitenant stages have their own folder, simplify stage numbering

* stage renumbering

* wip

* rename tests

* exclude fast providers in fixture

* stage 0 tests

* stage 1 tests

* network stages tests

* stage tests

* tfdoc

* fix links

* tfdoc

* multitenant tests

* remove local files

* stage links command

* fix links script, TODO

* wip

* wip single tenant bootstrap

* working tenant bootstrap

* update gitignore

* remove local files

* tfdoc

* remove local files

* allow tests for tenant bootstrap stage

* tenant bootstrap proxies stage 1 tfvars

* stage 2 and 3 service accounts and IAM in tenant bootstrap

* wip

* wip

* wip

* drop multitenant bootstrap

* tfdoc

* add missing stage 2 SAs, fix org-level IAM condition

* wip

* wip

* optional tag value creation in organization module

* stage 1 working

* linting

* linting

* READMEs

* wip

* Make stage-links script work in old macos bash

* stage links command help

* fix output file names

* diagrams

* fix svg

* stage 0 skeleton and diagram

* test svg

* test svg

* test diagram

* diagram

* readme

* fix stage links script

* stage 0 readme

* README changes

* stage readmes

* fix outputs order

* fix link

* fix tests

* stage 1 test

* skip stage example

* boilerplate

* fix tftest skip

* default bootstrap stage log sinks to log buckets

* add logging to tenant bootstrap

* move iam variables out of tenant config

* fix cicd, reintroduce missing variable

* use optional in stage 1 cicd variable

* rename extras stage

* rename and move identity providers local, use optional for cicd variable

* tfdoc

* add support for wif pool and providers, ci/cd

* tfdoc

* fix links

* better handling of modules repository

* add missing role on logging project

* fix cicd pools in locals, test cicd

* fix workflow extension

* fix module source replacement

* allow tenant bootstrap cicd sa to impersonate resman sa

* tenant workflow templates fix for no providers file

* fix output files, push github workflow template to new repository

* remove try from outpout files

* align stage 1 cicd internals to stage 0

* tfdoc

* tests

* fix tests

* tests

* improve variable descriptions

* use optional in fast features

* actually create tenant log sinks, and allow the resman sa to do it

* test

* tests

* aaaand tests again

* fast features tenant override

* fast features tenant override

* fix wording

* add missing comment

* configure pf service accounts

* add missing comment

* tfdoc

* tests

* IAM docs

* update copyright

---------

Co-authored-by: Julio Castillo <jccb@google.com>
2023-02-04 15:00:45 +01:00
lcaggio f00d4d3edd
Merge branch 'master' into lcaggio/shieldedfolder 2023-02-03 22:17:30 +01:00
javiergp ce1f86d20b
Vertex Pipelines MLOps framework blueprint (#1038)
* First release of the MLOps blueprint
2023-02-02 19:13:13 +01:00
lcaggio f9e3eb7d5a Update copyright 2023-02-01 09:30:28 +01:00
Julio Castillo 351698873b Fix test names and update to yaml-based tests 2023-02-01 09:03:53 +01:00
lcaggio 840fc86b3e Fix groups. Fix tests. 2023-02-01 08:55:33 +01:00
lcaggio 3995ec1550
Merge branch 'master' into lcaggio/shieldedfolder 2023-02-01 00:28:01 +01:00
lcaggio f36b004664 Make VPCSC optional; ingress policy 2023-02-01 00:26:57 +01:00
lcaggio fb04e78829 Fix variables 2023-01-31 22:35:48 +01:00
Julio Castillo 1204b0077e
Merge branch 'master' into mci_gateway 2023-01-31 11:54:31 +00:00
Miren Esnaola 1a2745b632 In the apigee module now both the /22 and /28 peering IP ranges are passed at instance creation 2023-01-31 11:32:53 +01:00
lcaggio 2584eb149c Fix test 2023-01-31 00:02:30 +01:00
lcaggio a166c612d5 Merge branch 'master' into lcaggio/shieldedfolder 2023-01-30 23:52:46 +01:00
lcaggio 66a10d76c3 Add test 2023-01-30 23:47:33 +01:00
Wiktor Niesiobędzki db8382fc02 Fix tests after version bump 2023-01-29 15:50:24 +01:00
Wiktor Niesiobędzki 2976df596e Fix tests (add JIT-ed SA for multiclusteringress.googleapis.com) 2023-01-29 15:50:24 +01:00
Ayman Farhat edd3a82453
Include cloudbuild API in project module (#1116)
* Include cloudbuild API in project module

* Increase number of resources
2023-01-27 21:38:01 +01:00
fdhaussy a291dca63b chore: linting issue in tfvars file 2023-01-27 16:22:34 +01:00
fdhaussy bed7e05d09 add support for deployment_type and api_proxy_type in google_apigee_environment resource 2023-01-27 15:37:57 +01:00
Julio Castillo d537897cbf Remove trailing whitespaces 2023-01-26 17:08:20 +00:00
Julio Diez 4d6561712e Fix tftest and format 2023-01-26 17:56:20 +01:00
Julio Castillo 551d45760f
Merge branch 'master' into google_gkehub_feature_membership 2023-01-23 09:11:49 +01:00
apichick 6a633390b2
Merge branch 'master' into hybrid-gke-updates 2023-01-20 13:18:19 +01:00
Ludovico Magnocavallo 050daa65f2
Merge branch 'master' into hybrid-gke-updates 2023-01-20 07:48:49 +01:00
Miren Esnaola 8945165bc3 Improvements in apigee hybrid-gke: now using workload identity and GLB 2023-01-19 22:11:44 +01:00
Julio Castillo 13352779ac Fix nodepool test 2023-01-19 18:55:30 +01:00
Julio Castillo 1820269680 Add inventories to gke-nodepool examples 2023-01-19 18:19:34 +01:00
Julio Castillo 9c9aafb3f1 Update gke-cluster tests 2023-01-19 17:47:14 +01:00
Julio Castillo 1e0d7776e1 Update DNS tests 2023-01-19 17:47:14 +01:00
Julio Castillo a12089ef8c Move VPC factory and route tests to examples. 2023-01-19 17:47:14 +01:00
Julio Castillo 2aad7845a4 Allow dashes and underscores in tftest file ids 2023-01-19 17:47:14 +01:00
Julio Castillo a0cb67e1f4 Add inventories to gcs examples 2023-01-19 17:47:14 +01:00
Julio Castillo 12f07ebeac Extend net-vpc README with more tested examples 2023-01-19 17:47:14 +01:00
Julio Castillo fd19e4a923 add inventories net-vpc examples 2023-01-19 17:47:14 +01:00
Julio Castillo 4897aa7109 bump test suite versions 2023-01-19 17:47:14 +01:00
Julio Castillo de704110c9 Update api-gateway tests 2023-01-19 17:47:14 +01:00
Wiktor Niesiobędzki b38ef22572 Even more test fixes 2023-01-19 09:37:48 +01:00
Wiktor Niesiobędzki 10e462d594 Fix tests for servicemesh 2023-01-19 09:37:48 +01:00
lcaggio 07a7be29e3 Add shared-vpc support on Data Playgroud blueprint 2023-01-19 00:33:31 +01:00
Miren Esnaola 7d9dc6c28e Added tags to gke-cluster module 2023-01-13 12:58:40 +01:00
lcaggio 488b6d4dc0 Remove plg project, composer 2 2023-01-11 00:31:52 +01:00
Ludovico Magnocavallo f7350be743
Merge branch 'master' into apigee-hybrid-gke 2023-01-05 09:11:39 +01:00
Miren Esnaola f6413747b7 Fixes in Apigee Bigquery Analytics blueprint 2023-01-04 17:30:07 +01:00
apichick 9774e866e3
Merge branch 'master' into apigee-hybrid-gke 2023-01-04 11:47:40 +01:00
Miren Esnaola 33f5607ff1 Apigee hybrid on GKE 2023-01-04 10:53:49 +01:00
Taneli Leppä fbf42197a0
Merge branch 'master' into stateful-disks-deletion-rule-fix 2023-01-04 08:39:43 +01:00
Taneli Leppä ca4cb3b3b9 Fixed delete_rule in compute-mig module for stateful disks. 2023-01-03 21:53:31 +01:00
Julio Castillo 2e35bff903 Fix tests for latest provider version 2023-01-03 16:52:31 +01:00
Julio Castillo 1114c6a8a4 Fix org module tests 2023-01-03 16:52:31 +01:00
Julio Castillo c8bfe892a6 Update folder tests 2023-01-03 16:52:31 +01:00
Julio Castillo 065b1471a8 Reorder org policy rules 2023-01-03 16:52:31 +01:00
Israel Herraiz 20579394b8 Add cluster replicas to Bigtable module.
This adds the possiblity to define several clusters in a Bigtable instance,
which enables replication in Bigtable.

Some of the configurations options are moved inside a `map` that defines the
properties of each cluster.

These changes alter the interface of the module, so any previous code using this
module will have to adapt to the new options interface.
2022-12-28 19:53:17 +01:00
Miren Esnaola 0235690aaa Moved apigee bigquery analytics blueprint, added apigee network patterns 2022-12-23 14:38:15 +01:00
Ludovico Magnocavallo 66a402083b
Allow setting no ranges in firewall module custom rules (#1073)
* allow setting no ranges in custom firewall rules

* fix blueprint

* fix example

* fix example
2022-12-23 09:03:31 +01:00
Israel Herraiz 5fc5165adf Fix modules tests after version bump 2022-12-23 00:33:53 +01:00
Israel Herraiz f0395f9a8d
Merge branch 'master' into fix_column_families 2022-12-22 17:22:12 +01:00
Israel Herraiz 8427bd3ba6 Fix linting 2022-12-22 16:50:37 +01:00
Israel Herraiz 9152d5a0f5 Fix default values for test 2022-12-22 16:49:05 +01:00
Ludovico Magnocavallo 082c63dfc5
refactor GCS module and tests (#1066) 2022-12-22 12:27:09 +01:00
Ludovico Magnocavallo b438e0c37a
Allow using dynamically generated address in LB modules NEGs (#1061)
* test

* fix #1055 for net-ilb-l7

* fix glb module
2022-12-21 17:04:56 +01:00
Ludo 0d7243979b
revert last commit 2022-12-21 13:12:15 +01:00
Ludo 7c95b7ce43
fix #1055 for net-ilb-l7 2022-12-21 13:07:36 +01:00
Ludo aaf5a9013b
fix test 2022-12-20 07:55:03 +01:00
Julio Castillo 4f7cb39a06 Simplify readme discovery 2022-12-18 14:00:20 +01:00