Commit Graph

52 Commits

Author SHA1 Message Date
Natalia Strelkova d96f95c2b6 cannot instead of can not 2022-11-11 11:56:47 +00:00
Natalia Strelkova d5d1d9eb34 terraform formatting fixed 2022-11-10 15:11:38 +00:00
Natalia Strelkova 68c3b13d6a prefix variable consistency across modules 2022-11-10 15:05:53 +00:00
Julio Castillo 1a3bb25917 Update provider version (needed for dns logging support). 2022-10-25 12:15:02 +02:00
Ludovico Magnocavallo e8056577ce
Refactor GKE nodepool and blueprints (#875)
* first shot, untested

* example tests working

* module tests

* work on gke blueprints

* multitenant fleet doc examples

* fix gke hub doc examples

* blueprint tests

* move master range to vpc config

* fast stage 3 gke test

* tfdoc

* bump provider versions

* and bump provider again to latest
2022-10-12 12:59:36 +02:00
Natalia Strelkova 5dbc61cb8c temporary revert to Terraform 1.3.1 to support Cloud Shell 2022-10-10 09:19:55 +00:00
Ludovico Magnocavallo a0171b2c49
Bump terraform required version (#864)
* bump terraform required version

* fix test

* debug test

* debug test

* disable test

* fix CI file, bump terraform action version
2022-10-07 12:51:56 +02:00
Julio Castillo ac835b6d50 Update terraform version 2022-09-28 11:28:05 +02:00
Julio Castillo a866182161 Test documentation examples in the examples/ folder 2022-09-06 17:46:09 +02:00
Simone Ruffilli a29faa7f8c
instance_termination_action must be set for compute-vm spot instances (#778)
* Bumped providers version
* Adds ability to control instance_termination_action for SpotVMs
2022-08-20 18:37:17 +02:00
Ludovico Magnocavallo b20ab65756
GKE hub module refactor (#760)
GKE hub module refactor 
Co-authored-by: Daniel Marzini <danielmarzini@users.noreply.github.com>
Co-authored-by: Miren Esnaola <mirene@google.com>
2022-07-29 08:39:25 +02:00
Julio Castillo 07b00c34fe Bump providers versions and pin versions for tests 2022-06-28 10:20:40 +02:00
Julio Castillo 0bf1880431 Fix FAST audit logs when using pubsub as destination
This commit also splits each organization-level logging sink of type
`logging` to a separate logging bucket.
2022-06-10 12:25:26 +02:00
Ludovico Magnocavallo ab646f38ed
Bump provider versions to >= 4.17.0, terraform to >= 1.1.0 (#634)
* bump provider versions to >= 4.17.0, terraform to >= 1.1.0

* bump teraform version in lint check, edit CHANGELOG
2022-04-17 13:55:40 +02:00
Ludovico Magnocavallo 725f7effce
Initial MVP for CI/CD (#608)
* preliminary support for wif in stage 0

* IAM wif role

* IAM wif role TODO

* add support for external SA IAM to SA module

* add name output to SA module

* separate cicd SA

* tfdoc

* GITLAB principal (untested)

* make GCS name output static

* outputs bucket

* fix stage 1 test

* tweak outputs

* tfdoc

* move wif_pool to automation variable

* add support for top-level and repository providers

* add missing boilerplate

* fix branchless principal

* initial workflow

* symlink provider template in stages

* remove service accounts from stage 0 cicd tfvars

* add cicd interface variable to resman stage

* fix cicd variable in resman stage

* better condition on outputs_location

* fix last change

* change outputs_location type

* revert outputs_location change

* split outputs in stage 0

* update ci/cd temporary notes

* rename additive IAM resource in SA module

* split outputs in stage 1

* remove unused locals

* fix stage 1 tests

* tfdoc

* Upload action files to outputs_bucket

* Fix tests and README

* rename template, streamline outputs

* local templates and gcs output for all stage 2

* add workflows to local output files

* Use lowercase WIF providers everywhere

* Bring back suffix for workflow files

* Remove unused files

* Update READMEs

* preliminary CI/CD implementation for stage 1

* fix stage 1

* stage 1 cicd

* tfdoc

* fix tests

* readme and links for cicd and wif

* refactor wif providers

* refactor cicd for stage 1

* fix stage 1

* wif org policies

* split identity provider configuration from cicd

* add type attribute to cicd repositories

* valid cicd repositories have a workflow template

* refactor stage 01

* fix stage 01 tests

* minimal CI/CD documentation

* better check_links error reporting

* fix links

* Added Gitlab specific configurations

Set the default issuer_uri for Gitlab. Added allowed audiences to OIDC configuration.

* Fixed TF formatting in identity providers.

* Changing identity provider audience to null

Changing identity provider audience to default to null.

* add instructions for renaming workflows

* address Julio's comments

Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: alexmeissner <alexmeissner@google.com>
2022-04-12 08:17:27 +02:00
Simone Ruffilli abb6b50a46
Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
Julio Castillo cf423998f0 Align tftest syntax with tdoc
This commit changes the token separator for inline examples from a
semicolon to a space
2022-01-28 21:34:15 +01:00
Julio Castillo 31f625f149 Link vars and outputs from README 2022-01-22 14:15:16 +01:00
yuryninog a3da60bc71
Merge branch 'master' into yuryninog-patch-1 2022-01-03 10:47:27 -05:00
Simone Ruffilli ee25965c89
Copyright bump (#410) 2022-01-01 15:52:31 +01:00
Ludovico Magnocavallo 2bc5f7d33c
update tfdoc (#404) 2021-12-30 10:56:19 +01:00
Ludovico Magnocavallo 1ac3fe4460
New tfdoc version (#396)
* update tfdoc

* rewrite check docs, refactor tfdoc replace, regenerate modules READMEs

* remove dead code from check docs

* do not fail on missing variable files in check docs

* fix typos
2021-12-21 08:51:51 +01:00
Yury Nino 63019316e1 Remove location from local.prefix 2021-12-12 16:15:21 -05:00
caiotavaresdito 40c66f9fa9 small var conditional fix 2021-11-29 22:35:07 -05:00
caiotavaresdito 193b3f1097 added depends on topic iam binding 2021-11-14 07:21:35 -05:00
Ludovico Magnocavallo f6775aca1b
Use the same versions file everywhere, pin to tf 1.0+ provider 4.0+ (#355)
* add default versions file, remove old providers and versions

* use default versions file everywhere

* fix kms module

* re-add provider configuration for data platform step 2

* update kms module outputs sorting

* update kms documentation

* fix data solutions tests

* fix GKE workload identity attribute name

* work around firewall provider issue in datafusion example
2021-11-03 15:05:43 +01:00
Caio Tavares f74599a317
Added GCS notification support (#335)
* Added GCS notification support

* fixed notification output indices

* merged vars and added more conditional validation

* Terraform linting

* Added sa_email serviceAccount variable

* Fixed bool check and use try in notification var

* Fixed typo source path example block

* Fixed assert number tftest gcs example
2021-10-21 10:27:35 -04:00
caiotavaresdito 75b5c91c28 Terraform linting 2021-10-15 13:39:30 -04:00
caiotavaresdito 910567ce5c removed default labels and let user pass values in 2021-10-15 13:38:23 -04:00
caiotavaresdito 06d0085edd removed name of bucket from label field 2021-10-15 13:35:40 -04:00
Caio Tavares 7dad4496b4
Feature/added gcs website (#325)
* Added GCS website block support

* Terraform linting

* Moved variable to last and re-generated README
2021-10-14 20:11:26 +02:00
Julio Castillo 1d13e3e624 Add more validations to linter
- Ensure all variables and outputs are sorted
- Ensure all variables and outputs have a description
- Add data-solutions/data-platform-foundations to linter

Fix all modules to follow these new conventions.
2021-10-08 18:26:04 +02:00
Julio Castillo cb7c65135e
Update CI processes (#296)
- Upgrade to latest terraform version (1.0.4)
- Remove tflint from linting pipeline (was not doing anything)
- Add terraform fmt check to linting pipeline
- Pass all code through terraform fmt
2021-08-12 17:30:53 +02:00
Ludovico Magnocavallo 202892b344
Add support for lifecycle_rule in gcs module (#288) (#289)
* Add support for lifecycle_rule in gcs module (#288)

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* fix docs

* rename unrelated interconnect module tests

* fix doc example test

Co-authored-by: iury <1934268+IuryAlves@users.noreply.github.com>
2021-07-30 12:07:17 +02:00
Chinmay Dorlikar 9c0b37f100
Added CORS dynamic block for gcs : feature/cors for gcs (#232)
* Added a dynamic CORS block for gcs module. Changed main.tf and variables.tf

* Updated the README for the CORS block

* Ran tfdoc for /modules/gcs/README.md

Co-authored-by: Chinmay Dorlikar <chinmay.dorlikar@quantiphi.com>
2021-04-23 17:58:58 +02:00
Julio Castillo 1e11c670f5 Update copyright to 2021 2021-02-15 09:38:10 +01:00
Julio Castillo eecdee63e6 Make examples in READMEs runnable and testable 2020-11-07 10:28:33 +01:00
Julio Castillo 1df08caa7f Update READMEs with new variable names 2020-11-06 09:43:12 +01:00
Ludovico Magnocavallo f9e4a1d614 bump required tf version in modules using conditions 2020-11-06 08:43:06 +01:00
Ludovico Magnocavallo 9d0db19c5e rename iam variables in gcs module 2020-11-04 16:57:06 +01:00
Julio Castillo 7bd31ccf52 Added some basic variable validation 2020-11-03 08:12:11 +01:00
Julio Castillo 61d402fece Update gcs module to terraform 0.13 2020-10-29 23:26:03 +01:00
Luca Prete f2c80e17f1
[#138] Update copyright headers to 2020 (#139)
Co-authored-by: Luca Prete <lucaprete@google.com>
2020-09-23 11:07:03 +02:00
vanessabodard-voi 435d64d81a
Change bucket_policy_only into uniform_bucket_level_access in GCS module (#135)
* Change bucket_policy_only into bucket_policy_only

* Update changelog
2020-09-15 19:33:40 +02:00
Ludovico Magnocavallo 120e1be1d9 extend gcs module tests to cover new variables 2020-09-03 19:19:41 +02:00
Ludovico Magnocavallo 9e32b32b3d reformat GCS module and update README 2020-09-03 19:08:29 +02:00
vanessabodard-voi e8c227fdd6
Add bucket logging (#134)
* Add logging

* Improve syntax

* Add example

* Improve type for retention policy
2020-09-03 19:06:35 +02:00
Ludovico Magnocavallo 0265ba0951
Refactor net-address variables, add support for internal address purpose
* add support for internal address purpose
* update gcs module README
* refactor net address module interface and add tests
* add more examples in net-address README
2020-09-01 18:49:21 +02:00
vanessabodard-voi daf3dc41e7
Add retention policy (#133) 2020-09-01 17:48:02 +02:00
lcaggio 1b450fe444
Add Cloud KMS support to GCS module (#87)
* Add support to Cloud KMS

* Fixes

* Fix tests

* Fix tests

* - change variable name to be consistent with BQ module
 - remove output, not needed
 - change string default value to null

* use locals to pre-populate kms key variable for all names

* rename kms variable, fix prefix check in locals

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2020-06-05 21:59:34 +02:00