Commit Graph

168 Commits

Author SHA1 Message Date
Ludovico Magnocavallo d5d0554972 remove redundant firewall rules and subnets 2022-02-16 12:54:49 +01:00
Ludovico Magnocavallo 728f6485ae remove unneeded permissions in resman 2022-02-16 12:51:12 +01:00
Ludovico Magnocavallo 9c736ea337
Merge branch 'master' into lcaggioni/fast-data-platform 2022-02-16 11:47:41 +00:00
Julio Castillo dda86119f9
Fix typo 2022-02-16 11:33:43 +01:00
Julio Castillo 49f36157d5 Fix typo in stage1 outputs 2022-02-16 10:57:54 +01:00
Ludovico Magnocavallo 4b73cc4de6 tfdoc, stages README 2022-02-16 10:14:51 +01:00
lcaggio 8e8378fb28
Merge branch 'master' into lcaggioni/fast-data-platform 2022-02-16 09:56:42 +01:00
Julio Castillo 0544456462 Use local for tfvar outputs 2022-02-16 09:07:07 +01:00
Ludovico Magnocavallo 9015abfc80 stage 01 docs 2022-02-16 08:57:45 +01:00
Ludovico Magnocavallo 41a848e501 stage 00 doc 2022-02-16 08:52:19 +01:00
Ludovico Magnocavallo 748aaa1b3f tfdoc 2022-02-16 08:23:34 +01:00
Ludovico Magnocavallo 74d56700f5 03-project-factory 2022-02-16 08:20:32 +01:00
Ludovico Magnocavallo c0f73cb3be replace : with - in output keys 2022-02-16 08:20:22 +01:00
Ludovico Magnocavallo 442e647caf 02-networking-nva 2022-02-16 08:07:58 +01:00
Ludovico Magnocavallo 9c9312c4b8 tfdoc 2022-02-16 07:53:41 +01:00
Ludovico Magnocavallo 5c46d351d5 02-networking-vpn 2022-02-16 07:52:20 +01:00
Lorenzo Caggioni c3a6ebee20 Fix roles 2022-02-16 06:55:45 +01:00
Ludovico Magnocavallo ca186054df 02-security 2022-02-16 01:18:51 +01:00
Ludovico Magnocavallo 7e9843d445 tfdoc for real 2022-02-16 00:48:13 +01:00
Ludovico Magnocavallo 8c684124da Merge branch 'fast/var-contracts' of github.com:GoogleCloudPlatform/cloud-foundation-fabric into fast/var-contracts 2022-02-16 00:44:24 +01:00
Ludovico Magnocavallo b50deb68a7 tfdoc 2022-02-16 00:44:14 +01:00
Ludovico Magnocavallo d3c95e5784
Merge branch 'master' into fast/var-contracts 2022-02-15 23:42:30 +00:00
Ludovico Magnocavallo cd52f7c34c stage 01 2022-02-16 00:35:50 +01:00
Ludovico Magnocavallo 742a08ba17 add tfvars output 2022-02-16 00:35:44 +01:00
Ludovico Magnocavallo 369253cc3a write providers to a common folder 2022-02-16 00:14:49 +01:00
Ludovico Magnocavallo 8dd5060779 file permissions 2022-02-16 00:08:09 +01:00
Ludovico Magnocavallo ad247e9435 bootstrap outputs 2022-02-16 00:03:10 +01:00
Lorenzo Caggioni 51026e6d0f Fix xpnAdmin 2022-02-15 21:36:11 +01:00
Simone Ruffilli 1d187ddd23
FAST: PF example implementation changed to dev. Tests updated (#544)
* FAST: PF example implementation changed to dev. Tests updated
* FAST: simplified teams folder names
2022-02-15 12:22:08 +01:00
Ludovico Magnocavallo c91802f501
Change psa type in net-vpc, fix psa in fast net stages (#545)
* change psn type in net-vpc, fix psa in fast net stages

* fix doc examples

* psn ---> psa
2022-02-15 09:24:27 +01:00
Lorenzo Caggioni 8906252528 Fix 2022-02-14 23:54:53 +01:00
Lorenzo Caggioni 7252e7ec01 Fix review comments. 2022-02-14 16:54:42 +01:00
Ludovico Magnocavallo 93ce6aac5b README 2022-02-14 14:46:32 +01:00
Ludovico Magnocavallo b44b7178ed README refactored 2022-02-14 14:44:19 +01:00
Ludovico Magnocavallo b987d9bd85 fix link 2022-02-14 14:37:46 +01:00
Ludovico Magnocavallo 4086d28b9b README refactor up to providers section 2022-02-14 14:23:19 +01:00
Ludovico Magnocavallo 96fd909141 top-level README 2022-02-14 14:07:47 +01:00
Ludovico Magnocavallo 5835d1d811 fix links 2022-02-14 14:02:29 +01:00
Ludovico Magnocavallo d8f4f37c48 tfdoc 2022-02-14 13:57:07 +01:00
Lorenzo Caggioni 2646f7bcd8 Rever router asn config 2022-02-14 10:47:09 +01:00
Lorenzo Caggioni 026cea4554 Align with master branch 2022-02-14 10:27:03 +01:00
lcaggio f98d690516
Merge branch 'master' into lcaggioni/fast-data-platform 2022-02-14 10:12:35 +01:00
Ludovico Magnocavallo 00f24698d0 refactor DRS org policy 2022-02-13 10:40:23 +01:00
Ludovico Magnocavallo 2d27d20f1a update IAM docs 2022-02-12 15:47:31 +01:00
Ludovico Magnocavallo 54c7d8a5c6 fix perimeter definition in locals 2022-02-12 15:41:13 +01:00
Ludovico Magnocavallo fbf4d29c88
Fix FAST names (#539)
* name checker, initial names fix

* fix name parser

* sdbx -> sbox

* explicit names

* show total name length

* check names in linting action

* validate prefix length

* fix typo
2022-02-12 13:29:22 +01:00
Lorenzo Caggioni e7ebaeedaf Fix Bootstrap output. 2022-02-11 23:24:00 +01:00
lcaggio bf64a3dfda
Add Data Platform to FAST (#510)
* Import Fast from dev repository.
>
>
Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>

* Import Fast from dev repository.
>
>
Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>

* merge tools changes

* Import Fast from dev repository.
>
>
Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>

* add bolierplate to validate_schema

Co-authored-by: Julio Castillo <juliocc@users.noreply.github.com>

* stage 02-security

* Import Fast from dev repository.

Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>

* Copy FAST top level README

* Copy FAST top level README

* TODO list

* TODO list

* fix linting action to account for fast

* remove providers file

* add missing boilerplate

* update factory README

* align examples tfdoc

* fast readmes tfdoc

* disable markdown link check

* really disable markdown link check

* update TODO

* switch to local module refs in stage0

* replace module refs in 02-sec

* Import Fast from dev repository.
>
>
Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>

* merge tools changes

* Import Fast from dev repository.
>
>
Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>

* add bolierplate to validate_schema

Co-authored-by: Julio Castillo <juliocc@users.noreply.github.com>

* Import Fast from dev repository.
>
>
Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>

* stage 02-security

* Import Fast from dev repository.

Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>

* Copy FAST top level README

* Copy FAST top level README

* TODO list

* TODO list

* fix linting action to account for fast

* remove providers file

* add missing boilerplate

* update factory README

* align examples tfdoc

* fast readmes tfdoc

* disable markdown link check

* really disable markdown link check

* update TODO

* switch to local module refs in stage0

* replace module refs in 02-sec

* Move first draft to fast branch

* Fix roles and variables. Add e2e DAG example!

* Fix example

* Fix KMS

* First draft: README

* Update README

* Add DLP, update README

* Update Readme

* README

* Add todos

* Merge master

* Merge master

* Merge master

* Fix and test KMS, Fix and test existing prj (it works also with single prj), Update README

* Fix READM and Demo

* add  on TF files

* Remove block comments

* simplify service_encryption_keys logic

* fix README

* Fix TODOs

* fix tfdoc description

* fix demo README

* fix sample files

* rename tf files

* Fix outputs file name, fix README, remove dependeces on composer resource

* Add test.

* Fix README.

* Initial README update

* README review

* Fix issues & readme

* Fix README

* Fix README

* Fix test error

* Fix test error

* Add datacatalog

* Fix test, for real? :-)

* fix readme

* support policy_boolean

* split Cloud NAT flag

* Fix README.

* Fix Shared VPC, first try :-)

* Fix tests and resource name

* fix tests

* fix tests

* README refactor

* Fix secondary range logic

* First commit

* Replace existing data platform

* Fix secondary range logic

* Fix README

* Replace DP example tests with the new one.

* Fix test module location.

* Fix test module location, for real.

* Support DataPlatform project in VPC-SC

* Fix VPC-SC

* Add TODO, VPC-SC

* Possible improvement to handle VPC-SC perimeter projects with folder as variable

* Add TODO

* Fix module path

* Initial fix for KMS

* Add PubSub encryption

* Fix secondary range logic

* First commit

* Support DataPlatform project in VPC-SC

* Fix VPC-SC

* Add TODO, VPC-SC

* Possible improvement to handle VPC-SC perimeter projects with folder as variable

* Add TODO

* Fix module path

* Initial fix for KMS

* Update READMEs

* Update README

* Fix composer roles and README.

* Fix test.

* Fixes.

* Add DLP documentation link.

* Temp commit with errors

* Refactor variables

* Fix secondary range logic

* First commit

* Support DataPlatform project in VPC-SC

* Fix VPC-SC

* Add TODO, VPC-SC

* Possible improvement to handle VPC-SC perimeter projects with folder as variable

* Add TODO

* Fix module path

* Initial fix for KMS

* rebase

* rebase

* rebase

* Rebase

* rebase

* Update READMEs

* Fixes.

* Fix new variables

* Fix misconfiguration and tests.

* Fix secondary range logic

* First commit

* Support DataPlatform project in VPC-SC

* Fix VPC-SC

* Add TODO, VPC-SC

* Possible improvement to handle VPC-SC perimeter projects with folder as variable

* Add TODO

* Fix module path

* Initial fix for KMS

* rebase

* rebase

* rebase

* Rebase

* rebase

* Update READMEs

* Fixes.

* Rebase - Fix secondary range logic

* Rebase - First commit

* Support DataPlatform project in VPC-SC

* Fix VPC-SC

* Possible improvement to handle VPC-SC perimeter projects with folder as variable

* Initial fix for KMS

* Fix secondary range logic

* First commit

* Support DataPlatform project in VPC-SC

* Fix VPC-SC

* Fix module path

* Initial fix for KMS

* Update READMEs

* Fixes.

* Fix new variables

* Revert VPC-SC logic

* Fix variable typos

* README fixes

* Fix Project Name logic

* Fix Linting

* READEME

* update READEME

* update READEME

* update README

* mandatory project creation, refactor

* formatting

* add TODO for service accounts descriptive name

* use project module to assign shared vpc roles

* Fix shared-vpc-project module

* Fix vpc name and tests

* README

* update to newer version

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Simone Ruffilli <sruffilli@google.com>
Co-authored-by: Julio Castillo <juliocc@users.noreply.github.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2022-02-11 17:32:16 +01:00
Julio Castillo 9076c2f2b0 Fix external billing org 2022-02-11 17:10:44 +01:00
Simone Ruffilli a978000e31
Renamed vpc-(.*) files to (#538) 2022-02-11 10:23:57 +01:00
Julio Castillo 547ded37b2 Update networking folder names to match teams folder 2022-02-11 08:29:46 +01:00
Ludovico Magnocavallo 53144713aa
update bootstrap commands (#536) 2022-02-11 08:20:33 +01:00
Julio Castillo 096dce08e9 Use prefix for PF projects 2022-02-11 00:43:14 +01:00
Julio Castillo fd599ea286 Fix renamed argument to project factory module 2022-02-11 00:30:46 +01:00
Ludovico Magnocavallo bb97486987 tfdoc 2022-02-10 19:17:35 +01:00
Ludovico Magnocavallo 677f3c8df1 use custom role name for billing org too 2022-02-10 19:16:13 +01:00
Ludovico Magnocavallo 3246d1c08d fix variable 2022-02-10 19:13:55 +01:00
Ludovico Magnocavallo c4d36cc66b Allow specifying custom role names 2022-02-10 19:12:07 +01:00
Ludovico Magnocavallo ae49074921
Update terraform.tfvars.sample 2022-02-10 17:25:38 +01:00
Simone Ruffilli 2696af1a7e
Update vpc-sc.tf - manage empty perimeters. (#530)
* Update vpc-sc.tf - manage empty perimeters.

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-10 16:24:14 +01:00
Julio Castillo 6700faf662 Document log sinks in stage 0 2022-02-10 13:00:43 +01:00
lcaggio b377b30910
Update README (#517)
Update path to config folder

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-09 13:05:46 +01:00
eeaton a18bea7f2c
Add Zonal DNS Only org policy (#527)
This is a safe and sane org policy that should be recommended for most customers to prevent them from accidentally configuring internal dns in a way that has reduced availability
https://cloud.google.com/compute/docs/internal-dns#enforce_dns_by_policy
2022-02-09 12:21:43 +01:00
Ludovico Magnocavallo 40cb46e1cc
Add support for Shared VPC service IAM to project module (#525)
* project module changes

* fix examples

* add comments in module code

* re-enable nullable on svpc variables

* project factory

* Tests still failing (#526)

* fix pf

* tfdoc

* pf test boilerplate

Co-authored-by: Simone Ruffilli <sruffilli@google.com>
2022-02-09 11:06:51 +01:00
Ludovico Magnocavallo d21304267b revert dry-run to true as default 2022-02-08 13:43:37 +01:00
Ludovico Magnocavallo 02dc9de9b0
make it simpler to switch from/ry run mode (#524) 2022-02-08 13:26:44 +01:00
Ludovico Magnocavallo 4567b788a2 add org policy role to cloud admins 2022-02-08 11:31:39 +01:00
Luca Prete be33a7f880
FAST - Fixes 498 - 02-networking-nva stage 2022-02-07 13:22:58 +01:00
Simone Ruffilli 40142572f8
Update variables.tf example for team_folders 2022-02-07 11:15:13 +01:00
Ludovico Magnocavallo 8f1639a3c5 sample tfvars file 2022-02-07 11:07:13 +01:00
Ludovico Magnocavallo e5440f98a2
use prod folder for landing project (#514) 2022-02-06 19:25:05 +01:00
Ludovico Magnocavallo d711a93397
fix previous merge (#513) 2022-02-06 18:34:32 +01:00
Ludovico Magnocavallo c4533503a6
Fast: use pathexpand for output location (#512)
* use pathexpand for output location

* tfdoc
2022-02-06 18:24:46 +01:00
Simone Ruffilli 1aa5d5d93f
Misc documentation fixes (#493) 2022-02-06 10:50:23 +01:00
Ludovico Magnocavallo 6c1c943600 fix org id 2022-02-06 10:05:31 +01:00
Ludovico Magnocavallo 769fc73e83 remove unused roles on automation project 2022-02-06 09:47:40 +01:00
Ludovico Magnocavallo c8cbf9b7d7
Add utility to extract IAM bindings from state (#503)
* add utility to extract IAM bindings from state

* TODO

* TODO

* output one row per role/member pairs

* sorting

* rename, delete spurious file

* generalize output functions

* generate IAM.md

* fix org id

* add link to role in markdown

* fix org id

* replace organization ids
2022-02-05 17:34:43 +01:00
Simone Ruffilli 75aff4081f
default=null for `shared_vpc_self_link ` and `vpc_host_project` (#502)
* Update variables.tf

* Update README.md
2022-02-04 19:57:06 +01:00
Julio Castillo 0c0614e12f Fix typo in stage2 variable
Co-authored-by: Daniel Marzini <dmarzi@google.com>
2022-02-04 16:54:09 +01:00
Julio Castillo 18adf869ae Update networking stages to use multiple folders
Co-authored-by: Daniel Marzini <dmarzi@google.com>
2022-02-04 16:21:00 +01:00
Julio Castillo ed4fc477a7 Update resman outputs and projects 2022-02-04 16:21:00 +01:00
Julio Castillo f184ced544 Add xpnAdmin to diffent folders 2022-02-04 16:21:00 +01:00
Simone Ruffilli 190442da9d
FAST-02-nva: uniformed l7 and PSA CIDRs (#497)
* FAST-02-nva: uniformed l7 and PSA CIDRs

* Update variables.tf

* Fixes README.md

* Fixes typo in variables.tf

* Fixes README.md
2022-02-04 14:40:24 +01:00
Simone Ruffilli a82f107f54
FAST-00: Adds projectCreator to resman SA. Always create delegated role grants. (#496) 2022-02-04 13:59:32 +01:00
Ludovico Magnocavallo 02e8a3927d
CI link checker (#494)
* CI link checker

* fix link errors

* fix ci

* wildcard on *.md
2022-02-04 13:28:07 +01:00
Simone Ruffilli 0cef15301b
Rename 02-networking to 02-networking-vpn (#492) 2022-02-04 11:03:37 +01:00
Julio Castillo 52c4b608c2 Rename tf files to use dashes 2022-02-04 08:45:49 +01:00
Daniel Marzini 2291e0643a remove module.organization.custom_role_id.xpnServiceAdmin
to be discussed with jccb
2022-02-04 08:45:49 +01:00
Simone Ruffilli 8272694360 02-net-nva: README.md updates 2022-02-04 07:42:56 +01:00
Luca Prete 9d81e29be7
FAST - Add 02-networking-nva stage 2022-02-03 20:30:56 +01:00
Julio Castillo c8f59c105e Remove unneeded delegated grants 2022-02-03 19:22:32 +01:00
Julio Castillo 5d0c57ef0c Update stage0 readme 2022-02-03 19:22:32 +01:00
Julio Castillo 9c552f8978 Fix syntax error 2022-02-03 19:22:32 +01:00
Julio Castillo 76d3ed41f1 Add org level role for networking delegated grants 2022-02-03 19:22:32 +01:00
Julio Castillo 37f37f939d Fix stage2 readme 2022-02-03 19:22:32 +01:00
Julio Castillo 346914d315 Add delegated grants for stage 3 service accounts 2022-02-03 19:22:32 +01:00
lcaggio 6e896382d6
Fix READMEs. (#484)
* Fix READMEs.

* fix outputs location paths in READMEs

* fix output location paths in READMEs

* Update README.md

* Update README.md

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-01 18:12:57 +01:00
Ludovico Magnocavallo c727abfa3b
Update README.md 2022-02-01 13:20:19 +01:00
Ludovico Magnocavallo 8a7dda94b2
Update README.md 2022-02-01 13:19:07 +01:00
Simone Ruffilli 272401e120
Removed obsolete sentence from README.md 2022-01-31 18:35:25 +01:00