e3809e6735
Add main project factory service account ( #2353 )
...
* add main project factory service account
* add main project factory service account
2024-06-10 12:23:30 +02:00
b13b6032d3
Remove support for source repositories from FAST CI/CD ( #2352 )
...
* stage 0
* stage 1
* stage 1 mt
* remove unused locals from resman
* remove unused locals from resman
* tfdoc
2024-06-10 09:02:55 +00:00
d736a06c0b
Fix resman top-level folders variable types ( #2333 )
...
* fix resman top-level folders variable types
* pass logging settings to underlying module
* fix logging settings
2024-05-31 14:45:31 +02:00
11050c46cf
FAST MT: Readme updates and more prefix validation ( #2305 )
...
This change documents the process of deploying FAST on a tenant-factory bootstrapped tenant.
It also fixes changes the validation logic for prefix as follows:
- 0-bootstrap: 9 chars or less
- 1-resman/1-tenant-factory: 9 chars or less if ran at org-level, else 11
- else 11
It also uniforms across all stages the variables.tf and variables-fast.tf breakdown.
2024-05-24 12:01:55 +02:00
7a5dd4e6db
FAST: add top-level folders and restructure teams/tenants in resman ( #2254 )
...
* remove teams and tenants from resman
* move fast features to stage 1, fix test inventories
* folders
* fix factory, add top level folder resources to outputs
* tfdoc
* stage 0 log sink defs
* tfdoc
* enable toc in resman readme
* simple tenants
* fast compatibility automation and logging
* testing fast-compatible tenants
* testing fast-compatible tenants
* tfdoc
* remove mt stages
* remove tests, fix links
* disable tflint
* fast tests
* make organization conditional in resman
* check names tool
* export real prefix to tfvars, prevent destroy errors
* prefix validation
* fix billing account export format
* tfdoc
* root node folder
* resman changes
* tenant resman roles
* first apply of tenant resman
* tenant log sinks in stage 1
* fix test vars
* tfdoc
* tenant vpc-sc access policy
* fix tests expected values
* tenant CI/CD
* identity providers
* wif
* tfdoc
* add comments to identity locals
* full-feature tenant resman apply
* tenant billing IAM
* stage test
* fix CI/CD comments
* tenant net stage verified
* tenant sec stage verified
* fix test
* README work
* tfdoc
* README
* README rewording
* README rewording
* tfdoc
* FAST excalidraw
* review comments
* diagram review changes
* add iam log sink for tenants
* remove redundant try from security stage
* Implement tflint-fast in Python driven by tftest.yaml files
* tflint
* test ci changes
* revert linting changes
* disable tflint for fast
* Create junit-style report for FAST tflint
* Remove junit-reporter
* YAPF tflint-fast.py
* Output tflint FAST to job summary
* Step summary
* Disable step_summary as output is not useful
* ignore tflint warning
* re-enable tflint on FAST
---------
Co-authored-by: Wiktor Niesiobędzki <wiktorn@google.com>
2024-05-15 09:17:13 +00:00
94c32c1d71
Misc FAST fixes ( #2253 )
...
* Misc FAST fixes
* Fix readme
* Fix FAST nva bgp tests
2024-05-02 06:56:26 +00:00
b4b926a56e
Remove unused variables/locals from FAST ( #2219 )
...
* Remove unused variables/locals from FAST
* Fix readmes
2024-04-16 14:14:24 +00:00
215c5cec26
Update the description and README for the tags variable ( #2206 )
...
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2024-04-10 15:08:59 +02:00
a9ac0f40cd
Add variable to resman to control top-level folder IAM ( #2196 )
2024-04-04 10:26:35 +02:00
33ffe2daa6
Allow r/o project factory SAs access to folder-level IAM ( #2195 )
...
* allow project factory SAs read access to folder-level IAM
* tfdoc
2024-04-03 21:51:46 +02:00
b80132a618
FAST GCVE stage ( #2191 )
...
* GCVE stage prerequisites
* fix gcve prereq
* gcve stage first deploy
* Updated readme filex
* docs updated
* some fixes after testing
* updated readme files
* elia fix
* gcve net admin custom role
* gcve net admin custom role
* elia fix
* ven peering deploy
* elia fix
* added blueprint and stage tests
* Edits to Readme files
* typo in outputs
* clean-up
* gcve stage tests fix
* readme fix
* fix sorting
* fix copyrights and readme file
* fix test
* fix copyright
* fixed gcve feature flag cond.
* removed validation
* fixed typo
* fixed typo
* fixed gcve tests
* fixed typo
* fixed typo
* fixed sorting
* fixed sorting
---------
Co-authored-by: Konrad Schieban <kschieban@google.com>
2024-04-03 17:25:12 +02:00
71a64487d5
Extend FAST to support different principal types ( #2064 )
...
* add doc draft
* typos
* typo
* typo
* typos
* rewording
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* move iam variables to a separate file
* move billing-account module to iam_principals
* move data-catalog-policy-tag module to iam_principals
* move dataplex-datascan module to iam_principals
* move dataproc module to iam_principals
* move folder module to iam_principals
* copyright
* move organization module to iam_principals
* move project module to iam_principals
* move source-repository module to iam_principals
* update blueprints for iam_principals interface
* FAST bootstrap
* module READMEs fixes
* FAST bootstrap
* FAST networking stages
* FAST security stage
* FAST gke stage
* FAST multitenant bootstrap stage
* FAST multitenant resman stage
* tfdoc
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* fix module test
* Update 0-domainless-iam.md
* Update 0-domainless-iam.md
* Rename iam_principals to iam_by_principals
* Update IAM template to include iam_by_principals
* Update Resman README
* Fix ADR link format
---------
Co-authored-by: Julio Castillo <jccb@google.com>
2024-02-12 14:35:30 +01:00
a8c84357f4
Integrate checklist data in FAST ( #1969 )
...
* add locals for additive and authoritative org iam roles
* first shot at IAM and logging location
* tfdoc
* use locals for locations
* fix file parsing, resman stubs
* initial resman implementation
* remove unneeded code
* fix data file
* replace dumb yamldecode
* fix wrong type in organization additive bindings try
* simplify logging local
* Use check asserts for version and org id
* Checks on checklist for resman
* refactor checks, ignore checklist files on wrong org id
* stage 0 tests
* fix checklist checks
* stage 1 tests
---------
Co-authored-by: Wiktor Niesiobędzki <wiktorn@google.com>
2024-01-18 05:45:29 +01:00
9d6e61428b
(WIP) Read-only service accounts for automation and CI/CD ( #1899 )
...
* add design doc for the new CI/CD sa
* describe the actual implementation
* specify which files will need to be changed
* Update 0-cicd-plan-sa.md
* Update 0-cicd-plan-sa.md
* Update 0-cicd-plan-sa.md
* Update 0-cicd-plan-sa.md
* Update 0-cicd-plan-sa.md
* Update 0-cicd-plan-sa.md
* Update 0-cicd-plan-sa.md
* Fix typo
* stage 0 read-only service accounts
* stage 0 IAM map
* linting
* cicd read-only service accounts
* tweak workflow templates
* roles and github workflow fixes
* tfdoc
* Ad-hoc custom role factory for FAST bootstrap
* use factory variable for custom roles data path
* custom roles factory in org/project modules
* tfdoc
* rename custom roles factory variable, fix gitlab template
* gitlab workflow fixes
* fix merge
* output plan results on failed assertion
* update stage 0 expected values
* data platform branch
* gke
* networking
* security
* project factory
* outputs
* workflow templates
* resman apply fixes
* tfdoc
* fix stage 1 test fixture
* fix gh workflow
* read-only resman sa roles
* fix test
* read-only resman sa roles
* read-only resman sa roles
* read-only resman sa roles
* read-only resman sa roles
* fix test variables
* rename wif principal attribute names
* rename wif principal variables
* multitenant stages
---------
Co-authored-by: Wiktor Niesiobędzki <wiktorn@google.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2023-12-27 11:33:16 +00:00
a2263da1f3
fix GitHub CI/CD provider ( #1945 )
2023-12-21 17:10:50 +00:00
f628cdbc06
FAST: move organization policies to stage 0 ( #1698 )
...
* design doc
* Update 0-org-policies.md
* moved org policies to stage 0, wip
* stage0
* stage 0
* export tag keys and values from stage 0
* rename factory variable
* change org policy outputs
* stage 1
* Update 0-org-policies.md
* make org policy variable not nullable, README changes
* use optionals for tag names
* better factory variable name
* README changes
* ADR
2023-09-21 14:03:21 +00:00
2423fd40c1
Fix FAST CI/CD for Gitlab ( #1593 )
...
* fix cicd (multitenant untested)
* tfdoc
* rename allowed_audiences to audiences, align multitenant
2023-08-15 12:59:31 +02:00
9600047a32
Enable team CI/CD impersonation ( #1579 )
2023-08-09 08:46:24 -04:00
47daeaafe1
Update FAST CI/CD workflows so it can work with ID_TOKEN and Gitlab 15+
2023-08-03 16:09:45 +00:00
154df17951
FAST: initial implementation of lightweight tenants ( #1470 )
...
* initial import
* fixes
* fixes
* fixes
* red SA roles
* red SA roles
* org-level custom roles var, tenants IAM config
* tfdoc
* allow core SA to write output files to tenant bucket
* README
* implement comments on PR
* show tenant org example
* update example
2023-07-07 08:40:37 +02:00
c024eca320
Add custom tag support to FAST ( #1426 )
...
* initial implementation of custom tags
* depend org policies on tags
* fix test
* integrate default and custom org policy tags
2023-06-07 22:10:27 +00:00
d2f0b17ec4
Allows groups from other orgs/domains ( #1383 )
...
* Allows groups from other orgs
2023-05-17 11:07:47 +02:00
2217abe5f0
Allow preventing creation of billing IAM roles in FAST, add instructions on delayed billing association ( #1207 )
...
* stage 0
* resman and networking stages
* tfdoc
* security stage
2023-03-03 09:24:41 +01:00
5453c585e0
FAST multitenant bootstrap and resource management, rename org-level FAST stages ( #1052 )
...
* rename stages
* remove support for external org billing, rename output files
* resman: make groups optional, align on new billing account variable
* bootstrap: multitenant outputs
* tenant bootstrap stage, untested
* fix folder name
* fix stage 0 output names
* optional creation for tag keys in organization module
* single tenant bootstrap minus tag
* rename output files, add tenant tag key
* fix organization module tag values output
* test skipping creation for tags in organization module
* single tenant bootstrap plan working
* multitenant bootstrap
* tfdoc
* fix check links error messages
* fix links
* tfdoc
* fix links
* rename fast tests, fix bootstrap tests
* multitenant stages have their own folder, simplify stage numbering
* stage renumbering
* wip
* rename tests
* exclude fast providers in fixture
* stage 0 tests
* stage 1 tests
* network stages tests
* stage tests
* tfdoc
* fix links
* tfdoc
* multitenant tests
* remove local files
* stage links command
* fix links script, TODO
* wip
* wip single tenant bootstrap
* working tenant bootstrap
* update gitignore
* remove local files
* tfdoc
* remove local files
* allow tests for tenant bootstrap stage
* tenant bootstrap proxies stage 1 tfvars
* stage 2 and 3 service accounts and IAM in tenant bootstrap
* wip
* wip
* wip
* drop multitenant bootstrap
* tfdoc
* add missing stage 2 SAs, fix org-level IAM condition
* wip
* wip
* optional tag value creation in organization module
* stage 1 working
* linting
* linting
* READMEs
* wip
* Make stage-links script work in old macos bash
* stage links command help
* fix output file names
* diagrams
* fix svg
* stage 0 skeleton and diagram
* test svg
* test svg
* test diagram
* diagram
* readme
* fix stage links script
* stage 0 readme
* README changes
* stage readmes
* fix outputs order
* fix link
* fix tests
* stage 1 test
* skip stage example
* boilerplate
* fix tftest skip
* default bootstrap stage log sinks to log buckets
* add logging to tenant bootstrap
* move iam variables out of tenant config
* fix cicd, reintroduce missing variable
* use optional in stage 1 cicd variable
* rename extras stage
* rename and move identity providers local, use optional for cicd variable
* tfdoc
* add support for wif pool and providers, ci/cd
* tfdoc
* fix links
* better handling of modules repository
* add missing role on logging project
* fix cicd pools in locals, test cicd
* fix workflow extension
* fix module source replacement
* allow tenant bootstrap cicd sa to impersonate resman sa
* tenant workflow templates fix for no providers file
* fix output files, push github workflow template to new repository
* remove try from outpout files
* align stage 1 cicd internals to stage 0
* tfdoc
* tests
* fix tests
* tests
* improve variable descriptions
* use optional in fast features
* actually create tenant log sinks, and allow the resman sa to do it
* test
* tests
* aaaand tests again
* fast features tenant override
* fast features tenant override
* fix wording
* add missing comment
* configure pf service accounts
* add missing comment
* tfdoc
* tests
* IAM docs
* update copyright
---------
Co-authored-by: Julio Castillo <jccb@google.com>
2023-02-04 15:00:45 +01:00
Ludovico Magnocavallo
Simone Ruffilli
Julio Castillo
Timothy Jabez
Elia
Matt
Luca Prete
Roberto Jung Drebes