Commit Graph

1439 Commits

Author SHA1 Message Date
Julio Castillo 547ded37b2 Update networking folder names to match teams folder 2022-02-11 08:29:46 +01:00
Ludovico Magnocavallo 53144713aa
update bootstrap commands (#536) 2022-02-11 08:20:33 +01:00
Julio Castillo 765f291259
Merge pull request #534 from GoogleCloudPlatform/jccb/fast-fix-pf
Fix renamed argument to project factory module
2022-02-11 08:17:30 +01:00
Julio Castillo 05842c5989
Merge pull request #535 from GoogleCloudPlatform/jccb/pf-prefix
Use prefix for PF projects
2022-02-11 08:17:13 +01:00
Julio Castillo 096dce08e9 Use prefix for PF projects 2022-02-11 00:43:14 +01:00
Julio Castillo fd599ea286 Fix renamed argument to project factory module 2022-02-11 00:30:46 +01:00
Julio Castillo eac11193c1
Merge pull request #533 from GoogleCloudPlatform/ludo/fast-custom-role-names
Allow specifying custom role names
2022-02-10 19:29:31 +01:00
Ludovico Magnocavallo bb97486987 tfdoc 2022-02-10 19:17:35 +01:00
Ludovico Magnocavallo 677f3c8df1 use custom role name for billing org too 2022-02-10 19:16:13 +01:00
Ludovico Magnocavallo 3246d1c08d fix variable 2022-02-10 19:13:55 +01:00
Ludovico Magnocavallo c4d36cc66b Allow specifying custom role names 2022-02-10 19:12:07 +01:00
Ludovico Magnocavallo ae49074921
Update terraform.tfvars.sample 2022-02-10 17:25:38 +01:00
Simone Ruffilli 2696af1a7e
Update vpc-sc.tf - manage empty perimeters. (#530)
* Update vpc-sc.tf - manage empty perimeters.

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-10 16:24:14 +01:00
Julio Castillo 89467e1c86
Merge pull request #531 from GoogleCloudPlatform/jccb/fast-logging
Document log sinks in stage 0
2022-02-10 13:12:32 +01:00
Julio Castillo 6700faf662 Document log sinks in stage 0 2022-02-10 13:00:43 +01:00
Julio Castillo 8844f1b3a4
Merge pull request #529 from GoogleCloudPlatform/jccb/fix-project-robots
Add service account prefix to member bindings
2022-02-09 18:40:10 +01:00
Julio Castillo ca7dc0e7a2 Add service account prefix to member bindings 2022-02-09 18:22:27 +01:00
lcaggio b377b30910
Update README (#517)
Update path to config folder

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-09 13:05:46 +01:00
lcaggio 307c29d2f8
Add Data Catalog Policy Tag (#520)
* First commit

* Add outputs, update README, fix variables

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix tests, for real?

* Fix tests, for real.

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-09 13:05:27 +01:00
Ludovico Magnocavallo f4ef54da34
Avoid nested tmp dirs in doc example tests (#528) 2022-02-09 12:53:17 +01:00
eeaton a18bea7f2c
Add Zonal DNS Only org policy (#527)
This is a safe and sane org policy that should be recommended for most customers to prevent them from accidentally configuring internal dns in a way that has reduced availability
https://cloud.google.com/compute/docs/internal-dns#enforce_dns_by_policy
2022-02-09 12:21:43 +01:00
Ludovico Magnocavallo c6a8f86cc0
Update CHANGELOG.md 2022-02-09 11:08:04 +01:00
Ludovico Magnocavallo 40cb46e1cc
Add support for Shared VPC service IAM to project module (#525)
* project module changes

* fix examples

* add comments in module code

* re-enable nullable on svpc variables

* project factory

* Tests still failing (#526)

* fix pf

* tfdoc

* pf test boilerplate

Co-authored-by: Simone Ruffilli <sruffilli@google.com>
2022-02-09 11:06:51 +01:00
Ludovico Magnocavallo c27b25c114 Merge branch 'master' of github.com:GoogleCloudPlatform/cloud-foundation-fabric 2022-02-08 16:10:52 +01:00
Julio Castillo 9b746f00cc
Update CHANGELOG.md 2022-02-08 15:25:15 +01:00
Julio Castillo 085142f07d
Update CHANGELOG.md 2022-02-08 15:24:40 +01:00
Ludovico Magnocavallo d21304267b revert dry-run to true as default 2022-02-08 13:43:37 +01:00
Ludovico Magnocavallo 02dc9de9b0
make it simpler to switch from/ry run mode (#524) 2022-02-08 13:26:44 +01:00
Ludovico Magnocavallo 4567b788a2 add org policy role to cloud admins 2022-02-08 11:31:39 +01:00
Ludovico Magnocavallo 76a3312a91 update changelog 2022-02-08 07:41:23 +01:00
Ludovico Magnocavallo c2a2b799b9
Remove older GCS to BQ example (#523)
* remove older GCS to BQ example

* remove tests
2022-02-08 07:30:03 +01:00
Luca Prete be33a7f880
FAST - Fixes 498 - 02-networking-nva stage 2022-02-07 13:22:58 +01:00
Julio Castillo 48cfd0e5bc Fix README 2022-02-07 11:54:19 +01:00
Julio Castillo 82b181f34e Project factory fixes
- Add GKE roles in the host project
- Use SA names from project module
- Add a few outputs
- Add prefix for project ids
2022-02-07 11:54:19 +01:00
Simone Ruffilli 40142572f8
Update variables.tf example for team_folders 2022-02-07 11:15:13 +01:00
Ludovico Magnocavallo 8f1639a3c5 sample tfvars file 2022-02-07 11:07:13 +01:00
Julio Castillo 5937bac299 Update PF to grant network user to the cloud service agent when using gke. 2022-02-06 19:57:25 +01:00
Ludovico Magnocavallo e5440f98a2
use prod folder for landing project (#514) 2022-02-06 19:25:05 +01:00
Ludovico Magnocavallo d711a93397
fix previous merge (#513) 2022-02-06 18:34:32 +01:00
Ludovico Magnocavallo c4533503a6
Fast: use pathexpand for output location (#512)
* use pathexpand for output location

* tfdoc
2022-02-06 18:24:46 +01:00
Simone Ruffilli 1aa5d5d93f
Misc documentation fixes (#493) 2022-02-06 10:50:23 +01:00
Ludovico Magnocavallo 6c1c943600 fix org id 2022-02-06 10:05:31 +01:00
Ludovico Magnocavallo 769fc73e83 remove unused roles on automation project 2022-02-06 09:47:40 +01:00
Julio Castillo d9a96b54cd Fix typo 2022-02-05 20:22:24 +01:00
Julio Castillo 06c3fb3757 Activate GHA for fast-dev-gke branch 2022-02-05 20:22:24 +01:00
Ludovico Magnocavallo c8cbf9b7d7
Add utility to extract IAM bindings from state (#503)
* add utility to extract IAM bindings from state

* TODO

* TODO

* output one row per role/member pairs

* sorting

* rename, delete spurious file

* generalize output functions

* generate IAM.md

* fix org id

* add link to role in markdown

* fix org id

* replace organization ids
2022-02-05 17:34:43 +01:00
Julio Castillo a22dff8938 Update net-vpc module to use beta provider for shared vpc resources. 2022-02-05 16:50:03 +01:00
Antonio Lopez 7bc10d1039
IoT module (#415)
* added iot-core module folder

* modified iot core readme file

* added initial version of the IoT Platform terraform files

* añadido detalles en README

* Update README.md

fix markup issue

* Update README.md

modified input/output

* deleted provider from main and module services

* pub_sub topic ids used in the registry instead of creating new ones

* variable extra_telemetry_pub_sub_topic_ids modified as default

* included data platform integration use case in the doc

* devices config moved to yaml file

* included example to create device certificates

* added HCL and #tftest to README. Moved project/region to variables

* solved bug with no optional variables for extra topics or devices yaml

* solved bug with no optional variables for extra topics or devices yaml

* added example to send MQTT telemetry to IoT Platform

* modified doc on Data Platform integration

* included diagram

* added Registry / Device creation default configuration into variables. Deleted exammple devices yaml file. Corrected module source path

* solved comments in PR

* applied terraform fmt

* solved bug in boolean (bool) variable

* updated variables in doc

* updated output variable name

* updated #tftest:skip on examples as using yaml input makes resources number variable

* Update README.md

modified input/output

* pub_sub topic ids used in the registry instead of creating new ones

* variable extra_telemetry_pub_sub_topic_ids modified as default

* included data platform integration use case in the doc

* devices config moved to yaml file

* included example to create device certificates

* added HCL and #tftest to README. Moved project/region to variables

* solved bug with no optional variables for extra topics or devices yaml

* solved bug with no optional variables for extra topics or devices yaml

* added example to send MQTT telemetry to IoT Platform

* modified doc on Data Platform integration

* included diagram

* added Registry / Device creation default configuration into variables. Deleted exammple devices yaml file. Corrected module source path

* solved comments in PR

* applied terraform fmt

* solved bug in boolean (bool) variable

* updated variables in doc

* Updated diagram and documentation for decentralized firewall.

* Fixed error with VPC connector. Count was referring to resource attributes that weren't known until after the configuration was applied

* Added Cloud Foundation Fabric logos. (#363)

* Create README.md

* Add logo to readme file

* exclusions for audit in locals in logging_sinks.audit-logs now

* style fix (whitespaces)

* Added dynamic block for dns_cache_config

* Fixed boolean variable condition

* Adding Apigee Environments as output for apigee-organization module

* small var conditional fix

* Added GKE pubsub notifications

* Default creation false

* Updated variable default value

* removed extra lines

* defaulted to false and conditional output

* depend log sinks from IAM roles, fixes #371

* Update README.md

* [#374] Add taint when Windows node pools are created to match the one GKE implicitly adds

* Update README.md

Fixes out of date link on the module usage example

* Update README.md - fixed broken link

* Added subnet id and self_link to outputs (#377)

Adjusted module outputs so that it's easier to consume them when using the factory in a larger codebase.

* net-vpc module: added subnet mini-factory

* Update README.md

* Code cleanup

* Adds support for IAM per-subnet IAM bindings via factory

* Gracefully handle a null secondary_ip_range

* Updated README.md. Added tests.

* Added license boilerplate to subnet yaml data in tests

* Update README.md

* Update README.md

* Removed dead code

* net-vpc-firewall mini rules-factory

* Paying tributes to the linting gods

* Fixed small bug on locals

* Tests for net-vpc-firewall module

* Update CHANGELOG.md

* refactor locals (#382)

* Add support for partitioned tables on Organization sinks (#380)

* Add support for partioned tables on Organization sinks

* Update changelog

* Fix lint

* Fix lint

* Use simple bool instead of block

* fix README

* Fix Readme

* Rename variable

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* Improve PSN support in net-vpc module (#384)

* improve PSN support

* fix variable order

* fix example test

* fix cloudsql example

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update CHANGELOG.md

* Remove location from local.prefix

* Organization module refactor, in-module firewall policy factory for organization and folder (#385)

* move iam and logging to separate files, minimal refactoring

* update README

* fix example

* factory

* tfdoc

* boilerplate

* remove data_folder variable

* tfdoc

* fix default factory name

* add firewall policy to folder module

* add factory example

* Update CHANGELOG.md

* Fix VPC-SC module, add example (#387)

* Update CONTRIBUTING.md

Suggest change of wording related to `terraform format`: should be done from the top, recursively, and after `pytest` step, because fixtures are also going to be checked for linting during PR.

* Add target_node and minor fixes  (#389)

* Add separate BQ tables per asset type

* Add missing BQ location

* Add missing CF region

* Change Scheduler job to non-generic

* Add target_node, pass tests

* Do tfdoc.py

* Do terraform fmt

* Do terraform fmt -recursive for tests' fixtures

* Fix typo in test's variables

* Added support for Stateful Managed Instance Groups (#367)

* First iteration updates

* All tests passing

* Updated README and var descriptions

* Updated README

* Updated example README

* Consolidated stateful vars

* consolidated stateful vars

* Updated README

* Requested changes to try

* Fixed README examples and try

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* SA key uploading and credentials json generation with terraform.

* Fix typo in the SA module readme

* TF fmt

* Update iam-sa docs

* Finalize onprem-sa-ket-mgmt example

* Add basic test for onprem-sa-mgmt example

* Refactoring

* Reorder variables

* Rewording, fix typos

* Bump tftest version

Bump tftest version to 1.6.1 and ensure test runners can update
providers if needed and available.

* Add bq_table_overwrite handling

* Add optional BQ table as a file export config

* Add getattr() to retrieve attribute from format

* Add roles/bigquery.jobUser for CF

* Update test_plan and README

* Change README, add diagram ( gcpdraw a6e4ec4f-7d6c-4796-b63e-ee4ce7b1792f )

* Change README to two diagrams

* Add count to toggle optional modules

* Change README

* Resolve order of variables test

* Linux sysctls configuration and Kubelet config (#388)

* Linux sysctls configuration and Kubelet config

* Fix terraform linting issues

* Updated README.md

* Updated Kubelet config object type

* Update readme

Co-authored-by: Sergio Tejón <stejon@freepik.com>
Co-authored-by: Julio Castillo <jccb@google.com>

* net-address: Added support for PSA ranges

* Update outputs.tf

* Fixes typo

* Resolved merge conflict

* Update CHANGELOG.md

* Add metric scopes support (#397)

* Add metric scopes support

* Fix typo

* new tfdoc block in README

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* fix tfdoc replacement (#398)

* Update CHANGELOG.md

* Ludo hfw fixes (#400)

* fix tfdoc replacement

* ignore changes to rule description

* add folder example, fixes #339

* Update CHANGELOG.md

* Fix ignore changes for hfw rules (#401)

* fix tfdoc replacement

* ignore changes to rule description

* add folder example, fixes #339

* fix ignore changes in org and folder module

* Update CHANGELOG.md

* update documentation check

* backport tfdoc and check doc fixes

* Re-run pydoc

* Redo pydoc + local linting checks

* update tfdoc (#404)

* Org/Folder: Allow for policy association when using rule factory (#405)

* Org/Folder: Allow for policy association when using rule factory

* Fix linting issue

* Update hierarchical firewall resource

This replaces all the `google_compute_organization_security_*`
resources with the newer `google_compute_firewall_*` resources.

* Fix typo.

* Update CHANGELOG.md

* Typo fix

* New vpc-sc module implementation (#406)

* first implementation

* minimal output

* split service perimeters in regular and bridge

* tests and fixes

* new vpc-sc implementation

* remove providers file used for testing

* remove provider used during development

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update README.md

* fix cases where bridge perimeter status resources are null (#408)

* Update CHANGELOG.md

* Copyright bump (#410)

* remove lifecycle block from vpc sc perimeters (#412)

* Update CHANGELOG.md

* Update CHANGELOG.md

* Interpolate access levels by key in vpc sc module (#414)

* interpolate access levels by key

* fix access level reference

* fix num resources in last README test

* Update CHANGELOG.md

* fix ingress policies in vpc sc module

* disable device policy support in vpc-sc module

* depend bridge from regular perimeters in vpc sc module

* Update CONTRIBUTING.md

* add versions to vpc-sc module

* Update CONTRIBUTING.md

* updated output variable name

* updated #tftest:skip on examples as using yaml input makes resources number variable

* changed pub_sub to pubsub

* unified protocol input variable

* changed extra_telemetry_pubsub_topic_ids variable type to: map

* solved issue in README.md

* grouped device configuration variables

* device config is now done individually per each device in the yaml file

* changes on device config yaml processing: 1 single yaml directory, use try() while parsing, example identation corrected

* updated headers to 2022

* removed get-pip.py
2022-02-05 15:54:24 +01:00
Simone Ruffilli 75aff4081f
default=null for `shared_vpc_self_link ` and `vpc_host_project` (#502)
* Update variables.tf

* Update README.md
2022-02-04 19:57:06 +01:00
Julio Castillo 0c0614e12f Fix typo in stage2 variable
Co-authored-by: Daniel Marzini <dmarzi@google.com>
2022-02-04 16:54:09 +01:00