Commit Graph

1687 Commits

Author SHA1 Message Date
lcaggio 042266f28c
Merge branch 'master' into fast-dev-dp 2022-02-08 09:02:48 +01:00
Ludovico Magnocavallo 76a3312a91 update changelog 2022-02-08 07:41:23 +01:00
Ludovico Magnocavallo c2a2b799b9
Remove older GCS to BQ example (#523)
* remove older GCS to BQ example

* remove tests
2022-02-08 07:30:03 +01:00
Lorenzo Caggioni 508fcf7527 Fix variable typos 2022-02-08 00:02:20 +01:00
Lorenzo Caggioni 97b9dae7e1 Fix misconfiguration and tests. 2022-02-07 23:16:47 +01:00
Lorenzo Caggioni d8bad57790 Refactor variables 2022-02-07 21:28:54 +01:00
Lorenzo Caggioni 94d94876a0 Merge branch 'fast-dev-dp' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into fast-dev-dp 2022-02-07 17:51:16 +01:00
Lorenzo Caggioni 2e560407c1 Temp commit with errors 2022-02-07 17:51:06 +01:00
lcaggio e3a4df27d6
Merge branch 'master' into fast-dev-dp 2022-02-07 15:55:34 +01:00
Luca Prete be33a7f880
FAST - Fixes 498 - 02-networking-nva stage 2022-02-07 13:22:58 +01:00
Julio Castillo 48cfd0e5bc Fix README 2022-02-07 11:54:19 +01:00
Julio Castillo 82b181f34e Project factory fixes
- Add GKE roles in the host project
- Use SA names from project module
- Add a few outputs
- Add prefix for project ids
2022-02-07 11:54:19 +01:00
Simone Ruffilli 40142572f8
Update variables.tf example for team_folders 2022-02-07 11:15:13 +01:00
Ludovico Magnocavallo 8f1639a3c5 sample tfvars file 2022-02-07 11:07:13 +01:00
Lorenzo Caggioni 48f442572c Add DLP documentation link. 2022-02-07 10:56:42 +01:00
Lorenzo Caggioni 072fa3d9fd Fix test. 2022-02-07 08:25:16 +01:00
Lorenzo Caggioni 78fcdc5374 Fix composer roles and README. 2022-02-07 08:20:20 +01:00
Lorenzo Caggioni e0f83569f1 Merge branch 'fast-dev-dp' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into fast-dev-dp 2022-02-06 20:59:22 +01:00
Lorenzo Caggioni 88ecca734d Update README 2022-02-06 20:59:16 +01:00
lcaggio ee0d0774b4
Merge branch 'master' into fast-dev-dp 2022-02-06 20:27:51 +01:00
Lorenzo Caggioni bfefb88f31 Add PubSub encryption 2022-02-06 20:27:41 +01:00
Julio Castillo 5937bac299 Update PF to grant network user to the cloud service agent when using gke. 2022-02-06 19:57:25 +01:00
Ludovico Magnocavallo e5440f98a2
use prod folder for landing project (#514) 2022-02-06 19:25:05 +01:00
Ludovico Magnocavallo d711a93397
fix previous merge (#513) 2022-02-06 18:34:32 +01:00
Ludovico Magnocavallo c4533503a6
Fast: use pathexpand for output location (#512)
* use pathexpand for output location

* tfdoc
2022-02-06 18:24:46 +01:00
Simone Ruffilli 1aa5d5d93f
Misc documentation fixes (#493) 2022-02-06 10:50:23 +01:00
Ludovico Magnocavallo 6c1c943600 fix org id 2022-02-06 10:05:31 +01:00
Ludovico Magnocavallo 769fc73e83 remove unused roles on automation project 2022-02-06 09:47:40 +01:00
Julio Castillo d9a96b54cd Fix typo 2022-02-05 20:22:24 +01:00
Julio Castillo 06c3fb3757 Activate GHA for fast-dev-gke branch 2022-02-05 20:22:24 +01:00
Ludovico Magnocavallo c8cbf9b7d7
Add utility to extract IAM bindings from state (#503)
* add utility to extract IAM bindings from state

* TODO

* TODO

* output one row per role/member pairs

* sorting

* rename, delete spurious file

* generalize output functions

* generate IAM.md

* fix org id

* add link to role in markdown

* fix org id

* replace organization ids
2022-02-05 17:34:43 +01:00
Julio Castillo a22dff8938 Update net-vpc module to use beta provider for shared vpc resources. 2022-02-05 16:50:03 +01:00
Antonio Lopez 7bc10d1039
IoT module (#415)
* added iot-core module folder

* modified iot core readme file

* added initial version of the IoT Platform terraform files

* añadido detalles en README

* Update README.md

fix markup issue

* Update README.md

modified input/output

* deleted provider from main and module services

* pub_sub topic ids used in the registry instead of creating new ones

* variable extra_telemetry_pub_sub_topic_ids modified as default

* included data platform integration use case in the doc

* devices config moved to yaml file

* included example to create device certificates

* added HCL and #tftest to README. Moved project/region to variables

* solved bug with no optional variables for extra topics or devices yaml

* solved bug with no optional variables for extra topics or devices yaml

* added example to send MQTT telemetry to IoT Platform

* modified doc on Data Platform integration

* included diagram

* added Registry / Device creation default configuration into variables. Deleted exammple devices yaml file. Corrected module source path

* solved comments in PR

* applied terraform fmt

* solved bug in boolean (bool) variable

* updated variables in doc

* updated output variable name

* updated #tftest:skip on examples as using yaml input makes resources number variable

* Update README.md

modified input/output

* pub_sub topic ids used in the registry instead of creating new ones

* variable extra_telemetry_pub_sub_topic_ids modified as default

* included data platform integration use case in the doc

* devices config moved to yaml file

* included example to create device certificates

* added HCL and #tftest to README. Moved project/region to variables

* solved bug with no optional variables for extra topics or devices yaml

* solved bug with no optional variables for extra topics or devices yaml

* added example to send MQTT telemetry to IoT Platform

* modified doc on Data Platform integration

* included diagram

* added Registry / Device creation default configuration into variables. Deleted exammple devices yaml file. Corrected module source path

* solved comments in PR

* applied terraform fmt

* solved bug in boolean (bool) variable

* updated variables in doc

* Updated diagram and documentation for decentralized firewall.

* Fixed error with VPC connector. Count was referring to resource attributes that weren't known until after the configuration was applied

* Added Cloud Foundation Fabric logos. (#363)

* Create README.md

* Add logo to readme file

* exclusions for audit in locals in logging_sinks.audit-logs now

* style fix (whitespaces)

* Added dynamic block for dns_cache_config

* Fixed boolean variable condition

* Adding Apigee Environments as output for apigee-organization module

* small var conditional fix

* Added GKE pubsub notifications

* Default creation false

* Updated variable default value

* removed extra lines

* defaulted to false and conditional output

* depend log sinks from IAM roles, fixes #371

* Update README.md

* [#374] Add taint when Windows node pools are created to match the one GKE implicitly adds

* Update README.md

Fixes out of date link on the module usage example

* Update README.md - fixed broken link

* Added subnet id and self_link to outputs (#377)

Adjusted module outputs so that it's easier to consume them when using the factory in a larger codebase.

* net-vpc module: added subnet mini-factory

* Update README.md

* Code cleanup

* Adds support for IAM per-subnet IAM bindings via factory

* Gracefully handle a null secondary_ip_range

* Updated README.md. Added tests.

* Added license boilerplate to subnet yaml data in tests

* Update README.md

* Update README.md

* Removed dead code

* net-vpc-firewall mini rules-factory

* Paying tributes to the linting gods

* Fixed small bug on locals

* Tests for net-vpc-firewall module

* Update CHANGELOG.md

* refactor locals (#382)

* Add support for partitioned tables on Organization sinks (#380)

* Add support for partioned tables on Organization sinks

* Update changelog

* Fix lint

* Fix lint

* Use simple bool instead of block

* fix README

* Fix Readme

* Rename variable

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* Improve PSN support in net-vpc module (#384)

* improve PSN support

* fix variable order

* fix example test

* fix cloudsql example

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update CHANGELOG.md

* Remove location from local.prefix

* Organization module refactor, in-module firewall policy factory for organization and folder (#385)

* move iam and logging to separate files, minimal refactoring

* update README

* fix example

* factory

* tfdoc

* boilerplate

* remove data_folder variable

* tfdoc

* fix default factory name

* add firewall policy to folder module

* add factory example

* Update CHANGELOG.md

* Fix VPC-SC module, add example (#387)

* Update CONTRIBUTING.md

Suggest change of wording related to `terraform format`: should be done from the top, recursively, and after `pytest` step, because fixtures are also going to be checked for linting during PR.

* Add target_node and minor fixes  (#389)

* Add separate BQ tables per asset type

* Add missing BQ location

* Add missing CF region

* Change Scheduler job to non-generic

* Add target_node, pass tests

* Do tfdoc.py

* Do terraform fmt

* Do terraform fmt -recursive for tests' fixtures

* Fix typo in test's variables

* Added support for Stateful Managed Instance Groups (#367)

* First iteration updates

* All tests passing

* Updated README and var descriptions

* Updated README

* Updated example README

* Consolidated stateful vars

* consolidated stateful vars

* Updated README

* Requested changes to try

* Fixed README examples and try

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* SA key uploading and credentials json generation with terraform.

* Fix typo in the SA module readme

* TF fmt

* Update iam-sa docs

* Finalize onprem-sa-ket-mgmt example

* Add basic test for onprem-sa-mgmt example

* Refactoring

* Reorder variables

* Rewording, fix typos

* Bump tftest version

Bump tftest version to 1.6.1 and ensure test runners can update
providers if needed and available.

* Add bq_table_overwrite handling

* Add optional BQ table as a file export config

* Add getattr() to retrieve attribute from format

* Add roles/bigquery.jobUser for CF

* Update test_plan and README

* Change README, add diagram ( gcpdraw a6e4ec4f-7d6c-4796-b63e-ee4ce7b1792f )

* Change README to two diagrams

* Add count to toggle optional modules

* Change README

* Resolve order of variables test

* Linux sysctls configuration and Kubelet config (#388)

* Linux sysctls configuration and Kubelet config

* Fix terraform linting issues

* Updated README.md

* Updated Kubelet config object type

* Update readme

Co-authored-by: Sergio Tejón <stejon@freepik.com>
Co-authored-by: Julio Castillo <jccb@google.com>

* net-address: Added support for PSA ranges

* Update outputs.tf

* Fixes typo

* Resolved merge conflict

* Update CHANGELOG.md

* Add metric scopes support (#397)

* Add metric scopes support

* Fix typo

* new tfdoc block in README

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* fix tfdoc replacement (#398)

* Update CHANGELOG.md

* Ludo hfw fixes (#400)

* fix tfdoc replacement

* ignore changes to rule description

* add folder example, fixes #339

* Update CHANGELOG.md

* Fix ignore changes for hfw rules (#401)

* fix tfdoc replacement

* ignore changes to rule description

* add folder example, fixes #339

* fix ignore changes in org and folder module

* Update CHANGELOG.md

* update documentation check

* backport tfdoc and check doc fixes

* Re-run pydoc

* Redo pydoc + local linting checks

* update tfdoc (#404)

* Org/Folder: Allow for policy association when using rule factory (#405)

* Org/Folder: Allow for policy association when using rule factory

* Fix linting issue

* Update hierarchical firewall resource

This replaces all the `google_compute_organization_security_*`
resources with the newer `google_compute_firewall_*` resources.

* Fix typo.

* Update CHANGELOG.md

* Typo fix

* New vpc-sc module implementation (#406)

* first implementation

* minimal output

* split service perimeters in regular and bridge

* tests and fixes

* new vpc-sc implementation

* remove providers file used for testing

* remove provider used during development

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update README.md

* fix cases where bridge perimeter status resources are null (#408)

* Update CHANGELOG.md

* Copyright bump (#410)

* remove lifecycle block from vpc sc perimeters (#412)

* Update CHANGELOG.md

* Update CHANGELOG.md

* Interpolate access levels by key in vpc sc module (#414)

* interpolate access levels by key

* fix access level reference

* fix num resources in last README test

* Update CHANGELOG.md

* fix ingress policies in vpc sc module

* disable device policy support in vpc-sc module

* depend bridge from regular perimeters in vpc sc module

* Update CONTRIBUTING.md

* add versions to vpc-sc module

* Update CONTRIBUTING.md

* updated output variable name

* updated #tftest:skip on examples as using yaml input makes resources number variable

* changed pub_sub to pubsub

* unified protocol input variable

* changed extra_telemetry_pubsub_topic_ids variable type to: map

* solved issue in README.md

* grouped device configuration variables

* device config is now done individually per each device in the yaml file

* changes on device config yaml processing: 1 single yaml directory, use try() while parsing, example identation corrected

* updated headers to 2022

* removed get-pip.py
2022-02-05 15:54:24 +01:00
Lorenzo Caggioni d692c57f20 Fix test module location, for real. 2022-02-05 09:30:40 +01:00
Lorenzo Caggioni 1c3f6270fb Fix test module location. 2022-02-05 09:23:14 +01:00
Lorenzo Caggioni 30b18374fb Replace DP example tests with the new one. 2022-02-05 09:11:03 +01:00
Lorenzo Caggioni 577fbf1cc3 Fix README 2022-02-05 09:06:30 +01:00
Lorenzo Caggioni 74b850b4b8 Fix secondary range logic 2022-02-05 09:04:18 +01:00
Lorenzo Caggioni b65d153ec1 Replace existing data platform 2022-02-05 08:51:11 +01:00
Simone Ruffilli 75aff4081f
default=null for `shared_vpc_self_link ` and `vpc_host_project` (#502)
* Update variables.tf

* Update README.md
2022-02-04 19:57:06 +01:00
Ludovico Magnocavallo 2cdea57954 README refactor 2022-02-04 17:35:30 +01:00
Julio Castillo 0c0614e12f Fix typo in stage2 variable
Co-authored-by: Daniel Marzini <dmarzi@google.com>
2022-02-04 16:54:09 +01:00
Julio Castillo 18adf869ae Update networking stages to use multiple folders
Co-authored-by: Daniel Marzini <dmarzi@google.com>
2022-02-04 16:21:00 +01:00
Julio Castillo ed4fc477a7 Update resman outputs and projects 2022-02-04 16:21:00 +01:00
Julio Castillo f184ced544 Add xpnAdmin to diffent folders 2022-02-04 16:21:00 +01:00
Julio Castillo 52a182ddbd Switch project module to beta provider for SVPC resources 2022-02-04 16:21:00 +01:00
Ludovico Magnocavallo 5ac7bd30b0
Merge branch 'master' into fast-dev-dp 2022-02-04 14:40:38 +01:00
Simone Ruffilli 190442da9d
FAST-02-nva: uniformed l7 and PSA CIDRs (#497)
* FAST-02-nva: uniformed l7 and PSA CIDRs

* Update variables.tf

* Fixes README.md

* Fixes typo in variables.tf

* Fixes README.md
2022-02-04 14:40:24 +01:00
Simone Ruffilli a82f107f54
FAST-00: Adds projectCreator to resman SA. Always create delegated role grants. (#496) 2022-02-04 13:59:32 +01:00
lcaggio 16a36b2452
Merge branch 'master' into fast-dev-dp 2022-02-04 13:55:20 +01:00