cloud-foundation-fabric/modules
Antonio Lopez 7bc10d1039
IoT module (#415)
* added iot-core module folder

* modified iot core readme file

* added initial version of the IoT Platform terraform files

* añadido detalles en README

* Update README.md

fix markup issue

* Update README.md

modified input/output

* deleted provider from main and module services

* pub_sub topic ids used in the registry instead of creating new ones

* variable extra_telemetry_pub_sub_topic_ids modified as default

* included data platform integration use case in the doc

* devices config moved to yaml file

* included example to create device certificates

* added HCL and #tftest to README. Moved project/region to variables

* solved bug with no optional variables for extra topics or devices yaml

* solved bug with no optional variables for extra topics or devices yaml

* added example to send MQTT telemetry to IoT Platform

* modified doc on Data Platform integration

* included diagram

* added Registry / Device creation default configuration into variables. Deleted exammple devices yaml file. Corrected module source path

* solved comments in PR

* applied terraform fmt

* solved bug in boolean (bool) variable

* updated variables in doc

* updated output variable name

* updated #tftest:skip on examples as using yaml input makes resources number variable

* Update README.md

modified input/output

* pub_sub topic ids used in the registry instead of creating new ones

* variable extra_telemetry_pub_sub_topic_ids modified as default

* included data platform integration use case in the doc

* devices config moved to yaml file

* included example to create device certificates

* added HCL and #tftest to README. Moved project/region to variables

* solved bug with no optional variables for extra topics or devices yaml

* solved bug with no optional variables for extra topics or devices yaml

* added example to send MQTT telemetry to IoT Platform

* modified doc on Data Platform integration

* included diagram

* added Registry / Device creation default configuration into variables. Deleted exammple devices yaml file. Corrected module source path

* solved comments in PR

* applied terraform fmt

* solved bug in boolean (bool) variable

* updated variables in doc

* Updated diagram and documentation for decentralized firewall.

* Fixed error with VPC connector. Count was referring to resource attributes that weren't known until after the configuration was applied

* Added Cloud Foundation Fabric logos. (#363)

* Create README.md

* Add logo to readme file

* exclusions for audit in locals in logging_sinks.audit-logs now

* style fix (whitespaces)

* Added dynamic block for dns_cache_config

* Fixed boolean variable condition

* Adding Apigee Environments as output for apigee-organization module

* small var conditional fix

* Added GKE pubsub notifications

* Default creation false

* Updated variable default value

* removed extra lines

* defaulted to false and conditional output

* depend log sinks from IAM roles, fixes #371

* Update README.md

* [#374] Add taint when Windows node pools are created to match the one GKE implicitly adds

* Update README.md

Fixes out of date link on the module usage example

* Update README.md - fixed broken link

* Added subnet id and self_link to outputs (#377)

Adjusted module outputs so that it's easier to consume them when using the factory in a larger codebase.

* net-vpc module: added subnet mini-factory

* Update README.md

* Code cleanup

* Adds support for IAM per-subnet IAM bindings via factory

* Gracefully handle a null secondary_ip_range

* Updated README.md. Added tests.

* Added license boilerplate to subnet yaml data in tests

* Update README.md

* Update README.md

* Removed dead code

* net-vpc-firewall mini rules-factory

* Paying tributes to the linting gods

* Fixed small bug on locals

* Tests for net-vpc-firewall module

* Update CHANGELOG.md

* refactor locals (#382)

* Add support for partitioned tables on Organization sinks (#380)

* Add support for partioned tables on Organization sinks

* Update changelog

* Fix lint

* Fix lint

* Use simple bool instead of block

* fix README

* Fix Readme

* Rename variable

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* Improve PSN support in net-vpc module (#384)

* improve PSN support

* fix variable order

* fix example test

* fix cloudsql example

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update CHANGELOG.md

* Remove location from local.prefix

* Organization module refactor, in-module firewall policy factory for organization and folder (#385)

* move iam and logging to separate files, minimal refactoring

* update README

* fix example

* factory

* tfdoc

* boilerplate

* remove data_folder variable

* tfdoc

* fix default factory name

* add firewall policy to folder module

* add factory example

* Update CHANGELOG.md

* Fix VPC-SC module, add example (#387)

* Update CONTRIBUTING.md

Suggest change of wording related to `terraform format`: should be done from the top, recursively, and after `pytest` step, because fixtures are also going to be checked for linting during PR.

* Add target_node and minor fixes  (#389)

* Add separate BQ tables per asset type

* Add missing BQ location

* Add missing CF region

* Change Scheduler job to non-generic

* Add target_node, pass tests

* Do tfdoc.py

* Do terraform fmt

* Do terraform fmt -recursive for tests' fixtures

* Fix typo in test's variables

* Added support for Stateful Managed Instance Groups (#367)

* First iteration updates

* All tests passing

* Updated README and var descriptions

* Updated README

* Updated example README

* Consolidated stateful vars

* consolidated stateful vars

* Updated README

* Requested changes to try

* Fixed README examples and try

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* SA key uploading and credentials json generation with terraform.

* Fix typo in the SA module readme

* TF fmt

* Update iam-sa docs

* Finalize onprem-sa-ket-mgmt example

* Add basic test for onprem-sa-mgmt example

* Refactoring

* Reorder variables

* Rewording, fix typos

* Bump tftest version

Bump tftest version to 1.6.1 and ensure test runners can update
providers if needed and available.

* Add bq_table_overwrite handling

* Add optional BQ table as a file export config

* Add getattr() to retrieve attribute from format

* Add roles/bigquery.jobUser for CF

* Update test_plan and README

* Change README, add diagram ( gcpdraw a6e4ec4f-7d6c-4796-b63e-ee4ce7b1792f )

* Change README to two diagrams

* Add count to toggle optional modules

* Change README

* Resolve order of variables test

* Linux sysctls configuration and Kubelet config (#388)

* Linux sysctls configuration and Kubelet config

* Fix terraform linting issues

* Updated README.md

* Updated Kubelet config object type

* Update readme

Co-authored-by: Sergio Tejón <stejon@freepik.com>
Co-authored-by: Julio Castillo <jccb@google.com>

* net-address: Added support for PSA ranges

* Update outputs.tf

* Fixes typo

* Resolved merge conflict

* Update CHANGELOG.md

* Add metric scopes support (#397)

* Add metric scopes support

* Fix typo

* new tfdoc block in README

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* fix tfdoc replacement (#398)

* Update CHANGELOG.md

* Ludo hfw fixes (#400)

* fix tfdoc replacement

* ignore changes to rule description

* add folder example, fixes #339

* Update CHANGELOG.md

* Fix ignore changes for hfw rules (#401)

* fix tfdoc replacement

* ignore changes to rule description

* add folder example, fixes #339

* fix ignore changes in org and folder module

* Update CHANGELOG.md

* update documentation check

* backport tfdoc and check doc fixes

* Re-run pydoc

* Redo pydoc + local linting checks

* update tfdoc (#404)

* Org/Folder: Allow for policy association when using rule factory (#405)

* Org/Folder: Allow for policy association when using rule factory

* Fix linting issue

* Update hierarchical firewall resource

This replaces all the `google_compute_organization_security_*`
resources with the newer `google_compute_firewall_*` resources.

* Fix typo.

* Update CHANGELOG.md

* Typo fix

* New vpc-sc module implementation (#406)

* first implementation

* minimal output

* split service perimeters in regular and bridge

* tests and fixes

* new vpc-sc implementation

* remove providers file used for testing

* remove provider used during development

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update README.md

* fix cases where bridge perimeter status resources are null (#408)

* Update CHANGELOG.md

* Copyright bump (#410)

* remove lifecycle block from vpc sc perimeters (#412)

* Update CHANGELOG.md

* Update CHANGELOG.md

* Interpolate access levels by key in vpc sc module (#414)

* interpolate access levels by key

* fix access level reference

* fix num resources in last README test

* Update CHANGELOG.md

* fix ingress policies in vpc sc module

* disable device policy support in vpc-sc module

* depend bridge from regular perimeters in vpc sc module

* Update CONTRIBUTING.md

* add versions to vpc-sc module

* Update CONTRIBUTING.md

* updated output variable name

* updated #tftest:skip on examples as using yaml input makes resources number variable

* changed pub_sub to pubsub

* unified protocol input variable

* changed extra_telemetry_pubsub_topic_ids variable type to: map

* solved issue in README.md

* grouped device configuration variables

* device config is now done individually per each device in the yaml file

* changes on device config yaml processing: 1 single yaml directory, use try() while parsing, example identation corrected

* updated headers to 2022

* removed get-pip.py
2022-02-05 15:54:24 +01:00
..
__experimental Update main.tf 2022-02-01 19:02:15 +01:00
apigee-organization Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
apigee-x-instance Add ip_range variable to apigee-x-instance module (#485) 2022-02-02 19:32:26 +01:00
artifact-registry Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
bigquery-dataset Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
bigtable-instance Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
billing-budget Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
cloud-config-container Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
cloud-function Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
cloud-identity-group Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
cloud-run Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
cloudsql-instance Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
compute-mig Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
compute-vm Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
container-registry Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
datafusion Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
dns Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
endpoints Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
folder Rename tf files to use dashes 2022-02-04 08:45:49 +01:00
folders-unit Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
gcs Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
gke-cluster feat: added missing addons gke (#481) 2022-02-01 07:23:00 +01:00
gke-nodepool Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
iam-service-account Define nullable variables in SA module 2022-01-29 09:51:02 +01:00
iot-core IoT module (#415) 2022-02-05 15:54:24 +01:00
kms Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
logging-bucket Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
naming-convention Link vars and outputs from README 2022-01-22 14:15:16 +01:00
net-address Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
net-cloudnat Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
net-glb Rename tf files to use dashes 2022-02-04 08:45:49 +01:00
net-ilb Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
net-interconnect-attachment-direct Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
net-vpc Fix stage2 readme 2022-02-03 19:22:32 +01:00
net-vpc-firewall Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
net-vpc-peering Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
net-vpn-dynamic Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
net-vpn-ha Add periods at the end of each description field where missing (#478) 2022-01-31 10:45:34 +01:00
net-vpn-static Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
organization Rename tf files to use dashes 2022-02-04 08:45:49 +01:00
project Switch project module to beta provider for SVPC resources 2022-02-04 16:21:00 +01:00
pubsub Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
secret-manager Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
service-directory Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
source-repository Align tftest syntax with tdoc 2022-01-28 21:34:15 +01:00
vpc-sc Rename tf files to use dashes 2022-02-04 08:45:49 +01:00
README.md Updated modules README to include details around module versioning an… (#476) 2022-02-02 07:59:21 +01:00

README.md

Terraform modules suite for Google Cloud

The modules collected in this folder are designed as a suite: they are meant to be composed together, and are designed to be forked and modified where use of third party code and sources is not allowed.

Modules try to stay close to the low level provider resources they encapsulate, and they all share a similar interface that combines management of one resource or set or resources, and the corresponding IAM bindings.

Authoritative IAM bindings are primarily used (e.g. google_storage_bucket_iam_binding for GCS buckets) so that each module is authoritative for specific roles on the resources it manages, and can neutralize or reconcile IAM changes made elsewhere.

Specific modules also offer support for non-authoritative bindings (e.g. google_storage_bucket_iam_member for service accounts), to allow granular permission management on resources that they don't manage directly.

These modules are not necessarily backward compatible. Changes breaking compatibility in modules are marked by major releases (but not all major releases contain breaking changes). Please be mindful when upgrading Fabric modules in existing Terraform setups, and always try to use versioned references in module sources so you can easily revert back to a previous version. Since the introduction of the moved block in Terraform we try to use it whenever possible to make updates non-breaking, but that does not cover all changes we might need to make.

These modules are used in the examples included in this repository. If you are using any of those examples in your own Terraform configuration, make sure that you are using the same version for all the modules, and switch module sources to GitHub format using references. The recommended approach to working with Fabric modules is the following:

  • Fork the repository and own the fork. This will allow you to:

    • Evolve the existing modules.
    • Create your own modules.
    • Sync from the upstream repository to get all the updates.
  • Use GitHub sources with refs to reference the modules in your fork. See an example below:

    module "project" {
        source              = "github.com/my-fork/cloud-foundation-fabric.git//modules/project?ref=v12.0.0"
        name                = "my-project"
        billing_account     = "123456-123456-123456"
        parent              = "organizations/123456"
    }
    

Foundational modules

Networking modules

Compute/Container

Data

Development

Security

Serverless