Go to file
Antonio Lopez 7bc10d1039
IoT module (#415)
* added iot-core module folder

* modified iot core readme file

* added initial version of the IoT Platform terraform files

* añadido detalles en README

* Update README.md

fix markup issue

* Update README.md

modified input/output

* deleted provider from main and module services

* pub_sub topic ids used in the registry instead of creating new ones

* variable extra_telemetry_pub_sub_topic_ids modified as default

* included data platform integration use case in the doc

* devices config moved to yaml file

* included example to create device certificates

* added HCL and #tftest to README. Moved project/region to variables

* solved bug with no optional variables for extra topics or devices yaml

* solved bug with no optional variables for extra topics or devices yaml

* added example to send MQTT telemetry to IoT Platform

* modified doc on Data Platform integration

* included diagram

* added Registry / Device creation default configuration into variables. Deleted exammple devices yaml file. Corrected module source path

* solved comments in PR

* applied terraform fmt

* solved bug in boolean (bool) variable

* updated variables in doc

* updated output variable name

* updated #tftest:skip on examples as using yaml input makes resources number variable

* Update README.md

modified input/output

* pub_sub topic ids used in the registry instead of creating new ones

* variable extra_telemetry_pub_sub_topic_ids modified as default

* included data platform integration use case in the doc

* devices config moved to yaml file

* included example to create device certificates

* added HCL and #tftest to README. Moved project/region to variables

* solved bug with no optional variables for extra topics or devices yaml

* solved bug with no optional variables for extra topics or devices yaml

* added example to send MQTT telemetry to IoT Platform

* modified doc on Data Platform integration

* included diagram

* added Registry / Device creation default configuration into variables. Deleted exammple devices yaml file. Corrected module source path

* solved comments in PR

* applied terraform fmt

* solved bug in boolean (bool) variable

* updated variables in doc

* Updated diagram and documentation for decentralized firewall.

* Fixed error with VPC connector. Count was referring to resource attributes that weren't known until after the configuration was applied

* Added Cloud Foundation Fabric logos. (#363)

* Create README.md

* Add logo to readme file

* exclusions for audit in locals in logging_sinks.audit-logs now

* style fix (whitespaces)

* Added dynamic block for dns_cache_config

* Fixed boolean variable condition

* Adding Apigee Environments as output for apigee-organization module

* small var conditional fix

* Added GKE pubsub notifications

* Default creation false

* Updated variable default value

* removed extra lines

* defaulted to false and conditional output

* depend log sinks from IAM roles, fixes #371

* Update README.md

* [#374] Add taint when Windows node pools are created to match the one GKE implicitly adds

* Update README.md

Fixes out of date link on the module usage example

* Update README.md - fixed broken link

* Added subnet id and self_link to outputs (#377)

Adjusted module outputs so that it's easier to consume them when using the factory in a larger codebase.

* net-vpc module: added subnet mini-factory

* Update README.md

* Code cleanup

* Adds support for IAM per-subnet IAM bindings via factory

* Gracefully handle a null secondary_ip_range

* Updated README.md. Added tests.

* Added license boilerplate to subnet yaml data in tests

* Update README.md

* Update README.md

* Removed dead code

* net-vpc-firewall mini rules-factory

* Paying tributes to the linting gods

* Fixed small bug on locals

* Tests for net-vpc-firewall module

* Update CHANGELOG.md

* refactor locals (#382)

* Add support for partitioned tables on Organization sinks (#380)

* Add support for partioned tables on Organization sinks

* Update changelog

* Fix lint

* Fix lint

* Use simple bool instead of block

* fix README

* Fix Readme

* Rename variable

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* Improve PSN support in net-vpc module (#384)

* improve PSN support

* fix variable order

* fix example test

* fix cloudsql example

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update CHANGELOG.md

* Remove location from local.prefix

* Organization module refactor, in-module firewall policy factory for organization and folder (#385)

* move iam and logging to separate files, minimal refactoring

* update README

* fix example

* factory

* tfdoc

* boilerplate

* remove data_folder variable

* tfdoc

* fix default factory name

* add firewall policy to folder module

* add factory example

* Update CHANGELOG.md

* Fix VPC-SC module, add example (#387)

* Update CONTRIBUTING.md

Suggest change of wording related to `terraform format`: should be done from the top, recursively, and after `pytest` step, because fixtures are also going to be checked for linting during PR.

* Add target_node and minor fixes  (#389)

* Add separate BQ tables per asset type

* Add missing BQ location

* Add missing CF region

* Change Scheduler job to non-generic

* Add target_node, pass tests

* Do tfdoc.py

* Do terraform fmt

* Do terraform fmt -recursive for tests' fixtures

* Fix typo in test's variables

* Added support for Stateful Managed Instance Groups (#367)

* First iteration updates

* All tests passing

* Updated README and var descriptions

* Updated README

* Updated example README

* Consolidated stateful vars

* consolidated stateful vars

* Updated README

* Requested changes to try

* Fixed README examples and try

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* SA key uploading and credentials json generation with terraform.

* Fix typo in the SA module readme

* TF fmt

* Update iam-sa docs

* Finalize onprem-sa-ket-mgmt example

* Add basic test for onprem-sa-mgmt example

* Refactoring

* Reorder variables

* Rewording, fix typos

* Bump tftest version

Bump tftest version to 1.6.1 and ensure test runners can update
providers if needed and available.

* Add bq_table_overwrite handling

* Add optional BQ table as a file export config

* Add getattr() to retrieve attribute from format

* Add roles/bigquery.jobUser for CF

* Update test_plan and README

* Change README, add diagram ( gcpdraw a6e4ec4f-7d6c-4796-b63e-ee4ce7b1792f )

* Change README to two diagrams

* Add count to toggle optional modules

* Change README

* Resolve order of variables test

* Linux sysctls configuration and Kubelet config (#388)

* Linux sysctls configuration and Kubelet config

* Fix terraform linting issues

* Updated README.md

* Updated Kubelet config object type

* Update readme

Co-authored-by: Sergio Tejón <stejon@freepik.com>
Co-authored-by: Julio Castillo <jccb@google.com>

* net-address: Added support for PSA ranges

* Update outputs.tf

* Fixes typo

* Resolved merge conflict

* Update CHANGELOG.md

* Add metric scopes support (#397)

* Add metric scopes support

* Fix typo

* new tfdoc block in README

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>

* fix tfdoc replacement (#398)

* Update CHANGELOG.md

* Ludo hfw fixes (#400)

* fix tfdoc replacement

* ignore changes to rule description

* add folder example, fixes #339

* Update CHANGELOG.md

* Fix ignore changes for hfw rules (#401)

* fix tfdoc replacement

* ignore changes to rule description

* add folder example, fixes #339

* fix ignore changes in org and folder module

* Update CHANGELOG.md

* update documentation check

* backport tfdoc and check doc fixes

* Re-run pydoc

* Redo pydoc + local linting checks

* update tfdoc (#404)

* Org/Folder: Allow for policy association when using rule factory (#405)

* Org/Folder: Allow for policy association when using rule factory

* Fix linting issue

* Update hierarchical firewall resource

This replaces all the `google_compute_organization_security_*`
resources with the newer `google_compute_firewall_*` resources.

* Fix typo.

* Update CHANGELOG.md

* Typo fix

* New vpc-sc module implementation (#406)

* first implementation

* minimal output

* split service perimeters in regular and bridge

* tests and fixes

* new vpc-sc implementation

* remove providers file used for testing

* remove provider used during development

* Update CHANGELOG.md

* Update CHANGELOG.md

* Update README.md

* fix cases where bridge perimeter status resources are null (#408)

* Update CHANGELOG.md

* Copyright bump (#410)

* remove lifecycle block from vpc sc perimeters (#412)

* Update CHANGELOG.md

* Update CHANGELOG.md

* Interpolate access levels by key in vpc sc module (#414)

* interpolate access levels by key

* fix access level reference

* fix num resources in last README test

* Update CHANGELOG.md

* fix ingress policies in vpc sc module

* disable device policy support in vpc-sc module

* depend bridge from regular perimeters in vpc sc module

* Update CONTRIBUTING.md

* add versions to vpc-sc module

* Update CONTRIBUTING.md

* updated output variable name

* updated #tftest:skip on examples as using yaml input makes resources number variable

* changed pub_sub to pubsub

* unified protocol input variable

* changed extra_telemetry_pubsub_topic_ids variable type to: map

* solved issue in README.md

* grouped device configuration variables

* device config is now done individually per each device in the yaml file

* changes on device config yaml processing: 1 single yaml directory, use try() while parsing, example identation corrected

* updated headers to 2022

* removed get-pip.py
2022-02-05 15:54:24 +01:00
.github/workflows CI link checker (#494) 2022-02-04 13:28:07 +01:00
assets/logos Add logo to readme file 2021-11-17 16:49:24 +01:00
examples M4CE (v5) Examples (#413) 2022-02-02 15:21:10 +01:00
fast default=null for `shared_vpc_self_link ` and `vpc_host_project` (#502) 2022-02-04 19:57:06 +01:00
modules IoT module (#415) 2022-02-05 15:54:24 +01:00
tests Rename 02-networking to 02-networking-vpn (#492) 2022-02-04 11:03:37 +01:00
tools CI link checker (#494) 2022-02-04 13:28:07 +01:00
.gitignore Update subnets (#466) 2022-01-28 08:26:03 +01:00
CHANGELOG.md Update CHANGELOG.md 2022-01-27 17:45:56 +01:00
CONTRIBUTING.md Update CONTRIBUTING.md 2022-01-05 03:16:01 +01:00
LICENSE Initial commit 2019-05-03 17:58:36 -04:00
MANIFESTO.md Update MANIFESTO.md 2021-07-21 11:07:03 +02:00
README.md Merge Fabric FAST (#435) 2022-01-19 14:19:39 +01:00
REFERENCES.md Reorder links in REFERENCES.md 2022-01-11 13:23:55 +01:00
default-versions.tf Copyright bump (#410) 2022-01-01 15:52:31 +01:00
stages.png Merge Fabric FAST (#435) 2022-01-19 14:19:39 +01:00

README.md

Cloud Foundation Fabric

Terraform Examples and Modules for Google Cloud

This repository provides end-to-end examples and a suite of Terraform modules for Google Cloud, which support different use cases:

  • organization-wide landing zone blueprint used to bootstrap real-world cloud foundations
  • reference examples used to deep dive on network patterns or product features
  • a comprehensive source of lean modules that lend themselves well to changes

The whole repository is meant to be cloned as a single unit, and then forked into separate owned repositories to seed production usage, or used as-is and periodically updated as a complete toolkit for prototyping. You can read more on this approach in our manifesto.

Both the examples and modules require some measure of Terraform skills to be used effectively. If you are looking for a feature-rich black box to manage project or product creation with minimal specific skills, you might be better served by the Cloud Foundation Toolkit suite of modules.

Organization blueprint (Fabric FAST)

Setting up a production-ready GCP organization is often a time-consuming process. Fabric FAST aims to speed up this process via two complementary goals. On the one hand, FAST provides a design of a GCP organization that includes the typical elements required by enterprise customers. Secondly, we provide a reference implementation of the FAST design using Terraform.

Modules

The suite of modules in this repository are designed for rapid composition and reuse, and to be reasonably simple and readable so that they can be forked and changed where use of third party code and sources is not allowed.

All modules share a similar interface where each module tries to stay close to the underlying provider resources, support IAM together with resource creation and modification, offer the option of creating multiple resources where it makes sense (eg not for projects), and be completely free of side-effects (eg no external commands).

The current list of modules supports most of the core foundational and networking components used to design end-to-end infrastructure, with more modules in active development for specialized compute, security, and data scenarios.

Currently available modules:

For more information and usage examples see each module's README file.

End-to-end examples

The examples in this repository are split in several main sections: foundational examples that bootstrap the organizational hierarchy and automation prerequisites, networking examples that implement core patterns or features, data solutions examples that demonstrate how to integrate data services in complete scenarios, cloud operations examples that leverage specific products to meet specific operational needs and factories that implement resource factories for the repetitive creation of specific resources.