Commit Graph

554 Commits

Author SHA1 Message Date
lcaggio 66a10d76c3 Add test 2023-01-30 23:47:33 +01:00
lcaggio a808ea3293 Draft README 2023-01-30 23:32:13 +01:00
Julio Diez 4c2e31baac Rename config file 2023-01-30 20:34:09 +01:00
Julio Diez 4c4018073f Add security configuration using Cloud Armor in the LB 2023-01-30 20:30:35 +01:00
Julio Diez 8a7aa397ef Add purpose to config files 2023-01-30 20:13:38 +01:00
Julio Diez 865a98e3ed Add ingress settings blocking requests not coming from the LB 2023-01-30 16:53:23 +01:00
Julio Diez 93276d03d8 Add custom domain output 2023-01-30 16:34:52 +01:00
Julio Diez cca1d9fe3c Output the LB IP address 2023-01-30 14:39:46 +01:00
Julio Diez e10c6ed62f Output URL as single string 2023-01-30 14:38:38 +01:00
Julio Diez 914a8c48a6 Rename output URL as default URL 2023-01-30 12:13:23 +01:00
Wiktor Niesiobędzki 1a657b31d3 Bump beta provider to 4.48
This is the first version that supports `gateway_api_config` block
2023-01-29 15:50:24 +01:00
Wiktor Niesiobędzki 2976df596e Fix tests (add JIT-ed SA for multiclusteringress.googleapis.com) 2023-01-29 15:50:24 +01:00
Ayman Farhat edd3a82453
Include cloudbuild API in project module (#1116)
* Include cloudbuild API in project module

* Increase number of resources
2023-01-27 21:38:01 +01:00
lcaggio 9a46f06dd0 update readme 2023-01-27 10:05:19 +01:00
Julio Diez 1d3449d0e8 Add custom domain as variable 2023-01-26 16:42:49 +01:00
Julio Diez 5004f176c2 Add custom-url configuration 2023-01-26 14:34:01 +01:00
Julio Diez b25afb5ea2 Fix format 2023-01-26 14:30:54 +01:00
Julio Diez 6039105651 Get rid of default-url config and make it 'default' 2023-01-26 14:29:25 +01:00
Julio Diez 417584f9bc Default config renamed to default-url config 2023-01-26 14:18:37 +01:00
Julio Diez 097c9ceace HTTPS frontend with static IP 2023-01-26 11:50:52 +01:00
lcaggio 1189e38788 Fix 2023-01-25 18:30:21 +01:00
lcaggio 0ce110f170 Make KMS and Log sink optionals 2023-01-25 18:22:43 +01:00
Aurélien Legrand 7f5c177cfe
Network Dashboard: PSA support for Filestore and Memorystore (#1106)
* Support for Filestore and Memorystore PSA ranges

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-01-25 15:02:30 +00:00
lcaggio 440e9c59b9 Update 2023-01-25 12:32:10 +01:00
Julio Diez 6c8c033c76 Add Global Load Balancer in front of Cloud Run 2023-01-25 10:17:46 +01:00
dependabot[bot] e780b7f98c
Bump cookiejar in /blueprints/apigee/bigquery-analytics/functions/export (#1110)
Bumps [cookiejar](https://github.com/bmeck/node-cookiejar) from 2.1.3 to 2.1.4.
- [Release notes](https://github.com/bmeck/node-cookiejar/releases)
- [Commits](https://github.com/bmeck/node-cookiejar/commits)

---
updated-dependencies:
- dependency-name: cookiejar
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-24 15:07:11 +00:00
Julio Diez aca604e085
Merge pull request #3 from GoogleCloudPlatform/master
Sync fork
2023-01-24 11:36:10 +01:00
Julio Diez c9b076cdaa Initial commit, Cloud Run service with default URL 2023-01-24 11:14:21 +01:00
Julio Castillo 551d45760f
Merge branch 'master' into google_gkehub_feature_membership 2023-01-23 09:11:49 +01:00
apichick e32036dbaa
Merge branch 'master' into hybrid-gke-README-fix 2023-01-22 11:22:07 +01:00
Ludovico Magnocavallo 3cca689792
Check linting for Python dashboard files (#1107)
* enable Python lint check for network dashboard

* fix linting for network dashboard
2023-01-21 17:17:51 +01:00
lcaggio 4007d42705 Add KMS and Log. 2023-01-21 01:08:51 +01:00
Miren Esnaola 4accf87bff Updated hybrid GKE readme 2023-01-20 14:41:25 +01:00
Ludovico Magnocavallo 050daa65f2
Merge branch 'master' into hybrid-gke-updates 2023-01-20 07:48:49 +01:00
Miren Esnaola 8945165bc3 Improvements in apigee hybrid-gke: now using workload identity and GLB 2023-01-19 22:11:44 +01:00
lcaggio dcbfdd9c91 Merge branch 'master' into lcaggio/shieldedfolder 2023-01-19 10:59:33 +01:00
Wiktor Niesiobędzki b38ef22572 Even more test fixes 2023-01-19 09:37:48 +01:00
Wiktor Niesiobędzki 720213593e Use google_gkehub_feature_membership
Use google_gkehub_feature_membership to provision ASM on clusters.

Ensure that the cluster membership is refreshed on cluster recreation.
2023-01-19 09:37:48 +01:00
lcaggio 3c88aace1a Fix dataflow shared-vpc support 2023-01-19 01:04:11 +01:00
lcaggio 6477d0790d Remove temp file. 2023-01-19 00:39:55 +01:00
lcaggio 07a7be29e3 Add shared-vpc support on Data Playgroud blueprint 2023-01-19 00:33:31 +01:00
lcaggio b9a4c27a03 VPC-SC 2023-01-18 15:50:49 +01:00
lcaggio 191e56fa80 Merge branch 'master' into lcaggio/shieldedfolder 2023-01-17 15:51:55 +01:00
lcaggio 84be665172 First commit. 2023-01-17 08:49:04 +01:00
lcaggio 02938bdfa1 Fix Table in readme. 2023-01-16 15:58:11 +01:00
lcaggio 1672cfe9c1 Fix README. 2023-01-12 12:45:39 +01:00
lcaggio 50a52ae01a Implement PR comments. 2023-01-12 12:41:00 +01:00
lcaggio 07a975f84e Fix example test. 2023-01-11 12:37:08 +01:00
lcaggio 72abd47520 Fix documentation. 2023-01-11 08:47:42 +01:00
lcaggio c172c7bb2e Remove plg project and update to composer 2 2023-01-11 00:31:58 +01:00
lcaggio 488b6d4dc0 Remove plg project, composer 2 2023-01-11 00:31:52 +01:00
Miren Esnaola 66c37a4169 Fixes in Apigee blueprints README files 2023-01-05 11:31:07 +01:00
Ludovico Magnocavallo f7350be743
Merge branch 'master' into apigee-hybrid-gke 2023-01-05 09:11:39 +01:00
Miren Esnaola f6413747b7 Fixes in Apigee Bigquery Analytics blueprint 2023-01-04 17:30:07 +01:00
Miren Esnaola 33f5607ff1 Apigee hybrid on GKE 2023-01-04 10:53:49 +01:00
Miren Esnaola 0235690aaa Moved apigee bigquery analytics blueprint, added apigee network patterns 2022-12-23 14:38:15 +01:00
Ludovico Magnocavallo 66a402083b
Allow setting no ranges in firewall module custom rules (#1073)
* allow setting no ranges in custom firewall rules

* fix blueprint

* fix example

* fix example
2022-12-23 09:03:31 +01:00
Israel Herraiz 7df527e1ef Bump versions EVERYWHERE 2022-12-23 00:06:42 +01:00
Aurélien Legrand 5063c3b513
Network dashboard: PSA ranges support, starting with Cloud SQL (#1063)
* Adding PSA ranges support and ip utilization, starting with Cloud SQL

* yapf formatting

* refactor

* fix camelcase

* remove unused variable

* remove test file

* rename discover plugin

* fixing issue with asset name

Co-authored-by: Ludo <ludomagno@google.com>
2022-12-22 13:14:42 +01:00
Wiktor Niesiobędzki 7e18f6d7b5 Fixes for GKE
* Fix non-empty plan when spot instances are used
* Add cluster_id and recommend its use, as this prevents inconsitencies
  when only cluster is recreated (with no changes on node pool)
2022-12-21 23:14:52 +01:00
Aurélien Legrand 7acb6b3747
Update src/README.md for Network Dashboard (#1060)
* Update src/README.md for Network Dashboard

Proposing some small updates to src/README.md file for the Network Dashboard

* Update README.md

* Update README.md

* Update README.md

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-12-21 16:30:09 +01:00
Julio Castillo b031d7add5 Fix tests 2022-12-18 20:37:16 +01:00
Julio Castillo e700a27079 Enforce terraform fmt in examples 2022-12-18 14:00:19 +01:00
Ludovico Magnocavallo 93361d7f3d
Networking dashboard and discovery tool refactor (#1020)
* wip

* wip

* wip

* wip

* wip

* discovery

* single discovery

* page token

* batch requests

* remove plugin name

* streamline

* streamline

* dynamic routes

* dynamic routes

* forwarding rules and addresses

* batch requests

* metrics

* notes

* notes

* streamline

* fixes, dump

* streamline

* remove globals

* wip metrics

* subnet time series

* networks per project plugin

* firewall rules timeseries

* use names in metric labels

* firewall policies timeseries

* wip

* instances per network timeseries

* routes timeseries

* custom quota

* simpler quota, network peering timeseries

* peering timeseries

* timeseries names

* wip descriptors

* metric descriptors

* fixes

* wip

* Use partial for all cf init functions

* Add requirements.txt

* fix org key mismatch

* Fix folder short cli name

* Fix instance_networks when iterable is empty

* more readability and fixing some strings

* replace() -> removeprefix and remove unneeded quoting

* setdefault in init()s

* Fix next hop type

* Remove unneeded fstring

* create descriptors

* create descriptors log

* rename descriptor requests function

* non-working metrics implementation (duplicate timeseries batched)

* timeseries

* fixes

* write timseries

* fix timeseries plugins

* start documenting code

* docstrings and comments

* docstrings comments and small fixes

* rename cf to src

* discover nodes instead of just projects

* discovery node can be a folder or org

* cf entrypoint and fixes

* cf deployment

* remove old paths

* cloud function deploy readme

* diagrams

* resource ids in example

* discovery tool readme

* top-level README

* Some documentation fixes

* Add secondary ranges

* Update README.md

* add legend to scope diagram

* improve description of discovery configuration variable

* add comment in example for custom quotas file

* rename op_project to monitoring_project

* dashboard metric rename wip

* Update discover-cai-compute.py

* deploy sample dashboard

Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: Aurélien Legrand <aurelien.legrand01@gmail.com>
2022-12-18 10:07:24 +01:00
Ludovico Magnocavallo d2015b0bc3
Assorted module fixes (#1045)
* net-ilb-l7 use both neg types in backends

* run example tests on cloud-config-container modules

* streamline nginx-tls cos module

* add tests for cos modules

* tfdoc

* onprem needs fixing, links

* disable test

* test
2022-12-10 15:40:15 +01:00
Ludovico Magnocavallo 46f694be08
Refactor net-glb module for Terraform 1.3 (#1044)
* wip

* urlmaps

* wip

* tested

* fix managed certificate names

* simple HTTP and HTTPS examples

* gce and hybrid neg examples

* internet NEG example

* serverless NEG and backend bucket examples

* certificate example

* fix example tests

* remove stale test module

* module test

* adfs blueprint

* add support for non-classic GLB and PSC NEGs

* apigee blueprint

* glb and cloud armor blueprint

* deprecate non-working nginx reverse cluster

* api gateway blueprint

* tfdoc

* fix top-level READMEs

* switch to new tests

* only/at most
2022-12-08 17:35:44 +01:00
Brian Jung 5b71f2f54c
Adding Secondary IP Utilization calculation (#982)
* hello

* Adding secondary range IP address utilization calculation.

* using yapf to format code

* Minor fixes for Network Monitor

Co-authored-by: Brian Jung <brianhmj@google.com>
2022-12-07 11:45:20 +01:00
dependabot[bot] fee7ecfa66
Bump qs and formidable (#1037)
Bumps [qs](https://github.com/ljharb/qs) and [formidable](https://github.com/node-formidable/formidable). These dependencies needed to be updated together.

Updates `qs` from 6.9.3 to 6.11.0
- [Release notes](https://github.com/ljharb/qs/releases)
- [Changelog](https://github.com/ljharb/qs/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ljharb/qs/compare/v6.9.3...v6.11.0)

Updates `formidable` from 2.0.1 to 2.1.1
- [Release notes](https://github.com/node-formidable/formidable/releases)
- [Changelog](https://github.com/node-formidable/formidable/blob/master/CHANGELOG.md)
- [Commits](https://github.com/node-formidable/formidable/commits)

---
updated-dependencies:
- dependency-name: qs
  dependency-type: indirect
- dependency-name: formidable
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-06 16:43:34 +01:00
Thomas GRUSON d76eadef18
feat(blueprints): get audience from tfc environment
Fix typo in documentation and get audience from Terraform Cloud `TFC_WORKLOAD_IDENTITY_AUDIENCE` environment variable.
2022-12-05 15:50:35 +01:00
Julio Castillo fa63e9d5d0 Remove optional stuff 2022-11-30 16:00:53 +01:00
Julio Castillo b5593db8a2 Update h&s blueprints advertisements 2022-11-30 10:59:15 +01:00
Julio Castillo 798d3a4136 Update VPN-HA module to tf1.3 (wip) 2022-11-30 10:52:24 +01:00
g-greatdevaks 3037a4f519 FIX APIGEE PAYG ENVIRONMENT NODE CONFIG
Fixed the Node Configuration for Apigee PAYG
specific Environments.

Removed current_aggregate_node_count as it
is a read-only field and cannot be taken
as an input for the Apigee Environment Terraform
resource.

Changes committed:
modified:   blueprints/cloud-operations/apigee/README.md
modified:   blueprints/cloud-operations/apigee/variables.tf
modified:   modules/apigee/README.md
modified:   modules/apigee/main.tf
modified:   modules/apigee/variables.tf
modified:   tests/blueprints/cloud_operations/apigee/fixture/variables.tf
modified:   tests/modules/apigee/fixture/variables.tf
2022-11-29 17:02:24 +05:30
Miren Esnaola 8d827b692c Added endpoint attachments to Apigee module 2022-11-28 17:27:00 +01:00
apichick 48c6733615
Merge branch 'master' into adfs-fixes 2022-11-28 13:30:12 +01:00
apichick 1c1f3b714e
Merge branch 'master' into adfs-fixes 2022-11-28 12:40:07 +01:00
apichick ba17e10ebd
Merge branch 'master' into binauthz-fixes 2022-11-28 12:33:34 +01:00
lcaggio e56762b4d3
Merge branch 'master' into lcaggio/fix-20221123 2022-11-25 14:54:47 +01:00
Ludo 53d7b99b41 fix comment 2022-11-24 19:26:07 +01:00
Julio Castillo 612d7283e8 Enforce nonempty descriptions ending in a colon 2022-11-24 18:56:01 +01:00
lcaggio d1cc0519d8
Merge branch 'master' into lcaggio/fix-20221123 2022-11-24 16:07:33 +01:00
lcaggio 6b01b8641c Fix encryption. 2022-11-24 15:25:29 +01:00
Sebastian Kunze e4fc47a063
Normalize prefix handling in blueprints (#1003) 2022-11-23 11:09:00 +01:00
Miren Esnaola 67be16f94e ADFS blueprint fixes 2022-11-22 12:47:12 +01:00
Miren Esnaola 5ba65b99ed Binauthz blueprint fixes related to project creation 2022-11-22 12:45:43 +01:00
Julio Castillo 826ff14ef9 Sort variables and outputs 2022-11-21 13:17:55 +01:00
Julio Castillo 17fde88a57 Skip bq factory tests 2022-11-18 17:48:52 +01:00
Julio Castillo 7be3288cc7 Add tests for factory examples 2022-11-18 17:48:52 +01:00
Julio Castillo bb8c62c6ec
Merge branch 'master' into apigee 2022-11-17 00:47:05 +01:00
Miren Esnaola 3501d20785 Apigee module and blueprint 2022-11-16 19:49:26 +01:00
Wiktor Niesiobędzki 97c6a25b90 Use hungarian notation.
As per: https://cloud.google.com/apis/design/naming_convention#quantities
2022-11-16 16:44:24 +01:00
Wiktor Niesiobędzki 755ff7b1d2 Add trigger service account creation 2022-11-16 16:44:01 +01:00
Wiktor Niesiobędzki 9e37a915c8 Review fixes.
* Refactor trigger_config and trigger_config_v2 into one structure
* bump default python version to 3.10
* typo fixes
2022-11-16 16:44:01 +01:00
Sebastian Kunze df539b5e18
Have Squid log to /dev/stdout to stream logs to Cloud Logging (#980) 2022-11-16 14:41:26 +01:00
Aurélien Legrand 9b84e15392
Merge branch 'master' into maunope/static_routes 2022-11-15 15:57:59 +01:00
Maurizio Noseda Pedraglio 9815403230 removed vpc connector var 2022-11-15 14:12:41 +01:00
Maurizio Noseda Pedraglio ce624f2c93 moving metrics project conf to next PR 2022-11-15 14:03:54 +01:00
Sebastian Kunze 5125a5ad03
Replace Docker's `gcplogs` driver with the GCP COS logging agent (#977) 2022-11-15 13:19:52 +01:00
Sebastian Kunze bcffb67e0f
Enforce PROXY protocol in `filtering-proxy-psc` blueprint (#968) 2022-11-15 07:18:57 +00:00
maunope 2ffc1c9533
Merge branch 'master' into maunope/static_routes 2022-11-11 17:34:55 +01:00
Sebastian Kunze ef38d238b4
Add filtering-proxy-psc blueprint (#962) 2022-11-11 11:24:37 +01:00
Maurizio Noseda Pedraglio 6a6e3260c3 Merge branch 'maunope/static_routes' of https://github.com/maunope/cloud-foundation-fabric into maunope/static_routes 2022-11-10 18:23:12 +01:00
Maurizio Noseda Pedraglio f3002e9e55 #599 comments 2022-11-10 18:23:06 +01:00
maunope d65f9acbdc
Merge branch 'vpc-sc' into maunope/static_routes 2022-11-10 14:00:18 +01:00
Maurizio Noseda Pedraglio bb072af325 addressed #599 comments 2022-11-10 13:22:41 +01:00
Maurizio Noseda Pedraglio 9eb63dfaba merge 2022-11-10 13:14:23 +01:00
maunope c2da049330
Merge branch 'maunope/static_routes' into vpc-sc 2022-11-10 13:03:42 +01:00
Maurizio Noseda Pedraglio da0c05c3e8 updated tfdoc 2022-11-10 12:57:52 +01:00
Maurizio Noseda Pedraglio 55d544b172 Merge branch 'master' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into vpc-sc 2022-11-10 12:54:39 +01:00
Maurizio Noseda Pedraglio 2bc60e6dee readme updates, removed default prefix, completed vpc-sc compatibility 2022-11-10 12:44:17 +01:00
Aurélien Legrand 0c50cb2b44
Merge branch 'master' into net-dash-psa 2022-11-08 18:30:54 +01:00
Ludovico Magnocavallo 6d46ef7c6f
remove duplicate blueprint folder (#952) 2022-11-07 13:46:22 +01:00
Aurélien Legrand 04ffbc928e
Merge branch 'master' into net-dash-psa 2022-11-04 14:02:54 +01:00
Ludovico Magnocavallo fae5654e33
Refactor VPC firewall module for Terraform 1.3 (#949)
* module and module tests/examples

* align blueprints and fast

* fix null ranges

* make ports optional

* tfdoc

* make rules optional defaulting to all protocols

* review comments

* last round of comments

* invert precedence of template variables

* add option to disable all default rules

* add option to disable all default rules

* split egress/ingress

* tests

* fix tests
2022-11-04 13:56:07 +01:00
Aurélien Legrand 5f6eb135c1
Merge branch 'master' into net-dash-psa 2022-11-03 14:03:50 +01:00
aurelien.legrand01@gmail.com c261bfe52a Improving comment for Redis. 2022-11-03 11:21:58 +01:00
Ludovico Magnocavallo 0563260678
Refactor ILB module for Terraform 1.3 (#941)
* wip

* wip

* wip

* backport health check to compute-mig

* align blueprints and fast

* fix blueprints

* tfdoc
2022-11-02 18:05:20 +01:00
Ludo a214368800 revert temporary blueprint copy to old name 2022-11-02 11:14:20 +01:00
Ludovico Magnocavallo edc9fa7789
temporarily duplicate cloud armor example (#939) 2022-11-02 09:36:03 +00:00
Julio Castillo 9a6b6fd202
Merge branch 'master' into maunope/static_routes 2022-11-02 08:44:21 +01:00
Kumar Dhanagopal 80b95b8f49
Update README.md
Fixed minor typos
2022-11-01 12:29:43 -07:00
Ludovico Magnocavallo 8c51a2a386
Enable org policy service and add README notice to modules (#936)
* enable org policy service and add README notice to modules

* fix tests
2022-11-01 14:25:07 +01:00
Ludovico Magnocavallo a30c186f1f
Refactor compute-mig module for Terraform 1.3 (#931)
* wip: autoscaler

* wip: fix autoscaler

* wip: health check

* wip: untested

* wip: tests and examples missing

* wip: examples

* wip: consumers

* blueprint tests

* fast
2022-11-01 09:38:59 +01:00
Malet d7e0af75b2
feat(project-factory): introduce additive iam bindings to project-factory (#932) 2022-10-31 18:24:25 +01:00
Julio Castillo 9262e11ebf Fix pf example 2022-10-28 17:55:29 +02:00
Julio Castillo 410fe1c73a Add pf example with deny all org policy 2022-10-28 17:49:44 +02:00
Julio Castillo c714952f39 Fix tests 2022-10-28 17:49:44 +02:00
Julio Castillo 73f89256ea Fix lining in tfc wif blueprint 2022-10-28 17:49:44 +02:00
Julio Castillo ad420138ad Fix readme examples 2022-10-28 17:49:44 +02:00
Brian Jung 980cc678c8
Update main.tf 2022-10-28 11:19:46 -04:00
Maurizio Noseda Pedraglio 06c2ae3d52 Merge branch 'maunope/static_routes' of https://github.com/maunope/cloud-foundation-fabric into maunope/static_routes 2022-10-28 15:58:33 +02:00
Maurizio Noseda Pedraglio fe29b9397a fixed proj creation and readme 2022-10-28 15:55:47 +02:00
Brian Jung 22736473fd
Update versions.tf 2022-10-28 09:22:59 -04:00
Brian Jung b38ade0a26
Create versions.tf 2022-10-28 09:21:17 -04:00
Brian Jung e0c41f959f
Update main.tf 2022-10-28 09:18:01 -04:00
Aurélien Legrand 5841c112d4
Merge branch 'master' into maunope/static_routes 2022-10-28 14:36:17 +02:00
Maurizio Noseda Pedraglio 5b3262172d Merge branch 'maunope/static_routes' of https://github.com/maunope/cloud-foundation-fabric into maunope/static_routes 2022-10-28 14:20:13 +02:00
Maurizio Noseda Pedraglio 561e113f61 added services to monitoring project 2022-10-28 14:19:26 +02:00
Brian Jung 1148a5fd24
Update README.md 2022-10-27 13:22:42 -04:00
Brian Jung 1ca493e3d7
Update main.tf
Added a terraform and provider block - terraform relies on plugins and following best practices to allow allowing the rightmost component of a version to increment. (https://developer.hashicorp.com/terraform/language/providers/requirements#version-constraints)

Also removed comment about it being ok to use project roles of monitoring viewer and compute networkViewer. (Look at Issue #922)
2022-10-27 13:17:20 -04:00
Ludovico Magnocavallo e20de3b86a
fix service account create (#923) 2022-10-27 15:12:04 +00:00
Ayman Farhat b021d84633
Fix formatting for gcloud dataflow job launch command (#924)
This fix is to prevent errors similar to "ERROR: (gcloud.dataflow.jobs.run) unrecognized arguments: df-loading@tf-pso-workshop-test.iam.gserviceaccount.com" when copy pasting the example code. Line 8 misses a space between the statement and line break, leading to missing a space between parameters when evaluated by the gcloud command.
2022-10-27 14:07:24 +00:00
Julio Castillo 2c83b9179a
Update README.md 2022-10-27 09:18:34 +02:00
Ludovico Magnocavallo ed9fd6b08d
Align documentation, move glb blueprint (#921)
* aling documentation, move glb blueprint

* modules README, sort modules

* reorder modules

* fix bp links

* fix moved blueprint test

* use a single cloud shell image in the repo
2022-10-26 14:31:04 +02:00
apichick d9ccf04221
Added managed_prometheus to features (#906)
* Added managed_prometheus monitoring_config

* fix module

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-10-25 21:18:50 +00:00
Aleksandr Averbukh fbbded31e9 Merge branch 'master' into averbuks-tfe-oidc 2022-10-25 20:54:54 +02:00
Aleksandr Averbukh 77614191bb Added more attribute mappings, updated attribute condition and IAM binding for WIF 2022-10-25 20:53:14 +02:00
Aleksandr Averbukh cadaba8cac Add missing newlines 2022-10-25 13:07:05 +02:00
Aleksandr Averbukh 991cd1324d feat: TFE OIDC with GCP WIF blueprint added. 2022-10-25 13:04:27 +02:00
maunope ec7adc4bf1
Merge branch 'master' into maunope/static_routes 2022-10-25 12:40:36 +02:00
Julio Castillo 1a3bb25917 Update provider version (needed for dns logging support). 2022-10-25 12:15:02 +02:00
Julio Castillo 192edf2b75 Remove redundant ttls 2022-10-25 12:11:07 +02:00
Aurélien Legrand 1b19587f0c
Update README.md 2022-10-25 11:50:40 +02:00
Aurélien Legrand a9ca2f664f
Merge branch 'master' into maunope/static_routes 2022-10-25 11:41:40 +02:00
Maurizio Noseda Pedraglio 946868062c updated readme 2022-10-25 11:37:14 +02:00
aurelien.legrand01@gmail.com 0ffb08d89c Adding support for PSA ranges, starting with Redis instances. 2022-10-25 11:33:58 +02:00
lcaggio 13ae26deb2
Merge branch 'master' into lcaggio/fix-pipeline 2022-10-25 09:08:30 +02:00
lcaggio ef29b3ba12 Fix template path. 2022-10-25 09:06:58 +02:00
lcaggio 7561f7db69 Remove data platform file wrongly committed. 2022-10-25 07:42:05 +02:00
lcaggio aa6cba24a3 Organize png and tpl in subfolders 2022-10-25 07:39:29 +02:00
lcaggio c61313b37c Move images and templates to subfolder. 2022-10-25 07:39:16 +02:00
lcaggio f9795a38d0 Fix DataPlatform file wrongly submitted. 2022-10-25 06:25:36 +02:00
lcaggio 35f39369c5 Merge branch 'master' into lcaggio/dp-dataaccess 2022-10-24 23:00:47 +02:00
lcaggio 9c985fbbb5 Fix regexp 2022-10-24 22:59:53 +02:00
lcaggio 529dde5a46 Fix CloudSQL blueprint 2022-10-24 22:59:35 +02:00
Maurizio Noseda Pedraglio c359c13d4a removed unneeded import 2022-10-24 13:49:31 +02:00
Maurizio Noseda Pedraglio 0a878454aa dashboard fix 2022-10-21 18:48:53 +02:00
Maurizio Noseda Pedraglio 4b1138c5bb pr comments fixed 2022-10-21 18:44:53 +02:00
Maurizio Noseda Pedraglio cebc9360f8 fixes to dashboard and statc routes category metric name 2022-10-21 17:43:00 +02:00
Julio Castillo b194b51ef3
Merge branch 'master' into maunope/static_routes 2022-10-20 23:11:44 +02:00
Julio Castillo f8208670e2 Fix variable cf_version validation 2022-10-20 19:12:57 +02:00
Julio Castillo ea9227dedf Update README 2022-10-20 19:10:46 +02:00
Julio Castillo 2d7319c4e8 Fix cron description 2022-10-20 19:10:46 +02:00
Julio Castillo 21152c3c45 Improve net dashboard variables 2022-10-20 19:10:46 +02:00
Julio Castillo a988775c14 Do not modify in parameters in format_* functions 2022-10-20 18:56:54 +02:00
Aurélien Legrand 4d067fe2cd
Network Dashboard: CFv2 and performance improvements (#896)
* Improving Cloud Function v2 support for the Networking Dashboard.

* yapf formatting.

* Improving support for CFv2 and performance for asset inventory queries

* Update README.md

added v2 parameter do readme

* cleanip up main.py and improving performance by 20% in metrics.py by reusing the same client instance

* Making a condition clearer

* Update blueprints/cloud-operations/network-dashboard/cloud-function/metrics/subnets.py

Co-authored-by: David Gleich <gleichda@google.com>

* Update after PR from Maurizio on Firewall Policies and David's comments.

Co-authored-by: maunope <44614195+maunope@users.noreply.github.com>
Co-authored-by: David Gleich <gleichda@google.com>
2022-10-19 18:59:28 +02:00
Maurizio Noseda Pedraglio 3a687fd387 Merge branch 'master' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into maunope/static_routes 2022-10-19 17:45:03 +02:00
Maurizio Noseda Pedraglio 94831780d5 Merge branch 'maunope/network-dashboards-updates' of https://github.com/maunope/cloud-foundation-fabric into maunope/network-dashboards-updates 2022-10-19 17:16:31 +02:00
Maurizio Noseda Pedraglio d2e38fb9d6 removed dependency 2022-10-19 17:15:54 +02:00
Aurélien Legrand 4d11251f17
Update README.md 2022-10-19 16:40:42 +02:00
Aurélien Legrand 23807615f4
Merge branch 'master' into maunope/network-dashboards-updates 2022-10-19 14:56:52 +02:00
marcjwo 5ef93e2829
Marcwo/bqfactory (#884)
* adding the bq factory

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-10-18 17:07:15 +02:00
Luca Prete 0122f145ab
Minor fixes to PSC hybrid blueprint readmes 2022-10-17 10:40:11 +02:00
Natalia Strelkova edfbd7f1f0
Merge branch 'master' into nstrelkova-wordpress-password-fix 2022-10-16 22:02:58 +02:00
Giovanni Baratta ca1dc3659a
Add auto_delete and instance_redistribution_type to compute-vm and compute-mig modules. (#890)
* Add auto_delete parameter to compute-vm module

* Add instance_redistribution_type in compute-mig module
2022-10-16 21:19:46 +02:00
Luca Prete a8ddf5d1ba
Add PSC hybrid blueprint 2022-10-16 10:18:40 +02:00
Natalia Strelkova 4ac24b68be random password: let the cloudsql module generate it 2022-10-15 20:16:50 +00:00
Maurizio Noseda Pedraglio 2248639e8b fixed merge 2022-10-14 13:02:05 +02:00
Maurizio Noseda Pedraglio 801fe1c626 fixes to dashboard 2022-10-14 12:55:07 +02:00
Maurizio Noseda Pedraglio 658b34c9c0 Merge branch 'master' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into maunope/network-dashboards-updates 2022-10-14 12:34:48 +02:00
Maurizio Noseda Pedraglio de5bad7f19 corrected default value for static routes 2022-10-14 12:05:17 +02:00
Ludovico Magnocavallo 4fa1dc431d
Refactor net-vpc module for Terraform 1.3 (#880)
* module tests pass

* doc examples

* refactor blueprints

* fast stages

* fix comment typo

* fix module factory test
2022-10-14 11:02:33 +02:00
Somnath Shukla a12da693a3
added support 2nd generation cloud function (#872)
* added support 2nd generation cloud function

* changed function_version to a simple boolean v2
removed memory_2ndGen

* will use the var.v2 to add the invoker role

* removed the list uisng compact and formated the code

* formated the code and added conditional feature

* formated the code

* added formating

* resolved the merge conflict

* Update readme

* Create local function object

* added secret_volumes
and secret_environment_variables for CF V2

Co-authored-by: Julio Castillo <jccb@google.com>
2022-10-13 08:09:00 +02:00
lcaggio ce148d68f4 Update roles 2022-10-13 06:36:20 +02:00
Maurizio Noseda Pedraglio 1fb93e1b64 aligned timestamps for ppg data 2022-10-12 15:05:58 +02:00
Maurizio Noseda Pedraglio 61917690e5 added support for ppg static routes 2022-10-12 14:51:03 +02:00
Ludovico Magnocavallo e8056577ce
Refactor GKE nodepool and blueprints (#875)
* first shot, untested

* example tests working

* module tests

* work on gke blueprints

* multitenant fleet doc examples

* fix gke hub doc examples

* blueprint tests

* move master range to vpc config

* fast stage 3 gke test

* tfdoc

* bump provider versions

* and bump provider again to latest
2022-10-12 12:59:36 +02:00
Julio Castillo bb4aacd152
Update README.md 2022-10-11 15:25:27 +02:00
Julio Castillo 29b3d84b3f
Update README.md 2022-10-11 15:23:59 +02:00
Julio Castillo 9c2b850a0a
Update README.md 2022-10-11 15:22:46 +02:00
Julio Castillo 6abb7ae0bc
Update README.md 2022-10-11 15:21:30 +02:00
Julio Castillo d8f0f7040f Revert "Fix cloud shell links"
This reverts commit 75a6dab413.
2022-10-11 15:16:38 +02:00
Julio Castillo 75a6dab413 Fix cloud shell links 2022-10-11 14:53:15 +02:00
Natalia Strelkova d4a5354daf
fixes: docker tag command and link to Cloud Shell 2022-10-11 14:22:04 +02:00
Maurizio Noseda Pedraglio 311d50c183 added static routes per vpc tracking 2022-10-10 22:06:57 +02:00
Maurizio Noseda Pedraglio 3608b573fd updated dashbaord and readme 2022-10-10 17:45:08 +02:00
Maurizio Noseda Pedraglio 3b259a90bb Merge branch 'maunope/network-dashboards-updates' of https://github.com/maunope/cloud-foundation-fabric into maunope/network-dashboards-updates 2022-10-10 15:54:47 +02:00
Maurizio Noseda Pedraglio c52b623857 Added Firewall Policies Monitoring
Added buffering for writes (execution now 4x faster on my laptop)
Added aligned timestamps per monitored resource type
2022-10-10 15:53:14 +02:00
Maurizio Noseda Pedraglio 82f3daf917 Added Firewall Policies Monitoring, added buffered metric writes (CF now 4x faster on my laptop), switched to aligned timestamps (should avoid "sawtoothing") 2022-10-10 15:52:54 +02:00
Ludovico Magnocavallo f080794167
Merge branch 'master' into tmp_revert_to_1.3.1 2022-10-10 11:21:26 +02:00
Natalia Strelkova 5dbc61cb8c temporary revert to Terraform 1.3.1 to support Cloud Shell 2022-10-10 09:19:55 +00:00
maunope d5b42d5378
Maunope/network added firewall metrics (#856)
* support for project level VPC firewall metrics

* updated GCP networking dashboard (.json file)

Co-authored-by: Maurizio Noseda Pedraglio <mnoseda@google.com>, Aurélien Legrand <aurelien.legrand01@gmail.com>
2022-10-10 10:46:22 +02:00
Aurélien Legrand 17ee413a7e
Merge branch 'master' into maunope/network-dashboards-updates 2022-10-10 10:12:07 +02:00
Ludovico Magnocavallo 16822e94ab
Refactor GKE module for Terraform 1.3 (#868)
* wip

* module and module tests

* doc examples

* gke-hub doc examples

* gke blueprints

* hub and spoke peering blueprint

* Rename some keys of some optional objects

* Fix readme

Co-authored-by: Julio Castillo <jccb@google.com>
2022-10-10 09:38:21 +02:00
maunope dffd5b4c3b
Merge branch 'master' into maunope/network-dashboards-updates 2022-10-10 09:25:09 +02:00
Maurizio Noseda Pedraglio ac82a8ce7b solved pul comments and fixed grouping on firewalls utilization chart 2022-10-07 17:24:04 +02:00
Natalia Strelkova 54290fb18e
Merge branch 'master' into example-wordpress 2022-10-07 15:41:22 +02:00
Natalia Strelkova eb47e03d5d formatting 2022-10-07 13:31:15 +00:00
Natalia Strelkova 8eae3525b3 existing connector - variable 2022-10-07 13:29:55 +00:00
Maurizio Noseda Pedraglio 1f3cfe8e8e fixed dashboard comments 2022-10-07 15:18:13 +02:00
Natalia Strelkova 8a8a3fd76a firewall unnecessary 2022-10-07 13:13:15 +00:00
Ludovico Magnocavallo a0171b2c49
Bump terraform required version (#864)
* bump terraform required version

* fix test

* debug test

* debug test

* disable test

* fix CI file, bump terraform action version
2022-10-07 12:51:56 +02:00
maunope 6e128eeb4d
Merge branch 'master' into maunope/network-dashboards-updates 2022-10-07 12:23:55 +02:00
Maurizio Noseda Pedraglio 2df2bbde64 Merge branch 'maunope/network-dashboards-updates' of https://github.com/maunope/cloud-foundation-fabric into maunope/network-dashboards-updates 2022-10-07 11:35:34 +02:00
Maurizio Noseda Pedraglio c0573ce596 fixed PR #856 comments 2022-10-07 11:34:00 +02:00
Ludovico Magnocavallo e66340c4db
Refactor compute-vm for Terraform 1.3 (#860)
* refactor compute-vm for Terraform 1.3

* bump Terraform version in CI tests config

* fix optional null handling (ht jccb)

* tfdoc

* update blueprints

* align fast

* align README examples
2022-10-07 10:53:53 +02:00
Ludovico Magnocavallo 00b3383d16
Merge branch 'master' into example-wordpress 2022-10-07 10:32:43 +02:00
Natalia Strelkova 2f8a03a801
style and a note on password change 2022-10-07 09:46:39 +02:00
Julio Castillo 894647ff9e Leverage new shared VPC project config defaults across the repo 2022-10-07 08:55:47 +02:00
Natalia Strelkova 07f89e0aa0 connector creation in a variable 2022-10-07 06:37:07 +00:00
Natalia Strelkova e9779e30ed locals moved to main 2022-10-07 06:28:05 +00:00
Natalia Strelkova c770abd88d files restructured, connector added separately 2022-10-06 14:25:30 +00:00
Natalia Strelkova aa3c6abcc2
explanation on accessing the installation 2022-10-06 13:43:31 +02:00
Natalia Strelkova bb436e47a8
Merge branch 'GoogleCloudPlatform:master' into example-wordpress 2022-10-06 11:33:19 +02:00
Natalia Strelkova b6dcde6745
Info on the VPC serverless connector 2022-10-06 11:32:27 +02:00
Natalia Strelkova c2056602e3 principals: rights list 2022-10-06 09:25:38 +00:00
Natalia Strelkova c72d3555a3 principals varibale description: users 2022-10-06 09:10:40 +00:00
Natalia Strelkova bea92728fb removed unnecessary README 2022-10-06 08:53:27 +00:00
Natalia Strelkova 0411dbbd51 ip_ranges var 2022-10-06 07:58:48 +00:00
maunope 8d39ded6d6
Merge branch 'master' into maunope/network-dashboards-updates 2022-10-05 17:38:06 +02:00
Natalia Strelkova b11ae47738 passwords: either specified or random 2022-10-05 14:11:10 +00:00
Natalia Strelkova b5a5150bb8 docker image tag added 2022-10-05 14:09:48 +00:00
Maurizio Noseda Pedraglio 14da0eec29 removed obsolete code - compute api firewalls list 2022-10-05 12:27:35 +02:00
Maurizio Noseda Pedraglio bebe9ed110 removed hardcoded debug value 2022-10-05 11:13:53 +02:00
Taneli Leppä 4feb3514fd Added an example of a Nginx reverse proxy cluster using RMIGs. 2022-10-04 15:38:52 +02:00
Maurizio Noseda Pedraglio 7f2399bd70 Added charts to dashboard, fixed a merge glitch, updated readme, removed hardcoded parameters 2022-10-04 10:11:09 +02:00
Maurizio Noseda Pedraglio cdf53552d7 support for project level VPC firewall metrics 2022-10-03 15:48:46 +02:00
Maurizio Noseda Pedraglio ec54165a89 reverted stuff pushed by mistake 2022-09-30 11:55:11 +02:00
Maurizio Noseda Pedraglio 10e1a5e48a Merge branch 'updates-quota-monitoring-function' of https://github.com/maunope/cloud-foundation-fabric into updates-quota-monitoring-function 2022-09-30 11:15:53 +02:00
Maurizio Noseda Pedraglio 1c134a735b tracking of vpc firewalls, initial commit 2022-09-30 11:10:48 +02:00
maunope 9a67546cb9
Merge branch 'GoogleCloudPlatform:master' into updates-quota-monitoring-function 2022-09-30 11:08:49 +02:00
Maurizio Noseda Pedraglio eea4642cf2 applied tfdoc 2022-09-30 11:07:44 +02:00
Aurélien Legrand a709febfdb
Network dashboard: Subnet IP utilization update (#837)
* Adding IP utilization per subnet metrics and folder level support.

* Update README.md

* Removing unused imports

* yapf formatting

* removing unused imports

* removing hard coded prefix

* Update README.md

* Variable renaming

* variable renaming

* formatting

* Comments and yapf formatting

* in the proper blueprints folder this time

* Updated after comments from David.

Co-authored-by: Aurélien Legrand <legranda@google.com>
2022-09-30 10:51:16 +02:00
Maurizio Noseda Pedraglio 10811b3d31 fixed conditional creation and updated readme 2022-09-30 10:27:31 +02:00
Maurizio Noseda Pedraglio 8b7bf698d2 made alert creation optional 2022-09-30 09:55:38 +02:00
Maurizio Noseda Pedraglio 5e2763835f Main.py: removed some commented Lines
main.tf updated sample alert, no "catch all" alerts are possible since we use multiple metrics, switched to a single metric alert (cpus quota)
2022-09-29 19:38:42 +02:00
Maurizio Noseda Pedraglio 06d02c248a fixed typo as per ludo review 2022-09-29 19:37:08 +02:00
Maurizio Noseda Pedraglio 75972de1b6 fixed bulleted list 2022-09-29 19:29:12 +02:00
Maurizio Noseda Pedraglio a7c2de1d8f update readme for quota monitoring CF 2022-09-29 19:25:54 +02:00
Maurizio Noseda Pedraglio b15193f75f Merge branch 'updates-quota-monitoring-function' of https://github.com/maunope/cloud-foundation-fabric into updates-quota-monitoring-function 2022-09-29 17:55:23 +02:00
Maurizio Noseda Pedraglio 3781c077e5 address ludo review comments 2022-09-29 17:53:35 +02:00
maunope a2651f46f8
Merge branch 'master' into updates-quota-monitoring-function 2022-09-29 17:39:22 +02:00
Maurizio Noseda Pedraglio cebe08d1be Changed time series format: split time series for limit, usage and utilization. 2022-09-29 17:28:47 +02:00
lcaggio f7ef127149 first commit. 2022-09-28 15:14:36 +02:00
Julio Castillo ac835b6d50 Update terraform version 2022-09-28 11:28:05 +02:00
lcaggio 3a2b2d443b Remove env_variables in the default value. 2022-09-27 15:32:30 +02:00
lcaggio a2598991fc Implements review comments. 2022-09-27 12:44:54 +02:00
Natalia Strelkova 256b1b77f9
Merge branch 'master' into example-wordpress 2022-09-21 15:47:04 +02:00
Natalia Strelkova dbdaeda376 style in locals 2022-09-21 13:46:38 +00:00
Natalia Strelkova d95f5d948b more readability 2022-09-21 13:43:28 +00:00
Natalia Strelkova 0722f7d124 variables alphabetically 2022-09-21 13:38:52 +00:00
Natalia Strelkova 4379525718 typos and style corrections 2022-09-21 13:34:16 +00:00
lcaggio 78026a4d5a Improve composer config variable. 2022-09-21 15:00:52 +02:00
lcaggio 3937e46da9 Merge branch 'master' into lcaggio/composer-2 2022-09-20 17:26:47 +02:00
lcaggio ee309ecc06 Update firewall rules. 2022-09-20 16:57:35 +02:00
lcaggio 0704a0ad30 Fixes based on comments. 2022-09-20 12:26:57 +02:00
lcaggio a88447d10f Merge branch 'master' into lcaggio/composer-2 2022-09-20 11:49:20 +02:00
Natalia Strelkova 9c8969cc65 one block for code instead of three 2022-09-20 09:27:06 +00:00
lcaggio f28dc5cb04 Fix tests 2022-09-20 10:51:11 +02:00
lcaggio 6c42fa3504 Add articatregistry service 2022-09-20 10:35:06 +02:00
Natalia Strelkova 0b5b9c57d1 comments on separate lines 2022-09-20 07:55:06 +00:00
lcaggio df8bcc1bb2 Fix resource dependencies. 2022-09-19 12:00:42 +02:00
lcaggio 5968661e8d First commit 2022-09-19 10:34:46 +02:00
Natalia Strelkova c811269850
more info in the readme (org. policy and other) 2022-09-15 16:17:24 +02:00
Eva 2330d3e6f5 Merge branch 'example-wordpress' of https://github.com/skalolazka/cloud-foundation-fabric into example-wordpress
getting
2022-09-15 13:03:33 +00:00
Natalia Strelkova fa68ed4ce1 moving Wordpress to the right folder 2022-09-15 12:17:45 +00:00
Ludovico Magnocavallo ec87f4abea typo 2022-09-14 23:39:09 +02:00
Ludovico Magnocavallo 9400eed2bf
Add documentation example test for pf (#813)
* Add documentation example test for pf

* skip tmpdir for examples
2022-09-14 14:34:30 +02:00
Julio Castillo 7e9173d35d Create fully recursive e2e test runner 2022-09-12 13:58:11 +02:00
Ludovico Magnocavallo aea24f24f8 fix blueprint tests 2022-09-12 11:54:18 +02:00
Ludovico Magnocavallo 8026eef3b7 remove stale link in blueprints readme 2022-09-12 11:06:01 +02:00
Ludovico Magnocavallo a2849cf4a0 remove stale foundation blueprints links 2022-09-12 10:33:04 +02:00
Julio Castillo 96edc4b58f Move gke multi cluster mesh example to gke folder 2022-09-12 10:26:33 +02:00
Julio Castillo 96257871a2 Move binautz to gke folder 2022-09-12 10:21:56 +02:00
Julio Castillo 91c569268e Update readmes 2022-09-12 10:15:47 +02:00
Julio Castillo 20d5ebac40 Remove foundations blueprints in favor of FAST 2022-09-12 10:11:35 +02:00
Julio Castillo 014c2c7d10 Add readme to serverless blueprints folder 2022-09-12 10:09:56 +02:00
Julio Castillo faf6c48a80 Add gke description 2022-09-12 10:03:27 +02:00
Julio Castillo 61c45501ab Link shared vpc gke blueprint in gke folder 2022-09-12 10:00:38 +02:00
Julio Castillo 72da12e377 Rename gke-serverless to gke and add test for fast gke stage 2022-09-12 09:56:25 +02:00