c1be435b09
Fix range names definition of GKE clusters
...
Fixes #1677
2023-09-14 12:51:43 +02:00
fdb133f1de
Fixed, added back environments to each instance, that way we can also create instances for already existing environments
2023-09-13 14:43:37 +02:00
e141b86f79
merge labels from data_merges in project factory ( #1662 )
...
* merge labels from data_merges in project factory
* fix project factory test for labels
2023-09-08 10:27:46 +00:00
0e7cfc8b29
add AIRFLOW_VAR_ prefix to environment variables in data-platform blueprints ( #1651 )
...
* add AIRFLOW_VAR_ prefix to env vars in minimal blueprint
* update DAGs for env vars in minimal blueprint
* add AIRFLOW_VAR_ prefix to env vars in foundation blueprint
* update DAGs for env vars in foundation blueprint
* apply tf linting
---------
Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-09-08 07:38:28 +00:00
77c1e69666
New phpIPAM serverless third parties solution in blueprints ( #1642 )
...
* Added new phpIPAM serverless third parties solution in blueprints
* added jit to iap.googleapis.com service in project module
* updated tests
2023-09-07 15:30:22 +02:00
12e78af055
Fix project factory blueprint and fast stage ( #1654 )
2023-09-07 12:48:39 +00:00
3d4cc7164a
Bump provider version to 4.80.0
2023-09-05 09:48:15 +02:00
988fd2ee05
gke-cluster-standard: change logging configuration ( #1638 )
...
* Update logging configuration of this module to use object interface in harmony with `gke-cluster-autopilot` module.
* Update blueprints that use this module.
* Add "WORKLOADS" log source to logging configuration of the blueprints where the README files say so.
* Update FAST stage 3 because it uses this module.
2023-08-31 12:49:15 +01:00
b3e1e8e1ba
Delete blueprints/serverless/api-gateway directory
2023-08-29 11:48:13 +02:00
a7ec00acba
Delete API Gateway from serverless' README
2023-08-29 11:45:15 +02:00
6ce8fd6942
Delete API Gateway from blueprint's README
2023-08-29 11:40:31 +02:00
44c1cec041
Fix tests
2023-08-24 20:09:23 +02:00
91f71fef68
trap requests timeout error ( #1607 )
2023-08-21 18:37:54 +02:00
819894d2ba
IAM interface refactor ( #1595 )
...
* IAM modules refactor proposal
* policy
* subheading
* Update 20230816-iam-refactor.md
* log Julio's +1
* data-catalog-policy-tag
* dataproc
* dataproc
* folder
* folder
* folder
* folder
* project
* better filtering in test examples
* project
* folder
* folder
* organization
* fix variable descriptions
* kms
* net-vpc
* dataplex-datascan
* modules/iam-service-account
* modules/source-repository/
* blueprints/cloud-operations/vm-migration/
* blueprints/third-party-solutions/wordpress
* dataplex-datascan
* blueprints/cloud-operations/workload-identity-federation
* blueprints/data-solutions/cloudsql-multiregion/
* blueprints/data-solutions/composer-2
* Update 20230816-iam-refactor.md
* Update 20230816-iam-refactor.md
* capture discussion in architectural doc
* update variable names and refactor proposal
* project
* blueprints first round
* folder
* organization
* data-catalog-policy-tag
* re-enable folder inventory
* project module style fix
* dataproc
* source-repository
* source-repository tests
* dataplex-datascan
* dataplex-datascan tests
* net-vpc
* net-vpc test examples
* iam-service-account
* iam-service-account test examples
* kms
* boilerplate
* tfdoc
* fix module tests
* more blueprint fixes
* fix typo in data blueprints
* incomplete refactor of data platform foundations
* tfdoc
* data platform foundation
* refactor data platform foundation iam locals
* remove redundant example test
* shielded folder fix
* fix typo
* project factory
* project factory outputs
* tfdoc
* test workflow: less verbose tests, fix tf version
* re-enable -vv, shorter traceback, fix action version
* ignore github extension warning, re-enable action version
* fast bootstrap IAM, untested
* bootstrap stage IAM fixes
* stage 0 tests
* fast stage 1
* tenant stage 1
* minor changes to fast stage 0 and 1
* fast security stage
* fast mt stage 0
* fast mt stage 0
* fast pf
2023-08-20 09:44:20 +02:00
ea0de3adbb
Fixing some typos
2023-08-18 05:51:00 +00:00
79373721df
Remove firewall policy management from resource management modules ( #1581 )
...
* rename firewall policy module, fix outputs
* add TOC to firewall policy module
* don't depend policy on parent id
* remove firewall policy from resource management modules
* remove factory conditionals
* fast net a and b
* fast stages
* fast tfdoc
* fast tfdoc
* remove unused test
* fix shielded folder blueprint
* fix shielded folder blueprint
2023-08-09 11:23:07 +00:00
6a13742e3c
Apigee addons
2023-08-09 08:12:06 +02:00
dd3a298892
Moved allow_net_admin to enable_features flag. Bumped provider version to 4.76
2023-08-07 14:27:20 +01:00
182ce27143
Add information about required groups
2023-08-06 20:27:59 +02:00
9c75aa469c
More module descriptions ( #1572 )
...
* bigquery dataset
* data catalog policy tag
* net-address
* fix data catalog callers
* bigquery dataset views
* fix data catalog callers
* logging bucket
* net vpn ha
2023-08-06 09:25:45 +00:00
fa34499767
Removed unused attribute in variable of ha-vpn-over-blueprint blueprint
2023-08-02 13:02:17 +02:00
a2eddd0be0
Fixed Cloud Build default bucket name and vpc/subnet names ( #1548 )
2023-07-31 12:52:36 +02:00
b524aa137c
Peering module refactor ( #1547 )
...
* refactor net-vpc-peering module
* hub and spoke peering blueprint
* fast stages
* boilerplate
* fast tfdoc
---------
Co-authored-by: Julio Castillo <jccb@google.com>
2023-07-29 21:33:57 +02:00
4998f1d376
Grant IAM rights to service identities in host project ( #1542 )
...
* [module/project] Grant IAM rights to service identities based on used services in host project
* [blueprints/factories/project-factory] enable granting IAM permissions in host VPC for service identities directly or by specifying services in use
2023-07-29 20:07:21 +02:00
5a534edf5c
update and refactor artifact registry module ( #1536 )
2023-07-28 09:54:36 +00:00
009c6d0f93
Make demo pipeline append into BQ tables ( #1533 )
2023-07-27 11:38:00 -04:00
cacb0c02e2
Refactoring of dns module
2023-07-19 12:57:44 +02:00
69028a801e
Bump semver in /blueprints/serverless/api-gateway/function ( #1504 )
...
Bumps [semver](https://github.com/npm/node-semver ) from 5.7.1 to 5.7.2.
- [Release notes](https://github.com/npm/node-semver/releases )
- [Changelog](https://github.com/npm/node-semver/blob/v5.7.2/CHANGELOG.md )
- [Commits](https://github.com/npm/node-semver/compare/v5.7.1...v5.7.2 )
---
updated-dependencies:
- dependency-name: semver
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-13 08:05:52 +02:00
b79261dfa5
Fix in nb-glb-psc-neg-sb-psc-ilbl7-hybrid-neg blueprint
2023-07-11 11:46:53 +02:00
0b224a7f55
Return only bucket name of composer, not full url to dags folder
2023-07-10 11:20:51 +02:00
d9f7cef1e7
allow using a separate resource for boot disk ( #1496 )
2023-07-07 15:40:13 +00:00
0bc6dffce0
Fix and improve quota monitor blueprint ( #1488 )
...
* quota monitoring blueprint fixes
* wip
* wip
* quota
* improvements
* improve variables
* refactor http code
* fix http post
* improve logging
* fix project creation, improve readme
* fix test
* Update main.py
* remove unneeded constant
* exit with http error message instead of json when failing to decode api response
* actually do what previous commit wanted :)
* nits
2023-07-03 09:23:49 +02:00
d3739cc0ff
Update outputs.tf
2023-06-29 22:36:27 -04:00
43b3490ef1
Updating a few files for typos
...
fast/stages/3-data-platform/dev/README.md
fast/stages/3-data-platform/dev/outputs.tf
CHANGELOG.md
blueprints/data-solutions/data-platform-minimal/README.md
blueprints/data-solutions/data-platform-minimal/outputs.tf
blueprints/data-solutions/data-platform-foundations/README.md
2023-06-29 21:47:17 -04:00
0bd3f5ab0e
Merge branch 'master' into kthhrv-patch-1
2023-06-29 18:18:39 +02:00
981068e442
add region to cf ( #1482 )
2023-06-29 13:02:56 +02:00
b203198441
Merge branch 'master' into kthhrv-patch-1
2023-06-29 10:10:14 +01:00
912497a158
use key/value and update docs
2023-06-29 09:57:23 +01:00
f15e2f3509
default to empty map
2023-06-29 09:55:10 +01:00
e3e05540de
change var name, drop default, update docs
2023-06-29 09:45:29 +01:00
026071209c
Minimal Data Platform - Shared VPC ( #1475 )
...
* Fix
* Fix dataproc vpc links
* Add missing networkUser role.
* Fix README.
2023-06-28 21:58:03 +02:00
52ad1fee34
more linting
2023-06-28 14:07:36 +01:00
f9742c5405
lint
2023-06-28 14:06:05 +01:00
9e8323bd7d
Update 02-composer.tf
2023-06-28 13:56:35 +01:00
b30efa8bfe
Update variables.tf
2023-06-28 13:56:00 +01:00
7cd9083fd7
data-platform-minimal - support web_server_network_access_control
2023-06-28 13:28:28 +01:00
099ad03910
Improve Minimal Data Platform Blueprint ( #1473 )
...
* Add SA to access to Curated resources
* Add BQ dataset in the landing project
* Provide example to move data from landing to curated using BQ engine
* Improve diagram
2023-06-28 09:05:48 +02:00
eace97cf4b
Merge branch 'master' into apigateway-blueprint-dependency-update
2023-06-27 08:13:15 +02:00
e64c043aaa
Bump semver and @google-cloud/storage in /blueprints/gke/binauthz/image ( #1469 )
...
Removes [semver](https://github.com/npm/node-semver ). It's no longer used after updating ancestor dependency [@google-cloud/storage](https://github.com/googleapis/nodejs-storage ). These dependencies need to be updated together.
Removes `semver`
Updates `@google-cloud/storage` from 5.18.3 to 6.11.0
- [Release notes](https://github.com/googleapis/nodejs-storage/releases )
- [Changelog](https://github.com/googleapis/nodejs-storage/blob/main/CHANGELOG.md )
- [Commits](https://github.com/googleapis/nodejs-storage/compare/v5.18.3...v6.11.0 )
---
updated-dependencies:
- dependency-name: semver
dependency-type: indirect
- dependency-name: "@google-cloud/storage"
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-26 15:03:47 +02:00
e11d1a8ea8
Merge branch 'master' into apigateway-blueprint-dependency-update
2023-06-26 09:56:52 +02:00
Julio Castillo
Miren Esnaola
Pierre Formont
Pierre Formont
simonebruzzechesse
Luca Prete
Oliver Frolovs
Julio Diez
Ludovico Magnocavallo
Alejandro Leal
Eunan Hardy
Wiktor Niesiobędzki
javiergp
Daniel De Leo
dependabot[bot]
Alejandro Leal
Keith Harvey
lcaggio