5a534edf5c
update and refactor artifact registry module ( #1536 )
2023-07-28 09:54:36 +00:00
009c6d0f93
Make demo pipeline append into BQ tables ( #1533 )
2023-07-27 11:38:00 -04:00
0b224a7f55
Return only bucket name of composer, not full url to dags folder
2023-07-10 11:20:51 +02:00
d9f7cef1e7
allow using a separate resource for boot disk ( #1496 )
2023-07-07 15:40:13 +00:00
d3739cc0ff
Update outputs.tf
2023-06-29 22:36:27 -04:00
43b3490ef1
Updating a few files for typos
...
fast/stages/3-data-platform/dev/README.md
fast/stages/3-data-platform/dev/outputs.tf
CHANGELOG.md
blueprints/data-solutions/data-platform-minimal/README.md
blueprints/data-solutions/data-platform-minimal/outputs.tf
blueprints/data-solutions/data-platform-foundations/README.md
2023-06-29 21:47:17 -04:00
b203198441
Merge branch 'master' into kthhrv-patch-1
2023-06-29 10:10:14 +01:00
912497a158
use key/value and update docs
2023-06-29 09:57:23 +01:00
f15e2f3509
default to empty map
2023-06-29 09:55:10 +01:00
e3e05540de
change var name, drop default, update docs
2023-06-29 09:45:29 +01:00
026071209c
Minimal Data Platform - Shared VPC ( #1475 )
...
* Fix
* Fix dataproc vpc links
* Add missing networkUser role.
* Fix README.
2023-06-28 21:58:03 +02:00
52ad1fee34
more linting
2023-06-28 14:07:36 +01:00
f9742c5405
lint
2023-06-28 14:06:05 +01:00
9e8323bd7d
Update 02-composer.tf
2023-06-28 13:56:35 +01:00
b30efa8bfe
Update variables.tf
2023-06-28 13:56:00 +01:00
7cd9083fd7
data-platform-minimal - support web_server_network_access_control
2023-06-28 13:28:28 +01:00
099ad03910
Improve Minimal Data Platform Blueprint ( #1473 )
...
* Add SA to access to Curated resources
* Add BQ dataset in the landing project
* Provide example to move data from landing to curated using BQ engine
* Improve diagram
2023-06-28 09:05:48 +02:00
638841c8d1
Rename network load balancer modules ( #1466 )
...
* update LB modules to new names
* update LB modules names
* update test paths
2023-06-26 07:50:10 +00:00
45adcf1187
First commit.
2023-06-23 15:52:08 +02:00
15ae95df90
Fixing typos
...
- modules/organization/variables.tf
- modules/organization/README.md
- blueprints/data-solutions/shielded-folder/main.tf
2023-06-23 00:14:02 -04:00
adc1ff3fca
match readme groups with variables file ( #1455 )
...
I faced error during my deployment even though I created data-engineers group. Then I found out that variables file uses gcp-data-engineers as default. The same is valid for data-security.
2023-06-21 11:51:32 +02:00
261ad646a8
Improve Minimal Data Platform blueprint ( #1451 )
2023-06-20 16:47:15 +00:00
dc964411e0
data-platform-minimal - 02-processing.tf typo ( #1454 )
...
error is
```
│ Error: Unsupported attribute
│
│ on ../../../../blueprints/data-solutions/data-platform-minimal/02-processing.tf line 46, in locals:
│ 46: ? var.network_config.subnet_self_links.processingestration
│ ├────────────────
│ │ var.network_config.subnet_self_links is object with 2 attributes
│
│ This object does not have an attribute named "processingestration".
╵
```
I'm guessing this should be `processing_transformation` the other option is `processing_composer`
2023-06-20 15:26:10 +02:00
a37b99501e
fix typo data-platform-minimal ( #1453 )
...
Fix `container-engine` service agent typo.
2023-06-20 13:12:00 +02:00
26e5662e84
Some fixes
2023-06-16 00:01:07 +00:00
81285065ca
Added module for Secure Web Proxy.
2023-06-13 08:49:58 +02:00
e900e9c951
Make internal/external addresses optional in compute-vm
...
Fixes 1431
2023-06-08 14:00:10 +02:00
39b27ac25e
Add support for Log Analytics on logging-bucket module and bump provider version ( #1423 )
...
* first commit
* Bump provider versions
* Fix tests
2023-06-07 23:23:28 +02:00
7ed197aff4
Fix and improve GCS2BQ blueprint ( #1416 )
...
* Fix roles
* Implement Shared VPC roles relying on project service_identity_iam variable
* Group project variable into project_config variable
* Rely on optional variables to avoid try()
2023-06-06 09:06:58 +02:00
884cb8b4bf
Ensure all modules have an `id` output ( #1410 )
...
* net-vpc
* a-d
* complete modules
* fix error
2023-06-02 16:07:22 +02:00
cecbd2072c
Fix modules and blueprints tests
2023-05-26 16:38:41 +02:00
47ae6dc7c3
chore: update mlops blueprint metadata ( #1382 )
2023-05-17 07:41:57 +00:00
40656a23de
Minimal Data Platform - Make components optional ( #1380 )
...
make some components optional: Composer and Data Proc history server.
2023-05-16 14:08:03 +02:00
6a89d71e96
Update to multiple README.md ( #1379 )
...
- blueprints/data-solutions/data-platform-foundations/README.md
- blueprints/factories/project-factory/README.md
- modules/net-ilb-l7/README.md
- modules/project/README.md
2023-05-16 06:11:34 +00:00
31c1c8534a
Updates to blueprints/data-solutions/vertex-mlops
...
Updates to blueprints/data-solutions/vertex-mlops
2023-05-15 19:41:55 -04:00
a0beec747e
README to blueprints/data-solutions/shielded-folder
2023-05-15 17:46:48 -04:00
11f7f3efed
Reverted variables.tf metadata.yaml README.md to commit 85407109c8
2023-05-15 16:45:13 -04:00
65e6ef98fa
Reverted README.md to commit 85407109c8
2023-05-15 16:34:18 -04:00
87cd83f5c0
Several updates
...
Several updates
2023-05-13 23:51:46 -04:00
3cc6c71e96
Add Minimal Data Platform blueprint ( #1362 )
...
Minimal Data Platform blueprint
2023-05-08 10:25:06 +02:00
05ed1bf12f
Add blueprint metadata validation tool
2023-05-05 16:57:48 +02:00
4d66623de1
Fix Shielded Folder - VertexML interoperability ( #1355 )
...
* Fix Shielded Folder - VertexML interoperability
* Fix README outputs
* Adding prefix for keyrings and update output
2023-05-05 07:54:57 +00:00
75cc2f3d7a
FAST: shorten stage 3 prefixes, enforce prefix length in stage 3s ( #1346 )
...
* shorten stage 3 prefixes, enforce prefix length in stage 3s
* tfdoc
* tfdoc
2023-05-03 07:39:41 +02:00
94589efc34
Fix external documentation links ( #1347 )
2023-05-02 05:26:58 +00:00
1547a55e1f
chore: update metadata schema ( #1345 )
2023-04-28 17:14:20 -05:00
1e0b1da0d2
Add directory to vertex-mlops blueprint metadata
2023-04-27 08:52:24 +02:00
bca8a33f1e
Fix typo and blueprint module name
2023-04-24 20:36:50 +02:00
8488e866bc
Update readme
2023-04-20 16:53:09 +02:00
b896ccb9e5
Update metadata types and defaults.
2023-04-19 15:20:29 +02:00
9fdf80738f
Fix linting.
2023-04-19 14:09:40 +02:00
Ludovico Magnocavallo
Daniel De Leo
Wiktor Niesiobędzki
Alejandro Leal
Keith Harvey
lcaggio
Canburak Tümer
bluPhy
Taneli Leppä
Julio Castillo
Bharath KKB
Bob Idle