e3e05540de
change var name, drop default, update docs
2023-06-29 09:45:29 +01:00
026071209c
Minimal Data Platform - Shared VPC ( #1475 )
...
* Fix
* Fix dataproc vpc links
* Add missing networkUser role.
* Fix README.
2023-06-28 21:58:03 +02:00
52ad1fee34
more linting
2023-06-28 14:07:36 +01:00
f9742c5405
lint
2023-06-28 14:06:05 +01:00
9e8323bd7d
Update 02-composer.tf
2023-06-28 13:56:35 +01:00
b30efa8bfe
Update variables.tf
2023-06-28 13:56:00 +01:00
7cd9083fd7
data-platform-minimal - support web_server_network_access_control
2023-06-28 13:28:28 +01:00
099ad03910
Improve Minimal Data Platform Blueprint ( #1473 )
...
* Add SA to access to Curated resources
* Add BQ dataset in the landing project
* Provide example to move data from landing to curated using BQ engine
* Improve diagram
2023-06-28 09:05:48 +02:00
638841c8d1
Rename network load balancer modules ( #1466 )
...
* update LB modules to new names
* update LB modules names
* update test paths
2023-06-26 07:50:10 +00:00
45adcf1187
First commit.
2023-06-23 15:52:08 +02:00
15ae95df90
Fixing typos
...
- modules/organization/variables.tf
- modules/organization/README.md
- blueprints/data-solutions/shielded-folder/main.tf
2023-06-23 00:14:02 -04:00
adc1ff3fca
match readme groups with variables file ( #1455 )
...
I faced error during my deployment even though I created data-engineers group. Then I found out that variables file uses gcp-data-engineers as default. The same is valid for data-security.
2023-06-21 11:51:32 +02:00
261ad646a8
Improve Minimal Data Platform blueprint ( #1451 )
2023-06-20 16:47:15 +00:00
dc964411e0
data-platform-minimal - 02-processing.tf typo ( #1454 )
...
error is
```
│ Error: Unsupported attribute
│
│ on ../../../../blueprints/data-solutions/data-platform-minimal/02-processing.tf line 46, in locals:
│ 46: ? var.network_config.subnet_self_links.processingestration
│ ├────────────────
│ │ var.network_config.subnet_self_links is object with 2 attributes
│
│ This object does not have an attribute named "processingestration".
╵
```
I'm guessing this should be `processing_transformation` the other option is `processing_composer`
2023-06-20 15:26:10 +02:00
a37b99501e
fix typo data-platform-minimal ( #1453 )
...
Fix `container-engine` service agent typo.
2023-06-20 13:12:00 +02:00
26e5662e84
Some fixes
2023-06-16 00:01:07 +00:00
81285065ca
Added module for Secure Web Proxy.
2023-06-13 08:49:58 +02:00
e900e9c951
Make internal/external addresses optional in compute-vm
...
Fixes 1431
2023-06-08 14:00:10 +02:00
39b27ac25e
Add support for Log Analytics on logging-bucket module and bump provider version ( #1423 )
...
* first commit
* Bump provider versions
* Fix tests
2023-06-07 23:23:28 +02:00
7ed197aff4
Fix and improve GCS2BQ blueprint ( #1416 )
...
* Fix roles
* Implement Shared VPC roles relying on project service_identity_iam variable
* Group project variable into project_config variable
* Rely on optional variables to avoid try()
2023-06-06 09:06:58 +02:00
884cb8b4bf
Ensure all modules have an `id` output ( #1410 )
...
* net-vpc
* a-d
* complete modules
* fix error
2023-06-02 16:07:22 +02:00
cecbd2072c
Fix modules and blueprints tests
2023-05-26 16:38:41 +02:00
47ae6dc7c3
chore: update mlops blueprint metadata ( #1382 )
2023-05-17 07:41:57 +00:00
40656a23de
Minimal Data Platform - Make components optional ( #1380 )
...
make some components optional: Composer and Data Proc history server.
2023-05-16 14:08:03 +02:00
6a89d71e96
Update to multiple README.md ( #1379 )
...
- blueprints/data-solutions/data-platform-foundations/README.md
- blueprints/factories/project-factory/README.md
- modules/net-ilb-l7/README.md
- modules/project/README.md
2023-05-16 06:11:34 +00:00
31c1c8534a
Updates to blueprints/data-solutions/vertex-mlops
...
Updates to blueprints/data-solutions/vertex-mlops
2023-05-15 19:41:55 -04:00
a0beec747e
README to blueprints/data-solutions/shielded-folder
2023-05-15 17:46:48 -04:00
11f7f3efed
Reverted variables.tf metadata.yaml README.md to commit 85407109c8
2023-05-15 16:45:13 -04:00
65e6ef98fa
Reverted README.md to commit 85407109c8
2023-05-15 16:34:18 -04:00
87cd83f5c0
Several updates
...
Several updates
2023-05-13 23:51:46 -04:00
3cc6c71e96
Add Minimal Data Platform blueprint ( #1362 )
...
Minimal Data Platform blueprint
2023-05-08 10:25:06 +02:00
05ed1bf12f
Add blueprint metadata validation tool
2023-05-05 16:57:48 +02:00
4d66623de1
Fix Shielded Folder - VertexML interoperability ( #1355 )
...
* Fix Shielded Folder - VertexML interoperability
* Fix README outputs
* Adding prefix for keyrings and update output
2023-05-05 07:54:57 +00:00
75cc2f3d7a
FAST: shorten stage 3 prefixes, enforce prefix length in stage 3s ( #1346 )
...
* shorten stage 3 prefixes, enforce prefix length in stage 3s
* tfdoc
* tfdoc
2023-05-03 07:39:41 +02:00
94589efc34
Fix external documentation links ( #1347 )
2023-05-02 05:26:58 +00:00
1547a55e1f
chore: update metadata schema ( #1345 )
2023-04-28 17:14:20 -05:00
1e0b1da0d2
Add directory to vertex-mlops blueprint metadata
2023-04-27 08:52:24 +02:00
bca8a33f1e
Fix typo and blueprint module name
2023-04-24 20:36:50 +02:00
8488e866bc
Update readme
2023-04-20 16:53:09 +02:00
b896ccb9e5
Update metadata types and defaults.
2023-04-19 15:20:29 +02:00
9fdf80738f
Fix linting.
2023-04-19 14:09:40 +02:00
30bef8546f
Create metadata yaml file
2023-04-19 12:58:00 +02:00
f4490fcaea
Fix comments
2023-04-19 11:22:50 +02:00
1f4fac2f1d
fix lint
2023-04-18 17:51:24 +02:00
edf67fc5d0
First commit
2023-04-18 17:32:15 +02:00
91a1168d1d
rename blueprint providers file ( #1334 )
2023-04-18 11:44:09 +02:00
4b2e2d2ef7
Add providers to vertex-mlops blueprint
2023-04-18 09:42:46 +02:00
5e9b7091c2
Merge branch 'master' into lcaggioni/data-eng-fix
2023-04-12 15:57:39 +02:00
c6e79ddfc4
fix: create log-export-dataset on shielded-folder when no ecryption keys are defined
2023-04-12 15:31:08 +03:00
4722efea40
bump provider versions
2023-04-11 22:18:31 +10:00
c8d5b85ac9
Fix test in README
2023-04-06 15:55:34 +02:00
1bd5c66b42
Fix test
2023-04-06 14:21:57 +02:00
83e5ef180c
Remove state
2023-04-06 13:54:47 +02:00
badec52d11
Update IAM.md
2023-04-06 13:53:46 +02:00
bb2abb8822
Fix data-eng role on orchestration project.
2023-04-06 13:41:29 +02:00
865ef463bb
Support new fields in bigquery module, bump provider versions, unpin local provider ( #1306 )
...
* add support for new attributes to bigquery module
* bump provider versions
2023-04-05 14:22:52 +00:00
230cbe4903
Fix variable terraform.tfvars.sample ( #1261 )
2023-03-17 11:13:10 +01:00
21fa6d1f13
Fixes related to boot_disk in compute-vm module
2023-03-16 15:58:39 +01:00
79a6e9b191
pin local provider ( #1256 )
2023-03-16 10:59:06 +00:00
368472c9a0
Fix 1236
2023-03-13 21:24:27 +01:00
3f9bbc2e5c
Add cmek support on google_vertex_ai_metadata_store.
2023-03-09 09:13:21 +01:00
1671c5b4f3
Add cmek support on google_vertex_ai_metadata_store
2023-03-09 09:11:47 +01:00
ca9898395d
Merge branch 'master' into conteg/bqml-fix
2023-03-08 17:52:03 +01:00
e213f156ad
Fix Jit notebook service account.
2023-03-08 16:06:27 +01:00
a9bb717554
minor fix on bqml demo
2023-03-07 14:20:48 +00:00
3123d67ddf
moved sql to notebook
2023-03-06 12:28:58 +00:00
ee55127ede
Fix notebook
2023-03-06 12:51:46 +01:00
0ac6dd65cf
sql fix and more comments on demo notebook
2023-03-06 11:21:30 +00:00
c82e7cca7b
added demo README file
2023-03-06 11:12:36 +00:00
0852ae3778
demo: added batch prediction example
2023-03-06 10:16:21 +00:00
dc034d74f7
Variables.
2023-03-05 22:24:16 +01:00
9e19f89608
Implement PR comments.
2023-03-05 22:02:41 +01:00
2b8ba16a9a
Fix typos
2023-03-04 14:32:54 +01:00
652495e530
Update versions.
2023-03-04 14:12:50 +01:00
f8a7aa865a
Fix test.
2023-03-04 08:25:29 +01:00
8d70e1d900
Merge branch 'master' into lcaggio/bqml
2023-03-04 08:22:22 +01:00
ccd68b2fa6
Fix linting.
2023-03-04 08:19:47 +01:00
0d4b599e99
Fix README
2023-03-04 08:13:53 +01:00
98e17bb997
Fix readme.
2023-03-04 08:09:29 +01:00
6526dda8c7
sql linting
2023-03-03 14:52:35 +00:00
594a615e1e
Update
2023-03-03 15:08:57 +01:00
32808f93ea
Update README.
2023-03-03 14:52:33 +01:00
52eb83758f
Fix compute-vm:CloudKMS test for provider>=4.54.0
...
* TF provider >= 4.54.0 now returns `rsa_encrypted_key` for
`google_compute_disk.disks["attached-disk"]` (see
hashicorp/terraform-provider-google#4448 )
* Add this field to expected model to fix test assertion failure
* Update required TF provider to 4.55.0 (latest) since the assertion
will now fail with <4.54.0, which do not return `rsa_encrypted_key`
* Updated the whole repo on advice from @ludoo
2023-02-28 15:10:22 +00:00
17b8a461f0
fixed notebook with dynamic model name
...
cleared output from cells
added creation of view instead of table
2023-02-27 15:28:49 +00:00
3271acd2f2
Added sql and jupyter notebook to run the demo
2023-02-27 10:56:47 +00:00
be60753246
Fix failing tests
2023-02-25 19:26:11 +01:00
edce6edd28
Update factories and apigee tests
2023-02-25 19:26:11 +01:00
b186365cab
Update data solutions tests
2023-02-25 19:26:11 +01:00
99e69e319f
Update data platform tests
2023-02-25 19:26:11 +01:00
a51c682005
Updated tf file to add the following features:
...
- default location of dataset to US
- changed name of vertex metastore to "default"
- add ai user and service account us to notebook SA
- add ai user to vertex sa
2023-02-24 13:27:44 +00:00
50856e6951
First commit
2023-02-23 18:36:03 +01:00
47855cb682
Merge branch 'master' into lcaggio/dp-projectcreate
2023-02-23 11:54:48 +01:00
b279c083a0
Fix README and IAM files
2023-02-23 11:54:16 +01:00
2108b4650d
Fix Tests, rely on iam additive.
2023-02-22 01:36:01 +01:00
a5e905cb80
Update remaining org policies
2023-02-21 15:49:16 +01:00
d3bcf625f9
Update yaml org policies
2023-02-21 15:49:16 +01:00
eda9597f0b
Fix linting
2023-02-20 01:03:38 +01:00
c523dce3a6
Fix
2023-02-20 01:00:57 +01:00
f4c1fa6c20
Fix tests.
2023-02-20 00:56:32 +01:00
db6a4f9ac7
Remove variables
2023-02-20 00:45:40 +01:00
Keith Harvey
lcaggio
Ludovico Magnocavallo
Alejandro Leal
Canburak Tümer
bluPhy
Taneli Leppä
Julio Castillo
Bharath KKB
Bob Idle
bgdanix
Fawzi
Dedeco
Miren Esnaola
Giorgio Conte
Giorgio Conte
Dan Farmer