Commit Graph

75 Commits

Author SHA1 Message Date
Simone Ruffilli ee25965c89
Copyright bump (#410) 2022-01-01 15:52:31 +01:00
Ludovico Magnocavallo 2bc5f7d33c
update tfdoc (#404) 2021-12-30 10:56:19 +01:00
Ludovico Magnocavallo 1ac3fe4460
New tfdoc version (#396)
* update tfdoc

* rewrite check docs, refactor tfdoc replace, regenerate modules READMEs

* remove dead code from check docs

* do not fail on missing variable files in check docs

* fix typos
2021-12-21 08:51:51 +01:00
Andras Gyomrey d2ef4c3277 Allow using gVNIC in compute-vm (#211) 2021-11-08 11:18:15 +00:00
Ludovico Magnocavallo f6775aca1b
Use the same versions file everywhere, pin to tf 1.0+ provider 4.0+ (#355)
* add default versions file, remove old providers and versions

* use default versions file everywhere

* fix kms module

* re-add provider configuration for data platform step 2

* update kms module outputs sorting

* update kms documentation

* fix data solutions tests

* fix GKE workload identity attribute name

* work around firewall provider issue in datafusion example
2021-11-03 15:05:43 +01:00
Julio Castillo 1d13e3e624 Add more validations to linter
- Ensure all variables and outputs are sorted
- Ensure all variables and outputs have a description
- Add data-solutions/data-platform-foundations to linter

Fix all modules to follow these new conventions.
2021-10-08 18:26:04 +02:00
Julio Castillo 2863d929a5 Remove redundant variable `admin_ranges_enabled` 2021-10-04 14:12:00 +02:00
Ludovico Magnocavallo 262f823464
Refactor compute-vm to remove multiple instance support (#314)
* first iteration, largely untested

* basic tests pass

* basic tests pass

* nic test

* disk tests, refactor

* fix tests

* update README

* update gcs to bq example

* fix README examples, do not create disks for template

* fix data solutions examples

* update cloud operations examples

* update networking examples, mig and ilb modules examples

* update default image to debian 11

* update README table
2021-10-04 10:46:44 +02:00
javiergp 15b2736a7c
Bugfixing Data Foundations (#310)
* Bugfixing Data Foundations and impersonation support
- Fixed SA permissions
- Usage of impersonation to avoid SA private key export
- Fixed required API enablement
- Added FW rules required by dataflow
- Added provider for sa impersonation
2021-09-28 17:13:18 +02:00
Julio Castillo cb7c65135e
Update CI processes (#296)
- Upgrade to latest terraform version (1.0.4)
- Remove tflint from linting pipeline (was not doing anything)
- Add terraform fmt check to linting pipeline
- Pass all code through terraform fmt
2021-08-12 17:30:53 +02:00
Lorenzo Caggioni 54e4155ae8 Add details on VPC-SC and CMEK in README files 2021-07-09 10:52:52 +02:00
Lorenzo Caggioni 15d3742b06 add vpc-sc support 2021-07-08 16:51:57 +02:00
Lorenzo Caggioni 57c6bf49b0 - Remove Regional KMS key, not in use at the moment
- Remove Bittable and Secretmanager, not in use at the moment
2021-07-05 07:06:21 +02:00
Lorenzo Caggioni b1d8c06422 fix variables 2021-06-28 10:57:11 +02:00
Lorenzo Caggioni 37533b2d41 Add support for CMEK keys in Data Foundation end to end example 2021-06-25 13:06:19 +02:00
Yoram Ben-Yaacov de14c51b1d open-in-cloud-shell button added 2021-06-15 21:55:25 +03:00
lcaggio 381b532c0c
Merge pull request #242 from terraform-google-modules/add-data-platform-foundations
Add data platform foundations
2021-06-15 17:39:53 +02:00
lcaggio a24b2f8f0a
Update README.md 2021-06-15 17:18:11 +02:00
lcaggio 3d25b81dbd
Update README.md 2021-06-15 17:17:20 +02:00
lcaggio 03b24b5aa9
Update README.md 2021-06-15 17:13:40 +02:00
Yoram Ben-Yaacov d14d3475d5 Add information about the relation between the two first steps 2021-06-15 16:46:21 +03:00
Yoram Ben-Yaacov fb56bb6673 Folders rename 2021-06-15 16:12:20 +03:00
lcaggio efb52eeb6c
Move `bq` robot service account into the robot service account project output (#262) 2021-06-11 13:02:30 +02:00
Yoram Ben-Yaacov d9bf58c757 1. Diagrams redo to make them similar to the ones for the other examples.
2. Link fix in the README file
2021-06-11 11:15:04 +03:00
Ludovico Magnocavallo abca488737 refactor resources 2021-06-10 17:04:27 +02:00
Yoram Ben-Yaacov fc987a9a5d
Merged all components into one main file. (#259)
* Merged all components into one main file.

* rename datasource folder to resources

* resources output added for:
* datamart-bigquery-datasets-list
* dwh-bigquery-datasets-list
* landing-bucket-names
* landing-pubsub-list
* transformation-bucket-names

* Change the project ID with a link to the module

* add support for IAM roles to the datasets created

* Removed unused local variable module_version

* Moved from  access and access_identities to IAM.

* Update README.md

Co-authored-by: lcaggio <lcaggioni@google.com>
2021-06-10 09:58:40 +02:00
Ludovico Magnocavallo 1074546510 refactor environment 2021-06-05 16:05:39 +02:00
Julio Castillo c5e7ca78e8 Fix data examples 2021-06-01 18:47:57 +02:00
Ludovico Magnocavallo 34dd1f565c
Data Foundations: reorder first level README and folder structure (#251)
* reorder first level README and folder structure

* Link fix

Co-authored-by: Yoram Ben-Yaacov <benyaacov@google.com>
2021-05-30 20:04:56 +02:00
Ludovico Magnocavallo 99bfd4da98
Update README.md 2021-05-26 08:15:38 +02:00
Yoram Ben-Yaacov fd60b8328a projects prefix added 2021-05-24 21:45:54 +03:00
Yoram Ben-Yaacov 097e4da818 Renaming and reordering the files 2021-05-23 13:46:47 +03:00
Yoram Ben-Yaacov 8610ec84a7 Documents list reordering 2021-05-18 20:03:04 +03:00
Yoram Ben-Yaacov 256bbcec61 Link text update 2021-05-18 20:02:13 +03:00
Yoram Ben-Yaacov 33f3a9834d Add Data Platform Foundations description to the data-solutions README file 2021-05-18 20:00:45 +03:00
Yoram Ben-Yaacov c53b755684 Adding data-platform-foundations code 2021-05-18 19:30:21 +03:00
Julio Castillo a3e8f5391b Avoid data sources in in gcs-to-bq-with-dataflow example 2021-02-15 18:15:20 +01:00
Julio Castillo 1e11c670f5 Update copyright to 2021 2021-02-15 09:38:10 +01:00
Ludovico Magnocavallo e3a03a76ff
Add support for rePD and existing disk attachment to compute VM (#194)
* initial untested support for repd in compute-vm

* fix repd reference in instance disks

* add support for snapshot source, change disk variable

* fix attach existing disk to instance

* fix examples, add documentation on disk sources

* fix attaching disk for instance templates, add examples

* fix data e2e examples

* update vars table in README
2021-02-03 08:00:08 +01:00
Ludovico Magnocavallo cffc823f48
refactor access in bq module, add iam (#172) 2020-11-21 09:45:56 +01:00
Julio Castillo c31764fa7e
Add lint step to check module READMEs (#154)
* Add documentation check to lint process

* Split get_variables_outputs

* Install tfdoc dependencies in linting pipeline

* doc lint variant

* use new script args in ci build config

* exit early if doc does not exist

* align README docs with variables

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2020-11-07 09:12:41 +01:00
Ludovico Magnocavallo f89d782304 remove version constraints from examples 2020-11-06 08:45:46 +01:00
Ludovico Magnocavallo 1423a82322 update kms iam variables in examples 2020-11-06 08:28:42 +01:00
Ludovico Magnocavallo 9ebff3ece8 update examples for gcs module variable rename 2020-11-04 17:00:22 +01:00
Julio Castillo 53cb8359ee Remove *_roles variables in kms module 2020-10-30 17:58:45 +01:00
Julio Castillo 61d402fece Update gcs module to terraform 0.13 2020-10-29 23:26:03 +01:00
Julio Castillo d624295702 Fix service account tests 2020-10-20 23:25:50 +02:00
Lorenzo Caggioni 534662a41c - Fix issue 128 2020-08-31 10:48:14 +02:00
Ludovico Magnocavallo 60c068ffea update input variable tables in data solutions examples 2020-08-29 11:15:42 +02:00
Julio Castillo 5ae489f50d
Add alias IP support in `compute-vm` (#127)
* Add alias IP support in `compute-vm`

* Fix tests

* add end to end tests for data solutions examples and fix example errors

* update changelog

* add missing boilerplate

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2020-08-29 10:12:30 +02:00