Commit Graph

382 Commits

Author SHA1 Message Date
lcaggio 2108b4650d Fix Tests, rely on iam additive. 2023-02-22 01:36:01 +01:00
lcaggio eda9597f0b Fix linting 2023-02-20 01:03:38 +01:00
lcaggio c523dce3a6 Fix 2023-02-20 01:00:57 +01:00
lcaggio f4c1fa6c20 Fix tests. 2023-02-20 00:56:32 +01:00
lcaggio db6a4f9ac7 Remove variables 2023-02-20 00:45:40 +01:00
lcaggio c8f25512eb Fix variabler to support existing projects. 2023-02-20 00:39:37 +01:00
lcaggio ad6667a8fa First commit 2023-02-19 22:37:32 +01:00
Aleksandr Averbukh befc73ec12 feat: Update TFC+WIF blueprint with TFC Dynamic Credentials feature. 2023-02-19 00:51:49 +01:00
Ayman Farhat eac2065ae2 Update on docs wording 2023-02-16 17:04:05 +01:00
Ayman Farhat fcdadf521d Fix spelling mistake 2023-02-16 15:48:12 +01:00
Ayman Farhat a853dc4fe2 update Data Platform blueprint README with more example Dataflow commands 2023-02-16 15:45:20 +01:00
lcaggio ebc4bc51a5 Workaround to mitigate issue 9164 2023-02-13 15:25:24 +01:00
Julio Diez 0cfd8dd883 Move all images to an images/ folder 2023-02-10 19:48:04 +01:00
Julio Diez 5c3fd31b02 Add missing newlines in README 2023-02-10 19:43:56 +01:00
Julio Diez 621ee6e517 Update variables table via tfdoc.py 2023-02-10 18:02:37 +01:00
Julio Diez e72602a11d Update variables table via tfdoc.py 2023-02-10 18:02:37 +01:00
Julio Diez 6c470ece11 Option to create a project 2023-02-10 18:02:37 +01:00
Julio Diez 98f9a318bc Update output and variable tables via tfdoc.py 2023-02-10 14:38:16 +01:00
Julio Diez 1335fd65da Update output and variable tables via tfdoc.py 2023-02-10 14:21:38 +01:00
Julio Diez 9fa48ea177 Add ending periods to descriptions 2023-02-10 14:13:56 +01:00
Julio Diez 4aa135f7e8 Generated output and variable tables via tfdoc.py 2023-02-10 14:01:11 +01:00
Julio Diez d19d434538 Add HTML tags to generate output and variable tables 2023-02-10 13:21:01 +01:00
Julio Diez aca3069951 Add quotes around var project_id 2023-02-10 12:59:09 +01:00
Julio Diez f31293ba04 Specify block types 2023-02-10 12:56:59 +01:00
Julio Diez d916632686 Update URL to repo 2023-02-10 12:49:39 +01:00
Julio Diez 3935867d92 Simplify conditional expressions 2023-02-10 12:48:47 +01:00
Julio Diez a8de9088c6 Alphabetical ordering for outputs and variables 2023-02-10 12:46:34 +01:00
Julio Diez a199414794 Add license boilerplate 2023-02-10 12:30:39 +01:00
Julio Diez e8303e15ba
Merge pull request #8 from juliodiez/master
Sync branch
2023-02-10 10:27:54 +01:00
Julio Diez 3e7d8c563e Infer LB creation from custom_domain var
This way we can remove one var (glb_create) and simplify it for the user.
2023-02-09 10:33:51 +01:00
Julio Diez a44759d585 Fix typos in README 2023-02-08 21:21:20 +01:00
Julio Diez 8b41008397 Add README file with the use cases 2023-02-08 21:04:51 +01:00
Julio Castillo d7b88b7d0e Fix bq factory docs 2023-02-08 18:22:10 +01:00
Julio Diez 642fff04ad Get rid of config files
Follow CFF way, instead of using config files set appropriate values in file
variables.tf and use examples in the README to show how to tweak variables.
2023-02-07 21:01:28 +01:00
Julio Castillo 08f2540872 Bump provider version 2023-02-07 15:59:29 +01:00
lcaggio d78815d3d7 Fix README 2023-02-07 13:57:26 +01:00
lcaggio 71469679e3 Add variables validation 2023-02-07 13:53:54 +01:00
lcaggio dd77c2fe79
Merge branch 'master' into lcaggio/shieldedfolder 2023-02-07 07:58:00 +01:00
lcaggio 307cf32cf9 Fix 2023-02-06 21:34:29 +01:00
lcaggio d68bb4b320 Fixes 2023-02-06 21:33:04 +01:00
Julio Castillo e1e0c38236 Fix README and var order 2023-02-06 18:08:03 +01:00
Julio Castillo c883d5ec3a Fix README 2023-02-06 18:03:43 +01:00
Paul Woelfel bd90aa7f47
Add descriptive_name 2023-02-06 17:39:33 +01:00
Paul Woelfel f2b61b1e31
Add descriptive name as optional argument 2023-02-06 17:35:11 +01:00
lcaggio 1e4499c8ab Fixes 2023-02-06 14:58:40 +01:00
Ayman Farhat 02d8d8367a
[Feature] Update data platform blue print with Dataflow Flex template (#1105)
* Add initial dataflow template code + TF infra

* Refactor the datapipeline DAG to use flex template operator, cleanup code

* Remove unneeded bash scripts, update README with manual examples

* Refactor datapipeline_dc_tags.py and include new Flex template

* Update docs to reflect changes

* Remove sub-dependencies and keep apache beam

* Add missing license headers and update tests

* Set resouces to 291 in tests

* Update outputs via tfdoc

* Update with outputs order and tfdoc

* Correct number of resources

* Fix to add region into command from var

* Enable service account impersonation for running builds

* Update example dataflow run command to use orchestrator SA

* Remove hard coded values in example

* Keep original airflow files, add new which use Flex template as example

* Update tests and doc

* Fix number of resources in plan

* Run tfdoc remove files section in README

* Fix number of modules in tfdoc

* Update number of resources

* Add missin service account

* Update DF demo README

* Quick rename

---------

Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-02-06 07:35:40 +01:00
lcaggio 39ffdcf184
Merge branch 'master' into lcaggio/shieldedfolder 2023-02-05 22:45:14 +01:00
lcaggio f49e5ccec7 Fix readmes and variables. 2023-02-05 22:44:31 +01:00
lcaggio 47c75f8862 Implement project_config variable 2023-02-05 21:12:46 +01:00
lcaggio 38fc9e8b9b First commit 2023-02-05 07:52:33 +01:00