Commit Graph

8 Commits

Author SHA1 Message Date
simonebruzzechesse d11c380aec
Format python files in blueprints (#2079)
* format python files in blueprints
* update check on blueprints python code
* update python linter in CI workflow
2024-02-15 09:37:49 +01:00
Simone Ruffilli 6d89b88149
versions.tf maintenance + copyright notice bump (#1782)
* Bump copyright notice to 2023

* Delete versions.tf on blueprints

* Pin provider to major version 5

* Remove comment

* Fix lint

* fix bq-ml blueprint readme

---------

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2023-10-20 18:17:47 +02:00
lcaggio 79723f9ce1
Add lineage on Minimal Data Platform blueprint (#1679)
Add lineage on Minimal Data Platform blueprint
2023-09-14 17:52:19 +02:00
Pierre Formont 0e7cfc8b29
add AIRFLOW_VAR_ prefix to environment variables in data-platform blueprints (#1651)
* add AIRFLOW_VAR_ prefix to env vars in minimal blueprint

* update DAGs for env vars in minimal blueprint

* add AIRFLOW_VAR_ prefix to env vars in foundation blueprint

* update DAGs for env vars in foundation blueprint

* apply tf linting

---------

Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2023-09-08 07:38:28 +00:00
lcaggio 099ad03910
Improve Minimal Data Platform Blueprint (#1473)
* Add SA to access to Curated resources

* Add BQ dataset in the landing project

* Provide example to move data from landing to curated using BQ engine

* Improve diagram
2023-06-28 09:05:48 +02:00
lcaggio 261ad646a8
Improve Minimal Data Platform blueprint (#1451) 2023-06-20 16:47:15 +00:00
lcaggio 40656a23de
Minimal Data Platform - Make components optional (#1380)
make some components optional: Composer and Data Proc history server.
2023-05-16 14:08:03 +02:00
lcaggio 3cc6c71e96
Add Minimal Data Platform blueprint (#1362)
Minimal Data Platform blueprint
2023-05-08 10:25:06 +02:00