Ayman Farhat 02d8d8367a [Feature] Update data platform blue print with Dataflow Flex template (#1105) ... * Add initial dataflow template code + TF infra * Refactor the datapipeline DAG to use flex template operator, cleanup code * Remove unneeded bash scripts, update README with manual examples * Refactor datapipeline_dc_tags.py and include new Flex template * Update docs to reflect changes * Remove sub-dependencies and keep apache beam * Add missing license headers and update tests * Set resouces to 291 in tests * Update outputs via tfdoc * Update with outputs order and tfdoc * Correct number of resources * Fix to add region into command from var * Enable service account impersonation for running builds * Update example dataflow run command to use orchestrator SA * Remove hard coded values in example * Keep original airflow files, add new which use Flex template as example * Update tests and doc * Fix number of resources in plan * Run tfdoc remove files section in README * Fix number of modules in tfdoc * Update number of resources * Add missin service account * Update DF demo README * Quick rename --------- Co-authored-by: lcaggio <lorenzo.caggioni@gmail.com> Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>		2023-02-06 07:35:40 +01:00
..
df_demo_pipeline.png	[Feature] Update data platform blue print with Dataflow Flex template (#1105)	2023-02-06 07:35:40 +01:00
dlp_diagram.png	Rename examples folder to blueprints	2022-09-09 16:38:43 +02:00
kms_diagram.png	Rename examples folder to blueprints	2022-09-09 16:38:43 +02:00
overview_diagram.png	Remove plg project, composer 2	2023-01-11 00:31:52 +01:00