Commit Graph

47 Commits

Author SHA1 Message Date
Ludovico Magnocavallo 6941313c7d
Factories refactor (#1843)
* factories refactor doc

* Adds file schema and filesystem organization

* Update 20231106-factories.md

* move factories out of blueprints and create new factories  README

* align factory in billing-account module

* align factory in dataplex-datascan module

* align factory in billing-account module

* align factory in net-firewall-policy module

* align factory in dns-response-policy module

* align factory in net-vpc-firewall module

* align factory in net-vpc module

* align factory variable names in FAST

* remove decentralized firewall blueprint

* bump terraform version

* bump module versions

* update top-level READMEs

* move project factory to modules

* fix variable names and tests

* tfdoc

* remove changelog link

* add project factory to top-level README

* fix cludrun eventarc diff

* fix README

* fix cludrun eventarc diff

---------

Co-authored-by: Simone Ruffilli <sruffilli@google.com>
2024-02-26 10:16:52 +00:00
Wiktor Niesiobędzki 2c9eb5795b Bum terraform to version 1.7.0 2024-02-07 17:25:11 +01:00
Ludovico Magnocavallo 819894d2ba
IAM interface refactor (#1595)
* IAM modules refactor proposal

* policy

* subheading

* Update 20230816-iam-refactor.md

* log Julio's +1

* data-catalog-policy-tag

* dataproc

* dataproc

* folder

* folder

* folder

* folder

* project

* better filtering in test examples

* project

* folder

* folder

* organization

* fix variable descriptions

* kms

* net-vpc

* dataplex-datascan

* modules/iam-service-account

* modules/source-repository/

* blueprints/cloud-operations/vm-migration/

* blueprints/third-party-solutions/wordpress

* dataplex-datascan

* blueprints/cloud-operations/workload-identity-federation

* blueprints/data-solutions/cloudsql-multiregion/

* blueprints/data-solutions/composer-2

* Update 20230816-iam-refactor.md

* Update 20230816-iam-refactor.md

* capture discussion in architectural doc

* update variable names and refactor proposal

* project

* blueprints first round

* folder

* organization

* data-catalog-policy-tag

* re-enable folder inventory

* project module style fix

* dataproc

* source-repository

* source-repository tests

* dataplex-datascan

* dataplex-datascan tests

* net-vpc

* net-vpc test examples

* iam-service-account

* iam-service-account test examples

* kms

* boilerplate

* tfdoc

* fix module tests

* more blueprint fixes

* fix typo in data blueprints

* incomplete refactor of data platform foundations

* tfdoc

* data platform foundation

* refactor data platform foundation iam locals

* remove redundant example test

* shielded folder fix

* fix typo

* project factory

* project factory outputs

* tfdoc

* test workflow: less verbose tests, fix tf version

* re-enable -vv, shorter traceback, fix action version

* ignore github extension warning, re-enable action version

* fast bootstrap IAM, untested

* bootstrap stage IAM fixes

* stage 0 tests

* fast stage 1

* tenant stage 1

* minor changes to fast stage 0 and 1

* fast security stage

* fast mt stage 0

* fast mt stage 0

* fast pf
2023-08-20 09:44:20 +02:00
Ludovico Magnocavallo d9f7cef1e7
allow using a separate resource for boot disk (#1496) 2023-07-07 15:40:13 +00:00
Julio Castillo f4b8a61981 Clean workflow files 2023-04-25 15:28:34 +02:00
Julio Castillo ee4a908b10 Remove last remaining legacy fixture 2023-04-25 15:12:32 +02:00
Julio Castillo 78867b0f99 Merge actions 2023-04-25 15:12:32 +02:00
Julio Castillo a09959539c Use tftest copy env var 2023-04-25 15:12:32 +02:00
Julio Castillo cc73c30c08 Pin provider versions in cache 2023-04-25 15:12:32 +02:00
Julio Castillo 3cd3106695 troubleshoot 2023-04-25 15:12:32 +02:00
Julio Castillo 7dd30f104f Reorder cache file 2023-04-25 15:12:11 +02:00
Julio Castillo 89fe36b4f4 print lockfiles 2023-04-25 15:12:11 +02:00
Julio Castillo 1b4e8eb305 Copy default versions to lockfile directory before tf init 2023-04-25 15:12:11 +02:00
Julio Castillo 20ccf7416f Enable parallel tests 2023-04-25 15:12:11 +02:00
Julio Castillo b097d297ff Extend tests to use lockfile if available
This commints allows the test framework to use a lockfile generated
within the tools/lockfile directory. This allows reusing the provider
cache and also running tests in parallel.
2023-04-25 15:12:11 +02:00
Ludovico Magnocavallo 40cda39093
bump Terraform version (#1307) 2023-04-05 09:15:23 +02:00
Julio Castillo 744863b9a3 Simplify testing workflow 2023-03-09 16:04:01 +01:00
Ludovico Magnocavallo ef28e208d3
Use composite action for test workflow prerequisite steps (#1216)
* test composite action

* add shell in action steps

* home input

* boilerplate

* static home

* use action in all test steps

* fix step name
2023-03-06 11:44:57 +01:00
Ludovico Magnocavallo 563ef270af
Try plugin cache, split examples tests (#1215)
* try plugin cache, split examples tests

* fix mkdir

* use cache
2023-03-06 10:38:39 +01:00
Julio Castillo 59ed5d1915 Bump actions versions 2023-02-25 13:08:30 +01:00
Ludovico Magnocavallo cb87f3efa5
Document new testing approach (#1048)
* document new testing approach

* remove unused workflow branches

* remove stale folder

* fix link

* document new testing approach

* remove unused workflow branches

* fix link

* Extend tests details in contributing guide

* Typos

Co-authored-by: Julio Castillo <jccb@google.com>
2022-12-12 19:59:46 +00:00
Julio Castillo 15d21eba39 Rename workflow names 2022-10-25 16:58:37 +02:00
Ludovico Magnocavallo 680eb656cb
disable parallel execution of tests and plugin cache (#887) 2022-10-14 19:52:38 +02:00
Ludovico Magnocavallo b39abd2389
Revert "Improve handling of tf plugin cache in tests (#885)" (#886)
This reverts commit af447e34e6.
2022-10-14 19:35:30 +02:00
Ludovico Magnocavallo af447e34e6
Improve handling of tf plugin cache in tests (#885)
* disable tf cache in CI

* re-enable cache

* try a different approach
2022-10-14 19:14:47 +02:00
Ludovico Magnocavallo 4b798fb34d
Run tests in parallel using `pytest-xdist` (#881)
* test terraform cache

* try pytest-xdist

* revert cache changes

* extend to other jobs

* change dist, bump processes to 4

* revert

* mark tests

* run init to prime providers cache

* prime providers cache

* prime providers cache for all jobs

* add local provider to versions

* remove leftover code
2022-10-14 14:56:16 +02:00
Ludovico Magnocavallo 78d1a09aeb
Enable FAST 00-cicd provider test (#865)
* enable fast 00-cicd provider test

* don't overwrite version files in CI

* change provider pinning for all tests in CI file
2022-10-07 13:20:56 +02:00
Ludovico Magnocavallo a0171b2c49
Bump terraform required version (#864)
* bump terraform required version

* fix test

* debug test

* debug test

* disable test

* fix CI file, bump terraform action version
2022-10-07 12:51:56 +02:00
Ludovico Magnocavallo e66340c4db
Refactor compute-vm for Terraform 1.3 (#860)
* refactor compute-vm for Terraform 1.3

* bump Terraform version in CI tests config

* fix optional null handling (ht jccb)

* tfdoc

* update blueprints

* align fast

* align README examples
2022-10-07 10:53:53 +02:00
Julio Castillo 040c9284e6 Fix tf version in pipelines 2022-09-28 11:50:23 +02:00
Ludovico Magnocavallo 834c5d53c9 point tests to new folders
Co-authored-by: Julio Castillo <juliocc@users.noreply.github.com>
2022-09-09 16:39:01 +02:00
Roberto Jung Drebes e1eea481b4 some more yaml quoting 2022-08-31 15:28:47 +02:00
Julio Castillo 07b00c34fe Bump providers versions and pin versions for tests 2022-06-28 10:20:40 +02:00
Julio Castillo 0ea0fa622b Move FAST tests to main tests workflow 2022-04-12 21:03:20 +02:00
Julio Castillo 06c3fb3757 Activate GHA for fast-dev-gke branch 2022-02-05 20:22:24 +01:00
Julio Castillo 3f798d3032
Fix failing tests (#442)
* Fix failing tests

* useless try

* try using job dependencies

* retry

* revert

* disable concurrency, try general config/env

* use in-job config

* don't use home var

* individual configs

* remove multiline

* useless tests

* one more try to figure it out

* use the right home path

* multiline

* fix typo

* remove unused files, revert conftest changes

* Move plugin init to separate action

* Remove parallel tests

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-01-21 17:25:16 +01:00
Ludovico Magnocavallo e866db2c88 Merge Fabric FAST (#435)
Co-authored-by: Simone Ruffilli <sruffilli@google.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2022-01-19 14:19:39 +01:00
Julio Castillo f84957270f Rename ci test jobs 2022-01-11 11:53:19 +01:00
Julio Castillo 144e841ce4 Allow tftest fixtures to run tests in parallel 2022-01-11 11:53:19 +01:00
Julio Castillo 8df9ef9035 New folder structure 2022-01-11 11:53:19 +01:00
Simone Ruffilli ee25965c89
Copyright bump (#410) 2022-01-01 15:52:31 +01:00
Taneli Leppä c263525177
Run tests nightly 2021-11-03 12:28:16 +01:00
Julio Castillo c11031a377 add colors to pytest output 2021-10-27 16:08:29 +02:00
caiotavaresdito d6ce44636e Fixed name convention for all actions 2021-10-27 08:28:51 -04:00
Julio Castillo 63fd88dee3 fix fake key path 2021-10-27 08:31:41 +02:00
Julio Castillo 1974f7c84d Remove env block 2021-10-27 08:28:10 +02:00
Julio Castillo be43421fdd Use setup-terraform action 2021-10-27 08:24:45 +02:00