Commit Graph

39 Commits

Author SHA1 Message Date
Ludovico Magnocavallo fc7bf40e69
Initial replacement for CI/CD stage (#903)
* github extra stage

* remove original cicd stage

* allow setting commit attributes via variabes

* remove reference to deleted stage

* optional repo creation, documentation
2022-10-23 19:52:45 +02:00
Ludovico Magnocavallo 4b798fb34d
Run tests in parallel using `pytest-xdist` (#881)
* test terraform cache

* try pytest-xdist

* revert cache changes

* extend to other jobs

* change dist, bump processes to 4

* revert

* mark tests

* run init to prime providers cache

* prime providers cache

* prime providers cache for all jobs

* add local provider to versions

* remove leftover code
2022-10-14 14:56:16 +02:00
Ludovico Magnocavallo e8056577ce
Refactor GKE nodepool and blueprints (#875)
* first shot, untested

* example tests working

* module tests

* work on gke blueprints

* multitenant fleet doc examples

* fix gke hub doc examples

* blueprint tests

* move master range to vpc config

* fast stage 3 gke test

* tfdoc

* bump provider versions

* and bump provider again to latest
2022-10-12 12:59:36 +02:00
Simone Ruffilli 24c3ffe66b
FAST: Separate network environment (#566) 2022-10-10 11:50:07 +02:00
Ludovico Magnocavallo 78d1a09aeb
Enable FAST 00-cicd provider test (#865)
* enable fast 00-cicd provider test

* don't overwrite version files in CI

* change provider pinning for all tests in CI file
2022-10-07 13:20:56 +02:00
Ludovico Magnocavallo a0171b2c49
Bump terraform required version (#864)
* bump terraform required version

* fix test

* debug test

* debug test

* disable test

* fix CI file, bump terraform action version
2022-10-07 12:51:56 +02:00
Julio Castillo 7e9173d35d Create fully recursive e2e test runner 2022-09-12 13:58:11 +02:00
Julio Castillo 72da12e377 Rename gke-serverless to gke and add test for fast gke stage 2022-09-12 09:56:25 +02:00
Julio Castillo 52e7e0517a Merge branch 'master' into fast/gke2 2022-08-24 15:37:15 +02:00
Stefan Tomm 5b7f6ab91a
fix data-platform-dev folder in stage 03-data-platform (#774) 2022-08-16 09:36:24 +02:00
Ludovico Magnocavallo 0bec03b0a0 Merge remote-tracking branch 'origin/master' into fast/gke2 2022-08-03 20:42:09 +02:00
Ludovico Magnocavallo 9b6262de41
FAST: move region trigrams to a variable in network stages (#765)
* add region trigram variable

* debug check documentation

* fix linting
2022-08-03 11:36:27 +02:00
Julio Castillo 07c5da4283 Fix tests 2022-07-12 12:39:00 +02:00
Ludovico Magnocavallo dfb447a2c4
Merge branch 'master' into fast/gke2 2022-06-23 13:50:28 +02:00
Ludovico Magnocavallo ed4b301a17 align subnets between vpn and peering network stages 2022-06-23 09:05:20 +02:00
Ludovico Magnocavallo 666d8a469c
Merge branch 'master' into fast/gke2 2022-06-23 08:34:09 +02:00
Lorenzo Caggioni ceb611bb81 Remove custom role and rely on conditions. 2022-06-23 07:04:35 +02:00
lcaggio 5c653638bc
Merge branch 'master' into lcaggio/data-p-200622 2022-06-22 16:13:28 +02:00
Lorenzo Caggioni bcfa324825 Fix test 2022-06-20 22:39:29 +02:00
Lorenzo Caggioni 7625773dea Fix tests 2022-06-20 22:05:22 +02:00
Lorenzo Caggioni 41d8847a60 Fix test 2022-06-20 17:56:36 +02:00
Ludovico Magnocavallo 528219bbf3 fix stage1 tests 2022-06-16 22:03:08 +02:00
Julio Castillo f9b808b4bc Fix permissions and update NVA and peering net stages for gke 2022-06-08 11:42:04 +02:00
Julio Castillo 96b01cf68c Fix networking-vpn tests 2022-06-08 11:42:04 +02:00
Ludovico Magnocavallo ff25809020
Fix tfdoc parsing on newllines in outputs (#649)
* fix

* use the right (ugly) Python formatter

* boilerplate on new file

* and do the actual tfdoc run on the original outputs file
2022-05-05 14:43:38 +02:00
Ludovico Magnocavallo 725f7effce
Initial MVP for CI/CD (#608)
* preliminary support for wif in stage 0

* IAM wif role

* IAM wif role TODO

* add support for external SA IAM to SA module

* add name output to SA module

* separate cicd SA

* tfdoc

* GITLAB principal (untested)

* make GCS name output static

* outputs bucket

* fix stage 1 test

* tweak outputs

* tfdoc

* move wif_pool to automation variable

* add support for top-level and repository providers

* add missing boilerplate

* fix branchless principal

* initial workflow

* symlink provider template in stages

* remove service accounts from stage 0 cicd tfvars

* add cicd interface variable to resman stage

* fix cicd variable in resman stage

* better condition on outputs_location

* fix last change

* change outputs_location type

* revert outputs_location change

* split outputs in stage 0

* update ci/cd temporary notes

* rename additive IAM resource in SA module

* split outputs in stage 1

* remove unused locals

* fix stage 1 tests

* tfdoc

* Upload action files to outputs_bucket

* Fix tests and README

* rename template, streamline outputs

* local templates and gcs output for all stage 2

* add workflows to local output files

* Use lowercase WIF providers everywhere

* Bring back suffix for workflow files

* Remove unused files

* Update READMEs

* preliminary CI/CD implementation for stage 1

* fix stage 1

* stage 1 cicd

* tfdoc

* fix tests

* readme and links for cicd and wif

* refactor wif providers

* refactor cicd for stage 1

* fix stage 1

* wif org policies

* split identity provider configuration from cicd

* add type attribute to cicd repositories

* valid cicd repositories have a workflow template

* refactor stage 01

* fix stage 01 tests

* minimal CI/CD documentation

* better check_links error reporting

* fix links

* Added Gitlab specific configurations

Set the default issuer_uri for Gitlab. Added allowed audiences to OIDC configuration.

* Fixed TF formatting in identity providers.

* Changing identity provider audience to null

Changing identity provider audience to default to null.

* add instructions for renaming workflows

* address Julio's comments

Co-authored-by: Julio Castillo <jccb@google.com>
Co-authored-by: alexmeissner <alexmeissner@google.com>
2022-04-12 08:17:27 +02:00
Ludovico Magnocavallo a22cf80b60
Fix PSA (#584)
* Fix PSA

* fix typo

* fix vpn/peering diff

* output filename on failed checksum test
2022-03-17 11:09:02 +01:00
Julio Castillo a988107006 Compare md5 sums too 2022-03-01 14:36:40 +01:00
Julio Castillo a8dd5ae7cc Add test to ensure parity between 02-networking-[vpn/peering] 2022-03-01 14:36:40 +01:00
Simone Ruffilli fb90500adc
FAST: add 02-networking-peering stage. (#561)
* Networking with peering - initial commit

* README and tests

* Linter fixes

* Linter fixes

* Linter fixes

* Update README.md

* split out vpn/peering in separate files so the rest is identical

* fix dns for vpn and peering

* update tfdoc to support multiple outputs/variables files

* add peering variables

* update tfdoc for modules

* make it easier to spot errored docs

* fix doc

* yapf

* fix permadiff in firewall module source ranges

* FAST: Networking: DNS Fixes

* FAST: ability to toggle on-prem vpn creation

* FAST: fix outputs

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-28 12:27:27 +01:00
Simone Ruffilli 0d08c7d56a Re-aligning PF vars post varpocalypse 2022-02-27 19:04:47 +01:00
Julio Castillo 4194cae448 Fix resman tests 2022-02-25 12:29:11 +01:00
Simone Ruffilli dc3a2ad7be Fix tests on stages 2022-02-24 15:05:18 +01:00
Lorenzo Caggioni ed844cdedf Add tests 2022-02-18 00:58:14 +01:00
Simone Ruffilli 1d187ddd23
FAST: PF example implementation changed to dev. Tests updated (#544)
* FAST: PF example implementation changed to dev. Tests updated
* FAST: simplified teams folder names
2022-02-15 12:22:08 +01:00
Simone Ruffilli 0cef15301b
Rename 02-networking to 02-networking-vpn (#492) 2022-02-04 11:03:37 +01:00
Luca Prete 9d81e29be7
FAST - Add 02-networking-nva stage 2022-02-03 20:30:56 +01:00
Julio Castillo 43270247bf
Delete README.md 2022-01-19 19:15:33 +01:00
Ludovico Magnocavallo e866db2c88 Merge Fabric FAST (#435)
Co-authored-by: Simone Ruffilli <sruffilli@google.com>
Co-authored-by: Julio Castillo <jccb@google.com>
2022-01-19 14:19:39 +01:00