Commit Graph

308 Commits

Author SHA1 Message Date
Julio Castillo 166c9574a1 Multi-region Cloud-SQL example 2022-04-04 17:01:24 +02:00
lcaggio ec3832760d
Merge branch 'master' into lcaggio/dp-dc-policy-tag 2022-04-04 15:38:52 +02:00
Lorenzo Caggioni f1a404a5d4 PR review fixes. 2022-04-04 15:38:36 +02:00
Lorenzo Caggioni 67b1715ecc Fix data_eng_principals logging role. 2022-04-04 09:16:55 +02:00
Lorenzo Caggioni d5fd15ae17 Update README 2022-04-04 08:59:05 +02:00
Lorenzo Caggioni 6f00caaaab Handle Service Identity SA. Update IAM.md 2022-04-04 00:38:34 +02:00
Lorenzo Caggioni e008fde9bb Update READMEs and separate demo pipelines 2022-04-03 22:03:35 +02:00
Lorenzo Caggioni d5bdc2a7e0 Update IAM.md 2022-04-03 14:59:00 +02:00
Lorenzo Caggioni 15ba9559c5 Update READMEs 2022-04-01 18:44:18 +02:00
Lorenzo Caggioni 3f933bb129 Update pipeline example and fix roles. 2022-04-01 18:25:05 +02:00
Lorenzo Caggioni c35e0298bd Merge branch 'master' into lcaggio/dp-dc-policy-tag 2022-04-01 12:04:54 +02:00
lcaggio c0be8dcddf
Merge branch 'master' into lcaggio/gcs2bq_shared_vpc 2022-03-31 16:30:11 +02:00
Lorenzo Caggioni 1061c6ebc9 Update DAG pipeline 2022-03-31 11:14:14 +02:00
Lorenzo Caggioni 14a0fbf336 Update pipeline example. 2022-03-31 09:34:34 +02:00
Lorenzo Caggioni 730d6d50b1 Update README. 2022-03-30 17:53:48 +02:00
Aurélien Legrand 1045723a62 Merge branch 'network-dashboard' of https://github.com/aurelienlegrand/cloud-foundation-fabric into network-dashboard 2022-03-30 17:46:28 +02:00
Aurélien Legrand 63a4d81de7 Documentation fix. 2022-03-30 17:46:01 +02:00
Aurélien Legrand 2bfcdd4744
Merge branch 'master' into network-dashboard 2022-03-30 17:08:31 +02:00
Aurélien Legrand db37e43a99 Adding Dynamic Routes per Network as a new metric. 2022-03-30 17:03:31 +02:00
Lorenzo Caggioni 112e7d5380 Merge branch 'master' into lcaggio/dp-dc-policy-tag 2022-03-30 15:06:22 +02:00
Lorenzo Caggioni 809f416477 [gcs-to-bq] Add support for shared VPC 2022-03-29 15:12:37 +02:00
dependabot[bot] 1e60249c77
Bump minimist in /examples/serverless/api-gateway/function (#600)
Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-03-29 15:08:49 +02:00
Lorenzo Caggioni d6fb5e4b62 policy tag 2022-03-29 12:06:45 +02:00
Aurélien Legrand 0344e7df8c formatting 2022-03-28 18:47:11 +02:00
Aurélien Legrand 02dc53d0d4 Refactored how limits are managed, now you can edit the metrics.yaml file to set specific metrics per network. 2022-03-28 18:44:16 +02:00
Aurélien Legrand 291470b8c4 Refactoring to use Cloud Asset Inventory, reducing latency for metrics data, reduced execution time by 50%. 2022-03-24 10:07:58 +01:00
Aurélien Legrand 7317c3f75c Improving README 2022-03-18 10:56:16 +01:00
Aurélien Legrand 7391aa1179 Improving README 2022-03-18 10:56:16 +01:00
Aurélien Legrand 0fe548ee80 Improving README.md and adding a picture 2022-03-18 10:56:16 +01:00
Aurélien Legrand b4c1b16217 formatting test.tf 2022-03-18 10:56:16 +01:00
Aurélien Legrand e207928e07 Removing unless variables, using local modules. 2022-03-18 10:56:16 +01:00
Aurélien Legrand 58d71ff37a Sorting imports and constant variables 2022-03-18 10:56:16 +01:00
Aurélien Legrand 7874f9c02b refactoring main.py 2022-03-18 10:56:16 +01:00
Aurélien Legrand 7802c33988 Variables to uppercase. 2022-03-18 10:56:16 +01:00
Aurélien Legrand ea6d86ce01 Removing global variables. 2022-03-18 10:56:16 +01:00
Aurélien Legrand 261fc20227 formatting 2022-03-18 10:56:16 +01:00
Aurélien Legrand c0981c0fdd Using Cloud Function Fabric Terraform module 2022-03-18 10:56:16 +01:00
Aurélien Legrand dfc7c355b8 Refactoring Cloud Function code: added metrics.yaml file to create all metrics. 2022-03-18 10:56:16 +01:00
Aurélien Legrand 2a8236b7b8 Pinning version for libs and terraform modules, adding docstrings, improving documentation of the code, tabs 2 spaces. 2022-03-18 10:56:16 +01:00
Aurélien Legrand 971726224f Networking dashboard to display per VPC and per VPC peering group limits that are not shown in the console 2022-03-18 10:56:16 +01:00
Aurélien Legrand 344a489a27 Improving README 2022-03-18 10:46:30 +01:00
Aurélien Legrand 76f8f4b19d Improving README 2022-03-18 10:45:54 +01:00
Aurélien Legrand 5d7e25484d Improving README.md and adding a picture 2022-03-18 10:43:16 +01:00
Aurélien Legrand 44b32400e6 formatting test.tf 2022-03-18 10:10:08 +01:00
Aurélien Legrand 73269eeed5 Removing unless variables, using local modules. 2022-03-18 10:05:51 +01:00
Aurélien Legrand 18a59285d2 Sorting imports and constant variables 2022-03-17 20:35:33 +01:00
Aurélien Legrand 90bc1bf772 Merge branch 'network-dashboard' of https://github.com/aurelienlegrand/cloud-foundation-fabric into network-dashboard 2022-03-17 20:10:15 +01:00
Aurélien Legrand 65172031f0 refactoring main.py 2022-03-17 20:08:58 +01:00
Aurélien Legrand 82635499b7
Merge branch 'master' into network-dashboard 2022-03-17 17:44:55 +01:00
Aurélien Legrand 6f6b0796da Variables to uppercase. 2022-03-17 17:28:17 +01:00
Aurélien Legrand 13244d8904 Removing global variables. 2022-03-17 17:04:31 +01:00
Aurélien Legrand a1fdb73a96 formatting 2022-03-17 16:38:24 +01:00
Aurélien Legrand 5a085f4147 Using Cloud Function Fabric Terraform module 2022-03-17 16:36:56 +01:00
Aurélien Legrand 9a076553a5 Refactoring Cloud Function code: added metrics.yaml file to create all metrics. 2022-03-17 16:36:36 +01:00
averbukh ee5666563c Fix typos 2022-03-16 19:33:09 +01:00
averbukh 8ba9300091 Healthchecker configuration explained in the readme 2022-03-16 08:21:46 +01:00
averbukh 78b3fcedca Empty commit to rerun the tests 2022-03-16 01:07:57 +01:00
averbukh 9bf9b165db Fix references to the functions code 2022-03-16 00:52:52 +01:00
averbukh f65c64e7f7 go fmt 2022-03-16 00:16:24 +01:00
averbukh a0c4b0bcd7 Update examples readme 2022-03-15 23:58:36 +01:00
averbukh e98de6c453 Unmanaged GCE instances TCP healthchecker 2022-03-15 23:50:57 +01:00
Aurélien Legrand 221557d066 Pinning version for libs and terraform modules, adding docstrings, improving documentation of the code, tabs 2 spaces. 2022-03-09 19:02:59 +01:00
Aurélien Legrand 9f3ee4dc22 Networking dashboard to display per VPC and per VPC peering group limits that are not shown in the console 2022-03-08 18:36:02 +01:00
Simone Ruffilli fb90500adc
FAST: add 02-networking-peering stage. (#561)
* Networking with peering - initial commit

* README and tests

* Linter fixes

* Linter fixes

* Linter fixes

* Update README.md

* split out vpn/peering in separate files so the rest is identical

* fix dns for vpn and peering

* update tfdoc to support multiple outputs/variables files

* add peering variables

* update tfdoc for modules

* make it easier to spot errored docs

* fix doc

* yapf

* fix permadiff in firewall module source ranges

* FAST: Networking: DNS Fixes

* FAST: ability to toggle on-prem vpn creation

* FAST: fix outputs

Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-28 12:27:27 +01:00
apichick 00473fda64 API gateway module and example that creates a multi-region deployment for API gateway 2022-02-22 12:00:44 +01:00
Ludovico Magnocavallo f258ff1998 fw rules 2022-02-19 07:59:30 +01:00
Lorenzo Caggioni 55c78a132f Add network tag. Add KMS support in the DAG example. 2022-02-18 22:09:48 +01:00
Ludovico Magnocavallo 97d2ab3912 tfdoc 2022-02-18 19:19:28 +01:00
Ludovico Magnocavallo fb5d1adf9e composer working 2022-02-18 19:17:58 +01:00
Ludovico Magnocavallo 02a351d44f postfix on common name 2022-02-18 17:52:53 +01:00
Ludovico Magnocavallo 2259f3f44c add support for optional project suffix 2022-02-18 14:39:04 +01:00
Lorenzo Caggioni 421257ef25 Fix GKE roles 2022-02-17 18:00:47 +01:00
Julio Castillo a07e187c31
Merge branch 'master' into workload-identity-federation 2022-02-16 12:20:56 +01:00
Lorenzo Caggioni d70e165a92 Fix Shared VPC members 2022-02-16 08:57:30 +01:00
apichick 8ba83cf504 Added new example for workload identity federation 2022-02-13 20:15:13 +01:00
Ludovico Magnocavallo eb35d464d7 fix IAM roles, reword a few sentences 2022-02-13 11:26:55 +01:00
Ludovico Magnocavallo 255e834fa0 tfdoc 2022-02-13 11:06:51 +01:00
Lorenzo Caggioni b84406c7ae Roles and IAM. 2022-02-12 16:06:06 +01:00
Lorenzo Caggioni bd1461ed61 Fix roles and tests. 2022-02-12 15:52:34 +01:00
Lorenzo Caggioni cdc6c7fc94 Add SA display names. 2022-02-12 10:20:14 +01:00
Lorenzo Caggioni eb2e510518 Fix IAM and tests 2022-02-12 10:10:05 +01:00
Lorenzo Caggioni 12383ae72d Fix roles 2022-02-12 09:48:16 +01:00
Lorenzo Caggioni 2412f4d1ad Switch to multiregion GCS and BQ. Add IAM.MD 2022-02-12 00:50:38 +01:00
Ludovico Magnocavallo 5019531c8b shared vpc roles 2022-02-10 15:24:29 +01:00
Lorenzo Caggioni aaf0441e92 Fix shared VPC roles 2022-02-10 14:25:38 +01:00
Lorenzo Caggioni 0892e3ad63 README 2022-02-10 10:09:27 +01:00
Lorenzo Caggioni 2d9d52fd8d Fix vpc name and tests 2022-02-10 09:48:51 +01:00
Lorenzo Caggioni 3617c3abf8 Fix shared-vpc-project module 2022-02-10 09:28:56 +01:00
Ludovico Magnocavallo 26a26e63b3 use project module to assign shared vpc roles 2022-02-10 08:47:16 +01:00
Ludovico Magnocavallo db1dc76e74 add TODO for service accounts descriptive name 2022-02-10 07:54:52 +01:00
Ludovico Magnocavallo 9c374c85ab formatting 2022-02-10 07:47:52 +01:00
Ludovico Magnocavallo 4f4a9cd7ac mandatory project creation, refactor 2022-02-09 17:01:25 +01:00
Ludovico Magnocavallo a64e7a8e41
Merge branch 'master' into fast-dev-dp 2022-02-09 14:37:28 +01:00
Lorenzo Caggioni c14a2fe9cf update README 2022-02-09 14:15:11 +01:00
Lorenzo Caggioni abaa0b4da3 update READEME 2022-02-09 13:01:58 +01:00
Lorenzo Caggioni 1b908e4074 update READEME 2022-02-09 11:24:21 +01:00
Ludovico Magnocavallo 40cb46e1cc
Add support for Shared VPC service IAM to project module (#525)
* project module changes

* fix examples

* add comments in module code

* re-enable nullable on svpc variables

* project factory

* Tests still failing (#526)

* fix pf

* tfdoc

* pf test boilerplate

Co-authored-by: Simone Ruffilli <sruffilli@google.com>
2022-02-09 11:06:51 +01:00
Lorenzo Caggioni 908422d636 Fix Linting 2022-02-08 17:49:32 +01:00
Lorenzo Caggioni e270adf516 Fix Project Name logic 2022-02-08 17:46:34 +01:00
lcaggio 042266f28c
Merge branch 'master' into fast-dev-dp 2022-02-08 09:02:48 +01:00
Ludovico Magnocavallo c2a2b799b9
Remove older GCS to BQ example (#523)
* remove older GCS to BQ example

* remove tests
2022-02-08 07:30:03 +01:00
Lorenzo Caggioni 508fcf7527 Fix variable typos 2022-02-08 00:02:20 +01:00
Lorenzo Caggioni 97b9dae7e1 Fix misconfiguration and tests. 2022-02-07 23:16:47 +01:00
Lorenzo Caggioni d8bad57790 Refactor variables 2022-02-07 21:28:54 +01:00
Lorenzo Caggioni 94d94876a0 Merge branch 'fast-dev-dp' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into fast-dev-dp 2022-02-07 17:51:16 +01:00
Lorenzo Caggioni 2e560407c1 Temp commit with errors 2022-02-07 17:51:06 +01:00
lcaggio e3a4df27d6
Merge branch 'master' into fast-dev-dp 2022-02-07 15:55:34 +01:00
Julio Castillo 48cfd0e5bc Fix README 2022-02-07 11:54:19 +01:00
Julio Castillo 82b181f34e Project factory fixes
- Add GKE roles in the host project
- Use SA names from project module
- Add a few outputs
- Add prefix for project ids
2022-02-07 11:54:19 +01:00
Lorenzo Caggioni 48f442572c Add DLP documentation link. 2022-02-07 10:56:42 +01:00
Lorenzo Caggioni 78fcdc5374 Fix composer roles and README. 2022-02-07 08:20:20 +01:00
Lorenzo Caggioni e0f83569f1 Merge branch 'fast-dev-dp' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into fast-dev-dp 2022-02-06 20:59:22 +01:00
Lorenzo Caggioni 88ecca734d Update README 2022-02-06 20:59:16 +01:00
lcaggio ee0d0774b4
Merge branch 'master' into fast-dev-dp 2022-02-06 20:27:51 +01:00
Lorenzo Caggioni bfefb88f31 Add PubSub encryption 2022-02-06 20:27:41 +01:00
Julio Castillo 5937bac299 Update PF to grant network user to the cloud service agent when using gke. 2022-02-06 19:57:25 +01:00
Lorenzo Caggioni 577fbf1cc3 Fix README 2022-02-05 09:06:30 +01:00
Lorenzo Caggioni 74b850b4b8 Fix secondary range logic 2022-02-05 09:04:18 +01:00
Lorenzo Caggioni b65d153ec1 Replace existing data platform 2022-02-05 08:51:11 +01:00
Ludovico Magnocavallo 2cdea57954 README refactor 2022-02-04 17:35:30 +01:00
Lorenzo Caggioni 49aa21cd9a Fix tests and resource name 2022-02-03 17:37:42 +01:00
Lorenzo Caggioni b3238969df Fix Shared VPC, first try :-) 2022-02-03 14:25:46 +01:00
Lorenzo Caggioni 1d2c041e28 Fix README. 2022-02-03 11:18:27 +01:00
Lorenzo Caggioni 2f86fd882c split Cloud NAT flag 2022-02-03 10:39:08 +01:00
Lorenzo Caggioni ac1ca68dbd support policy_boolean 2022-02-03 09:37:50 +01:00
Lorenzo Caggioni 22739f43ea Merge branch 'fast-dev-dp' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into fast-dev-dp 2022-02-02 18:34:55 +01:00
Lorenzo Caggioni b38b9b2d57 fix readme 2022-02-02 18:34:48 +01:00
lcaggio fafbe5c1c8
Merge branch 'master' into fast-dev-dp 2022-02-02 16:58:18 +01:00
Lorenzo Caggioni e51722d615 Add datacatalog 2022-02-02 16:51:14 +01:00
Lorenzo Caggioni 7704212b3c Fix test error 2022-02-02 16:20:27 +01:00
Lorenzo Caggioni f1ee12e20c Fix README 2022-02-02 16:13:54 +01:00
Lorenzo Caggioni d839553994 Fix README 2022-02-02 16:12:09 +01:00
Lorenzo Caggioni 3c99074b3f Fix issues & readme 2022-02-02 15:31:54 +01:00
Elia e279818b55
M4CE (v5) Examples (#413)
* M4CE (v5) Examples

* vm-migration new parent folder

* New vm-migration section

* Updated variables description

* Updated variables description

* Fixed broken link

* Updated variables description

* Fix lines spacing

* Added output variable

* Updated Variables description

* New variables layout

* fixed new line

* M4CE (v5) Examples

* vm-migration new parent folder

* New vm-migration section

* Updated variables description

* Updated variables description

* Fixed broken link

* Updated variables description

* Fix lines spacing

* Added output variable

* Updated Variables description

* New variables layout

* fixed new line

* added test

* move test on new folder

* Updated variables order and description

* Added output file

* vm-migration example tests

* Updated output description

* Updated output description

* Fixed Typo

Co-authored-by: Simone Ruffilli <sruffilli@google.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-02 15:21:10 +01:00
Lorenzo Caggioni 4d04933a57 README review 2022-02-02 09:48:03 +01:00
Julio Castillo 5396735bc6
Changes to gcs to bq least privilege example (#447)
* Changes to gcs to bq least privilege example

* Fix 'try' on encryption variables

* Fix roles

* Fix tests

* Use templatefile in output variables

* Remove FIXME

* Fix tests

* Changes to gcs to bq least privilege example

* Fix 'try' on encryption variables

* Fix roles

* Fix tests

* Use templatefile in output variables

* Remove FIXME

* Fix tests

* Merge branch 'jccb/gcs-to-bq-changes' of https://github.com/GoogleCloudPlatform/cloud-foundation-fabric into jccb/gcs-to-bq-changes

* fix readme and template

* fix readme

* Update FIXME.

Co-authored-by: Lorenzo Caggioni <lorenzo.caggioni@gmail.com>
Co-authored-by: Ludovico Magnocavallo <ludomagno@google.com>
2022-02-02 08:32:59 +01:00
Lorenzo Caggioni bf0b240e1a Initial README update 2022-02-01 18:02:06 +01:00
Lorenzo Caggioni 1e63c0f44a Fix README. 2022-02-01 11:01:33 +01:00
Lorenzo Caggioni 679b20533e Fix outputs file name, fix README, remove dependeces on composer resource 2022-02-01 10:09:25 +01:00
Lorenzo Caggioni 6e9b884dce rename tf files 2022-02-01 09:30:29 +01:00
Lorenzo Caggioni 8e7436f4fc fix sample files 2022-02-01 09:19:32 +01:00
Lorenzo Caggioni b81841fc99 fix demo README 2022-02-01 09:16:51 +01:00
Lorenzo Caggioni 3b9ecddfee fix tfdoc description 2022-02-01 09:09:53 +01:00
Lorenzo Caggioni c533642b85 Fix TODOs 2022-02-01 07:25:00 +01:00
Lorenzo Caggioni 97b0d57053 fix README 2022-02-01 07:22:14 +01:00
Lorenzo Caggioni 7bcaa86703 simplify service_encryption_keys logic 2022-02-01 07:09:25 +01:00
Lorenzo Caggioni 5021592ec3 Remove block comments 2022-02-01 06:57:13 +01:00
Lorenzo Caggioni d52507217e add on TF files 2022-02-01 06:41:33 +01:00
lcaggio fc246b7f4b
Merge branch 'master' into fast-dev-dp 2022-01-31 19:00:23 +01:00
Lorenzo Caggioni 5777004187 Fix READM and Demo 2022-01-31 18:58:55 +01:00