94 lines
4.6 KiB
Markdown
94 lines
4.6 KiB
Markdown
|
# Load testing an application running on an autopilot cluster
|
||
|
|
|
||
|
|
This blueprint creates an Autopilot cluster with Google-managed Prometheus enabled and install an application that scales as the traffic that is hitting the load balancer exposing it grows. It also installs the tooling required to distributed load test with [locust](https://locust.io) on that application and the monitoring tooling required to observe how things evolve in the cluster during the load test. Ansible is used to install the application and all the tooling on a management VM.
|
||
|
|
|
||
|
|
The diagram below depicts the architecture.
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
## Running the blueprint
|
||
|
|
|
||
|
|
1. Clone this repository or [open it in cloud shell](https://ssh.cloud.google.com/cloudshell/editor?cloudshell_git_repo=https%3A%2F%2Fgithub.com%2Fterraform-google-modules%2Fcloud-foundation-fabric&cloudshell_print=cloud-shell-readme.txt&cloudshell_working_dir=blueprints%2Fgke%2Fautopilot), then go through the following steps to create resources:
|
||
|
|
|
||
|
|
2. Initialize the terraform configuration
|
||
|
|
|
||
|
|
```
|
||
|
|
terraform init
|
||
|
|
```
|
||
|
|
|
||
|
|
3. Apply the terraform configuration
|
||
|
|
|
||
|
|
```
|
||
|
|
terraform apply -var project_id=my-project-id
|
||
|
|
```
|
||
|
|
|
||
|
|
4. Copy the IP addresses for grafana, the locust master.
|
||
|
|
|
||
|
|
4. Change to the ansible directory and run the following command
|
||
|
|
|
||
|
|
```
|
||
|
|
ansible-playbook -v playbook.yaml
|
||
|
|
```
|
||
|
|
|
||
|
|
5. Open to the locust master web interface url in your browser and start the load test
|
||
|
|
|
||
|
|
|
||
|
|
6. SSH to the management VM
|
||
|
|
|
||
|
|
```
|
||
|
|
gcloud compute ssh mgmt --project my-project
|
||
|
|
```
|
||
|
|
|
||
|
|
7. Run the following command to check that the application pods are running on different nodes than the load testing and monitoring tooling.
|
||
|
|
|
||
|
|
```
|
||
|
|
kubectl get pods -A -o wide
|
||
|
|
```
|
||
|
|
|
||
|
|
8. Run the following command to see how the application pods scale
|
||
|
|
|
||
|
|
```
|
||
|
|
kubectl get hpa -n sample -w
|
||
|
|
```
|
||
|
|
|
||
|
|
9. Run the following command to see how the cluster nodes scale
|
||
|
|
|
||
|
|
```
|
||
|
|
kubectl get nodes -n
|
||
|
|
```
|
||
|
|
|
||
|
|
Alternatively you can also check all the above using the dashboards available in grafana.
|
||
|
|
<!-- BEGIN TFDOC -->
|
||
|
|
|
||
|
|
## Variables
|
||
|
|
|
||
|
|
| name | description | type | required | default |
|
||
|
|
|---|---|:---:|:---:|:---:|
|
||
|
|
| [project_id](variables.tf#L75) | Project ID. | <code>string</code> | ✓ | |
|
||
|
|
| [cluster_network_config](variables.tf#L17) | Cluster network configuration. | <code title="object({ nodes_cidr_block = string pods_cidr_block = string services_cidr_block = string master_authorized_cidr_blocks = map(string) master_cidr_block = string })">object({…})</code> | | <code title="{ nodes_cidr_block = "10.0.1.0/24" pods_cidr_block = "172.16.0.0/20" services_cidr_block = "192.168.0.0/24" master_authorized_cidr_blocks = { internal = "10.0.0.0/8" } master_cidr_block = "10.0.0.0/28" }">{…}</code> |
|
||
|
|
| [mgmt_server_config](variables.tf#L37) | Management server configuration. | <code title="object({ disk_size = number disk_type = string image = string instance_type = string })">object({…})</code> | | <code title="{ disk_size = 50 disk_type = "pd-ssd" image = "projects/ubuntu-os-cloud/global/images/family/ubuntu-2204-lts" instance_type = "n1-standard-2" }">{…}</code> |
|
||
|
|
| [mgmt_subnet_cidr_block](variables.tf#L53) | Management subnet IP CIDR range. | <code>string</code> | | <code>"10.0.2.0/24"</code> |
|
||
|
|
| [network](variables.tf#L59) | VPC name. | <code>string</code> | | <code>"vpc"</code> |
|
||
|
|
| [project_create](variables.tf#L66) | Parameters for the creation of the new project. | <code title="object({ billing_account_id = string parent = string })">object({…})</code> | | <code>null</code> |
|
||
|
|
| [region](variables.tf#L80) | Region. | <code>string</code> | | <code>"europe-west1"</code> |
|
||
|
|
|
||
|
|
## Outputs
|
||
|
|
|
||
|
|
| name | description | sensitive |
|
||
|
|
|---|---|:---:|
|
||
|
|
| [urls](outputs.tf#L17) | Grafanam, locust and application URLs. | |
|
||
|
|
|
||
|
|
<!-- END TFDOC -->
|
||
|
|
## Test
|
||
|
|
|
||
|
|
```hcl
|
||
|
|
module "test" {
|
||
|
|
source = "./fabric/blueprints/gke/autopilot"
|
||
|
|
project_create = {
|
||
|
|
billing_account_id = "12345-12345-12345"
|
||
|
|
parent = "folders/123456789"
|
||
|
|
}
|
||
|
|
project_id = "my-project"
|
||
|
|
}
|
||
|
|
# tftest modules=10 resources=30
|
||
|
|
```
|