Commit Graph

141 Commits

Author SHA1 Message Date
Michael Vines ab6c7f6ca3 /it/ti/ 2019-02-16 10:40:47 -08:00
Michael Vines e4c6e4bf26 Report full node info before starting/updating network 2019-01-16 10:24:00 -08:00
Michael Vines c1cd92bbee Avoid -d arg conflict
-D is now "delete"
-d is now "disk type"
2019-01-09 16:39:24 -08:00
Michael Vines 6b46c22b42 Use restart 2019-01-09 11:59:01 -08:00
Michael Vines 35fe08b3bc Add update support 2019-01-08 21:11:43 -08:00
Michael Vines 7f2fa8bbcb Collect and upload network logs 2018-12-23 10:19:10 -08:00
Michael Vines b46c809544
source ci/upload-ci-artifact.sh 2018-12-22 12:34:30 -08:00
Michael Vines eb29a2898c
Uplaod net/log/ files as buildkite artifacts 2018-12-22 12:22:58 -08:00
Michael Vines 094f0a8be3 Leader rotation flag plumbing 2018-12-10 14:07:59 -08:00
Michael Vines 04a0652614 Generalize net/ from leader/validator to bootstrap-fullnode/fullnode 2018-12-05 17:11:16 -08:00
Michael Vines def7d156f6 codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e' 2018-11-11 16:24:36 -08:00
Michael Vines 33aab094ef codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash' 2018-11-11 16:24:36 -08:00
Michael Vines b02b636b36
Support local tarball deploys 2018-11-07 14:44:40 -08:00
Michael Vines 812a8bcc6c
Permit release tag tarballs 2018-11-07 10:33:58 -08:00
Michael Vines dd4fb7aa90 Add AWS-based nets 2018-11-07 07:47:39 -08:00
Pankaj Garg db98f7e0b4
Use env variables to disable validator sanity and ledger verification (#1675) 2018-10-31 12:30:33 -07:00
Pankaj Garg 85869552e0
Update testnet scripts to use release tar ball (#1660)
* Update testnet scripts to use release tar ball

* use curl instead of s3cmd
2018-10-30 18:05:38 -07:00
Michael Vines 8d92232949
Specify zone 2018-09-28 07:32:49 -07:00
Michael Vines e4d8c094a4
Include -z when deleting network 2018-09-27 21:27:09 -07:00
Pankaj Garg 35e6343d61
Update testnet-deploy script to configure GPUs for leader node (#1379) 2018-09-27 13:42:24 -07:00
Michael Vines afc764752c Permit testnets without a GPU 2018-09-26 10:37:41 -07:00
Michael Vines f06113500d bench-tps/net sanity: add ability to check for unexpected extra nodes 2018-09-12 15:38:57 -07:00
Michael Vines 506a81e8cc Assume -y 2018-09-07 12:01:43 -07:00
Michael Vines 88298bf321 Add -n option 2018-09-07 12:01:43 -07:00
Michael Vines e088833b81
s/create/start/ 2018-09-06 21:07:11 -07:00
Michael Vines b1bacf12a6
Add some log sections 2018-09-06 20:38:11 -07:00
Michael Vines 66ff602659 Rewrite ci/testnet-{deploy,sanity}.sh in terms of net/ primitives 2018-09-06 19:54:39 -07:00
Michael Vines 072d0b67e4
Send deploy metrics to the testnet-specific database 2018-09-06 08:30:03 -07:00
Michael Vines 43b4207101 Run oom-monitor in net/ testnets 2018-09-05 09:02:02 -07:00
Rob Walker 61abee204f
don't check for snap mode in common.sh, is only relevant to snap daemons (#1113)
snap mode is for daemons, remove it from client (i.e. common.sh)

supply leader info to client via snap
2018-09-04 14:31:54 +09:00
Rob Walker d1f1cbe88f leader-address=>leader-ip 2018-09-01 04:38:18 +09:00
Rob Walker fbc7c9c431 fix client_start to deal with new client.sh 2018-09-01 03:23:05 +09:00
Rob Walker 8b248dcf09 specify port 2018-09-01 02:56:24 +09:00
Rob Walker 4938aad939 fixups 2018-09-01 02:21:46 +09:00
Rob Walker 7e882dfe62 inform all snaps where the network is 2018-09-01 02:21:46 +09:00
Michael Vines 9d53208d68 Use gcloud_DeleteInstances 2018-08-28 08:11:44 -07:00
Michael Vines c8e3ce26a9 Start of scripts/gcloud.sh 2018-08-27 22:35:14 -07:00
Michael Vines bd5c6158ae Move some common scripts from multinode-demo/ to scripts/ 2018-08-27 13:52:38 -07:00
Michael Vines 229d825fe0
Fix master-perf basename 2018-08-17 21:59:36 -07:00
Michael Vines 98d0ef6df5 Add some wget retries 2018-08-16 20:22:49 -07:00
Rob Walker 73797c789b back to 4 TX threads 2018-08-16 12:02:11 -07:00
Rob Walker 036fcced31 test -t nproc 2018-08-16 12:02:11 -07:00
Rob Walker 1d3157fb80 fixups 2018-08-16 12:02:11 -07:00
Rob Walker 0b11c2e119 restart testnet clients in case airdrop fails 2018-08-16 12:02:11 -07:00
Michael Vines 8ca514a5ca
Remove unnecessary : 2018-08-08 22:45:39 -07:00
Michael Vines b605552079 Record network version in testnet-deploy start datapoint 2018-08-08 22:41:02 -07:00
Michael Vines 054298d957
Retry snap install 3 times, sometimes the snap server 503s 2018-08-08 08:56:05 -07:00
Michael Vines cca240c279
Add SOLANA_NET_NAME, rename SOLANA_NET_URL to SOLANA_NET_ENTRYPOINT 2018-08-08 08:49:30 -07:00
Michael Vines 89f17ceecf
Route setup-args 2018-08-08 08:32:23 -07:00
Michael Vines ecea41a0ab Install EarlyOOM on testnet nodes 2018-08-07 16:58:46 -07:00
Michael Vines e3cf1e6598 Bundle metrics_write_datapoint.sh in Snap 2018-08-07 13:35:01 -07:00
Michael Vines c230360f4c Wait until recycled machines are reachable before provisioning them 2018-08-02 22:13:17 -07:00
Michael Vines a9240a42bf Delete unreachable validators to cause a fresh one to be spawned 2018-08-02 20:45:29 -07:00
Michael Vines a7204d5353 Use a local user to avoid GCP login quota limits 2018-08-02 19:43:35 -07:00
Michael Vines 2c9d288ca9 Add a CI metric data point upload timeout to prevent CI build stalls
5 seconds is somewhat arbitrary, seems like enough
2018-08-01 15:49:48 -07:00
Michael Vines 2b259aeb41 testnet now deploys successfully on days of the month < 10 2018-08-01 14:10:52 -07:00
Michael Vines 416c141775 `export SKIP_INSTALL=1` to reset the network without reinstalling the snap 2018-07-28 18:04:13 -07:00
Michael Vines 4cdb9a73f8 Skip testnet-sanity on manual deploy 2018-07-28 12:37:29 -07:00
Michael Vines 4433730610 Add support for deploying a locally built snap 2018-07-28 12:37:29 -07:00
Michael Vines 71eb5bdecc Factor out vm_foreach 2018-07-28 12:37:29 -07:00
Michael Vines 4dceb73909 Reinstall client nodes in the background to speed up deploys 2018-07-26 09:49:00 -07:00
Michael Vines 4c4659be13 Add more stdout 2018-07-25 16:38:21 -07:00
Michael Vines 1b79fe73a1 Emit a metrics datapoint if bench-tps terminates 2018-07-25 15:55:02 -07:00
Michael Vines 5fa072cf16 Avoid quotes around net name 2018-07-25 15:55:02 -07:00
Stephen Akridge 80ecef2832 Add --sustained to ci testnet deploy script 2018-07-25 10:16:46 -07:00
Michael Vines dcce475f0b Progagate logging configuration to client nodes 2018-07-24 21:40:02 -07:00
Michael Vines 735a0ee16d Switch back to running bench-tps in 10 minute iterations 2018-07-24 15:43:25 -07:00
Michael Vines 782aa7b23b Cap at 4 threads 2018-07-24 11:35:03 -07:00
Michael Vines 7a71adaa8c Adjust threads by the number of cpus 2018-07-23 21:17:36 -07:00
Michael Vines ce8796bc2e Correctly calculate the expected number of full nodes 2018-07-23 19:55:09 -07:00
Michael Vines c7e1409f7b Not so much |set -x| 2018-07-23 19:55:09 -07:00
Michael Vines 9de9379925 Add support more more than 1 client node 2018-07-23 19:34:34 -07:00
Michael Vines 96a6e09050 Enable metrics in the TPS client 2018-07-23 16:51:39 -07:00
Michael Vines 7ebbaaeb2d Use bench-tps default duration 2018-07-22 16:26:49 -07:00
Michael Vines 5d065133ef Add data point for testnet startup and shutdown 2018-07-21 23:27:24 -07:00
Michael Vines d403808564
Restart `solana.bench-tps` every 10 minutes to work around memory leak
cc: #728
2018-07-21 19:48:13 -07:00
Michael Vines 3ffdca193d Rename client-demo to bench-tps catchup 2018-07-21 15:46:03 -07:00
Michael Vines 009d5adcba
Tell the client to transact for 1 hour blocks 2018-07-20 17:52:19 -07:00
Michael Vines 52c55a0335
Log to /tmp/solana.log for easy runtime inspection of client activity 2018-07-20 17:45:13 -07:00
Michael Vines 120add0e82 Add support for a client node running continuous transactions on the net 2018-07-20 17:07:36 -07:00
Michael Vines 1abefb2c7a Pass expected node count to testnet-sanity 2018-07-20 09:47:01 -07:00
Michael Vines 68ca9b2cb8 Generalize testnet deployment scripts 2018-07-20 09:10:28 -07:00
Michael Vines d76d3162e5
Slow down deployment more 2018-07-19 10:11:04 -07:00
Michael Vines b2ea2455e2 Disable rolling updates 2018-07-18 21:16:03 -07:00
Michael Vines dbab8792e4 Use real default value 2018-07-18 08:23:59 -07:00
Michael Vines 4eb676afaa Tunnel SOLANA_DEFAULT_METRICS_RATE into Snap nodes 2018-07-18 08:23:59 -07:00
Michael Vines 85d6627ee6 Deploy in one ssh login in a further attempt to avoid hitting GCP login quota 2018-07-17 20:45:52 -07:00
Michael Vines 611a005ec9 Avoid |wait| as it masks failures 2018-07-17 19:52:39 -07:00
Michael Vines 2bd48b4207 Display better deploy logs 2018-07-17 09:10:55 -07:00
Michael Vines fdf94a77b4 CUDA is now configurable 2018-07-16 16:23:45 -07:00
Michael Vines 194a84c8dd Add testnet-sanity.sh 2018-07-16 12:17:39 -07:00