Commit Graph

148 Commits

Author SHA1 Message Date
Dan Albert adecd4cfdc
Pull testnet vars up to buildkite env (#5098) 2019-07-14 20:27:49 -06:00
Dan Albert 440d006ec1
Plumb --no-snapshot in from CI (#5077)
* Plumb --no-snapshot in from CI
2019-07-14 13:17:30 -06:00
Dan Albert 5ac173d208
Enable GPUs and secondary disks for TdS net, pull external account file (#5031)
* Enable V100 GPUs over 3 regions for TdS cluster

* Turn on secondary config-local drive for tds net

* Enable long args bypass for GPU machine details

* bypass quoted long arg

* Pull external account file from wget

* typo

* Symlink config-local instead of changing the path variables

* Fix link path
2019-07-12 09:38:47 -06:00
Dan Albert e563a4dda3
Rename tds-testnet to tds (#5008) 2019-07-10 10:26:24 -06:00
Michael Vines 0a949677f0 net/ plumbing to manage LetsEncrypt TLS certificates (#4985)
automerge
2019-07-09 15:45:46 -07:00
Dan Albert 1ca7e9f67b
Add testnet-tds support to testnet manager (#4762)
* Add testnet-tds support to testnet scripts
2019-07-09 14:39:55 -06:00
Michael Vines dd1c3514a8
Use auto hashes-per-tick config for testnet testnet 2019-06-12 08:40:56 -07:00
Pankaj Garg ead947e710
Change default setting for real PoH in testnet scripts (#4573) 2019-06-06 12:49:46 -07:00
Michael Vines 53275cc678
Introduce normalized CI environment vars: ci/env.sh (#4571) 2019-06-06 12:20:47 -07:00
Michael Vines aa4a7b0c73
Disable |solana-install| check for edge/beta testnets (#4564)
The release tarball URL changes for these testnets, which causes the
normal |solana-install| check to fail and the testnet is unnecessarily
rebooted.
2019-06-05 15:31:29 -07:00
Michael Vines a7ef409c2b Drop influxcloud (#4460)
automerge
2019-05-28 16:26:59 -07:00
Pankaj Garg 6b35e16676
Turn on real PoH in perf testnets (#4407)
* Turn on real PoH in perf testnets

* enable real PoH for all testnets except "testnet"
2019-05-23 13:22:52 -07:00
Michael Vines 20b2be6e0b
Enable real PoH on beta testnet as well 2019-05-18 19:45:00 -07:00
Michael Vines 392a39dd54
Poh subsystem cleanup, genesis plumbing, enable real PoH on edge testnet (#4292)
* Remove unused PohServiceConfig::Step

* Clarify variable name

* Poh::hash() now takes an iteration counter

* man -> max

* Inline functions with single call site

* Move PohServiceConfig into GenesisBlock

* Add plumbing to enable real PoH on testnets

* Batch hashes to improve PoH hash rate

* Ensure a constant hashes_per_tick

* Remove PohEntry mixin field

* Poh/PohEntry no longer maintains tick_height

* Ensure a constant hashes_per_tick

* ci/localnet-sanity.sh: Use real PoH

* Rework Poh/PohService to keep PohRecorder unlocked as much as possible while hashing
2019-05-18 14:01:36 -07:00
Michael Vines 915956b94b Remove disable leader rotation option (#4299)
automerge
2019-05-15 15:16:45 -07:00
Michael Vines 1afccb7351
Add more regions to the testnet 2019-05-11 14:12:13 -07:00
Michael Vines 21f845ed39
Use more -w 2019-04-30 09:57:14 -07:00
Michael Vines 7a369df9a7
Add flag to skip slow extras when deploying a large testnet 2019-04-30 09:26:50 -07:00
Michael Vines d21fa4a177
v0.14: various net/ fixes for large clusters (#4080)
* net.sh: Add -F to discard validator nodes that didn't bootup successfully

* Relax sanity node count when validator bootup failure is permitted

* Less sanity for testnet-demo

* net.sh: Add -F to discard validator nodes that didn't bootup successfully
2019-04-29 21:38:32 -07:00
Michael Vines c3ec5ad846
testnet-demo: use more low quota nodes 2019-04-29 12:18:39 -07:00
Michael Vines e2e55f81d0
Increase testnet-demo node count a little 2019-04-29 09:09:55 -07:00
Michael Vines 0cc3956693
testnet-demo now runs across more GCE zones (#4053)
* testnet-demo now runs across more GCE zones

* Save zone info to config file

* Add geoip whitelist for common data centers

* Skip more of start

* Include -x for config

* Fetch private key from first validator node if necessary

* Correct -r propagation
2019-04-28 19:50:52 -07:00
Michael Vines 0b7269b64e
Switch testnet-demo to influxcloud 2019-04-27 22:12:50 -07:00
Michael Vines 457a2d948b
Correct us-central1-b zone name 2019-04-27 21:43:18 -07:00
Michael Vines 528bdf34fd
testnet-demo: skip over validator nodes that fail to boot 2019-04-27 21:34:23 -07:00
Michael Vines 9c1fd55768
testnet-demo: add more GCE zones, remove client 2019-04-27 16:52:09 -07:00
Michael Vines 4a5837a286
Add " 2019-04-27 07:41:21 -07:00
Michael Vines d36af917ea
Swap testnet-beta and testnet configuration 2019-04-26 23:24:35 -07:00
Michael Vines c81733b41a
Add testnet-demo configuration 2019-04-26 22:59:26 -07:00
Michael Vines b6558a2ef3
Remove created lockfile 2019-04-26 21:36:20 -07:00
Michael Vines 634d8e25ee
testnet-deploy.sh updates 2019-04-26 21:29:42 -07:00
Dan Albert 3e678511d2
Add enable/disable key value pairs into the steps block (#4018) 2019-04-26 14:26:05 -06:00
Dan Albert 08f0fb1e14
Implement working lockfile for testnet lockout (#4013) 2019-04-26 11:22:23 -06:00
Dan Albert f5f5281f85
Add on-demand functionality to all testnets (#4003)
* Add on-demand functionality to all testnets
2019-04-26 10:02:23 -06:00
Michael Vines 1684a7bd18
Move validators from testnet-beta to testnet (#4011)
* Move validators from testnet-beta to testnet

* Move testnet influxdb datasource to influxcloud
2019-04-26 09:02:12 -07:00
Michael Vines 0add5c1dc8
Move testnet buildkite env variables back into the tree (#3989) 2019-04-25 11:44:58 -07:00
Pankaj Garg 060793f451
Fix testnet automation scripts (#3886)
- missing machine type since change in gce.sh
2019-04-18 15:12:35 -07:00
Michael Vines beb8c7914e
Disable testnet-sanity ledger verification, too slow 2019-04-17 15:19:37 -07:00
Michael Vines ca36a6f4e0
Run sanity only in the zone that contains the bootstrap leader and blockstreamer nodes (#3828) 2019-04-17 14:25:40 -07:00
Michael Vines eb185b9ea5
testnet-beta sanity no longer tries to check inactive zones 2019-04-17 09:30:41 -07:00
Pankaj Garg 8d613f3977
Selectively deploy beta testnet to GCE/AWS or both clouds (#3805) 2019-04-16 10:40:30 -07:00
Michael Vines 5e2831f09e Disable cluster restart attempt 2019-04-15 09:59:53 -07:00
Michael Vines 6c9fba058b Reenable validator sanity check for testnet-{beta,edge} 2019-04-15 08:58:29 -07:00
Dan Albert a5254a3f7a
Add TESTNET_TAG Env var to buildkite (#3692)
* Add TESTNET_TAG Env var to buildkite
2019-04-09 13:00:45 -07:00
Michael Vines 6ac919c71a Set warn log level only for perf testnets 2019-04-09 11:09:16 -07:00
Pankaj Garg 72b7419e1c
Define list of valid cloud regions for GCE and AWS (#3670) 2019-04-07 14:29:09 -07:00
Pankaj Garg 7baff0920c Propagate cloud env variables to buildkite job 2019-04-07 11:48:25 -07:00
Pankaj Garg d9ecc278b4
Configure cloud zones and nodes from buildkite for beta testnet (#3666) 2019-04-07 08:25:34 -07:00
Pankaj Garg 89efe67e73 Fix the ordering of beta testnet zones 2019-04-05 17:53:31 -07:00
Dan Albert 3fcca5bc0a Suppress shellcheck array expansion warnings 2019-04-05 13:25:14 -07:00
Dan Albert 9d4c6f6aaa Appease shellcheck 2019-04-05 13:25:14 -07:00
Dan Albert d570b08134 Clean up array expansion 2019-04-05 13:25:14 -07:00
Dan Albert 8b6d7129f3 Fix option flag lettering 2019-04-05 13:25:14 -07:00
Dan Albert 50444181c5 Fix arg array ordering and rename network-name option 2019-04-05 13:25:14 -07:00
Dan Albert 0c51f156ae Reverse order of zone arg array building 2019-04-05 13:25:14 -07:00
Dan Albert 9ba0439593 Add multi-region deploy functionality 2019-04-05 13:25:14 -07:00
Pankaj Garg b33a1fa019 Fix clippy errors 2019-04-05 12:22:10 -07:00
Pankaj Garg 63fd4222aa Fix testnet sanity check for beta testnet 2019-04-05 12:22:10 -07:00
Pankaj Garg ed78c8d3bb Fix beta testnet launch script 2019-04-04 15:16:01 -07:00
Pankaj Garg ef1e5db0ee Force delete all beta testnet nodes before restarting them 2019-04-03 17:58:54 -07:00
Pankaj Garg 2e4acba579 Remove second block streamer from testnet beta 2019-04-02 15:15:11 -07:00
Pankaj Garg f441177840 Deploy beta testnet with 100 nodes across AWS and GCP 2019-04-02 11:21:57 -07:00
Pankaj Garg cb3adea94f Increase node count in beta testnet 2019-04-01 11:06:24 -07:00
Pankaj Garg 1d48c4dd45 enable leader rotation in beta testnet 2019-03-28 13:44:44 -07:00
Pankaj Garg c09e0eb536 propagate TESTNET_DB_HOST env variable to next step in buildkite 2019-03-26 14:40:18 -07:00
Pankaj Garg 0d90dfae1a Add provisions to specify a database server in testnet manager buildkite 2019-03-26 14:40:18 -07:00
Michael Vines ba2cdd0bf6
Move testnet/testnet-perf to the stable channel 2019-03-11 16:14:16 -07:00
Michael Vines cd4bccfd12 Remove snap support 2019-03-02 17:41:09 -08:00
Michael Vines 10270dcbad Add an API node to non-perf testnets 2019-02-17 10:39:27 -08:00
Michael Vines 514bf32b99
Enable ledger verification for non-perf testnets 2019-01-19 20:28:56 -08:00
Michael Vines c1cd92bbee Avoid -d arg conflict
-D is now "delete"
-d is now "disk type"
2019-01-09 16:39:24 -08:00
Michael Vines 64ebd9a194 Add update-to-restart operation. Also try to update before restarting on sanity failures 2019-01-08 21:11:43 -08:00
Michael Vines 71a2b794b4
Enable info logging on non-perf clusters to aid debug of failures 2019-01-05 08:28:32 -08:00
Michael Vines ea00c1274e Add net sanity failure metric 2019-01-04 18:45:55 -08:00
Michael Vines 3a2fa9a650 Enable ledger/validator sanity for non-perf testnets 2018-12-24 22:51:36 -08:00
Michael Vines 95c9fefbd0
Make sanity failure message more visible 2018-12-23 17:30:59 -08:00
Michael Vines c3a74e5e63
Avoid unnecessary shellcheck directives 2018-12-22 11:57:47 -08:00
Michael Vines d78f19f8bb
Select correct branch for {testnet,-perf} when using a stable channel tag 2018-12-19 17:46:18 -08:00
Pankaj Garg 2fe3402362
Use SSD for perf testnet (#2227) 2018-12-19 16:11:26 -08:00
carllin 69d7384cc0
Enable leader rotation on edge testnet (#2204) 2018-12-17 16:04:25 -08:00
Michael Vines af3ca02e35
Switch testnet-edge from snap to tarball
Snap publishing has been failing all day, unclear why.  Potentially
revert this commit if/when resolved.
2018-12-11 23:34:41 -08:00
Michael Vines 3d996bf080 Disable leader rotation on CI testnets until it's ready 2018-12-10 14:07:59 -08:00
Michael Vines def7d156f6 codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e' 2018-11-11 16:24:36 -08:00
Michael Vines 33aab094ef codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash' 2018-11-11 16:24:36 -08:00
Michael Vines b0405db5a9
Assign static IPs to {edge,beta}.testnet.solana.com 2018-11-07 20:11:00 -08:00
Michael Vines 22b6cbb4da
Switch testnet to AWS 2018-11-07 18:57:08 -08:00
Michael Vines 25dd5145bb
Switch to us-west-1a, us-west-1b is causing trouble 2018-11-07 18:23:28 -08:00
Michael Vines 3b41eec199
Shuffle AWS regions 2018-11-07 15:00:55 -08:00
Michael Vines 63807935cb
Switch testnet/testnet-beta to tarball release 2018-11-07 10:30:02 -08:00
Michael Vines d9f9e347ab
Delete testnet-master, testnet-master-perf 2018-11-07 10:08:29 -08:00
Michael Vines 863a0c3f8f
s/edge/beta/ 2018-11-07 08:54:32 -08:00
Michael Vines dd4fb7aa90 Add AWS-based nets 2018-11-07 07:47:39 -08:00
Michael Vines 2af5aad032 Switch testnet/testnet-perf to the latest beta or stable tag 2018-11-07 07:47:39 -08:00
Michael Vines d8d23c9971
Remove unused debug trace 2018-11-06 09:29:39 -08:00
Michael Vines 6b5d12a8bb
Set metrics database correctly 2018-11-06 07:25:18 -08:00
Michael Vines c4b9d5d8b9
Remove stray line 2018-11-05 20:53:34 -08:00
Michael Vines 52491b467a
Update testnet deploy docs 2018-11-05 19:12:55 -08:00
Michael Vines 7789fda016 Add testnet-manager pipeline 2018-11-05 17:35:30 -08:00