Michael Vines
0a949677f0
net/ plumbing to manage LetsEncrypt TLS certificates ( #4985 )
...
automerge
2019-07-09 15:45:46 -07:00
Michael Vines
bd884a56bf
Install libssl1.1 better
2019-06-14 08:01:22 -07:00
Michael Vines
e4ca3900ae
Reduce default validators from 5 to 2
2019-06-02 22:58:59 -07:00
Michael Vines
e15246746d
Enable non-zero fees for all testnets ( #4513 )
...
automerge
2019-05-31 22:33:55 -07:00
Michael Vines
ce04d2bfc2
Add replicator support to net/ ( #4494 )
2019-05-31 15:27:31 -07:00
Michael Vines
471465a5f4
net/: Add solana-install test to sanity ( #4438 )
...
* Add instance creation date to motd
* Setup localtime
* Add solana-install test
2019-05-26 11:17:07 -07:00
Michael Vines
458ae3fdac
Switch to instances with AVX-512 if possible for better interop with dev machines ( #4328 )
...
automerge
2019-05-17 20:06:07 -07:00
Michael Vines
915956b94b
Remove disable leader rotation option ( #4299 )
...
automerge
2019-05-15 15:16:45 -07:00
Michael Vines
50f79e495e
net/ improvements ( #4257 )
...
automerge
2019-05-11 22:54:50 -07:00
Michael Vines
dd12db2f06
Correctly handle more zones than additional nodes
2019-05-11 14:47:27 -07:00
Michael Vines
bfc65e829e
Use zone[0] for any left over nodes
2019-05-11 14:07:36 -07:00
Michael Vines
7fe3c75c6b
Add a node-specific ip echo service to remove dependency on ifconfig.co ( #4137 )
2019-05-03 11:01:35 -07:00
Michael Vines
d21fa4a177
v0.14: various net/ fixes for large clusters ( #4080 )
...
* net.sh: Add -F to discard validator nodes that didn't bootup successfully
* Relax sanity node count when validator bootup failure is permitted
* Less sanity for testnet-demo
* net.sh: Add -F to discard validator nodes that didn't bootup successfully
2019-04-29 21:38:32 -07:00
Michael Vines
0cc3956693
testnet-demo now runs across more GCE zones ( #4053 )
...
* testnet-demo now runs across more GCE zones
* Save zone info to config file
* Add geoip whitelist for common data centers
* Skip more of start
* Include -x for config
* Fetch private key from first validator node if necessary
* Correct -r propagation
2019-04-28 19:50:52 -07:00
Pankaj Garg
697cd17b59
Use GPU nodes for blockstreamer as well if rest of testnet has GPUs ( #4046 )
...
- The blockstreamer crashes otherwise, as sigverify() looks for CUDA libs
2019-04-27 20:45:38 -07:00
Pankaj Garg
29a25990d3
Add provision in testnet scripts to ignore validator nodes that failed to bootup ( #3972 )
...
* Skip writing to config file if the node didn't bootup
* Detect dead nodes quicker
2019-04-24 16:23:26 -07:00
Dan Albert
4e7e5ace9d
Add support for Azure instances in testnet creation ( #3905 )
...
* Add support for Azure instances in testnet creation
* Fixup
* Fix shellcheck errors
* More shellcheck and cleanup node creation and deletion
* More shellcheck and cleanup node creation and deletion
* Fixup instance wait API
* Fix revieew comments and add GPU installation extension
2019-04-23 16:41:45 -06:00
Pankaj Garg
d83a71d89f
More AWS regions for testnet deployment ( #3911 )
...
- also some minor fixes to gce.sh
2019-04-19 17:46:14 -07:00
sakridge
684e1c73dd
Allow for custom cpu config on gce and use 20gb ram for clients ( #3856 )
2019-04-18 09:36:11 -07:00
Pankaj Garg
d0fb55d9b1
Allow testnet creation with no validator nodes ( #3846 )
2019-04-17 17:38:18 -07:00
Stephen Akridge
76e524ae48
Remove check for 0 additional nodes
...
Network with 1 leader is valid.
2019-04-09 11:16:55 -07:00
Michael Vines
1ba4806f8c
Document recent -z and -x command-line arg changes
2019-04-09 10:39:55 -07:00
Pankaj Garg
0904df327d
Parallelize cloud node deployment commands in case of multiple zones ( #3657 )
2019-04-07 08:13:48 -07:00
Pankaj Garg
9cd555cad5
AWS script change for additional zones and regions
2019-04-04 15:59:59 -07:00
Pankaj Garg
97bd7a00f1
Support for configuring testnet nodes across multiple cloud services
2019-04-01 17:11:41 -07:00
Pankaj Garg
cb3adea94f
Increase node count in beta testnet
2019-04-01 11:06:24 -07:00
Pankaj Garg
a94bc80383
fix clippy errors
2019-03-27 18:05:17 -07:00
Pankaj Garg
586b6fc3d7
review comments
2019-03-27 18:05:17 -07:00
Pankaj Garg
a14c202d60
fix the ip address that's stored in the config file
2019-03-27 18:05:17 -07:00
Pankaj Garg
ed48c495a3
fix shell-check errors
2019-03-27 18:05:17 -07:00
Pankaj Garg
f0abd06a46
Added support for multi-region cloud testnet
2019-03-27 18:05:17 -07:00
Michael Vines
ede99d5913
Revert "Block until instances are confirmed to be deleted"
...
This reverts commit 47ddbbe53b
.
2019-03-14 20:53:10 -07:00
Michael Vines
47ddbbe53b
Block until instances are confirmed to be deleted
2019-03-14 16:20:18 -07:00
Michael Vines
5d27f221f7
Drop socat for iptables
2019-03-13 12:03:56 -05:00
Pankaj Garg
76feb2098e
Use same VM type for validators as leader, if CUDA is enabled ( #3253 )
...
- Since all nodes are created equal
2019-03-12 17:42:47 -07:00
Rob Walker
a799f8f4b1
tell blockexplorer to run on port 8080 ( #3237 )
...
* tell blockexplorer to run on port 8080
* forward port 80 to 5000 for a blockexplorer node
2019-03-12 13:39:09 -07:00
Tyera Eulberg
18d48f09f8
Plumb blockstreamer name through testnet scripts
2019-02-21 17:24:29 -07:00
Michael Vines
a444cac2aa
Switch to upstream AMIs for non-CUDA EC2 testnets
2019-02-18 18:59:56 -08:00
Michael Vines
1e714eb6b2
Generate ec2 security group programmatically
2019-02-18 18:59:56 -08:00
Michael Vines
4ff4fb6c38
Add support for an API node that hosts the block explorer
2019-02-17 10:39:27 -08:00
Michael Vines
9eb8b67b5c
Install blockexplorer dependencies
2019-02-15 20:17:46 -08:00
Michael Vines
6015a0ff15
Add info command
2019-01-16 10:24:00 -08:00
Michael Vines
e0c68bf9ad
docs: -z is a common option
2019-01-08 21:11:43 -08:00
Pankaj Garg
4bf797c8f1
Load nvidia drivers on node startup ( #2263 )
...
* Load nvidia drivers on node startup
* added new script to enable nvidia driver persistent mode
* remove set -ex
2018-12-21 11:43:52 -08:00
Michael Vines
094f0a8be3
Leader rotation flag plumbing
2018-12-10 14:07:59 -08:00
Michael Vines
b54b0a1d25
Document that -P is now available for |config|
2018-12-09 15:25:27 -08:00
Michael Vines
f5794de636
Clean up bootstrap leader terminology in comments and variable names
2018-12-09 15:25:27 -08:00
Michael Vines
04a0652614
Generalize net/ from leader/validator to bootstrap-fullnode/fullnode
2018-12-05 17:11:16 -08:00
Michael Vines
c5b1bc1128
Remove obsolete update-default-cuda.sh
2018-11-12 20:31:16 -08:00
Michael Vines
851e012c6c
Upgrade EC2 image to 18.04 with CUDA 9.2 and 10
2018-11-12 15:17:34 -08:00
Michael Vines
7ee4dec3f1
Upgrade GCE GPU image to 18.04
2018-11-12 12:18:50 -08:00
Michael Vines
3466f139a4
set -e shuffling
2018-11-11 16:24:36 -08:00
Michael Vines
def7d156f6
codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e'
2018-11-11 16:24:36 -08:00
Michael Vines
33aab094ef
codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash'
2018-11-11 16:24:36 -08:00
Michael Vines
87ac549689
Work around AWS key management limitation
2018-11-07 18:48:27 -08:00
Michael Vines
f8f11b7f50
Remove docker0 interface if present
2018-11-07 18:23:24 -08:00
Michael Vines
82f914e0dc
Work around AWS boot check weirdness
2018-11-07 15:46:04 -08:00
Michael Vines
9359cc69d5
Invert gpu check
2018-11-07 14:44:40 -08:00
Michael Vines
b02b636b36
Support local tarball deploys
2018-11-07 14:44:40 -08:00
Michael Vines
2ef8ebe111
AWS AMIs are region specific
2018-11-07 10:05:58 -08:00
Michael Vines
f8673931b8
Increase boot timeout
2018-11-07 08:32:15 -08:00
Michael Vines
dd4fb7aa90
Add AWS-based nets
2018-11-07 07:47:39 -08:00
Michael Vines
6aac096c77
Add timeout to prevent a stuck ssh
2018-11-06 14:08:28 -08:00
Michael Vines
1a7830f460
Set imageName if G
2018-11-05 13:33:42 -08:00
Michael Vines
8041461a07
Bump EC2 validator machine type
2018-11-05 08:47:51 -08:00
Michael Vines
eae9372a5d
Upgrade GCP CPU-based testnet to 18.04
2018-11-04 19:18:47 -08:00
Pankaj Garg
3cc78d3a41
Added a new remote node configuration script to set rmem/wmem ( #1647 )
...
* Added a new remote node configuration script to set rmem/wmem
* Update common.sh for rmem/wmem configuration
2018-10-30 09:17:35 -07:00
Pankaj Garg
30c79fd40d
Change validator node machine type ( #1537 )
...
- The current nodes are using lower RAM compared to leader/clients
2018-10-17 17:16:50 -07:00
Pankaj Garg
7fb7839c8f
Configure GPU type/count from command line in GCE scripts ( #1376 )
...
* Configure GPU type/count from command line in GCE scripts
* Change CLI to input full leader machine type information with GPU
2018-09-27 11:55:56 -07:00
sakridge
3199f174a3
Add option to pass boot disk type to gce create ( #1308 )
2018-09-22 16:43:47 -07:00
Michael Vines
155ee8792f
Add GPU support to ec2-provider
2018-09-17 09:26:25 -07:00
Michael Vines
f89f121d2b
Add AWS EC2 support
2018-09-17 09:26:25 -07:00
Michael Vines
ee74b367ce
Add docker install script
2018-09-12 17:09:37 -07:00
Michael Vines
ebcac3c2d1
Use a common solana user on all testnet instances
2018-09-08 22:34:26 -07:00
Michael Vines
9f5c86e60c
Install earlyoom at gce instance startup
2018-09-08 13:59:45 -07:00
Michael Vines
9f413fd656
Establish net/scripts/... for better scoping
2018-09-08 13:59:45 -07:00
Michael Vines
506a81e8cc
Assume -y
2018-09-07 12:01:43 -07:00
Michael Vines
dcb30a8489
Delete leader node first
2018-09-07 12:01:43 -07:00
Michael Vines
d252f7f687
Revert "Default to 10 validators"
...
This reverts commit ed5fbaef06
.
2018-09-07 12:01:43 -07:00
Michael Vines
53e16f68d9
Improve error handling
2018-09-06 20:57:05 -07:00
Michael Vines
ed5fbaef06
Default to 10 validators
2018-09-06 20:46:49 -07:00
Michael Vines
66ff602659
Rewrite ci/testnet-{deploy,sanity}.sh in terms of net/ primitives
2018-09-06 19:54:39 -07:00
Michael Vines
03e87e4169
Add more metrics
2018-09-06 19:54:39 -07:00
Michael Vines
9ca6a2d25b
Configure boot disk size
2018-09-06 19:54:39 -07:00
Michael Vines
aa07bdfbaa
Optionally suppress delete confirmation
2018-09-06 19:54:39 -07:00
Michael Vines
cae345b416
Allow - in prefix
2018-09-06 19:54:39 -07:00
Rob Walker
fdc48d521c
use USER instead of whoami ( #1134 )
...
* use USER instead of whoami
make gcloud_FigureRemoteUsername robust against unsolicited output
(that I get on login ;) )
validate --prefix argument
* Update gcloud.sh
2018-09-07 00:18:05 +09:00
Michael Vines
6560b0e2cc
s/whoami/id -un/
2018-09-05 14:26:21 -07:00
Michael Vines
ec38dba209
GCE leader nodes can now be provisioned with a static IP address
2018-09-05 14:26:21 -07:00
Michael Vines
89db85dbf9
Work around concurrent |gcloud compute ssh| terminal issue
2018-09-05 09:02:02 -07:00
Michael Vines
e677cda027
Private IP networks now work, and are the default
2018-09-05 09:02:02 -07:00
Michael Vines
6ad4a81123
s/_/-/g in filenames
2018-09-05 09:02:02 -07:00
Michael Vines
bcaa0fdcb1
net/ can now deploy Snaps
2018-09-05 09:02:02 -07:00
Michael Vines
2cb1375217
Run gcloud_PrepInstancesForSsh in parallel
2018-09-05 09:02:02 -07:00
Michael Vines
9365a47d42
Employ a startup script
2018-09-05 09:02:02 -07:00
Michael Vines
6ffe205447
Add -g option
2018-09-05 09:02:02 -07:00
Michael Vines
fa07c49cc9
net/ can now deploy Snaps
2018-09-05 09:02:02 -07:00
Michael Vines
7e2b65374d
gce instance types are now configurable
2018-09-05 09:02:02 -07:00
Michael Vines
399caf343c
Morph gce_multinode-based scripts into net/
2018-09-05 09:02:02 -07:00