Commit Graph

210 Commits

Author SHA1 Message Date
Michael Vines eb37aa2bba Kill monitoring scripts by process group to ensure a full shutdown 2019-01-09 11:59:01 -08:00
Michael Vines 87c9af142f Preserve config/ when skipSetup 2019-01-09 11:59:01 -08:00
Michael Vines aedab3f83f Run sanity when previous ledger/setup is preserved 2019-01-08 21:11:43 -08:00
Michael Vines 3c835b692b
Use netLogDir 2018-12-23 10:33:43 -08:00
Michael Vines a6fd1ca3db Add logs subcommand to fetch remote logs from each network node 2018-12-23 10:19:10 -08:00
Michael Vines c3c955b02e Build/install native programs within cargo-install-all.sh 2018-12-19 11:53:08 -08:00
Michael Vines 5c396c222a Clean up install-native-programs.sh usage 2018-12-11 23:29:05 -08:00
Michael Vines 088bab61a4 Remove |cargo install| duplication 2018-12-11 23:29:05 -08:00
Michael Vines b2d7b34082 Add |./net.sh update| command to live update all network nodes 2018-12-11 09:40:22 -08:00
Michael Vines 094f0a8be3 Leader rotation flag plumbing 2018-12-10 14:07:59 -08:00
Michael Vines b2ddac610c Add option to skip setup during cluster start 2018-12-10 07:47:15 -08:00
Michael Vines f5794de636 Clean up bootstrap leader terminology in comments and variable names 2018-12-09 15:25:27 -08:00
Carl b9743957fa Make directory to hold programs 2018-12-09 08:38:41 -08:00
Michael Vines f5569e76db Relocate native programs to deps/ subdirectory of the current executable
This layout is `cargo build` compatible, no post-build file moves
required.
2018-12-08 16:31:01 -08:00
Michael Vines 872a3317b5 Fully switch to bootstrap-leader for command-line args 2018-12-07 16:57:02 -08:00
Michael Vines 6516c2532d Ensure native programs for the correct platform are installed 2018-12-07 11:32:08 -08:00
Michael Vines fa58da2401 Explicitly specific build variant when installing native programs 2018-12-07 11:32:08 -08:00
Michael Vines f0fe089013
Adapt testnet-deploy metric datapoint names to {,bootnode-}fullnode 2018-12-06 08:04:33 -08:00
Michael Vines 04a0652614 Generalize net/ from leader/validator to bootstrap-fullnode/fullnode 2018-12-05 17:11:16 -08:00
Michael Vines 33a5d5fe93 Enable debug builds by default for better backtraces 2018-11-17 10:52:08 -08:00
Michael Vines d96a6b42a5 Move drone into its own crate 2018-11-16 20:42:21 -08:00
Michael Vines 83fc3c10cf Setup CUDA env for local builds 2018-11-15 08:00:52 -08:00
Michael Vines 7f76403d0a Clean ~/solana during network start to avoid tripping over leftover files 2018-11-12 15:09:14 -08:00
Michael Vines def7d156f6 codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e' 2018-11-11 16:24:36 -08:00
Michael Vines 33aab094ef codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash' 2018-11-11 16:24:36 -08:00
Michael Vines b8261d7d83
Determine network version for tar and local deploys 2018-11-08 22:02:42 -08:00
Michael Vines b02b636b36
Support local tarball deploys 2018-11-07 14:44:40 -08:00
Michael Vines c4bc331663 Add support for using a release tar 2018-11-07 07:47:39 -08:00
Michael Vines 7b58bd621a
Remove node check from client start-up
If the network loses a validator or two, it's the job of the sanity
check to detect this not the bench clients
2018-11-06 13:57:06 -08:00
Michael Vines 8041461a07
Bump EC2 validator machine type 2018-11-05 08:47:51 -08:00
Michael Vines f3b04894b9 Try harder to snap download 2018-11-03 00:29:13 +00:00
Pankaj Garg 85869552e0
Update testnet scripts to use release tar ball (#1660)
* Update testnet scripts to use release tar ball

* use curl instead of s3cmd
2018-10-30 18:05:38 -07:00
Michael Vines 5c523716aa Ship native programs 2018-10-10 16:49:48 -07:00
Pankaj Garg 0a39722719
Add support to trigger testnet from a PR (#1434)
* Add support for different node counts

* Update variable names

* Delete network even after failures

* Add array for node counts

* Changed number of nodes to a space separated string of numbers

* Adjust number of nodes

* Snap will not be published if the env variable DO_NOT_PUBLISH_SNAP is set

* Address review comments

* Replaced influx db URL
2018-10-05 16:32:05 -07:00
Pankaj Garg be7cce1fd2
Tweak GCE scripts for higher node count (#1229)
* Tweak GCE scripts for higher node count

- Some validators were unable to rsync config from leader when
  the node count was high (e.g. 25). Looks like the leader node was
  getting more rsync requests in parallel than it count handle.
- This change staggers the validators bootup, and rsync time

* Address review comments
2018-09-14 17:17:08 -07:00
Michael Vines f06113500d bench-tps/net sanity: add ability to check for unexpected extra nodes 2018-09-12 15:38:57 -07:00
Pankaj Garg 1c17c6dd2b
Report UDP network statistics (#1176)
* Report UDP network statistics

Fixes #1093

* Address review comments

* Address additional review comments

* Fix shellcheck errors
2018-09-10 15:52:08 -07:00
Michael Vines ebcac3c2d1 Use a common solana user on all testnet instances 2018-09-08 22:34:26 -07:00
Michael Vines 5afcdcbbe6
More log grooming 2018-09-08 14:16:34 -07:00
Michael Vines 7aeb6d642b Display log file 2018-09-08 13:59:45 -07:00
Michael Vines db825788fa Document how to get ssh access into CD testnets 2018-09-07 19:41:13 -07:00
Michael Vines 1090254ba5 Add datapoints for leader/validator start 2018-09-07 12:45:48 -07:00
Michael Vines a2631e89f6 Use consistent style 2018-09-07 12:01:43 -07:00
Michael Vines 09a48d773a Run bench-tps in a tmux 2018-09-07 12:01:43 -07:00
Michael Vines 5a57d9b5d9 de-y 2018-09-06 19:54:39 -07:00
Michael Vines 03e87e4169 Add more metrics 2018-09-06 19:54:39 -07:00
Michael Vines 31dee553d5 Split start/version reporting 2018-09-06 19:54:39 -07:00
Michael Vines a3178c3bc7 Remove unused name tag 2018-09-06 19:54:39 -07:00
Michael Vines eaef9be710 Clarify -f 2018-09-06 19:54:39 -07:00
Michael Vines 48c19d3100 Enable cargo features to be specified 2018-09-05 09:02:02 -07:00
Michael Vines e677cda027 Private IP networks now work, and are the default 2018-09-05 09:02:02 -07:00
Michael Vines db9219ccc8 Improve error monitoring 2018-09-05 09:02:02 -07:00
Michael Vines 6ad4a81123 s/_/-/g in filenames 2018-09-05 09:02:02 -07:00
Michael Vines bcaa0fdcb1 net/ can now deploy Snaps 2018-09-05 09:02:02 -07:00
Michael Vines 9365a47d42 Employ a startup script 2018-09-05 09:02:02 -07:00
Michael Vines ec3e62dd58 Add net/ sanity 2018-09-05 09:02:02 -07:00
Michael Vines fa07c49cc9 net/ can now deploy Snaps 2018-09-05 09:02:02 -07:00
Michael Vines 43b4207101 Run oom-monitor in net/ testnets 2018-09-05 09:02:02 -07:00
Michael Vines ff991b87da Add support for deploying from non-Linux machines 2018-09-05 09:02:02 -07:00
Michael Vines 399caf343c Morph gce_multinode-based scripts into net/ 2018-09-05 09:02:02 -07:00