Michael Vines
b5aa03dd7c
Rename --config-dir to --ledger (progress towards deleting validator.sh) ( #5423 )
2019-08-05 12:42:52 -07:00
Michael Vines
3709dc6558
Reduce size of cpu-only gcp instances
2019-08-04 20:36:23 -07:00
Michael Vines
8d38777c1f
Remove stray --stake 0
2019-08-02 15:06:40 -07:00
Michael Vines
a6c4525998
RPC to the bootstrap leader instead of the local node, which may not yet be fully initialized
2019-08-01 23:34:55 -07:00
Michael Vines
b6b9c2cf56
Delegate stake from the pre-created identity keypair if it exists
2019-08-01 23:00:15 -07:00
Michael Vines
59d900977d
Avoid airdroping when airdrops are disabled
2019-08-01 22:43:09 -07:00
Michael Vines
0f5acb86d3
wallet: Refuse to delegate stake to a vote account with a stale root slot ( #5282 )
...
* Refuse to delegate stake to a vote account with a stale root slot
* Remove sdk-c from the virtual manifest temporarily
For an unknown reason |cargo clippy| is getting stuck in CI
intermittently when trying to build this crate.
2019-08-01 21:08:24 -07:00
Michael Vines
870503ee36
Introduce delegate-stake.sh for adding stake to a validator.sh ( #5380 )
2019-08-01 13:48:00 -07:00
Michael Vines
f859243191
Remove unused var
2019-07-31 10:51:30 -07:00
Michael Vines
9ddc25283c
Adapt validator sanity args
2019-07-31 10:46:25 -07:00
Michael Vines
388d4a8592
Remove obsolete --generate-snapshots argument
2019-07-31 10:26:22 -07:00
Michael Vines
9b8b7dbfd7
Avoid setting RUST_LOG to the empty string ( #5338 )
2019-07-31 10:13:30 -07:00
Michael Vines
c209e14e40
validator.sh now supports an --entrypoint arg, mimicking the solana-validator CLI API ( #5363 )
2019-07-31 09:54:39 -07:00
Michael Vines
6df1f6450f
Drop rsync address
2019-07-31 09:24:49 -07:00
Michael Vines
bd7e269280
Kill rsync ( #5336 )
...
automerge
2019-07-30 22:43:47 -07:00
Michael Vines
294d9288d2
Update remote-node.sh to use bootstrap-leader.sh ( #5352 )
2019-07-30 15:53:03 -07:00
Michael Vines
2214d2dbb5
Eject bootstrap-leader support from fullnode.sh ( #5301 )
2019-07-29 21:25:28 -07:00
Michael Vines
252257fe66
Rewrite multinode-demo/replicator.sh to avoid fullnode.sh ( #5299 )
2019-07-26 19:00:34 -07:00
Michael Vines
5f81a67298
Add --no-deploy option to allow restarting nodes without a software update ( #5182 )
2019-07-22 21:38:26 -07:00
Michael Vines
3a69459645
Surface validator pubkey in metrics ( #5227 )
2019-07-22 16:08:21 -07:00
Dan Albert
21cef2fe21
Do not attempt to create solana user multiple times ( #5228 )
...
* Do not attempt to create solana user multiple times
2019-07-22 16:13:08 -06:00
Dan Albert
c95cda51c9
Fix internal node lamport funding and staking allocation logic ( #5192 )
...
* Plumb node funding from genesis
* Cleanup naming convention
* Fix balance vs stake yml file logic
* Lamps not Stakes
2019-07-19 12:51:38 -06:00
Michael Vines
06cd7c1020
Disable restart
2019-07-19 08:35:22 -07:00
sakridge
a12e7a2e33
Separate build and deploy steps in net/net.sh ( #5184 )
...
So one can keep the network up while a new experiment is building
2019-07-18 18:59:47 -07:00
Michael Vines
b58558ea4e
net/: startnode/stopnode now works for blockstreamer/replicator nodes ( #5146 )
...
* startnode/stopnode now works for blockstreamer/replicator nodes
* Plumb --skip-ledger-verify through net/
2019-07-17 19:26:23 -07:00
sakridge
5825b967d2
Check for valid pid before kill in node stop script ( #5126 )
2019-07-16 14:31:15 -07:00
Dan Albert
440d006ec1
Plumb --no-snapshot in from CI ( #5077 )
...
* Plumb --no-snapshot in from CI
2019-07-14 13:17:30 -06:00
Jack May
4a02914b30
Add pub key authorized list
2019-07-12 12:34:17 -07:00
Dan Albert
f093377805
apt-get update before installing certbot ( #5054 )
...
* apt-get update before installing certbot
2019-07-12 11:50:40 -06:00
Dan Albert
5ac173d208
Enable GPUs and secondary disks for TdS net, pull external account file ( #5031 )
...
* Enable V100 GPUs over 3 regions for TdS cluster
* Turn on secondary config-local drive for tds net
* Enable long args bypass for GPU machine details
* bypass quoted long arg
* Pull external account file from wget
* typo
* Symlink config-local instead of changing the path variables
* Fix link path
2019-07-12 09:38:47 -06:00
Dan Albert
e4861f52e0
Add support for additional disks for config-local ( #5030 )
...
* Add support for additional disks for config-local
* Restore wrongly deleted lines
* Shellcheck
* add args in the right place dummy
* Fix nits
* typo
* var naming cleanup
* Add stub function for remaining cloud providers
2019-07-11 16:23:32 -06:00
Michael Vines
8781aebe06
Pass SOLANA_METRICS_CONFIG along to oom-monitor.sh ( #5021 )
2019-07-10 20:11:55 -07:00
Michael Vines
32b55e6703
Fund solana-install deployments from the mint keypair to avoid airdrops ( #4997 )
2019-07-09 16:45:28 -07:00
Michael Vines
0a949677f0
net/ plumbing to manage LetsEncrypt TLS certificates ( #4985 )
...
automerge
2019-07-09 15:45:46 -07:00
Dan Albert
d111223085
Fix always passing in remote filename, even if no accounts file ( #4993 )
...
* Fix always passing in remote filename, even if no accounts file
* typo
2019-07-09 16:07:31 -06:00
Dan Albert
1ca7e9f67b
Add testnet-tds support to testnet manager ( #4762 )
...
* Add testnet-tds support to testnet scripts
2019-07-09 14:39:55 -06:00
carllin
1033f52877
Add pubkey ( #4971 )
2019-07-09 00:54:22 -07:00
Michael Vines
8620d0a3b2
Add curl retries
2019-07-02 08:37:18 -07:00
Michael Vines
27221e28f6
Use default pubkey for solana-install sanity check
2019-06-26 21:49:22 -07:00
Sathish
96b56fa6f7
Update authorized public key ( #4783 )
2019-06-22 08:33:39 -07:00
Michael Vines
465cd45833
Various Snapshot generation improvements
...
* Only a single snapshot is maintained to avoid unbounded disk growth
* Snapshot is stored as a compressed tar archive for faster rsyncing
* Any validator node may now generate snapshots
* Updated testnet scripts to generate snapshots on the blockstreamer node
2019-06-18 20:11:09 -07:00
Pankaj Garg
e43a634944
Calculate bench client lamports based on signature fee ( #4713 )
...
* use fee calculator to compute max fee
* review comments
* shellcheck
2019-06-18 14:44:53 -07:00
Sathish Ambley
44967abd1c
update storage len
2019-06-17 22:48:27 -07:00
Pankaj Garg
7fe10ba060
Don't start drone if primordial accounts are created for nodes ( #4704 )
...
* disable wallet sanity if no airdrops
2019-06-17 18:15:22 -07:00
Michael Vines
bd884a56bf
Install libssl1.1 better
2019-06-14 08:01:22 -07:00
Pankaj Garg
ee68b9800e
Wait for nodes to boot up before launching other nodes and client ( #4682 )
...
* Wait for nodes to bootup in testnet
* increase timeout (as with multiple clients it takes even longer)
2019-06-13 19:37:36 -07:00
Pankaj Garg
e3f895d7d4
Create bench exchange accounts in genesis block ( #4655 )
...
* fix script
* review comments
2019-06-13 11:51:35 -07:00
Pankaj Garg
288a3bdcd9
Provision bench client accounts in genesis block ( #4648 )
...
* fixes to script
* shellcheck
* address review comments
2019-06-11 18:47:35 -07:00
Pankaj Garg
9259d342ac
Facility to provision primordial accounts for fullnodes in genesis block ( #4631 )
...
* updated usage
* shellcheck
* support replicators
* disable airdrops if primordial accounts are used
* review comments
2019-06-10 19:42:49 -07:00
carllin
73491e3ca1
bump libssl ( #4634 )
2019-06-10 18:03:13 -07:00
Michael Vines
0dbe5ee559
Add chacha-sys crate ( #4620 )
...
* af9ff9c7f9/src/cpu-crypt
* Add chacha-sys crate
* Remove chacha feature
* Remove erasure feature
* Add .gitignore
2019-06-10 07:14:02 -07:00
Michael Vines
8676b5d40c
Use more -f
2019-06-07 22:18:55 -07:00
Michael Vines
a9f73ea321
solana-keygen no longer blindly overwrites a keypair, or assumes "new" ( #4599 )
...
automerge
2019-06-07 17:54:54 -07:00
Michael Vines
8e46c44f3e
Deploy mac OS solana-install update package to testnets ( #4595 )
2019-06-07 12:59:58 -07:00
Michael Vines
aa4a7b0c73
Disable |solana-install| check for edge/beta testnets ( #4564 )
...
The release tarball URL changes for these testnets, which causes the
normal |solana-install| check to fail and the testnet is unnecessarily
rebooted.
2019-06-05 15:31:29 -07:00
Michael Vines
9c47ce30a7
shift
2019-06-05 12:06:54 -07:00
Michael Vines
d26fd27bf9
Avoid sudo in tune-system.sh unless requested by the user ( #4556 )
2019-06-05 09:10:23 -07:00
Michael Vines
5c98c1d306
Sanity check that runs on the blockstreamer node now checks that node instead of the bootstrap leader ( #4551 )
...
automerge
2019-06-04 22:46:48 -07:00
Michael Vines
e3365529de
Enable transaction fees for multinode-demo/ and net/ ( #4527 )
...
* Collect fees at the end of a slot
* Enable transaction fees for multinode-demo/ and net/
2019-06-04 14:51:52 -07:00
Pankaj Garg
40a4ac15f1
Remove per transaction fee ( #4521 )
...
automerge
2019-06-03 13:00:08 -07:00
Michael Vines
e4ca3900ae
Reduce default validators from 5 to 2
2019-06-02 22:58:59 -07:00
Michael Vines
e15246746d
Enable non-zero fees for all testnets ( #4513 )
...
automerge
2019-05-31 22:33:55 -07:00
Michael Vines
ec5cca41bc
Separate bootstrap leader's stake lamports from its identity lamports ( #4510 )
...
* Revert "Prevent run.sh from running beyond the first epoch under normal use (#4498 )"
This reverts commit d343c409e6
.
* Separate bootstrap leader's stake lamports from its identity lamports
2019-05-31 19:58:52 -07:00
Michael Vines
ce04d2bfc2
Add replicator support to net/ ( #4494 )
2019-05-31 15:27:31 -07:00
Michael Vines
a7ef409c2b
Drop influxcloud ( #4460 )
...
automerge
2019-05-28 16:26:59 -07:00
Michael Vines
1eceb4831d
Use nohup and sleep a little to improve stability when launching a node
2019-05-27 13:57:40 -07:00
Michael Vines
471465a5f4
net/: Add solana-install test to sanity ( #4438 )
...
* Add instance creation date to motd
* Setup localtime
* Add solana-install test
2019-05-26 11:17:07 -07:00
sakridge
8611b40074
Add argument to net/net to specify number of nodes ( #4429 )
...
Allows for testing different node counts without recreating the network.
2019-05-24 16:20:14 -07:00
Michael Vines
94beb4b8c2
More fullnode -> validator renaming ( #4414 )
...
* s/fullnode_config/validator_config/g
* s/FullnodeConfig/ValidatorConfig/g
* mv core/lib/fullnode.rs core/lib/validator.rs
* s/Fullnode/Validator/g
* Add replicator-x.sh
* Rename fullnode.md to validator.md
* cargo fmt
2019-05-23 22:05:16 -07:00
Michael Vines
fb2eac20bb
Rename solana-fullnode to solana-validator ( #4411 )
2019-05-23 15:06:01 -07:00
sakridge
90e73515ed
Remove ls which is innacurate since we never clean up the logs ( #4392 )
...
automerge
2019-05-22 13:11:20 -07:00
Michael Vines
cbebc7a80c
Expand shortArgs correctly
2019-05-18 19:00:48 -07:00
Michael Vines
392a39dd54
Poh subsystem cleanup, genesis plumbing, enable real PoH on edge testnet ( #4292 )
...
* Remove unused PohServiceConfig::Step
* Clarify variable name
* Poh::hash() now takes an iteration counter
* man -> max
* Inline functions with single call site
* Move PohServiceConfig into GenesisBlock
* Add plumbing to enable real PoH on testnets
* Batch hashes to improve PoH hash rate
* Ensure a constant hashes_per_tick
* Remove PohEntry mixin field
* Poh/PohEntry no longer maintains tick_height
* Ensure a constant hashes_per_tick
* ci/localnet-sanity.sh: Use real PoH
* Rework Poh/PohService to keep PohRecorder unlocked as much as possible while hashing
2019-05-18 14:01:36 -07:00
Michael Vines
458ae3fdac
Switch to instances with AVX-512 if possible for better interop with dev machines ( #4328 )
...
automerge
2019-05-17 20:06:07 -07:00
Michael Vines
915956b94b
Remove disable leader rotation option ( #4299 )
...
automerge
2019-05-15 15:16:45 -07:00
Michael Vines
1393d26f63
Remove obsolete internal multinode-demo/ logging ( #4265 )
2019-05-13 10:51:18 -07:00
Michael Vines
50f79e495e
net/ improvements ( #4257 )
...
automerge
2019-05-11 22:54:50 -07:00
Michael Vines
dd12db2f06
Correctly handle more zones than additional nodes
2019-05-11 14:47:27 -07:00
Michael Vines
bfc65e829e
Use zone[0] for any left over nodes
2019-05-11 14:07:36 -07:00
Michael Vines
f2b727b534
Update mint keypair filename
2019-05-09 07:27:13 -07:00
Pankaj Garg
5719b8f251
Change remote node's ssh config to allow more login retries ( #4215 )
...
automerge
2019-05-08 11:20:06 -07:00
Michael Vines
7609a007c6
Add FeeCalculator to the genesis block ( #4196 )
2019-05-07 20:28:41 -07:00
Michael Vines
9b50583641
wallet: add --url, remove --host/--rpc-host/--rpc-port/-rpc-tls ( #4153 )
...
Also by default the wallet now talks to testnet.solana.com instead of
localhost
2019-05-06 07:38:26 -07:00
Michael Vines
0139e5db21
Correct blockstreamer node args
2019-05-04 08:22:36 -07:00
Michael Vines
586fb15c2c
fullnode positional arguments may now be mixed with optional arguments ( #4151 )
2019-05-03 20:49:24 -07:00
Michael Vines
f3f416b7ba
Rename --network argument to --entrypoint ( #4149 )
2019-05-03 15:00:19 -07:00
Michael Vines
7fe3c75c6b
Add a node-specific ip echo service to remove dependency on ifconfig.co ( #4137 )
2019-05-03 11:01:35 -07:00
Pankaj Garg
598f765960
Fix net.sh for running on macos ( #4107 )
...
automerge
2019-05-01 16:03:35 -07:00
Michael Vines
950d8494ba
earlyoom: Stop using unsupported -k option ( #4096 )
...
automerge
2019-05-01 11:29:02 -07:00
Michael Vines
c5f8b4960c
Stop nodes in parallel
2019-04-30 10:42:59 -07:00
Michael Vines
f02ec31c68
Flip if/else
2019-04-30 08:56:53 -07:00
Michael Vines
d21fa4a177
v0.14: various net/ fixes for large clusters ( #4080 )
...
* net.sh: Add -F to discard validator nodes that didn't bootup successfully
* Relax sanity node count when validator bootup failure is permitted
* Less sanity for testnet-demo
* net.sh: Add -F to discard validator nodes that didn't bootup successfully
2019-04-29 21:38:32 -07:00
Michael Vines
0cc3956693
testnet-demo now runs across more GCE zones ( #4053 )
...
* testnet-demo now runs across more GCE zones
* Save zone info to config file
* Add geoip whitelist for common data centers
* Skip more of start
* Include -x for config
* Fetch private key from first validator node if necessary
* Correct -r propagation
2019-04-28 19:50:52 -07:00
Michael Vines
6f56501034
Correctly terminate instances across multiple zones
2019-04-28 09:09:02 -07:00
Pankaj Garg
697cd17b59
Use GPU nodes for blockstreamer as well if rest of testnet has GPUs ( #4046 )
...
- The blockstreamer crashes otherwise, as sigverify() looks for CUDA libs
2019-04-27 20:45:38 -07:00
Pankaj Garg
13fcfcb964
Blockstreamer annotation fix for non buildkite deployments ( #4045 )
2019-04-27 20:37:36 -07:00
sakridge
b07290df81
Add usage to net.sh when it encounters an invalid argument ( #4042 )
...
automerge
2019-04-27 16:12:13 -07:00
Michael Vines
4ce2105548
Switch from a S3 URL to release.solana.com for release assets ( #4017 )
...
automerge
2019-04-26 13:06:55 -07:00
Dan Albert
d12705f9b0
Remove wait loops in non-GPU instance creation and add SSD option as default disk type ( #3992 )
2019-04-25 13:43:42 -06:00
Michael Vines
4dc0495a1b
Fix tar version check
2019-04-25 11:16:49 -07:00
Michael Vines
b67b0bff05
Do not enable rpc exit on the blockstreamer node ( #3977 )
2019-04-25 09:30:59 -07:00
Pankaj Garg
e867ce0944
Find unique zones and delete nodes in each zone ( #3978 )
2019-04-24 17:50:42 -07:00
Pankaj Garg
29a25990d3
Add provision in testnet scripts to ignore validator nodes that failed to bootup ( #3972 )
...
* Skip writing to config file if the node didn't bootup
* Detect dead nodes quicker
2019-04-24 16:23:26 -07:00
Pankaj Garg
9c7ccc0e2b
More metrics to track memory usage ( #3966 )
...
automerge
2019-04-24 11:11:30 -07:00
Michael Vines
3eed6a6090
Annotate testnet buildkite logs with blockexplorer URL ( #3964 )
...
automerge
2019-04-24 08:09:37 -07:00
Dan Albert
4e7e5ace9d
Add support for Azure instances in testnet creation ( #3905 )
...
* Add support for Azure instances in testnet creation
* Fixup
* Fix shellcheck errors
* More shellcheck and cleanup node creation and deletion
* More shellcheck and cleanup node creation and deletion
* Fixup instance wait API
* Fix revieew comments and add GPU installation extension
2019-04-23 16:41:45 -06:00
Pankaj Garg
3ba93aa8fe
Facility to pass extra arguments to bench clients from net.sh command ( #3952 )
...
automerge
2019-04-23 15:13:29 -07:00
Sagar Dhawan
69e67d06a7
Default to Docker based testnet deployment on unsupported Ubuntu versions ( #3937 )
...
* Run docker if Ubuntu version is unsupported
* ShellCheck fixes
2019-04-22 18:22:43 -07:00
Michael Vines
05bcb7f292
Add stop node command to solana-gossip ( #3928 )
2019-04-22 14:51:20 -07:00
sakridge
95a16426f3
Cleanup bench-exchange ( #3919 )
...
* bench-exchange changes
Generate new keypair for each bench-exchange
Add metrics
Tweak network sleep parameters for better reliability.
* Bench-exchange contract metrics
2019-04-22 13:16:28 -07:00
Pankaj Garg
bec094bb3e
Start bench tps clients as default ( #3917 )
2019-04-21 20:18:52 -07:00
Pankaj Garg
d83a71d89f
More AWS regions for testnet deployment ( #3911 )
...
- also some minor fixes to gce.sh
2019-04-19 17:46:14 -07:00
Jack May
1a9ac62f60
Add bench-exchange support to the net framework ( #3893 )
2019-04-19 09:56:01 -07:00
Jack May
aab410380e
Fix net for macos and local ( #3872 )
2019-04-18 14:49:35 -07:00
Pankaj Garg
8999bfef65
Try to delete nodes in all cloud zones ( #3874 )
2019-04-18 13:16:14 -07:00
sakridge
684e1c73dd
Allow for custom cpu config on gce and use 20gb ram for clients ( #3856 )
2019-04-18 09:36:11 -07:00
Michael Vines
78d5ace754
Refactor multinode-demo/ scripts to avoid shipping fullnode-x.sh ( #3835 )
2019-04-17 18:03:58 -07:00
Pankaj Garg
d0fb55d9b1
Allow testnet creation with no validator nodes ( #3846 )
2019-04-17 17:38:18 -07:00
Michael Vines
63d66ece57
net/ testnet nodes now stake more lamports ( #3812 )
...
* Add --bootstrap-leader-lamports
* Generalize --no-stake into --stake NUM
* Use a large stake for net/ fullnodes
* Setup vote account before starting fullnode to avoid mixed log output
2019-04-16 13:03:01 -07:00
Michael Vines
c67cc694ae
Remove stake from `./net sanity` ephemeral validator ( #3797 )
2019-04-15 21:42:25 -07:00
Michael Vines
9293a54234
Remove stray +
2019-04-15 20:28:11 -07:00
Michael Vines
666882fbbd
-r does not require an argument
2019-04-15 09:40:34 -07:00
Michael Vines
2f1b0bf4f5
Add solana-install deployments to the testnets
2019-04-11 10:03:35 -07:00
Michael Vines
88e5b14afc
Exit faster on sanity failures
2019-04-09 17:16:15 -07:00
Michael Vines
0b95a5c121
Include blockstreamer node in sanity
2019-04-09 16:52:57 -07:00
Stephen Akridge
76e524ae48
Remove check for 0 additional nodes
...
Network with 1 leader is valid.
2019-04-09 11:16:55 -07:00
Michael Vines
6ac919c71a
Set warn log level only for perf testnets
2019-04-09 11:09:16 -07:00
Michael Vines
1ba4806f8c
Document recent -z and -x command-line arg changes
2019-04-09 10:39:55 -07:00
Pankaj Garg
0904df327d
Parallelize cloud node deployment commands in case of multiple zones ( #3657 )
2019-04-07 08:13:48 -07:00
Pankaj Garg
9cd555cad5
AWS script change for additional zones and regions
2019-04-04 15:59:59 -07:00
Tyera Eulberg
acbc261891
Add gossip to build script, and fix bash strings
2019-04-04 00:18:48 -07:00
Pankaj Garg
efbb49d579
Don't use external node ssh key if one is not configured
2019-04-02 14:20:00 -07:00
Tyera Eulberg
92c66a411b
Remove bench-tps converge-only
2019-04-01 23:05:25 -06:00
Pankaj Garg
97bd7a00f1
Support for configuring testnet nodes across multiple cloud services
2019-04-01 17:11:41 -07:00
Pankaj Garg
cb3adea94f
Increase node count in beta testnet
2019-04-01 11:06:24 -07:00
Pankaj Garg
15b945a652
Fix EC2 scripts for blockstream startup
2019-03-28 15:37:23 -07:00
Pankaj Garg
a94bc80383
fix clippy errors
2019-03-27 18:05:17 -07:00
Pankaj Garg
586b6fc3d7
review comments
2019-03-27 18:05:17 -07:00
Pankaj Garg
a14c202d60
fix the ip address that's stored in the config file
2019-03-27 18:05:17 -07:00
Pankaj Garg
ed48c495a3
fix shell-check errors
2019-03-27 18:05:17 -07:00
Pankaj Garg
f0abd06a46
Added support for multi-region cloud testnet
2019-03-27 18:05:17 -07:00
Pankaj Garg
e8814b1297
Add support for influx cloud
2019-03-25 17:10:38 -07:00
Michael Vines
0a5b6154e8
Use same gossip port for all testnet nodes
2019-03-22 00:16:58 -07:00
Michael Vines
e6b9babf53
Run a drone on blockstreamer nodes
2019-03-21 22:09:44 -07:00
Michael Vines
ed8bada439
Kill all node processes (blockexplorer)
2019-03-21 22:09:44 -07:00
Michael Vines
3b5a9f512c
Get client-id.json out of the genesis ledger directory
2019-03-21 16:35:40 -07:00
Michael Vines
791ead6053
Include TARGET in release URL to make room for future targets
2019-03-20 13:54:32 -07:00
Michael Vines
7498488f5f
cloud_DeleteInstances() now waits for the instances to be terminated
2019-03-14 21:15:00 -07:00
Michael Vines
ede99d5913
Revert "Block until instances are confirmed to be deleted"
...
This reverts commit 47ddbbe53b
.
2019-03-14 20:53:10 -07:00
Michael Vines
8f25548781
Overhaul cargo/rustc version management
2019-03-14 20:22:46 -07:00
Michael Vines
47ddbbe53b
Block until instances are confirmed to be deleted
2019-03-14 16:20:18 -07:00
Michael Vines
34a8d591fa
Switch version file from .txt to .yaml; add target tuple to version.yml
2019-03-13 16:30:07 -07:00
Michael Vines
242bcf44db
Replace stale --no-signer usage with --no-voting
2019-03-13 13:50:30 -07:00
Michael Vines
ebd540972d
Remove duplicate --rpc-drone-address
2019-03-13 13:24:02 -07:00
Michael Vines
fedbae6f8c
Enable rpc for all testnet nodes
2019-03-13 10:49:40 -07:00
Michael Vines
5d27f221f7
Drop socat for iptables
2019-03-13 12:03:56 -05:00
Michael Vines
61db74d98e
Run socat in the background
2019-03-13 08:15:58 -07:00
Pankaj Garg
76feb2098e
Use same VM type for validators as leader, if CUDA is enabled ( #3253 )
...
- Since all nodes are created equal
2019-03-12 17:42:47 -07:00
Sagar Dhawan
866d3f467f
Fix flag to disable leader-rotation ( #3243 )
2019-03-12 16:35:13 -07:00
Rob Walker
a799f8f4b1
tell blockexplorer to run on port 8080 ( #3237 )
...
* tell blockexplorer to run on port 8080
* forward port 80 to 5000 for a blockexplorer node
2019-03-12 13:39:09 -07:00
Michael Vines
7b49c9f09c
Delete fullnode-config/
2019-03-04 15:49:02 -08:00
Michael Vines
cd4bccfd12
Remove snap support
2019-03-02 17:41:09 -08:00
Tyera Eulberg
18d48f09f8
Plumb blockstreamer name through testnet scripts
2019-02-21 17:24:29 -07:00
Tyera Eulberg
d8f6865338
Rename EntryStream to Blockstream
2019-02-21 17:24:29 -07:00
Pankaj Garg
bc52fce810
Fix the custom programs command in net.sh
2019-02-19 13:53:43 -07:00
Michael Vines
a444cac2aa
Switch to upstream AMIs for non-CUDA EC2 testnets
2019-02-18 18:59:56 -08:00
Michael Vines
1e714eb6b2
Generate ec2 security group programmatically
2019-02-18 18:59:56 -08:00
Michael Vines
3f14466965
Limit blockexplorer versions to 1.x.y
...
Per semver semantics when blockexplorer 2.0.0 is released it will be
incompatible in some way with 1.x.y and thus should be opt in.
2019-02-18 16:48:33 -08:00
Tyera Eulberg
760a82cb08
Add optional deploy of custom programs ( #2817 )
...
* Add optional deploy of custom programs
* Review comments
2019-02-18 11:43:36 -07:00
Michael Vines
2793404116
Ensure blockexplorer comes back up when nodes are updated instead of restarted
2019-02-17 20:07:12 -08:00
Michael Vines
858068cdc0
Drop sudo, it's now handled internally by the block explorer
2019-02-17 12:29:53 -08:00
Michael Vines
65fb307d0f
Avoid '' argument to fullnode.sh
2019-02-17 11:43:41 -08:00
Michael Vines
4ff4fb6c38
Add support for an API node that hosts the block explorer
2019-02-17 10:39:27 -08:00
Michael Vines
ab6c7f6ca3
/it/ti/
2019-02-16 10:40:47 -08:00
Michael Vines
9eb8b67b5c
Install blockexplorer dependencies
2019-02-15 20:17:46 -08:00
Michael Vines
bae7612f36
Revert "Wait until the node successfully boots"
...
This reverts commit e84f1f6de7
.
2019-01-23 11:27:08 -08:00
Michael Vines
e84f1f6de7
Wait until the node successfully boots
2019-01-23 00:02:30 -08:00
Michael Vines
a84b6bc7e4
Overhaul wallet rpc/drone command-line arguments
2019-01-17 08:36:05 -08:00
Pankaj Garg
00c4c30d72
Fix testnet bootup issue ( #2465 )
...
* Fix testnet bootup issue
* address review comments
2019-01-16 19:18:32 -08:00
Michael Vines
6015a0ff15
Add info command
2019-01-16 10:24:00 -08:00
Michael Vines
d5f27f9b1e
shellcheck
2019-01-09 22:06:58 -07:00
Michael Vines
86f19a3ab3
Propagate PS4 to prevent unintentional buildkite log unfolding
2019-01-09 22:02:31 -07:00
Michael Vines
be0eefb0af
Add timeout to prevent stuck bench-tps when a cluster goes bad
2019-01-09 19:21:53 -07:00
Michael Vines
28431ff22c
Add configurable RUST_LOG for ./net.sh sanity
2019-01-09 12:12:50 -08:00
Michael Vines
639bed2f6d
Reorder sanity.
...
1. Check for presence of nodes
2. Check for functioning RPC API
3. Then try the wallet
2019-01-09 12:05:30 -08:00
Michael Vines
eb37aa2bba
Kill monitoring scripts by process group to ensure a full shutdown
2019-01-09 11:59:01 -08:00
Michael Vines
048fe371aa
set -x for more detailed logs
2019-01-09 11:59:01 -08:00
Michael Vines
87c9af142f
Preserve config/ when skipSetup
2019-01-09 11:59:01 -08:00
Michael Vines
e0c68bf9ad
docs: -z is a common option
2019-01-08 21:11:43 -08:00
Michael Vines
aedab3f83f
Run sanity when previous ledger/setup is preserved
2019-01-08 21:11:43 -08:00
Michael Vines
1b7598e351
Add retries to RPC API probe
2019-01-08 08:50:51 -08:00
Michael Vines
1531a1777a
Add RPC API check
2018-12-24 22:51:36 -08:00
Michael Vines
04d46ea33f
Run oom-monitor as root
2018-12-24 22:51:36 -08:00
Michael Vines
f5bbc5e961
Fix args
2018-12-23 20:56:13 -08:00
Michael Vines
753a783ba9
Add solana user to adm group for /var/log/syslog access
2018-12-23 17:28:35 -08:00
Michael Vines
3c835b692b
Use netLogDir
2018-12-23 10:33:43 -08:00
Michael Vines
a6fd1ca3db
Add logs subcommand to fetch remote logs from each network node
2018-12-23 10:19:10 -08:00
Pankaj Garg
41f8764232
Ignore error while enabling nvidia persistence mode ( #2265 )
2018-12-21 12:37:51 -08:00
Pankaj Garg
4bf797c8f1
Load nvidia drivers on node startup ( #2263 )
...
* Load nvidia drivers on node startup
* added new script to enable nvidia driver persistent mode
* remove set -ex
2018-12-21 11:43:52 -08:00
Michael Vines
c3c955b02e
Build/install native programs within cargo-install-all.sh
2018-12-19 11:53:08 -08:00
Michael Vines
5c396c222a
Clean up install-native-programs.sh usage
2018-12-11 23:29:05 -08:00
Michael Vines
088bab61a4
Remove |cargo install| duplication
2018-12-11 23:29:05 -08:00
Michael Vines
b2d7b34082
Add |./net.sh update| command to live update all network nodes
2018-12-11 09:40:22 -08:00
Sathish
154e20484d
Use hostname in database if env is set ( #2101 )
2018-12-10 22:59:38 -08:00
Michael Vines
094f0a8be3
Leader rotation flag plumbing
2018-12-10 14:07:59 -08:00
Michael Vines
b2ddac610c
Add option to skip setup during cluster start
2018-12-10 07:47:15 -08:00
Michael Vines
b54b0a1d25
Document that -P is now available for |config|
2018-12-09 15:25:27 -08:00
Michael Vines
f5794de636
Clean up bootstrap leader terminology in comments and variable names
2018-12-09 15:25:27 -08:00
Carl
b9743957fa
Make directory to hold programs
2018-12-09 08:38:41 -08:00
Michael Vines
f5569e76db
Relocate native programs to deps/ subdirectory of the current executable
...
This layout is `cargo build` compatible, no post-build file moves
required.
2018-12-08 16:31:01 -08:00
Michael Vines
872a3317b5
Fully switch to bootstrap-leader for command-line args
2018-12-07 16:57:02 -08:00
Michael Vines
1db6a882bb
rsync of genesis ledger now works for non-snap deployments
2018-12-07 16:57:02 -08:00
Michael Vines
af11562627
Correct ledger path
2018-12-07 11:32:08 -08:00
Michael Vines
286f08f095
Drop old validator name, use fullnode instead
2018-12-07 11:32:08 -08:00
Michael Vines
6516c2532d
Ensure native programs for the correct platform are installed
2018-12-07 11:32:08 -08:00
Michael Vines
fa58da2401
Explicitly specific build variant when installing native programs
2018-12-07 11:32:08 -08:00
Michael Vines
70c149c7da
Rename leader/validator to bootstrap-leader/fullnode
...
Only rsyncing the genesis ledger snuck in here as well
2018-12-06 19:44:47 -08:00
Michael Vines
b34e197424
Add newline at end of file
2018-12-06 17:46:46 -08:00
Michael Vines
c4b8f0cd2f
bench-tps will now generate an ephemeral identity if not provided with one
...
Also simplify scripts as a result
2018-12-06 16:30:48 -08:00
carllin
aecb06cd2a
Update versions in install-libssl-compatibility.sh ( #2044 )
2018-12-06 15:57:30 -08:00
Michael Vines
f0fe089013
Adapt testnet-deploy metric datapoint names to {,bootnode-}fullnode
2018-12-06 08:04:33 -08:00
Michael Vines
a6312ba98f
Switch snap to bootstrap-fullnode/fullnode naming
2018-12-05 18:59:43 -08:00
Michael Vines
04a0652614
Generalize net/ from leader/validator to bootstrap-fullnode/fullnode
2018-12-05 17:11:16 -08:00
Michael Vines
5d80edd969
Properly check for failure (can't rely on `set -e` here)
2018-12-05 13:26:06 -08:00
Michael Vines
33a5d5fe93
Enable debug builds by default for better backtraces
2018-11-17 10:52:08 -08:00
Michael Vines
d96a6b42a5
Move drone into its own crate
2018-11-16 20:42:21 -08:00
carllin
cf95708c18
Set drone address to always be the initial network entry point ( #1847 )
...
* Set drone address to always be the initial network entry point, so that even when leaders rotate the client can still find the drone
* Extract drone address as a separate argument to bench-tps
* Add drone port to client.sh instead of setting it in bench-tps
* Add drone entrypoint to scripts
* Fix build error
2018-11-16 19:56:26 -08:00
Sathish
c973de1d76
Decouple log and metrics rate ( #1839 )
...
Use separate env for log and metrics rate.
Set default log level to WARN if unset.
2018-11-15 22:27:16 -08:00
Michael Vines
83fc3c10cf
Setup CUDA env for local builds
2018-11-15 08:00:52 -08:00
Michael Vines
017c281eaf
Remove CUDA support from Snap
2018-11-12 20:31:16 -08:00
Michael Vines
c5b1bc1128
Remove obsolete update-default-cuda.sh
2018-11-12 20:31:16 -08:00
Michael Vines
9e7b9487b0
perf-libs now drives setting CUDA_HOME
2018-11-12 18:49:15 -08:00
Michael Vines
851e012c6c
Upgrade EC2 image to 18.04 with CUDA 9.2 and 10
2018-11-12 15:17:34 -08:00
Michael Vines
7f76403d0a
Clean ~/solana during network start to avoid tripping over leftover files
2018-11-12 15:09:14 -08:00
Michael Vines
7ee4dec3f1
Upgrade GCE GPU image to 18.04
2018-11-12 12:18:50 -08:00
Michael Vines
c07d09c011
Add net/scp.sh for easier file transfer to/from network nodes
2018-11-12 11:48:53 -08:00
Michael Vines
3466f139a4
set -e shuffling
2018-11-11 16:24:36 -08:00
Michael Vines
def7d156f6
codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e'
2018-11-11 16:24:36 -08:00
Michael Vines
33aab094ef
codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash'
2018-11-11 16:24:36 -08:00
Michael Vines
cf6f344ccc
Add CUDA_HOME env var to permit overriding the CUDA install location
2018-11-11 16:24:18 -08:00
Michael Vines
49014393e1
Be less fancy for bash 4.4 compat
2018-11-10 18:05:55 -08:00
Michael Vines
818d03c835
Bump earlyoom version
2018-11-10 15:56:17 -08:00
Michael Vines
b8261d7d83
Determine network version for tar and local deploys
2018-11-08 22:02:42 -08:00
Michael Vines
51ed48941b
Continue if docker0 is not present
2018-11-07 19:33:20 -08:00
Michael Vines
87ac549689
Work around AWS key management limitation
2018-11-07 18:48:27 -08:00
Michael Vines
f8f11b7f50
Remove docker0 interface if present
2018-11-07 18:23:24 -08:00
Michael Vines
82f914e0dc
Work around AWS boot check weirdness
2018-11-07 15:46:04 -08:00
Michael Vines
9359cc69d5
Invert gpu check
2018-11-07 14:44:40 -08:00
Michael Vines
b02b636b36
Support local tarball deploys
2018-11-07 14:44:40 -08:00
Michael Vines
a537154c28
Remove all cuda dependencies from release tarball beyond solana-fullnode-cuda
2018-11-07 14:44:40 -08:00
Michael Vines
16d23292dc
Improve error messages
2018-11-07 10:35:10 -08:00
Michael Vines
2ef8ebe111
AWS AMIs are region specific
2018-11-07 10:05:58 -08:00
Michael Vines
f8673931b8
Increase boot timeout
2018-11-07 08:32:15 -08:00
Michael Vines
dd4fb7aa90
Add AWS-based nets
2018-11-07 07:47:39 -08:00
Michael Vines
c4bc331663
Add support for using a release tar
2018-11-07 07:47:39 -08:00
Michael Vines
cd18a1b7db
t
2018-11-06 14:08:47 -08:00
Michael Vines
6aac096c77
Add timeout to prevent a stuck ssh
2018-11-06 14:08:28 -08:00
Michael Vines
7b58bd621a
Remove node check from client start-up
...
If the network loses a validator or two, it's the job of the sanity
check to detect this not the bench clients
2018-11-06 13:57:06 -08:00
Michael Vines
1a7830f460
Set imageName if G
2018-11-05 13:33:42 -08:00
Michael Vines
8041461a07
Bump EC2 validator machine type
2018-11-05 08:47:51 -08:00
Michael Vines
eae9372a5d
Upgrade GCP CPU-based testnet to 18.04
2018-11-04 19:18:47 -08:00
Michael Vines
f3b04894b9
Try harder to snap download
2018-11-03 00:29:13 +00:00
Pankaj Garg
85869552e0
Update testnet scripts to use release tar ball ( #1660 )
...
* Update testnet scripts to use release tar ball
* use curl instead of s3cmd
2018-10-30 18:05:38 -07:00
Pankaj Garg
3cc78d3a41
Added a new remote node configuration script to set rmem/wmem ( #1647 )
...
* Added a new remote node configuration script to set rmem/wmem
* Update common.sh for rmem/wmem configuration
2018-10-30 09:17:35 -07:00
Pankaj Garg
fbde9bb731
Run bench-tps for longer duration in testnet ( #1638 )
...
- Increased to 2+ hours
2018-10-29 15:03:08 -07:00
Pankaj Garg
7abd456d45
Increase rmem and wmem for remote nodes in testnet ( #1635 )
2018-10-29 13:04:54 -07:00
Michael Vines
489894cb32
Mention logs more
2018-10-27 08:49:52 -07:00
Pankaj Garg
dfde83bdce
Wildcard early OOM deb package revision ( #1554 )
2018-10-19 14:17:19 -07:00
Pankaj Garg
30c79fd40d
Change validator node machine type ( #1537 )
...
- The current nodes are using lower RAM compared to leader/clients
2018-10-17 17:16:50 -07:00
Pankaj Garg
32fc0cd7e9
Fix bug introduced during RUST_LOG escaping ( #1507 )
...
* Fix bug introduced during RUST_LOG escaping
- remote node configuration should not be quoted
* shellcheck disable SC2090
2018-10-15 16:49:22 -07:00
Pankaj Garg
9fc30f6db4
Escape RUST_LOG configuration in remote-node.sh ( #1489 )
...
* Escape RUST_LOG configuration in remote-node.sh
- If it was set to #, it was causing other parameters to be commented out
* escape other variables as well
* disabled shell check
* Fix shellcheck error
2018-10-13 13:35:54 -07:00
Michael Vines
5c523716aa
Ship native programs
2018-10-10 16:49:48 -07:00
Pankaj Garg
0a39722719
Add support to trigger testnet from a PR ( #1434 )
...
* Add support for different node counts
* Update variable names
* Delete network even after failures
* Add array for node counts
* Changed number of nodes to a space separated string of numbers
* Adjust number of nodes
* Snap will not be published if the env variable DO_NOT_PUBLISH_SNAP is set
* Address review comments
* Replaced influx db URL
2018-10-05 16:32:05 -07:00
Michael Vines
b1e941cab9
Return all instances
2018-10-01 07:51:48 -07:00
Pankaj Garg
7fb7839c8f
Configure GPU type/count from command line in GCE scripts ( #1376 )
...
* Configure GPU type/count from command line in GCE scripts
* Change CLI to input full leader machine type information with GPU
2018-09-27 11:55:56 -07:00
sakridge
3199f174a3
Add option to pass boot disk type to gce create ( #1308 )
2018-09-22 16:43:47 -07:00
Tyera Eulberg
f273351789
Add missing port number
2018-09-18 09:36:54 -06:00
Tyera Eulberg
0125163190
Remove wallet.sh, update entrypoint syntax for wallet network argument
2018-09-17 11:53:33 -06:00
Michael Vines
155ee8792f
Add GPU support to ec2-provider
2018-09-17 09:26:25 -07:00
Michael Vines
f89f121d2b
Add AWS EC2 support
2018-09-17 09:26:25 -07:00
Pankaj Garg
be7cce1fd2
Tweak GCE scripts for higher node count ( #1229 )
...
* Tweak GCE scripts for higher node count
- Some validators were unable to rsync config from leader when
the node count was high (e.g. 25). Looks like the leader node was
getting more rsync requests in parallel than it count handle.
- This change staggers the validators bootup, and rsync time
* Address review comments
2018-09-14 17:17:08 -07:00
Michael Vines
ee74b367ce
Add docker install script
2018-09-12 17:09:37 -07:00
Michael Vines
f06113500d
bench-tps/net sanity: add ability to check for unexpected extra nodes
2018-09-12 15:38:57 -07:00
Michael Vines
af3eb5a16c
.sh
2018-09-11 11:29:49 -07:00
Pankaj Garg
1c17c6dd2b
Report UDP network statistics ( #1176 )
...
* Report UDP network statistics
Fixes #1093
* Address review comments
* Address additional review comments
* Fix shellcheck errors
2018-09-10 15:52:08 -07:00
Michael Vines
ebcac3c2d1
Use a common solana user on all testnet instances
2018-09-08 22:34:26 -07:00
Michael Vines
5afcdcbbe6
More log grooming
2018-09-08 14:16:34 -07:00
Michael Vines
3840b4b516
Groom log output
2018-09-08 14:10:18 -07:00
Michael Vines
7aeb6d642b
Display log file
2018-09-08 13:59:45 -07:00
Michael Vines
1d6c4aacae
Retry rsync a couple times before failing
2018-09-08 13:59:45 -07:00
Michael Vines
9f5c86e60c
Install earlyoom at gce instance startup
2018-09-08 13:59:45 -07:00
Michael Vines
9f413fd656
Establish net/scripts/... for better scoping
2018-09-08 13:59:45 -07:00
Michael Vines
c3af0d9d25
Improve client.log
2018-09-07 21:20:00 -07:00
Michael Vines
932c994dc9
Use new bench-tps command-line args
2018-09-07 21:20:00 -07:00
Michael Vines
ddd1871840
Install libssl1.1 for solanalabs/rust docker image compat
2018-09-07 19:57:41 -07:00
Michael Vines
db825788fa
Document how to get ssh access into CD testnets
2018-09-07 19:41:13 -07:00
Michael Vines
73a8441add
/var/snap is not writable by most users
2018-09-07 17:41:20 -07:00
Rob Walker
51b27779c9
client changes for TODOs and looping ( #1138 )
...
* remove client.sh from snap
* default to ephemeral instead of ~/.config key
* rework CLI for bench-tps
* remote multinode-demo stuff from remote-client.sh
* remove multinode-demo from remote-sanity and localnet-sanity
2018-09-08 07:07:10 +09:00
Michael Vines
0d945e6a92
Groom testnet-sanity logging
2018-09-07 12:45:48 -07:00
Michael Vines
1090254ba5
Add datapoints for leader/validator start
2018-09-07 12:45:48 -07:00