Michael Vines
35d6196384
Surface nvidia-smi errors in CI
2019-10-23 10:59:30 -07:00
Michael Vines
26b8747014
Exit cleanly for idle clients
2019-10-23 09:56:05 -07:00
Michael Vines
bedb05bdeb
Plumb GEOLOCATION_API_KEY down to the blockexplorer ( #6514 )
2019-10-23 09:53:06 -07:00
Justin Starry
6829b8a6fb
Ensure solana commands are added to idle clients ( #6513 )
2019-10-23 11:15:00 -04:00
Michael Vines
e462a7d1d5
net: Add ability to only start/stop client nodes ( #6503 )
...
* Add info --eval
* net: Add ability to start idle client nodes
2019-10-22 16:08:49 -07:00
Sagar Dhawan
4c515d0ef1
Sagar: Add ssh keys for colo ( #6507 )
2019-10-22 15:59:39 -07:00
Michael Vines
f80a5b8c34
Remove some TODOs ( #6488 )
...
* Remove stale TODOs
* Ban TODO markers from markdown
* Scrub all TODOs from ci/ and book/
2019-10-21 22:25:06 -07:00
Greg Fitzgerald
3b9b9b1500
Rename remaining uses of fullnode to validator ( #6476 )
...
automerge
2019-10-21 20:21:21 -07:00
Dan Albert
00809a67c0
Push perf test results to slack app ( #6371 )
...
* Add script to publish testnet results to slack
* Obscure webhook URL
* fixup
* Replace read with cat redirection
* Turn back on net restart
* Pick nits
* Make symlink before trying to delete its contents
* Display test config in slack and pick Trents nit not to maybe rm -rf /*
* Clean up results print
* Minor nits
* Turn the test settings back up to 11
* typo
* Shellcheck
* Just a few more fields
* fix payload formatting
* Del clear-config.sh
* Mount secondary
* Add commit SHA link and Grafana time range URL
* Add fancy buttons instead of text URLs
* Tighten up test config display
* Fixup display nits
* chellsheck
* Rebase and fix typo
2019-10-21 20:00:17 -04:00
Michael Vines
3fb70b8d47
Ban XXX, TBD, FIXME comments ( #6486 )
2019-10-21 16:43:11 -07:00
Trent Nelson
564c14a2c6
net.sh: Ensure external disk link is setup before cleaning config dir ( #6481 )
...
automerge
2019-10-21 15:38:58 -07:00
sakridge
6996f45d54
Print machine hostname in log ( #6480 )
...
automerge
2019-10-21 14:59:03 -07:00
sakridge
b1c2c6009e
Exclude net/log in rsync script ( #6475 )
...
automerge
2019-10-21 14:06:36 -07:00
Trent Nelson
934f69b660
Colo verbosity ( #6473 )
...
automerge
2019-10-21 13:49:12 -07:00
Sunny Gleason
951e1f8b48
feat: grant access to sunny@ ( #6471 )
2019-10-21 11:17:06 -07:00
Greg Fitzgerald
9232057e95
Rename replicator to archiver ( #6464 )
...
* Rename replicator to archiver
* cargo fmt
* Fix grammar
2019-10-21 11:29:37 -06:00
Trent Nelson
0fc3c7eee2
Bump Trent's keys... ( #6445 )
...
automerge
2019-10-18 15:42:50 -07:00
Michael Vines
6f58bdfcb1
Remove validator sanity check ( #6435 )
...
automerge
2019-10-18 08:26:08 -07:00
Pankaj Garg
854c62e208
Reduce kernel networking buffer for rmem and wmem ( #6422 )
...
automerge
2019-10-17 14:52:24 -07:00
Trent Nelson
1759968c1e
Colo: Put NVMe disks to use ( #6357 )
...
automerge
2019-10-17 14:44:45 -07:00
Dan Albert
b4ed88e0f7
Fail faster on boot up ( #6412 )
2019-10-17 12:26:12 -04:00
Michael Vines
2d351d3952
Prevent ping stats header from confusing buildkite log folding
2019-10-16 13:36:16 -07:00
Michael Vines
605b477e06
Permit finding more nodes than expected (./gce.sh config)
2019-10-16 13:21:00 -07:00
Michael Vines
b7af5f08d6
Avoid more non-standard ping. macOS 💔
2019-10-16 10:35:41 -07:00
Michael Vines
781dfd9dc4
Drop non-standard ping -o option
2019-10-16 10:05:46 -07:00
Michael Vines
9267931ef6
Add support for preemptible GCP instances
2019-10-16 08:10:31 -07:00
Michael Vines
37a29b979f
--force
2019-10-15 15:12:25 -07:00
Michael Vines
d89174ee82
Default to no client nodes to avoid unnecesary cost
2019-10-15 14:37:52 -07:00
Michael Vines
8bc9d8988f
-
2019-10-15 07:58:40 -07:00
Michael Vines
f7279804b4
Ensure solana-cli has a keypair
2019-10-15 07:47:45 -07:00
Michael Vines
169b772398
Show validators during net sanity
2019-10-14 20:38:51 -07:00
Trent Nelson
b75438ff32
gce.sh: Unwind allocation upon failure ( #6343 )
...
automerge
2019-10-14 09:36:20 -07:00
Trent Nelson
82fea9ce73
net.sh: Add support for selecting validator GPU mode ( #6326 )
...
automerge
2019-10-14 09:33:32 -07:00
Greg Fitzgerald
322fcea6e5
More fullnode to validator renaming ( #6337 )
2019-10-11 13:30:52 -06:00
Trent Nelson
fa64a0b367
gce.sh: Be strict about fullnode count w/o --allow-boot-failures ( #6321 )
...
automerge
2019-10-10 17:13:59 -07:00
Trent Nelson
81fb9e6a59
gce.sh: Rename -f flag to better reflect usage ( #6318 )
...
automerge
2019-10-10 12:57:03 -07:00
Trent Nelson
4713cb8675
Colo: Prefer public IPs, part 2 ( #6297 )
...
automerge
2019-10-09 15:17:24 -07:00
Trent Nelson
fdaee4ab17
Colo: Add running process cleanup to delete logic ( #6281 )
2019-10-09 15:49:33 -06:00
Justin Starry
95d15dc720
Add jstarry to authorized keys ( #6293 )
2019-10-09 15:04:44 -04:00
Trent Nelson
667f9e0d79
Colo: Factor out inlined scripts to own files ( #6266 )
...
automerge
2019-10-07 22:05:36 -07:00
Trent Nelson
57916f8be6
Colo: Prefer public IPs ( #6264 )
...
automerge
2019-10-07 20:44:57 -07:00
Michael Vines
18653b825b
Preserve previous fullnode log file on restart
2019-10-04 07:58:33 -07:00
Pankaj Garg
a05d772aa9
Add colo access pubkey ( #6232 )
...
* Add colo access pubkey
* Change the key to ed25519
2019-10-03 19:55:39 -07:00
Dan Albert
58139ce5ae
Add buildkite-agent key for colo access ( #6205 )
2019-10-01 13:24:04 -07:00
Michael Vines
8e888059d8
Use built-in solana-gossip timeout for better error messages ( #6189 )
2019-10-01 12:30:11 -07:00
Dan Albert
db18611c86
Add ability to manually create a db ( #6151 )
2019-09-27 12:03:20 -07:00
sakridge
f97d33e3a7
Add sakridge pubkey ( #6142 )
2019-09-27 10:55:38 -07:00
sakridge
06b445ac07
Skip if --custom-cpu is used as well. ( #6130 )
2019-09-26 15:52:03 -07:00
Michael Vines
b4da83a3ab
Remove CUDA feature ( #6094 )
2019-09-26 13:36:51 -07:00
Trent Nelson
c4ed80d544
colo-utils: Disable StrictHostKeyChecking for SSH calls ( #6117 )
...
automerge
2019-09-26 11:22:07 -07:00
Dan Albert
93ad637c5c
typo
2019-09-25 16:58:53 -04:00
Trent Nelson
02647c25a9
net: Add Trent's work laptop pubkey ( #6022 )
...
automerge
2019-09-23 10:25:36 -07:00
Michael Vines
4c49566a89
Enable nvidia persistence mode on instance reboots
2019-09-21 10:45:20 -07:00
Michael Vines
8bbc8343ff
Place verison.yml in the right location
2019-09-19 22:41:27 -07:00
Trent Nelson
2636a9c9f1
Add script for managing colo resourse ala gce.sh ( #5854 )
...
automerge
2019-09-19 14:08:22 -07:00
Trent Nelson
4c54245969
net/gce.sh: Sync cloud_CreateInstances docs and usage ( #5982 )
...
automerge
2019-09-19 13:28:25 -07:00
Sunny Gleason
51b3451e20
feat: use redis version 5+ via ppa:chris-lea ( #5981 )
2019-09-19 12:04:06 -07:00
Michael Vines
fee5c6c057
testnet-edge/testnet-beta now update while preserving the ledger ( #5979 )
...
* Check if an update is current before deploying it again
* Add (new) update command to deploy testnet updates
* Add --deploy-if-newer flag to permit conditional net updates
2019-09-19 12:03:47 -07:00
Michael Vines
9917ece826
Kill the old blockexplorer harder
2019-09-19 10:37:27 -07:00
Michael Vines
355564e486
`net/net.sh start --skip-setup ...` now works again ( #5977 )
2019-09-19 08:31:22 -07:00
Dan Albert
742562fc2e
Set maintenance policy to terminate and restart for GCE ( #5935 )
2019-09-18 10:38:38 -07:00
Michael Vines
de1636c792
Enable --limit-ledger-size on testnets ( #5927 )
...
automerge
2019-09-17 10:05:41 -07:00
Michael Vines
e1f4e8a84a
Add solana-crate-features workaround to avoid cargo feature thrashing ( #5904 )
...
automerge
2019-09-13 23:46:21 -07:00
Michael Vines
92a5979558
net/config/ is now shellcheck compliant ( #5888 )
...
automerge
2019-09-12 16:11:13 -07:00
Michael Vines
8b64de0a3c
Add restart-explorer script, to easily restart the network explorer on a testnet ( #5886 )
2019-09-12 15:12:10 -07:00
Michael Vines
bf1ecc2441
Remove ledger verification, it's racy and essentially globaly disabled already ( #5867 )
2019-09-11 10:53:10 -07:00
Michael Vines
fc4aa71193
GCE-based nodes now reboot on maintenance events instead of terminating ( #5861 )
2019-09-10 12:30:06 -07:00
Parth
468095ede2
Update project to use new account serialization format ( #5848 )
2019-09-09 16:17:10 -07:00
Trent Nelson
9dc5da7dbd
net/net.sh: Add flag to skip build ( #5853 )
...
automerge
2019-09-09 15:40:12 -07:00
Tyera Eulberg
0cbc0dc79c
Update solana validator-info commands for testnets ( #5806 )
2019-09-05 13:20:38 -07:00
Trent Nelson
8362b408d9
Move testnet ssh key ( #5770 )
...
* Factor out hardcoded testnet ssh key path
* Build/create test net ssh key path
* Rename testnet ssh dir
* Give testnetSSHDir a more generic name
* shellcheck
* favor hardcoded paths over `paths.sh`
* Put instance-startup-complete stamp in the scratch dir as well
* Rename `/solana` > `/solana-scratch`
2019-09-03 18:51:16 -06:00
Tyera Eulberg
0d20bc5e14
Move solana-validator-info into cli ( #5768 )
...
* Move solana-validator-info into cli
* Remove solana-validator-info and update docs
* Update test to use app()
2019-09-03 10:38:12 -07:00
Trent Nelson
a82754913f
Partner node setup tweaks ( #5715 )
...
automerge
2019-09-03 07:45:20 -07:00
Trent Nelson
36fcb4fbca
Add trent's workstation pubkey to authorized keys script ( #5748 )
...
automerge
2019-08-30 10:13:55 -07:00
Michael Vines
33e7e23484
Update ubuntu image
2019-08-29 14:40:08 -07:00
Michael Vines
81bb208a62
Add open file descriptor monitoring ( #5655 )
2019-08-26 15:17:19 -07:00
Trent Nelson
6bb22902cc
net: net.sh - Enable deploying testnets on debug binaries ( #5627 )
...
automerge
2019-08-23 18:31:18 -07:00
TristanDebrunner
51cf559ce1
Add datacenter node setup scripts ( #5517 )
...
automerge
2019-08-22 12:19:48 -07:00
Trent Nelson
5034331131
net: init-metrics.sh - urlencode influx password ( #5594 )
...
* net: init-metrics.sh - urlencode influx password
* old backticks bad!
* Move urlencode() to common.sh
* Make urlencode() vars local
Co-Authored-By: Michael Vines <mvines@gmail.com>
2019-08-21 19:06:09 -06:00
Trent Nelson
84f763d079
net: init-metrics.sh no longer supports -c flag ( #5588 )
...
automerge
2019-08-21 15:35:07 -07:00
Michael Vines
8df8f84701
publish fixes
2019-08-16 17:28:09 -07:00
Michael Vines
ccee6241a6
Revert "publish fixes"
...
This reverts commit 4d13d3871d
.
2019-08-16 17:28:07 -07:00
Michael Vines
4d13d3871d
publish fixes
2019-08-16 17:03:57 -07:00
Michael Vines
c298474e6f
Add validator-info for net/ managed nodes ( #5538 )
2019-08-16 11:39:58 -07:00
Michael Vines
1363841f32
Fix testnet deployment
2019-08-15 08:32:10 -07:00
Michael Vines
9f6c9c428b
Move genesis/snapshot archive download into Rust ( #5515 )
2019-08-14 19:25:22 -07:00
TristanDebrunner
79416381dc
Add pubkey setup for datacenter nodes ( #5514 )
2019-08-14 14:25:56 -06:00
Michael Vines
6085109171
Delete terminated GCP instances ( #5490 )
...
automerge
2019-08-12 08:28:58 -07:00
Michael Vines
b3b782988c
Remove extra e
2019-08-10 14:38:41 -07:00
Michael Vines
342733be54
Correct arg
2019-08-10 13:16:06 -07:00
Michael Vines
cc0e455a51
Skip sanity on blockstreamer node at cluster boot.
...
It may not have caught up to the bootstrap leader yet...
2019-08-05 17:11:28 -07:00
Michael Vines
b5aa03dd7c
Rename --config-dir to --ledger (progress towards deleting validator.sh) ( #5423 )
2019-08-05 12:42:52 -07:00
Michael Vines
3709dc6558
Reduce size of cpu-only gcp instances
2019-08-04 20:36:23 -07:00
Michael Vines
8d38777c1f
Remove stray --stake 0
2019-08-02 15:06:40 -07:00
Michael Vines
a6c4525998
RPC to the bootstrap leader instead of the local node, which may not yet be fully initialized
2019-08-01 23:34:55 -07:00
Michael Vines
b6b9c2cf56
Delegate stake from the pre-created identity keypair if it exists
2019-08-01 23:00:15 -07:00
Michael Vines
59d900977d
Avoid airdroping when airdrops are disabled
2019-08-01 22:43:09 -07:00
Michael Vines
0f5acb86d3
wallet: Refuse to delegate stake to a vote account with a stale root slot ( #5282 )
...
* Refuse to delegate stake to a vote account with a stale root slot
* Remove sdk-c from the virtual manifest temporarily
For an unknown reason |cargo clippy| is getting stuck in CI
intermittently when trying to build this crate.
2019-08-01 21:08:24 -07:00
Michael Vines
870503ee36
Introduce delegate-stake.sh for adding stake to a validator.sh ( #5380 )
2019-08-01 13:48:00 -07:00
Michael Vines
f859243191
Remove unused var
2019-07-31 10:51:30 -07:00
Michael Vines
9ddc25283c
Adapt validator sanity args
2019-07-31 10:46:25 -07:00
Michael Vines
388d4a8592
Remove obsolete --generate-snapshots argument
2019-07-31 10:26:22 -07:00
Michael Vines
9b8b7dbfd7
Avoid setting RUST_LOG to the empty string ( #5338 )
2019-07-31 10:13:30 -07:00
Michael Vines
c209e14e40
validator.sh now supports an --entrypoint arg, mimicking the solana-validator CLI API ( #5363 )
2019-07-31 09:54:39 -07:00
Michael Vines
6df1f6450f
Drop rsync address
2019-07-31 09:24:49 -07:00
Michael Vines
bd7e269280
Kill rsync ( #5336 )
...
automerge
2019-07-30 22:43:47 -07:00
Michael Vines
294d9288d2
Update remote-node.sh to use bootstrap-leader.sh ( #5352 )
2019-07-30 15:53:03 -07:00
Michael Vines
2214d2dbb5
Eject bootstrap-leader support from fullnode.sh ( #5301 )
2019-07-29 21:25:28 -07:00
Michael Vines
252257fe66
Rewrite multinode-demo/replicator.sh to avoid fullnode.sh ( #5299 )
2019-07-26 19:00:34 -07:00
Michael Vines
5f81a67298
Add --no-deploy option to allow restarting nodes without a software update ( #5182 )
2019-07-22 21:38:26 -07:00
Michael Vines
3a69459645
Surface validator pubkey in metrics ( #5227 )
2019-07-22 16:08:21 -07:00
Dan Albert
21cef2fe21
Do not attempt to create solana user multiple times ( #5228 )
...
* Do not attempt to create solana user multiple times
2019-07-22 16:13:08 -06:00
Dan Albert
c95cda51c9
Fix internal node lamport funding and staking allocation logic ( #5192 )
...
* Plumb node funding from genesis
* Cleanup naming convention
* Fix balance vs stake yml file logic
* Lamps not Stakes
2019-07-19 12:51:38 -06:00
Michael Vines
06cd7c1020
Disable restart
2019-07-19 08:35:22 -07:00
sakridge
a12e7a2e33
Separate build and deploy steps in net/net.sh ( #5184 )
...
So one can keep the network up while a new experiment is building
2019-07-18 18:59:47 -07:00
Michael Vines
b58558ea4e
net/: startnode/stopnode now works for blockstreamer/replicator nodes ( #5146 )
...
* startnode/stopnode now works for blockstreamer/replicator nodes
* Plumb --skip-ledger-verify through net/
2019-07-17 19:26:23 -07:00
sakridge
5825b967d2
Check for valid pid before kill in node stop script ( #5126 )
2019-07-16 14:31:15 -07:00
Dan Albert
440d006ec1
Plumb --no-snapshot in from CI ( #5077 )
...
* Plumb --no-snapshot in from CI
2019-07-14 13:17:30 -06:00
Jack May
4a02914b30
Add pub key authorized list
2019-07-12 12:34:17 -07:00
Dan Albert
f093377805
apt-get update before installing certbot ( #5054 )
...
* apt-get update before installing certbot
2019-07-12 11:50:40 -06:00
Dan Albert
5ac173d208
Enable GPUs and secondary disks for TdS net, pull external account file ( #5031 )
...
* Enable V100 GPUs over 3 regions for TdS cluster
* Turn on secondary config-local drive for tds net
* Enable long args bypass for GPU machine details
* bypass quoted long arg
* Pull external account file from wget
* typo
* Symlink config-local instead of changing the path variables
* Fix link path
2019-07-12 09:38:47 -06:00
Dan Albert
e4861f52e0
Add support for additional disks for config-local ( #5030 )
...
* Add support for additional disks for config-local
* Restore wrongly deleted lines
* Shellcheck
* add args in the right place dummy
* Fix nits
* typo
* var naming cleanup
* Add stub function for remaining cloud providers
2019-07-11 16:23:32 -06:00
Michael Vines
8781aebe06
Pass SOLANA_METRICS_CONFIG along to oom-monitor.sh ( #5021 )
2019-07-10 20:11:55 -07:00
Michael Vines
32b55e6703
Fund solana-install deployments from the mint keypair to avoid airdrops ( #4997 )
2019-07-09 16:45:28 -07:00
Michael Vines
0a949677f0
net/ plumbing to manage LetsEncrypt TLS certificates ( #4985 )
...
automerge
2019-07-09 15:45:46 -07:00
Dan Albert
d111223085
Fix always passing in remote filename, even if no accounts file ( #4993 )
...
* Fix always passing in remote filename, even if no accounts file
* typo
2019-07-09 16:07:31 -06:00
Dan Albert
1ca7e9f67b
Add testnet-tds support to testnet manager ( #4762 )
...
* Add testnet-tds support to testnet scripts
2019-07-09 14:39:55 -06:00
carllin
1033f52877
Add pubkey ( #4971 )
2019-07-09 00:54:22 -07:00
Michael Vines
8620d0a3b2
Add curl retries
2019-07-02 08:37:18 -07:00
Michael Vines
27221e28f6
Use default pubkey for solana-install sanity check
2019-06-26 21:49:22 -07:00
Sathish
96b56fa6f7
Update authorized public key ( #4783 )
2019-06-22 08:33:39 -07:00
Michael Vines
465cd45833
Various Snapshot generation improvements
...
* Only a single snapshot is maintained to avoid unbounded disk growth
* Snapshot is stored as a compressed tar archive for faster rsyncing
* Any validator node may now generate snapshots
* Updated testnet scripts to generate snapshots on the blockstreamer node
2019-06-18 20:11:09 -07:00
Pankaj Garg
e43a634944
Calculate bench client lamports based on signature fee ( #4713 )
...
* use fee calculator to compute max fee
* review comments
* shellcheck
2019-06-18 14:44:53 -07:00
Sathish Ambley
44967abd1c
update storage len
2019-06-17 22:48:27 -07:00
Pankaj Garg
7fe10ba060
Don't start drone if primordial accounts are created for nodes ( #4704 )
...
* disable wallet sanity if no airdrops
2019-06-17 18:15:22 -07:00
Michael Vines
bd884a56bf
Install libssl1.1 better
2019-06-14 08:01:22 -07:00
Pankaj Garg
ee68b9800e
Wait for nodes to boot up before launching other nodes and client ( #4682 )
...
* Wait for nodes to bootup in testnet
* increase timeout (as with multiple clients it takes even longer)
2019-06-13 19:37:36 -07:00
Pankaj Garg
e3f895d7d4
Create bench exchange accounts in genesis block ( #4655 )
...
* fix script
* review comments
2019-06-13 11:51:35 -07:00
Pankaj Garg
288a3bdcd9
Provision bench client accounts in genesis block ( #4648 )
...
* fixes to script
* shellcheck
* address review comments
2019-06-11 18:47:35 -07:00
Pankaj Garg
9259d342ac
Facility to provision primordial accounts for fullnodes in genesis block ( #4631 )
...
* updated usage
* shellcheck
* support replicators
* disable airdrops if primordial accounts are used
* review comments
2019-06-10 19:42:49 -07:00
carllin
73491e3ca1
bump libssl ( #4634 )
2019-06-10 18:03:13 -07:00
Michael Vines
0dbe5ee559
Add chacha-sys crate ( #4620 )
...
* af9ff9c7f9/src/cpu-crypt
* Add chacha-sys crate
* Remove chacha feature
* Remove erasure feature
* Add .gitignore
2019-06-10 07:14:02 -07:00
Michael Vines
8676b5d40c
Use more -f
2019-06-07 22:18:55 -07:00
Michael Vines
a9f73ea321
solana-keygen no longer blindly overwrites a keypair, or assumes "new" ( #4599 )
...
automerge
2019-06-07 17:54:54 -07:00
Michael Vines
8e46c44f3e
Deploy mac OS solana-install update package to testnets ( #4595 )
2019-06-07 12:59:58 -07:00
Michael Vines
aa4a7b0c73
Disable |solana-install| check for edge/beta testnets ( #4564 )
...
The release tarball URL changes for these testnets, which causes the
normal |solana-install| check to fail and the testnet is unnecessarily
rebooted.
2019-06-05 15:31:29 -07:00
Michael Vines
9c47ce30a7
shift
2019-06-05 12:06:54 -07:00
Michael Vines
d26fd27bf9
Avoid sudo in tune-system.sh unless requested by the user ( #4556 )
2019-06-05 09:10:23 -07:00
Michael Vines
5c98c1d306
Sanity check that runs on the blockstreamer node now checks that node instead of the bootstrap leader ( #4551 )
...
automerge
2019-06-04 22:46:48 -07:00
Michael Vines
e3365529de
Enable transaction fees for multinode-demo/ and net/ ( #4527 )
...
* Collect fees at the end of a slot
* Enable transaction fees for multinode-demo/ and net/
2019-06-04 14:51:52 -07:00
Pankaj Garg
40a4ac15f1
Remove per transaction fee ( #4521 )
...
automerge
2019-06-03 13:00:08 -07:00
Michael Vines
e4ca3900ae
Reduce default validators from 5 to 2
2019-06-02 22:58:59 -07:00
Michael Vines
e15246746d
Enable non-zero fees for all testnets ( #4513 )
...
automerge
2019-05-31 22:33:55 -07:00
Michael Vines
ec5cca41bc
Separate bootstrap leader's stake lamports from its identity lamports ( #4510 )
...
* Revert "Prevent run.sh from running beyond the first epoch under normal use (#4498 )"
This reverts commit d343c409e6
.
* Separate bootstrap leader's stake lamports from its identity lamports
2019-05-31 19:58:52 -07:00
Michael Vines
ce04d2bfc2
Add replicator support to net/ ( #4494 )
2019-05-31 15:27:31 -07:00
Michael Vines
a7ef409c2b
Drop influxcloud ( #4460 )
...
automerge
2019-05-28 16:26:59 -07:00
Michael Vines
1eceb4831d
Use nohup and sleep a little to improve stability when launching a node
2019-05-27 13:57:40 -07:00
Michael Vines
471465a5f4
net/: Add solana-install test to sanity ( #4438 )
...
* Add instance creation date to motd
* Setup localtime
* Add solana-install test
2019-05-26 11:17:07 -07:00
sakridge
8611b40074
Add argument to net/net to specify number of nodes ( #4429 )
...
Allows for testing different node counts without recreating the network.
2019-05-24 16:20:14 -07:00
Michael Vines
94beb4b8c2
More fullnode -> validator renaming ( #4414 )
...
* s/fullnode_config/validator_config/g
* s/FullnodeConfig/ValidatorConfig/g
* mv core/lib/fullnode.rs core/lib/validator.rs
* s/Fullnode/Validator/g
* Add replicator-x.sh
* Rename fullnode.md to validator.md
* cargo fmt
2019-05-23 22:05:16 -07:00
Michael Vines
fb2eac20bb
Rename solana-fullnode to solana-validator ( #4411 )
2019-05-23 15:06:01 -07:00
sakridge
90e73515ed
Remove ls which is innacurate since we never clean up the logs ( #4392 )
...
automerge
2019-05-22 13:11:20 -07:00
Michael Vines
cbebc7a80c
Expand shortArgs correctly
2019-05-18 19:00:48 -07:00
Michael Vines
392a39dd54
Poh subsystem cleanup, genesis plumbing, enable real PoH on edge testnet ( #4292 )
...
* Remove unused PohServiceConfig::Step
* Clarify variable name
* Poh::hash() now takes an iteration counter
* man -> max
* Inline functions with single call site
* Move PohServiceConfig into GenesisBlock
* Add plumbing to enable real PoH on testnets
* Batch hashes to improve PoH hash rate
* Ensure a constant hashes_per_tick
* Remove PohEntry mixin field
* Poh/PohEntry no longer maintains tick_height
* Ensure a constant hashes_per_tick
* ci/localnet-sanity.sh: Use real PoH
* Rework Poh/PohService to keep PohRecorder unlocked as much as possible while hashing
2019-05-18 14:01:36 -07:00
Michael Vines
458ae3fdac
Switch to instances with AVX-512 if possible for better interop with dev machines ( #4328 )
...
automerge
2019-05-17 20:06:07 -07:00
Michael Vines
915956b94b
Remove disable leader rotation option ( #4299 )
...
automerge
2019-05-15 15:16:45 -07:00
Michael Vines
1393d26f63
Remove obsolete internal multinode-demo/ logging ( #4265 )
2019-05-13 10:51:18 -07:00
Michael Vines
50f79e495e
net/ improvements ( #4257 )
...
automerge
2019-05-11 22:54:50 -07:00
Michael Vines
dd12db2f06
Correctly handle more zones than additional nodes
2019-05-11 14:47:27 -07:00
Michael Vines
bfc65e829e
Use zone[0] for any left over nodes
2019-05-11 14:07:36 -07:00
Michael Vines
f2b727b534
Update mint keypair filename
2019-05-09 07:27:13 -07:00
Pankaj Garg
5719b8f251
Change remote node's ssh config to allow more login retries ( #4215 )
...
automerge
2019-05-08 11:20:06 -07:00
Michael Vines
7609a007c6
Add FeeCalculator to the genesis block ( #4196 )
2019-05-07 20:28:41 -07:00
Michael Vines
9b50583641
wallet: add --url, remove --host/--rpc-host/--rpc-port/-rpc-tls ( #4153 )
...
Also by default the wallet now talks to testnet.solana.com instead of
localhost
2019-05-06 07:38:26 -07:00
Michael Vines
0139e5db21
Correct blockstreamer node args
2019-05-04 08:22:36 -07:00
Michael Vines
586fb15c2c
fullnode positional arguments may now be mixed with optional arguments ( #4151 )
2019-05-03 20:49:24 -07:00
Michael Vines
f3f416b7ba
Rename --network argument to --entrypoint ( #4149 )
2019-05-03 15:00:19 -07:00
Michael Vines
7fe3c75c6b
Add a node-specific ip echo service to remove dependency on ifconfig.co ( #4137 )
2019-05-03 11:01:35 -07:00
Pankaj Garg
598f765960
Fix net.sh for running on macos ( #4107 )
...
automerge
2019-05-01 16:03:35 -07:00
Michael Vines
950d8494ba
earlyoom: Stop using unsupported -k option ( #4096 )
...
automerge
2019-05-01 11:29:02 -07:00
Michael Vines
c5f8b4960c
Stop nodes in parallel
2019-04-30 10:42:59 -07:00
Michael Vines
f02ec31c68
Flip if/else
2019-04-30 08:56:53 -07:00
Michael Vines
d21fa4a177
v0.14: various net/ fixes for large clusters ( #4080 )
...
* net.sh: Add -F to discard validator nodes that didn't bootup successfully
* Relax sanity node count when validator bootup failure is permitted
* Less sanity for testnet-demo
* net.sh: Add -F to discard validator nodes that didn't bootup successfully
2019-04-29 21:38:32 -07:00
Michael Vines
0cc3956693
testnet-demo now runs across more GCE zones ( #4053 )
...
* testnet-demo now runs across more GCE zones
* Save zone info to config file
* Add geoip whitelist for common data centers
* Skip more of start
* Include -x for config
* Fetch private key from first validator node if necessary
* Correct -r propagation
2019-04-28 19:50:52 -07:00
Michael Vines
6f56501034
Correctly terminate instances across multiple zones
2019-04-28 09:09:02 -07:00
Pankaj Garg
697cd17b59
Use GPU nodes for blockstreamer as well if rest of testnet has GPUs ( #4046 )
...
- The blockstreamer crashes otherwise, as sigverify() looks for CUDA libs
2019-04-27 20:45:38 -07:00
Pankaj Garg
13fcfcb964
Blockstreamer annotation fix for non buildkite deployments ( #4045 )
2019-04-27 20:37:36 -07:00
sakridge
b07290df81
Add usage to net.sh when it encounters an invalid argument ( #4042 )
...
automerge
2019-04-27 16:12:13 -07:00
Michael Vines
4ce2105548
Switch from a S3 URL to release.solana.com for release assets ( #4017 )
...
automerge
2019-04-26 13:06:55 -07:00
Dan Albert
d12705f9b0
Remove wait loops in non-GPU instance creation and add SSD option as default disk type ( #3992 )
2019-04-25 13:43:42 -06:00
Michael Vines
4dc0495a1b
Fix tar version check
2019-04-25 11:16:49 -07:00
Michael Vines
b67b0bff05
Do not enable rpc exit on the blockstreamer node ( #3977 )
2019-04-25 09:30:59 -07:00
Pankaj Garg
e867ce0944
Find unique zones and delete nodes in each zone ( #3978 )
2019-04-24 17:50:42 -07:00
Pankaj Garg
29a25990d3
Add provision in testnet scripts to ignore validator nodes that failed to bootup ( #3972 )
...
* Skip writing to config file if the node didn't bootup
* Detect dead nodes quicker
2019-04-24 16:23:26 -07:00
Pankaj Garg
9c7ccc0e2b
More metrics to track memory usage ( #3966 )
...
automerge
2019-04-24 11:11:30 -07:00
Michael Vines
3eed6a6090
Annotate testnet buildkite logs with blockexplorer URL ( #3964 )
...
automerge
2019-04-24 08:09:37 -07:00
Dan Albert
4e7e5ace9d
Add support for Azure instances in testnet creation ( #3905 )
...
* Add support for Azure instances in testnet creation
* Fixup
* Fix shellcheck errors
* More shellcheck and cleanup node creation and deletion
* More shellcheck and cleanup node creation and deletion
* Fixup instance wait API
* Fix revieew comments and add GPU installation extension
2019-04-23 16:41:45 -06:00
Pankaj Garg
3ba93aa8fe
Facility to pass extra arguments to bench clients from net.sh command ( #3952 )
...
automerge
2019-04-23 15:13:29 -07:00
Sagar Dhawan
69e67d06a7
Default to Docker based testnet deployment on unsupported Ubuntu versions ( #3937 )
...
* Run docker if Ubuntu version is unsupported
* ShellCheck fixes
2019-04-22 18:22:43 -07:00
Michael Vines
05bcb7f292
Add stop node command to solana-gossip ( #3928 )
2019-04-22 14:51:20 -07:00
sakridge
95a16426f3
Cleanup bench-exchange ( #3919 )
...
* bench-exchange changes
Generate new keypair for each bench-exchange
Add metrics
Tweak network sleep parameters for better reliability.
* Bench-exchange contract metrics
2019-04-22 13:16:28 -07:00
Pankaj Garg
bec094bb3e
Start bench tps clients as default ( #3917 )
2019-04-21 20:18:52 -07:00
Pankaj Garg
d83a71d89f
More AWS regions for testnet deployment ( #3911 )
...
- also some minor fixes to gce.sh
2019-04-19 17:46:14 -07:00
Jack May
1a9ac62f60
Add bench-exchange support to the net framework ( #3893 )
2019-04-19 09:56:01 -07:00
Jack May
aab410380e
Fix net for macos and local ( #3872 )
2019-04-18 14:49:35 -07:00
Pankaj Garg
8999bfef65
Try to delete nodes in all cloud zones ( #3874 )
2019-04-18 13:16:14 -07:00
sakridge
684e1c73dd
Allow for custom cpu config on gce and use 20gb ram for clients ( #3856 )
2019-04-18 09:36:11 -07:00
Michael Vines
78d5ace754
Refactor multinode-demo/ scripts to avoid shipping fullnode-x.sh ( #3835 )
2019-04-17 18:03:58 -07:00
Pankaj Garg
d0fb55d9b1
Allow testnet creation with no validator nodes ( #3846 )
2019-04-17 17:38:18 -07:00
Michael Vines
63d66ece57
net/ testnet nodes now stake more lamports ( #3812 )
...
* Add --bootstrap-leader-lamports
* Generalize --no-stake into --stake NUM
* Use a large stake for net/ fullnodes
* Setup vote account before starting fullnode to avoid mixed log output
2019-04-16 13:03:01 -07:00
Michael Vines
c67cc694ae
Remove stake from `./net sanity` ephemeral validator ( #3797 )
2019-04-15 21:42:25 -07:00
Michael Vines
9293a54234
Remove stray +
2019-04-15 20:28:11 -07:00
Michael Vines
666882fbbd
-r does not require an argument
2019-04-15 09:40:34 -07:00
Michael Vines
2f1b0bf4f5
Add solana-install deployments to the testnets
2019-04-11 10:03:35 -07:00
Michael Vines
88e5b14afc
Exit faster on sanity failures
2019-04-09 17:16:15 -07:00
Michael Vines
0b95a5c121
Include blockstreamer node in sanity
2019-04-09 16:52:57 -07:00
Stephen Akridge
76e524ae48
Remove check for 0 additional nodes
...
Network with 1 leader is valid.
2019-04-09 11:16:55 -07:00
Michael Vines
6ac919c71a
Set warn log level only for perf testnets
2019-04-09 11:09:16 -07:00
Michael Vines
1ba4806f8c
Document recent -z and -x command-line arg changes
2019-04-09 10:39:55 -07:00
Pankaj Garg
0904df327d
Parallelize cloud node deployment commands in case of multiple zones ( #3657 )
2019-04-07 08:13:48 -07:00
Pankaj Garg
9cd555cad5
AWS script change for additional zones and regions
2019-04-04 15:59:59 -07:00
Tyera Eulberg
acbc261891
Add gossip to build script, and fix bash strings
2019-04-04 00:18:48 -07:00
Pankaj Garg
efbb49d579
Don't use external node ssh key if one is not configured
2019-04-02 14:20:00 -07:00
Tyera Eulberg
92c66a411b
Remove bench-tps converge-only
2019-04-01 23:05:25 -06:00
Pankaj Garg
97bd7a00f1
Support for configuring testnet nodes across multiple cloud services
2019-04-01 17:11:41 -07:00
Pankaj Garg
cb3adea94f
Increase node count in beta testnet
2019-04-01 11:06:24 -07:00
Pankaj Garg
15b945a652
Fix EC2 scripts for blockstream startup
2019-03-28 15:37:23 -07:00
Pankaj Garg
a94bc80383
fix clippy errors
2019-03-27 18:05:17 -07:00
Pankaj Garg
586b6fc3d7
review comments
2019-03-27 18:05:17 -07:00
Pankaj Garg
a14c202d60
fix the ip address that's stored in the config file
2019-03-27 18:05:17 -07:00
Pankaj Garg
ed48c495a3
fix shell-check errors
2019-03-27 18:05:17 -07:00
Pankaj Garg
f0abd06a46
Added support for multi-region cloud testnet
2019-03-27 18:05:17 -07:00
Pankaj Garg
e8814b1297
Add support for influx cloud
2019-03-25 17:10:38 -07:00
Michael Vines
0a5b6154e8
Use same gossip port for all testnet nodes
2019-03-22 00:16:58 -07:00
Michael Vines
e6b9babf53
Run a drone on blockstreamer nodes
2019-03-21 22:09:44 -07:00
Michael Vines
ed8bada439
Kill all node processes (blockexplorer)
2019-03-21 22:09:44 -07:00
Michael Vines
3b5a9f512c
Get client-id.json out of the genesis ledger directory
2019-03-21 16:35:40 -07:00
Michael Vines
791ead6053
Include TARGET in release URL to make room for future targets
2019-03-20 13:54:32 -07:00
Michael Vines
7498488f5f
cloud_DeleteInstances() now waits for the instances to be terminated
2019-03-14 21:15:00 -07:00
Michael Vines
ede99d5913
Revert "Block until instances are confirmed to be deleted"
...
This reverts commit 47ddbbe53b
.
2019-03-14 20:53:10 -07:00
Michael Vines
8f25548781
Overhaul cargo/rustc version management
2019-03-14 20:22:46 -07:00
Michael Vines
47ddbbe53b
Block until instances are confirmed to be deleted
2019-03-14 16:20:18 -07:00
Michael Vines
34a8d591fa
Switch version file from .txt to .yaml; add target tuple to version.yml
2019-03-13 16:30:07 -07:00
Michael Vines
242bcf44db
Replace stale --no-signer usage with --no-voting
2019-03-13 13:50:30 -07:00
Michael Vines
ebd540972d
Remove duplicate --rpc-drone-address
2019-03-13 13:24:02 -07:00
Michael Vines
fedbae6f8c
Enable rpc for all testnet nodes
2019-03-13 10:49:40 -07:00
Michael Vines
5d27f221f7
Drop socat for iptables
2019-03-13 12:03:56 -05:00
Michael Vines
61db74d98e
Run socat in the background
2019-03-13 08:15:58 -07:00
Pankaj Garg
76feb2098e
Use same VM type for validators as leader, if CUDA is enabled ( #3253 )
...
- Since all nodes are created equal
2019-03-12 17:42:47 -07:00
Sagar Dhawan
866d3f467f
Fix flag to disable leader-rotation ( #3243 )
2019-03-12 16:35:13 -07:00