Commit Graph

1169 Commits

Author SHA1 Message Date
Michael Vines f8e64aad5b
ci/shellcheck.sh now only audits files that git knows about (#6815) 2019-11-08 10:25:59 -07:00
Michael Vines 75fd13de5d
Prevent ci/nits.sh from incorrectly nitting on ci/nits. (#6814) 2019-11-08 09:40:25 -07:00
Michael Vines 87ba66b6d0
Add net/ support for reusable identity keypairs (#6783) 2019-11-06 21:14:05 -07:00
Tyera Eulberg b3a75a60a4
Use rooted bank by default in rpc bank selection (#6759)
* Name anonymous parameters for clarity

* Add CommitmentConfig to select bank for rpc

* Add commitment information to jsonrpc docs

* Update send_and_confirm retries as per commitment defaults

* Pass CommitmentConfig into client requests; also various 'use' cleanup

* Use _with_commitment methods to speed local_cluster tests

* Pass CommitmentConfig into Archiver in order to enable quick confirmations in local_cluster tests

* Restore solana ping speed

* Increase wallet-sanity timeout to account for longer confirmation time
2019-11-06 14:15:00 -07:00
Michael Vines fba1af6ea9
ledger-tool can now load a ledger snapshot (#6729) 2019-11-04 22:14:55 -07:00
Trent Nelson d085c8626f GCE: Add instances self-destruct (#6363)
automerge
2019-11-04 10:30:26 -08:00
TristanDebrunner e6c8bfd008
Add --use-move flag to cargo-install-all.sh and net/net.sh (#6670) 2019-11-01 07:53:30 -07:00
TristanDebrunner 627664b785 Re-enable tests (#6615)
automerge
2019-10-29 21:34:20 -07:00
Tyera Eulberg 4ec95043d7
Update sol:lamport ratio to base-10 (#6611)
* Update sol:lamport ratio

* Update various SOL quantities in bash scripts
2019-10-29 20:03:48 -06:00
TristanDebrunner b4dc1a7263 Remove move feature (#6605)
automerge
2019-10-29 17:14:07 -07:00
Michael Vines f3c0aa154a
-a is optional 2019-10-26 22:48:24 -07:00
Michael Vines 0d1f463f7f
Update testnet-manager.sh 2019-10-25 10:56:20 -07:00
Michael Vines 7f3072d53a
ignore test_fail_entry_verification_leader (#6537)
* Revert "Revert "Restore CUDA-based unit tests (#6518)""

This reverts commit 27f38a3770.

* ignore test_fail_entry_verification_leader
2019-10-24 21:16:17 -07:00
Michael Vines 90461245f9
Reduce TdS fees to 1 lamport per sig, and slots_per_epoch/2 (#6542) 2019-10-24 20:37:23 -07:00
Michael Vines 27f38a3770
Revert "Restore CUDA-based unit tests (#6518)"
This reverts commit dc52b17c4d.
2019-10-24 11:34:53 -07:00
Michael Vines dc52b17c4d
Restore CUDA-based unit tests (#6518) 2019-10-23 20:09:28 -07:00
Michael Vines e462a7d1d5
net: Add ability to only start/stop client nodes (#6503)
* Add info --eval

* net: Add ability to start idle client nodes
2019-10-22 16:08:49 -07:00
Michael Vines f80a5b8c34
Remove some TODOs (#6488)
* Remove stale TODOs

* Ban TODO markers from markdown

* Scrub all TODOs from ci/ and book/
2019-10-21 22:25:06 -07:00
Greg Fitzgerald 3b9b9b1500 Rename remaining uses of fullnode to validator (#6476)
automerge
2019-10-21 20:21:21 -07:00
Michael Vines 3fb70b8d47
Ban XXX, TBD, FIXME comments (#6486) 2019-10-21 16:43:11 -07:00
Michael Vines dec9272813 Skip ledger verification on restart to avoid timing out net/ (#6468)
automerge
2019-10-21 09:27:45 -07:00
Michael Vines 6f58bdfcb1 Remove validator sanity check (#6435)
automerge
2019-10-18 08:26:08 -07:00
Trent Nelson 1759968c1e Colo: Put NVMe disks to use (#6357)
automerge
2019-10-17 14:44:45 -07:00
TristanDebrunner 9e52d11ad0
Remove Backend trait (#6407) 2019-10-17 15:19:27 -06:00
Michael Vines bfc67e8680
gzip -f 2019-10-17 13:08:51 -07:00
Ryo Onodera b7b71b31d3 Magically improve coverage (#6345)
automerge
2019-10-16 16:53:07 -07:00
Michael Vines 8dd24bc7d9
Put dedicated arg in the right place 2019-10-16 10:36:29 -07:00
Michael Vines 51ac05b3cf Request dedicated instances 2019-10-16 08:10:31 -07:00
Michael Vines 79e32c92c1
Skip deploy attempt on sanity failure 2019-10-12 22:18:41 -07:00
Greg Fitzgerald 322fcea6e5
More fullnode to validator renaming (#6337) 2019-10-11 13:30:52 -06:00
Trent Nelson 81fb9e6a59 gce.sh: Rename -f flag to better reflect usage (#6318)
automerge
2019-10-10 12:57:03 -07:00
Dan Albert 60e8cf5a47
Implement nightly performance tests (#6140)
* Implement nightly performance tests on colo
2019-10-10 11:12:13 -04:00
Rob Walker 7cf90766a3
add epoch_schedule sysvar (#6256)
* add epoch_schedule sysvar

* book sheesh!
2019-10-08 22:34:26 -07:00
Michael Vines cf3bbc09b6 Jump to nightly-2019-10-03 (#6233)
* Reduce what gets build for coverage to avoid OoM with nightly 2019-10-03

* Update nightly to 2019-10-03
2019-10-03 20:05:44 -06:00
Michael Vines 4b42fa2d75
Ensure all builds are triggered on a rust upgrade (#6229) 2019-10-03 16:31:50 -07:00
Michael Vines 4d458a5e00
Keep the build green when there's nowhere to publish 2019-10-03 14:55:04 -07:00
Michael Vines cf2bcee607
Increase testnets to 4 validator nodes to avoid the need for 100% consensus 2019-10-03 09:53:31 -07:00
Michael Vines 586e0a67ef
Suppress nighly safety_doc warning 2019-10-02 22:51:14 -07:00
Michael Vines a20f12865a
Upgrade to rust 1.38 2019-10-02 22:51:14 -07:00
Michael Vines e5a7d08966 Add --expected-genesis-blockhash validator argument (#6174)
automerge
2019-09-29 19:09:24 -07:00
sakridge 75a92d58cb
Featureize move (#5897)
* Featureize move

* Add move featured test
2019-09-27 12:19:06 -07:00
sakridge db05864a69
Add ssh key check (#6149) 2019-09-27 10:55:51 -07:00
Michael Vines b4da83a3ab
Remove CUDA feature (#6094) 2019-09-26 13:36:51 -07:00
Dan Albert 678a5aff83
Remove brace expansion in arg list (#6091) 2019-09-25 12:52:07 -04:00
carllin 229836511d Remove local_cluster tests from stable-perf job, removee other tests from local-cluster job (#6067) 2019-09-24 19:05:25 -07:00
Michael Vines 61d7467ba8
Flip order of arg to ensure -t sticks 2019-09-23 22:20:22 -07:00
Michael Vines 433b0808e4
Remove the _/deps symlink, just copy instead (#6020) 2019-09-23 09:16:56 -07:00
Michael Vines ab60c578b9
Unconditionally redeploy the edge testnet hourly to better exercise snapshot restarts 2019-09-21 09:28:59 -07:00
Ryan Shea 050021cf77 Add SVGs for Gitbook (#6009) 2019-09-21 07:59:36 -07:00
Michael Vines 020d34187c
Fetch logs on redeploy failure 2019-09-20 15:45:47 -07:00
Michael Vines 33e2af341a
Add deps/ symlink so solana-validator-cuda can find native programs 2019-09-20 15:26:49 -07:00
Michael Vines bb9f07183b
Only fetch logs on sanity failure 2019-09-20 14:47:56 -07:00
Michael Vines 5dd3a07a23
Avoid changing the current working directory 2019-09-20 12:46:29 -07:00
Michael Vines 58a6c9a5f0
Adjust path to perf-libs 2019-09-20 12:27:09 -07:00
Michael Vines 7053978861
Fix cp src 2019-09-20 12:15:05 -07:00
Michael Vines 4b1de02bbb
solana-validator-cuda wrapper is now net.sh compatible 2019-09-20 11:37:45 -07:00
Michael Vines 890be36fd3
Fix check 2019-09-20 08:19:57 -07:00
Michael Vines 54cf9aaa1e
Preserve public network flag when testnet-edge is restarted 2019-09-19 23:02:47 -07:00
Michael Vines 1d0be265d9
Add explicit validator-cuda crate (#5985) 2019-09-19 20:50:34 -07:00
Sagar Dhawan d379786c90
Fix bind errors (#5986)
* Add ability to bind to a common tcp/udp port

* Extend port range for local-net sanity and fix validator executable
2019-09-19 17:16:22 -07:00
Michael Vines 05ada97d00
Clean up log folding 2019-09-19 13:44:59 -07:00
Rob Walker 8fa28f965c
clear config (#5980) 2019-09-19 12:10:29 -07:00
Michael Vines fee5c6c057
testnet-edge/testnet-beta now update while preserving the ledger (#5979)
* Check if an update is current before deploying it again

* Add (new) update command to deploy testnet updates

* Add --deploy-if-newer flag to permit conditional net updates
2019-09-19 12:03:47 -07:00
Michael Vines 8d94972d88
Publish version information as stand-alone file for easy access 2019-09-19 10:26:51 -07:00
Michael Vines 1650519962
SOLANA_CUDA=1 works again (#5968)
* SOLANA_CUDA=1 works again

* Minor comment reformat

* Set SOLANA_CUDA=1 explictly
2019-09-19 08:52:00 -07:00
carllin 86213d38fe
Release builds for local cluster tests (#5891)
* Release builds for test

* Remove setting thread count in local cluster

* Increase timeout

* Move local cluster to separate job

* Extract out local cluster test from bench-tps

* Make local cluster inaccessible from outside crate

* Update test-stable.sh to exclude local_cluster in stable, include it in local-cluster CI job

* Move bench-exchange to local cluster

* Remove local cluster from coverage
2019-09-18 13:10:50 -07:00
Dan Albert 8b99e6dfbe
Narrow wildcard matching for solana tarball (#5950) 2019-09-18 12:28:13 -07:00
Jack May c90595cba1
Cleanup nits (#5914) 2019-09-17 10:21:22 -07:00
Michael Vines de1636c792 Enable --limit-ledger-size on testnets (#5927)
automerge
2019-09-17 10:05:41 -07:00
Sagar Dhawan c1d788880d
Limit Rayon threadpool threads (#5871) 2019-09-12 11:39:39 -07:00
Jack May 176c7d8b13
Pull all the Rust BPF tests into a single workspace so they share dependencies (#5878) 2019-09-11 14:55:58 -07:00
Michael Vines bf1ecc2441
Remove ledger verification, it's racy and essentially globaly disabled already (#5867) 2019-09-11 10:53:10 -07:00
Michael Vines ee0c570d54 Rework solana-validator-cuda to automatically prepare the perf-libs env (#5849)
automerge
2019-09-08 21:20:08 -07:00
Michael Vines 11cec8f24e
Move appveyor off the system drive 2019-09-08 10:05:58 -07:00
Jack May e5f902369c
Rust BPF programs depend on Solana SDK (#5819) 2019-09-06 09:20:14 -07:00
Rob Walker b6da5a3f47
build all tests (#5785)
* build all tests

* try again

* try again
2019-09-04 17:01:38 -07:00
Jack May 5fb2d7a98f
Add libstd support to Rust BPF (#5788) 2019-09-04 16:00:11 -07:00
Rob Walker 933e835838
add stake lockup (#5782)
* add stake lockup

* fixup
2019-09-04 13:34:09 -07:00
sakridge 34155fc36f
Long-running banking benchmark (#5075) 2019-08-30 11:10:32 -07:00
Pankaj Garg f41fb7d772
Ignore cargo audit advisory RUSTSEC-2019-0013 (#5713) 2019-08-28 14:38:46 -07:00
Michael Vines 9f2119920c
Revert "Add debug to help track down ci/localnet-sanity.sh instability"
This reverts commit 7aaf5bc02c.
2019-08-27 14:28:22 -07:00
Michael Vines 7aaf5bc02c
Add debug to help track down ci/localnet-sanity.sh instability 2019-08-27 08:49:04 -07:00
Rob Walker 3d098d2ed9 turn cargo audit version back on (#5651) 2019-08-26 19:50:56 -07:00
Michael Vines 97db802be3
Add net-tools for netstat 2019-08-26 16:17:04 -07:00
Michael Vines 1abdeca4c1
Add TESTNET_DB_HOST default 2019-08-24 07:38:19 -07:00
Michael Vines 881a6dc0f7
Revert "Bump stable timeout"
This reverts commit bde4ba04af.
2019-08-23 17:14:08 -07:00
Michael Vines bde4ba04af
Bump stable timeout 2019-08-23 11:44:08 -07:00
Rob Walker 52f6da5cee
upgrade rust to 1.37 (#5611) 2019-08-23 08:55:51 -07:00
Michael Vines f402b477b2
🐌 Publish crates for even longer 2019-08-16 21:52:12 -07:00
Michael Vines 9f6c9c428b
Move genesis/snapshot archive download into Rust (#5515) 2019-08-14 19:25:22 -07:00
TristanDebrunner 687818aad6
Run sdk-c through clippy separately (#5504) 2019-08-12 16:41:17 -06:00
Michael Vines d59aae4849
Disable validator sanity for edge/beta 2019-08-10 13:16:06 -07:00
Rob Walker 784943ecab
unignore RUSTSEC 2019 0011 (#5365) 2019-08-08 14:53:02 -07:00
Michael Vines 06d8c06119
Allow TdS CHANNEL_OR_TAG to be overridden from buildkite UI 2019-08-05 17:22:06 -07:00
Michael Vines b5aa03dd7c
Rename --config-dir to --ledger (progress towards deleting validator.sh) (#5423) 2019-08-05 12:42:52 -07:00
Michael Vines 09ca92d416
Surface --voting-keypair to release users (#5420)
* Remove 'configured_flag' for vote/storage account, instead detect if they exist with the wallet

* Require --voting-keypair when using release binaries
2019-08-05 10:39:16 -07:00
Michael Vines 56ed033233
Remove unused var 2019-08-04 21:29:20 -07:00
Michael Vines e56efe237c
Move testnet from ec2 tp gcp 2019-08-04 21:02:27 -07:00
Michael Vines 3f0ff45de0
Move edge/beta testnets from ec2 to gcp 2019-08-04 20:42:28 -07:00
Michael Vines 6ec0318bae
Reduce AWS node count 2019-08-03 23:50:52 -07:00
Michael Vines 911dee24c5 Give a unique port range for each validator node (#5397)
automerge
2019-08-01 14:37:59 -07:00
Michael Vines 5212b2716c
Don't rebuild/retest release tags (#5385) 2019-08-01 13:11:42 -07:00
Pankaj Garg 149a63100d
remove no-snapshot option from tds testnet (#5368) 2019-07-31 14:51:54 -07:00
Michael Vines 1d6bafbc77
Move tds to edge (#5366) 2019-07-31 14:18:05 -07:00
Michael Vines bd7e269280 Kill rsync (#5336)
automerge
2019-07-30 22:43:47 -07:00
Michael Vines 8a5045f05c
Bump timeouts for publish docker/tarball builds 2019-07-30 20:09:47 -07:00
Michael Vines 2214d2dbb5
Eject bootstrap-leader support from fullnode.sh (#5301) 2019-07-29 21:25:28 -07:00
Michael Vines 506b305959
Move coverage back to the default queue (#5318) 2019-07-28 22:20:54 -07:00
Michael Vines e83efcfc80
Tidy test-checks.sh (#5319) 2019-07-28 22:19:03 -07:00
sakridge 4f1c881227
Add --use_move mode to bench-tps (#5311)
* Add --use_move mode to bench-tps

substitute for global flag.

* Use cuda queue for coverage build.
2019-07-28 10:43:42 -07:00
Greg Fitzgerald 64c770275b
Integrate Move VM into main build (#5229)
* Integrate Move VM into top-level build

* Switch to protoc-free libra
2019-07-27 06:59:46 -06:00
Michael Vines 5f09aa36b3
Drop code supporting no leader rotation (#5286) 2019-07-26 09:26:27 -07:00
Michael Vines fbfe1a59a6
bump timeout 2019-07-24 13:53:08 -07:00
Michael Vines d647a4ec57
Bump publish-crate.sh timeout 2019-07-23 22:12:34 -07:00
Michael Vines 17b9ea3e3b
Update buildkite-secondary.yml 2019-07-23 07:33:13 -07:00
Michael Vines 88d4d1db7a
Update buildkite.yml 2019-07-23 00:20:05 -07:00
Michael Vines cab4c88c71
Bump timeouts 2019-07-22 23:52:30 -07:00
Michael Vines 4ec5a899f5
Check longer 2019-07-22 23:41:42 -07:00
Michael Vines 2c8e0bcf87
Introduce --config-dir to avoid shipping clear-config.sh (#5241) 2019-07-22 22:59:02 -07:00
Dan Albert a0ccdccff1 Call book/build.sh from docker (#5237)
* Call book/build.sh from docker

* debug

* Revert "debug"

This reverts commit 32986b73b7dd1c8866051ea06544e4140ff0d354.
2019-07-22 21:37:43 -07:00
Dan Albert 735c7c9841
Add manual publish for book and create book-beta (#5112) 2019-07-22 17:45:00 -06:00
TristanDebrunner 038c6ea0a7 Bump solana_libra to v0.0.0.1 (#5225)
automerge
2019-07-22 14:17:06 -07:00
Rob Walker 43bf176fab
more granular check for memoffset ignore in audit (#5219)
* more granular check for memoffset ignore in audit

* debugggin

* debugggin

* debugggin

* debugggin

* debugggin
2019-07-22 13:36:27 -07:00
Greg Fitzgerald 186b514ebb Embed Move (#5150)
automerge
2019-07-22 12:01:52 -07:00
Michael Vines 02c7b89a8f
Update location of TdS external accounts file url 2019-07-21 17:38:15 -07:00
Michael Vines 1b5a332239
Adjustments for appveyor server 2019-07-21 09:21:28 -07:00
Greg Fitzgerald 9b1471acae
Upgrade to Rust 1.36.0 (#5206)
* Upgrade to Rust 1.36.0

* Move test-checks.sh back to stable

* update nightly version to 2019-07-19

* use both nightly and stable for checks
2019-07-20 18:53:16 -06:00
Rob Walker e6b525a614
disable audit until crossbeam epoch release (#5208) 2019-07-20 15:50:26 -07:00
Michael Vines 6969ece2dd
Ensure CI_OS_NAME is set for appveyor server 2019-07-19 20:06:32 -07:00
Dan Albert c95cda51c9
Fix internal node lamport funding and staking allocation logic (#5192)
* Plumb node funding from genesis

* Cleanup naming convention

*  Fix balance vs stake yml file logic

* Lamps not Stakes
2019-07-19 12:51:38 -06:00
Michael Vines 1e1cb7c57c
Select stable rust version (#5180) 2019-07-18 21:19:07 -07:00
Michael Vines 57036fbcc1
Check harder on crates.io for recently published crates (#5136) 2019-07-16 19:09:49 -07:00
Michael Vines 7e60ee39d9
Add missing dash 2019-07-16 07:27:35 -07:00
Dan Albert db7e78bf99
Add node zone and count to ENV (#5100)
* Add node zone and count to ENV
2019-07-14 22:40:18 -06:00
Dan Albert adecd4cfdc
Pull testnet vars up to buildkite env (#5098) 2019-07-14 20:27:49 -06:00
Dan Albert 440d006ec1
Plumb --no-snapshot in from CI (#5077)
* Plumb --no-snapshot in from CI
2019-07-14 13:17:30 -06:00
Michael Vines d2b21ce8d0
Stop trying to publish crates that are unpublishable 2019-07-12 21:53:09 -07:00
Michael Vines b01990d480
Avoid trying to republish crates already on crates.io 2019-07-12 21:43:16 -07:00
Michael Vines d7fdfb7e21
Give publish-crate more time 2019-07-12 20:28:10 -07:00
Rob Walker 0d27515d09
tmp dirs target to farf (#5079) 2019-07-12 18:28:42 -07:00
Dan Albert 5ac173d208
Enable GPUs and secondary disks for TdS net, pull external account file (#5031)
* Enable V100 GPUs over 3 regions for TdS cluster

* Turn on secondary config-local drive for tds net

* Enable long args bypass for GPU machine details

* bypass quoted long arg

* Pull external account file from wget

* typo

* Symlink config-local instead of changing the path variables

* Fix link path
2019-07-12 09:38:47 -06:00
Dan Albert e4861f52e0
Add support for additional disks for config-local (#5030)
* Add support for additional disks for config-local

* Restore wrongly deleted lines

* Shellcheck

* add args in the right place dummy

* Fix nits

* typo

* var naming cleanup

* Add stub function for remaining cloud providers
2019-07-11 16:23:32 -06:00
Michael Vines 41d0db078e
Wait for bootstrap leader to initialize before starting other validators (#5027) 2019-07-10 21:03:48 -07:00
Dan Albert e563a4dda3
Rename tds-testnet to tds (#5008) 2019-07-10 10:26:24 -06:00
Michael Vines aebd70ddce
Move letsencrypt arg to create_args 2019-07-09 21:27:12 -07:00
Michael Vines 7d80cfb17a
Include --letsencrypt ($1) 2019-07-09 20:54:11 -07:00
Michael Vines 0a949677f0 net/ plumbing to manage LetsEncrypt TLS certificates (#4985)
automerge
2019-07-09 15:45:46 -07:00
Dan Albert 1ca7e9f67b
Add testnet-tds support to testnet manager (#4762)
* Add testnet-tds support to testnet scripts
2019-07-09 14:39:55 -06:00
Jack May f9a2254688
Split out Rust BPF no-std stuff (#4968) 2019-07-08 20:28:05 -08:00
Sagar Dhawan 55b8ff72d0
Enable parallel tests to reduce test time (#4919)
* Add crate to serialize some tests

* Ignore unused attribute warning

* Enable parallel run in CI

* Try to fix lograte tests

* Fix interdependent counter tests
2019-07-02 17:35:03 -07:00
Michael Vines 4a10fd3272
Upload all artifacts 2019-06-26 14:37:18 -07:00
Michael Vines 9e2eb9e4f9
Set CI_REPO_SLUG correctly for the solana-secondary pipeline 2019-06-26 14:37:18 -07:00
Michael Vines 36aa876833 Avoid linking with CUDA directly 2019-06-21 15:26:22 -07:00
Jack May e59b53dfa8
BPF rust language updates (#4752) 2019-06-20 16:07:12 -07:00
Michael Vines 6854c64a09 Bump coverage build timeout 2019-06-20 09:24:11 -07:00
Jack May b430762a23
check rust programs (#4688) 2019-06-20 07:43:31 -07:00
Rob Walker f8523db51d
Revert "remove build --all (#4737)" (#4745)
This reverts commit 63503ad589.
2019-06-19 23:21:10 -07:00
Rob Walker 63503ad589
remove build --all (#4737)
* remove build  all

* Update test-stable.sh
2019-06-19 17:36:25 -07:00
Michael Vines 8bd1c57448 Defer CUDA selection to env.sh, also always create env.sh 2019-06-19 08:47:27 -07:00
Michael Vines 5683282c94 Update to solana-perf-libs v0.14.0, with support for both CUDA 10.0 and 10.1 2019-06-18 10:41:03 -07:00
Michael Vines bd633d2b81 Add CI_REPO_SLUG (#4714)
automerge
2019-06-17 20:42:09 -07:00
Jack May 2a7a9fdf03
Re-org SDK dir (#4690) 2019-06-17 11:04:38 -07:00
Jack May b91ad6fd96
Clear C dependency files from cache (#4692) 2019-06-14 19:11:16 -07:00
Michael Vines a016bc2736 Add infra to publish metrics tarball 2019-06-13 10:00:24 -07:00
Michael Vines dd1c3514a8
Use auto hashes-per-tick config for testnet testnet 2019-06-12 08:40:56 -07:00
Michael Vines 0dbe5ee559
Add chacha-sys crate (#4620)
* af9ff9c7f9/src/cpu-crypt

* Add chacha-sys crate

* Remove chacha feature

* Remove erasure feature

* Add .gitignore
2019-06-10 07:14:02 -07:00
Michael Vines 91b23f8316
Switch from solana-install to solana-install-init 2019-06-08 19:24:36 -07:00
Michael Vines 8676b5d40c
Use more -f 2019-06-07 22:18:55 -07:00
Michael Vines 97b9d57b62
shellcheck 2019-06-07 21:35:51 -07:00
Michael Vines 487826a539
Deploy windows updates 2019-06-07 20:46:58 -07:00
Michael Vines 4acb764589
Pick up .exe extension 2019-06-07 20:13:47 -07:00
Michael Vines 9de4c1dcd9
Add slack notification 2019-06-07 19:58:52 -07:00
Michael Vines e8c4302d6d
Add Appveyor CI for Windows release artifacts 2019-06-07 19:47:26 -07:00
Michael Vines a9f73ea321 solana-keygen no longer blindly overwrites a keypair, or assumes "new" (#4599)
automerge
2019-06-07 17:54:54 -07:00
Jack May 66c41b3e8c Enable iter test (#4542)
automerge
2019-06-07 16:44:14 -07:00
Michael Vines 8e46c44f3e
Deploy mac OS solana-install update package to testnets (#4595) 2019-06-07 12:59:58 -07:00
Michael Vines fdaa939892
Bring in Travis CI to build Windows and mac OS release binaries (#4591)
* Bring in Travis CI to build Windows and mac OS release binaries

* Update .travis.yml
2019-06-07 11:32:47 -07:00
Pankaj Garg ead947e710
Change default setting for real PoH in testnet scripts (#4573) 2019-06-06 12:49:46 -07:00
Michael Vines 53275cc678
Introduce normalized CI environment vars: ci/env.sh (#4571) 2019-06-06 12:20:47 -07:00
Michael Vines ee42040e6b Give coverage build more time (#4572)
automerge
2019-06-06 11:07:32 -07:00
Michael Vines 2b98a16ec6
Upgrade to rust stable 1.35.0 (#4568) 2019-06-06 09:24:38 -07:00
Michael Vines aa4a7b0c73
Disable |solana-install| check for edge/beta testnets (#4564)
The release tarball URL changes for these testnets, which causes the
normal |solana-install| check to fail and the testnet is unnecessarily
rebooted.
2019-06-05 15:31:29 -07:00
Michael Vines e3365529de
Enable transaction fees for multinode-demo/ and net/ (#4527)
* Collect fees at the end of a slot

* Enable transaction fees for multinode-demo/ and net/
2019-06-04 14:51:52 -07:00
Dan Albert 41daf1ef0c
Wait for crate to be locatable on crates.io after uploading (#4526)
* Wait for crate to be locatable on crates.io after uploading

* Fix nits and shellcheck

* shellchecker
2019-06-03 19:54:41 -06:00
Michael Vines c0a161afe8 Enable fees in ci/localnet-sanity.sh (#4508)
automerge
2019-05-31 16:50:39 -07:00
Michael Vines 2d284ba6db
Fix clear-config.sh 2019-05-30 15:31:41 -07:00
Michael Vines d642125f68
publish-crate fixups 2019-05-30 15:15:58 -07:00
Dan Albert d67dd8ce1f
Fix stable metrics dashboard for current channel use (#4483) 2019-05-30 13:16:26 -06:00
Michael Vines 4d6679906b
Clean up crates.io publishing (#4478)
* Clean up crates.io publishing

* Cargo.lock
2019-05-30 11:53:41 -07:00
Michael Vines a7ef409c2b Drop influxcloud (#4460)
automerge
2019-05-28 16:26:59 -07:00
Michael Vines 942785b626
sdk/bpf/scripts/install.sh: Retry downloads on transient 403 S3 failures seen in CI (#4436)
* Avoid caching perf-libs in CI

* Retry downloads on transient 403 S3 failures seen in CI
2019-05-25 14:41:09 -07:00
Michael Vines 8eac199e8b
Include perf-libs in release tarball (#4422) 2019-05-24 09:28:52 -07:00
Michael Vines 2e251ccc5c
De-fullnode variable names (#4420) 2019-05-24 04:31:39 -07:00
Michael Vines cfe5afd34c
_id => _pubkey variable renaming (#4419)
* wallet: rename *_account_id to *_account_pubkey

* s/from_id/from_pubkey/g

* s/node_id/node_pubkey/g

* s/stake_id/stake_pubkey/g

* s/voter_id/voter_pubkey/g

* s/vote_id/vote_pubkey/g

* s/delegate_id/delegate_pubkey/g

* s/account_id/account_pubkey/g

* s/to_id/to_pubkey/g

* s/my_id/my_pubkey/g

* cargo fmt

* s/staker_id/staker_pubkey/g

* s/mining_pool_id/mining_pool_pubkey/g

* s/leader_id/leader_pubkey/g

* cargo fmt

* s/funding_id/funding_pubkey/g
2019-05-23 23:20:04 -07:00
Michael Vines fb2eac20bb
Rename solana-fullnode to solana-validator (#4411) 2019-05-23 15:06:01 -07:00
Pankaj Garg 6b35e16676
Turn on real PoH in perf testnets (#4407)
* Turn on real PoH in perf testnets

* enable real PoH for all testnets except "testnet"
2019-05-23 13:22:52 -07:00
Michael Vines 77efe95730
Order "install" correctly 2019-05-20 13:54:15 -07:00
Michael Vines 6d418aa3f1
Use rust_stable 2019-05-20 10:48:48 -07:00
Michael Vines 20b2be6e0b
Enable real PoH on beta testnet as well 2019-05-18 19:45:00 -07:00
Michael Vines cbebc7a80c
Expand shortArgs correctly 2019-05-18 19:00:48 -07:00
Michael Vines 392a39dd54
Poh subsystem cleanup, genesis plumbing, enable real PoH on edge testnet (#4292)
* Remove unused PohServiceConfig::Step

* Clarify variable name

* Poh::hash() now takes an iteration counter

* man -> max

* Inline functions with single call site

* Move PohServiceConfig into GenesisBlock

* Add plumbing to enable real PoH on testnets

* Batch hashes to improve PoH hash rate

* Ensure a constant hashes_per_tick

* Remove PohEntry mixin field

* Poh/PohEntry no longer maintains tick_height

* Ensure a constant hashes_per_tick

* ci/localnet-sanity.sh: Use real PoH

* Rework Poh/PohService to keep PohRecorder unlocked as much as possible while hashing
2019-05-18 14:01:36 -07:00
Michael Vines 458ae3fdac Switch to instances with AVX-512 if possible for better interop with dev machines (#4328)
automerge
2019-05-17 20:06:07 -07:00
Rob Walker 431cc82032
add Transaction::partial_sign() (#4333)
* add partial sign

* nits
2019-05-17 18:55:57 -07:00
Jack May 9271ba0039
Cleanup Rust BPF program building (#4318) 2019-05-16 17:35:42 -07:00
Rob Walker 87414de3e2
switch over to passive stakes (#4295)
* add failing test

* switch over to passive stakes

* test multiple stakers
2019-05-16 08:23:31 -07:00
Michael Vines 915956b94b Remove disable leader rotation option (#4299)
automerge
2019-05-15 15:16:45 -07:00
Sagar Dhawan 5e91f8f59d
Update reported tx count to exclude errors (#4201) 2019-05-13 13:23:52 -07:00
Michael Vines 06378d6db6
Refine killNode logging 2019-05-12 21:21:31 -07:00
Michael Vines 1dce5976cf
Disable node restart in localnet-sanity.sh 2019-05-12 21:21:31 -07:00
Michael Vines 1afccb7351
Add more regions to the testnet 2019-05-11 14:12:13 -07:00
Jack May f567877d1d
Cleanup metrics (#4230) 2019-05-10 08:33:58 -07:00
Rob Walker a80176496d
add /target/ to .gitignore files for all crates (#4217)
* add /target/ to .gitignore files for all crates

* shellcheck
2019-05-08 12:15:05 -07:00
Michael Vines f690c64375
Disable solana-upload-perf until performance can be debugged (#4210) 2019-05-07 23:02:09 -07:00
Michael Vines b0f2220ef6
Fix solana-upload-perf log folding. Upload bench output too (#4208) 2019-05-07 22:30:42 -07:00
Michael Vines 908b48bf0e
Increase test-stable build timeout 2019-05-07 22:23:43 -07:00
Michael Vines 2621aeee82
Set default wallet rpc port correctly 2019-05-07 11:37:51 -07:00
Michael Vines 88fdba5aca
Temp: bump test-bench timeout 2019-05-06 10:00:00 -07:00
Michael Vines 9b50583641
wallet: add --url, remove --host/--rpc-host/--rpc-port/-rpc-tls (#4153)
Also by default the wallet now talks to testnet.solana.com instead of
localhost
2019-05-06 07:38:26 -07:00
Michael Vines 7fe3c75c6b
Add a node-specific ip echo service to remove dependency on ifconfig.co (#4137) 2019-05-03 11:01:35 -07:00
Michael Vines c8ed41167a
Factor tune_system() out of multinode-demo/ (#4138)
* Remove x bit from ulimit-n.sh

* Factor tune_system() out of multinode-demo/
2019-05-03 10:40:02 -07:00
Rob Walker ffb15578ce
remove cargo install cargo-audit from CI (#4123) 2019-05-02 15:35:47 -07:00
Rob Walker abcbbb925f
push latest, too (#4131) 2019-05-02 15:33:08 -07:00
Rob Walker 059755fe59
install mdbook and svgbob_cli (#4128) 2019-05-02 15:32:31 -07:00
Rob Walker 37b5c6afaa
install cargo audit (#4122) 2019-05-02 13:16:21 -07:00
Rob Walker 7f75cc8906
update nightly to 2019-05-01 (#4111)
* update nightly to 2019-05-01

* cargo fmt

* cargo fmt

* increase bench timeout
2019-05-01 20:08:42 -07:00
Rob Walker a7d18125d3
install grcov (#4097) 2019-05-01 14:27:17 -07:00
Michael Vines 21f845ed39
Use more -w 2019-04-30 09:57:14 -07:00
Michael Vines 7a369df9a7
Add flag to skip slow extras when deploying a large testnet 2019-04-30 09:26:50 -07:00
Michael Vines d21fa4a177
v0.14: various net/ fixes for large clusters (#4080)
* net.sh: Add -F to discard validator nodes that didn't bootup successfully

* Relax sanity node count when validator bootup failure is permitted

* Less sanity for testnet-demo

* net.sh: Add -F to discard validator nodes that didn't bootup successfully
2019-04-29 21:38:32 -07:00
Jack May c545e812d0
Expand bank benches to include async/sync and native_loader (#4026) 2019-04-29 13:09:11 -07:00
Michael Vines c3ec5ad846
testnet-demo: use more low quota nodes 2019-04-29 12:18:39 -07:00
Michael Vines e2e55f81d0
Increase testnet-demo node count a little 2019-04-29 09:09:55 -07:00
Michael Vines 0cc3956693
testnet-demo now runs across more GCE zones (#4053)
* testnet-demo now runs across more GCE zones

* Save zone info to config file

* Add geoip whitelist for common data centers

* Skip more of start

* Include -x for config

* Fetch private key from first validator node if necessary

* Correct -r propagation
2019-04-28 19:50:52 -07:00
Michael Vines 0b7269b64e
Switch testnet-demo to influxcloud 2019-04-27 22:12:50 -07:00
Michael Vines 457a2d948b
Correct us-central1-b zone name 2019-04-27 21:43:18 -07:00
Michael Vines 528bdf34fd
testnet-demo: skip over validator nodes that fail to boot 2019-04-27 21:34:23 -07:00
Michael Vines 9c1fd55768
testnet-demo: add more GCE zones, remove client 2019-04-27 16:52:09 -07:00
Michael Vines 4a5837a286
Add " 2019-04-27 07:41:21 -07:00
Michael Vines d36af917ea
Swap testnet-beta and testnet configuration 2019-04-26 23:24:35 -07:00
Michael Vines c81733b41a
Add testnet-demo configuration 2019-04-26 22:59:26 -07:00
Michael Vines b6558a2ef3
Remove created lockfile 2019-04-26 21:36:20 -07:00
Michael Vines 634d8e25ee
testnet-deploy.sh updates 2019-04-26 21:29:42 -07:00
Michael Vines fea212e64e
Initialize stopNetwork var 2019-04-26 21:10:36 -07:00
Dan Albert 3e678511d2
Add enable/disable key value pairs into the steps block (#4018) 2019-04-26 14:26:05 -06:00
Michael Vines 4ce2105548 Switch from a S3 URL to release.solana.com for release assets (#4017)
automerge
2019-04-26 13:06:55 -07:00
Dan Albert 08f0fb1e14
Implement working lockfile for testnet lockout (#4013) 2019-04-26 11:22:23 -06:00
Dan Albert f5f5281f85
Add on-demand functionality to all testnets (#4003)
* Add on-demand functionality to all testnets
2019-04-26 10:02:23 -06:00
Michael Vines 1684a7bd18
Move validators from testnet-beta to testnet (#4011)
* Move validators from testnet-beta to testnet

* Move testnet influxdb datasource to influxcloud
2019-04-26 09:02:12 -07:00
Michael Vines 0add5c1dc8
Move testnet buildkite env variables back into the tree (#3989) 2019-04-25 11:44:58 -07:00
Michael Vines 6293d324db
Spellnig 2019-04-24 07:39:29 -07:00
Michael Vines c1ecfec3b0
Bump stable build timeout 2019-04-23 20:29:14 -07:00
Michael Vines 05bcb7f292
Add stop node command to solana-gossip (#3928) 2019-04-22 14:51:20 -07:00
Pankaj Garg 060793f451
Fix testnet automation scripts (#3886)
- missing machine type since change in gce.sh
2019-04-18 15:12:35 -07:00
Dan Albert 901c74b653
Add packages and fix publish script (#3839)
* Add packages and fix publish script

* Fixup
2019-04-18 09:24:18 -06:00
Michael Vines 9ccd362461
Correct ./net.sh sanity argument order 2019-04-17 18:10:38 -07:00
Michael Vines 78d5ace754
Refactor multinode-demo/ scripts to avoid shipping fullnode-x.sh (#3835) 2019-04-17 18:03:58 -07:00
Pankaj Garg a2c8e3952f
Fixes to TPS calculation and reporting (#3836)
Fixes to TPS calculations and reporting
2019-04-17 15:37:01 -07:00
Michael Vines beb8c7914e
Disable testnet-sanity ledger verification, too slow 2019-04-17 15:19:37 -07:00
Michael Vines e03215c4c0
Remove iterations with leader rotation disabled 2019-04-17 15:07:51 -07:00
Michael Vines ca36a6f4e0
Run sanity only in the zone that contains the bootstrap leader and blockstreamer nodes (#3828) 2019-04-17 14:25:40 -07:00
Greg Fitzgerald 51a2988bb2
Revert "Rename programs to instruction_processors (#3789)" (#3824)
This reverts commit 34344982a9.
2019-04-17 15:05:49 -06:00
Michael Vines eb185b9ea5
testnet-beta sanity no longer tries to check inactive zones 2019-04-17 09:30:41 -07:00
Amr Ali 34344982a9
Rename programs to instruction_processors (#3789)
* Rename programs to instruction_processors

* Updates around the code base to support instruction_processors rename

* Kabab instruction_processors

* Update Cargo.toml files and scripts to use instruction-processors

* Update Cargo.toml to use instruction-processors

* Update CI scripts to use instruction-processors
2019-04-16 22:39:00 +02:00
Michael Vines 63d66ece57
net/ testnet nodes now stake more lamports (#3812)
* Add --bootstrap-leader-lamports

* Generalize --no-stake into --stake NUM

* Use a large stake for net/ fullnodes

* Setup vote account before starting fullnode to avoid mixed log output
2019-04-16 13:03:01 -07:00
Pankaj Garg 8d613f3977
Selectively deploy beta testnet to GCE/AWS or both clouds (#3805) 2019-04-16 10:40:30 -07:00
Michael Vines c67cc694ae
Remove stake from `./net sanity` ephemeral validator (#3797) 2019-04-15 21:42:25 -07:00
Pankaj Garg 819a0c5c7e
Update testnet automation script to reflect changes in metrics (#3779) 2019-04-15 18:56:04 -07:00
Greg Fitzgerald 80f3568062
Upgrade to Rust 1.34.0 (#3781)
* Upgrade to Rust 1.34.0

* Remove redundant closures

Thanks Clippy!
2019-04-15 15:56:08 -06:00
Michael Vines 5e2831f09e Disable cluster restart attempt 2019-04-15 09:59:53 -07:00
Michael Vines 6c9fba058b Reenable validator sanity check for testnet-{beta,edge} 2019-04-15 08:58:29 -07:00
Michael Vines f6aa90e193 Add fullnode --dynamic-port-range option 2019-04-14 07:08:29 -07:00
Michael Vines 5b438d917d Create fullnode-x.sh wrapper script for use with |solana-install run ...| 2019-04-12 17:08:18 -07:00
Michael Vines 2f1b0bf4f5 Add solana-install deployments to the testnets 2019-04-11 10:03:35 -07:00
Rob Walker 58a049ebe5
pick up logs as artifacts (#3721) 2019-04-10 17:05:39 -07:00
Dan Albert a5254a3f7a
Add TESTNET_TAG Env var to buildkite (#3692)
* Add TESTNET_TAG Env var to buildkite
2019-04-09 13:00:45 -07:00
Michael Vines 6ac919c71a Set warn log level only for perf testnets 2019-04-09 11:09:16 -07:00
Pankaj Garg 72b7419e1c
Define list of valid cloud regions for GCE and AWS (#3670) 2019-04-07 14:29:09 -07:00
Pankaj Garg 7baff0920c Propagate cloud env variables to buildkite job 2019-04-07 11:48:25 -07:00
Pankaj Garg d9ecc278b4
Configure cloud zones and nodes from buildkite for beta testnet (#3666) 2019-04-07 08:25:34 -07:00
Pankaj Garg 89efe67e73 Fix the ordering of beta testnet zones 2019-04-05 17:53:31 -07:00
Greg Fitzgerald c3654b0f65 Add sdk benches to ci
And add `-a` to `tee` for more reliable copypasta.
2019-04-05 17:58:11 -06:00
Dan Albert 3fcca5bc0a Suppress shellcheck array expansion warnings 2019-04-05 13:25:14 -07:00
Dan Albert 9d4c6f6aaa Appease shellcheck 2019-04-05 13:25:14 -07:00
Dan Albert d570b08134 Clean up array expansion 2019-04-05 13:25:14 -07:00
Dan Albert 8b6d7129f3 Fix option flag lettering 2019-04-05 13:25:14 -07:00
Dan Albert 50444181c5 Fix arg array ordering and rename network-name option 2019-04-05 13:25:14 -07:00
Dan Albert 0c51f156ae Reverse order of zone arg array building 2019-04-05 13:25:14 -07:00
Dan Albert fe2fb40d88 Add multi-region deploy functionality 2019-04-05 13:25:14 -07:00
Dan Albert 9ba0439593 Add multi-region deploy functionality 2019-04-05 13:25:14 -07:00
Pankaj Garg b33a1fa019 Fix clippy errors 2019-04-05 12:22:10 -07:00
Pankaj Garg 63fd4222aa Fix testnet sanity check for beta testnet 2019-04-05 12:22:10 -07:00
Pankaj Garg ed78c8d3bb Fix beta testnet launch script 2019-04-04 15:16:01 -07:00
Pankaj Garg ef1e5db0ee Force delete all beta testnet nodes before restarting them 2019-04-03 17:58:54 -07:00
Pankaj Garg 2e4acba579 Remove second block streamer from testnet beta 2019-04-02 15:15:11 -07:00
Pankaj Garg f441177840 Deploy beta testnet with 100 nodes across AWS and GCP 2019-04-02 11:21:57 -07:00
Tyera Eulberg 92c66a411b Remove bench-tps converge-only 2019-04-01 23:05:25 -06:00
Tyera Eulberg af97ad3d68 Add solana-gossip module 2019-04-01 23:05:25 -06:00
Pankaj Garg cb3adea94f Increase node count in beta testnet 2019-04-01 11:06:24 -07:00
Stephen Akridge 981e057363 Just test features in core 2019-03-28 21:40:52 -07:00
Pankaj Garg 1d48c4dd45 enable leader rotation in beta testnet 2019-03-28 13:44:44 -07:00