Commit Graph

985 Commits

Author SHA1 Message Date
Michael Vines 4b42fa2d75
Ensure all builds are triggered on a rust upgrade (#6229) 2019-10-03 16:31:50 -07:00
Michael Vines 4d458a5e00
Keep the build green when there's nowhere to publish 2019-10-03 14:55:04 -07:00
Michael Vines cf2bcee607
Increase testnets to 4 validator nodes to avoid the need for 100% consensus 2019-10-03 09:53:31 -07:00
Michael Vines 586e0a67ef
Suppress nighly safety_doc warning 2019-10-02 22:51:14 -07:00
Michael Vines a20f12865a
Upgrade to rust 1.38 2019-10-02 22:51:14 -07:00
Michael Vines e5a7d08966 Add --expected-genesis-blockhash validator argument (#6174)
automerge
2019-09-29 19:09:24 -07:00
sakridge 75a92d58cb
Featureize move (#5897)
* Featureize move

* Add move featured test
2019-09-27 12:19:06 -07:00
sakridge db05864a69
Add ssh key check (#6149) 2019-09-27 10:55:51 -07:00
Michael Vines b4da83a3ab
Remove CUDA feature (#6094) 2019-09-26 13:36:51 -07:00
Dan Albert 678a5aff83
Remove brace expansion in arg list (#6091) 2019-09-25 12:52:07 -04:00
carllin 229836511d Remove local_cluster tests from stable-perf job, removee other tests from local-cluster job (#6067) 2019-09-24 19:05:25 -07:00
Michael Vines 61d7467ba8
Flip order of arg to ensure -t sticks 2019-09-23 22:20:22 -07:00
Michael Vines 433b0808e4
Remove the _/deps symlink, just copy instead (#6020) 2019-09-23 09:16:56 -07:00
Michael Vines ab60c578b9
Unconditionally redeploy the edge testnet hourly to better exercise snapshot restarts 2019-09-21 09:28:59 -07:00
Ryan Shea 050021cf77 Add SVGs for Gitbook (#6009) 2019-09-21 07:59:36 -07:00
Michael Vines 020d34187c
Fetch logs on redeploy failure 2019-09-20 15:45:47 -07:00
Michael Vines 33e2af341a
Add deps/ symlink so solana-validator-cuda can find native programs 2019-09-20 15:26:49 -07:00
Michael Vines bb9f07183b
Only fetch logs on sanity failure 2019-09-20 14:47:56 -07:00
Michael Vines 5dd3a07a23
Avoid changing the current working directory 2019-09-20 12:46:29 -07:00
Michael Vines 58a6c9a5f0
Adjust path to perf-libs 2019-09-20 12:27:09 -07:00
Michael Vines 7053978861
Fix cp src 2019-09-20 12:15:05 -07:00
Michael Vines 4b1de02bbb
solana-validator-cuda wrapper is now net.sh compatible 2019-09-20 11:37:45 -07:00
Michael Vines 890be36fd3
Fix check 2019-09-20 08:19:57 -07:00
Michael Vines 54cf9aaa1e
Preserve public network flag when testnet-edge is restarted 2019-09-19 23:02:47 -07:00
Michael Vines 1d0be265d9
Add explicit validator-cuda crate (#5985) 2019-09-19 20:50:34 -07:00
Sagar Dhawan d379786c90
Fix bind errors (#5986)
* Add ability to bind to a common tcp/udp port

* Extend port range for local-net sanity and fix validator executable
2019-09-19 17:16:22 -07:00
Michael Vines 05ada97d00
Clean up log folding 2019-09-19 13:44:59 -07:00
Rob Walker 8fa28f965c
clear config (#5980) 2019-09-19 12:10:29 -07:00
Michael Vines fee5c6c057
testnet-edge/testnet-beta now update while preserving the ledger (#5979)
* Check if an update is current before deploying it again

* Add (new) update command to deploy testnet updates

* Add --deploy-if-newer flag to permit conditional net updates
2019-09-19 12:03:47 -07:00
Michael Vines 8d94972d88
Publish version information as stand-alone file for easy access 2019-09-19 10:26:51 -07:00
Michael Vines 1650519962
SOLANA_CUDA=1 works again (#5968)
* SOLANA_CUDA=1 works again

* Minor comment reformat

* Set SOLANA_CUDA=1 explictly
2019-09-19 08:52:00 -07:00
carllin 86213d38fe
Release builds for local cluster tests (#5891)
* Release builds for test

* Remove setting thread count in local cluster

* Increase timeout

* Move local cluster to separate job

* Extract out local cluster test from bench-tps

* Make local cluster inaccessible from outside crate

* Update test-stable.sh to exclude local_cluster in stable, include it in local-cluster CI job

* Move bench-exchange to local cluster

* Remove local cluster from coverage
2019-09-18 13:10:50 -07:00
Dan Albert 8b99e6dfbe
Narrow wildcard matching for solana tarball (#5950) 2019-09-18 12:28:13 -07:00
Jack May c90595cba1
Cleanup nits (#5914) 2019-09-17 10:21:22 -07:00
Michael Vines de1636c792 Enable --limit-ledger-size on testnets (#5927)
automerge
2019-09-17 10:05:41 -07:00
Sagar Dhawan c1d788880d
Limit Rayon threadpool threads (#5871) 2019-09-12 11:39:39 -07:00
Jack May 176c7d8b13
Pull all the Rust BPF tests into a single workspace so they share dependencies (#5878) 2019-09-11 14:55:58 -07:00
Michael Vines bf1ecc2441
Remove ledger verification, it's racy and essentially globaly disabled already (#5867) 2019-09-11 10:53:10 -07:00
Michael Vines ee0c570d54 Rework solana-validator-cuda to automatically prepare the perf-libs env (#5849)
automerge
2019-09-08 21:20:08 -07:00
Michael Vines 11cec8f24e
Move appveyor off the system drive 2019-09-08 10:05:58 -07:00
Jack May e5f902369c
Rust BPF programs depend on Solana SDK (#5819) 2019-09-06 09:20:14 -07:00
Rob Walker b6da5a3f47
build all tests (#5785)
* build all tests

* try again

* try again
2019-09-04 17:01:38 -07:00
Jack May 5fb2d7a98f
Add libstd support to Rust BPF (#5788) 2019-09-04 16:00:11 -07:00
Rob Walker 933e835838
add stake lockup (#5782)
* add stake lockup

* fixup
2019-09-04 13:34:09 -07:00
sakridge 34155fc36f
Long-running banking benchmark (#5075) 2019-08-30 11:10:32 -07:00
Pankaj Garg f41fb7d772
Ignore cargo audit advisory RUSTSEC-2019-0013 (#5713) 2019-08-28 14:38:46 -07:00
Michael Vines 9f2119920c
Revert "Add debug to help track down ci/localnet-sanity.sh instability"
This reverts commit 7aaf5bc02c.
2019-08-27 14:28:22 -07:00
Michael Vines 7aaf5bc02c
Add debug to help track down ci/localnet-sanity.sh instability 2019-08-27 08:49:04 -07:00
Rob Walker 3d098d2ed9 turn cargo audit version back on (#5651) 2019-08-26 19:50:56 -07:00
Michael Vines 97db802be3
Add net-tools for netstat 2019-08-26 16:17:04 -07:00
Michael Vines 1abdeca4c1
Add TESTNET_DB_HOST default 2019-08-24 07:38:19 -07:00
Michael Vines 881a6dc0f7
Revert "Bump stable timeout"
This reverts commit bde4ba04af.
2019-08-23 17:14:08 -07:00
Michael Vines bde4ba04af
Bump stable timeout 2019-08-23 11:44:08 -07:00
Rob Walker 52f6da5cee
upgrade rust to 1.37 (#5611) 2019-08-23 08:55:51 -07:00
Michael Vines f402b477b2
🐌 Publish crates for even longer 2019-08-16 21:52:12 -07:00
Michael Vines 9f6c9c428b
Move genesis/snapshot archive download into Rust (#5515) 2019-08-14 19:25:22 -07:00
TristanDebrunner 687818aad6
Run sdk-c through clippy separately (#5504) 2019-08-12 16:41:17 -06:00
Michael Vines d59aae4849
Disable validator sanity for edge/beta 2019-08-10 13:16:06 -07:00
Rob Walker 784943ecab
unignore RUSTSEC 2019 0011 (#5365) 2019-08-08 14:53:02 -07:00
Michael Vines 06d8c06119
Allow TdS CHANNEL_OR_TAG to be overridden from buildkite UI 2019-08-05 17:22:06 -07:00
Michael Vines b5aa03dd7c
Rename --config-dir to --ledger (progress towards deleting validator.sh) (#5423) 2019-08-05 12:42:52 -07:00
Michael Vines 09ca92d416
Surface --voting-keypair to release users (#5420)
* Remove 'configured_flag' for vote/storage account, instead detect if they exist with the wallet

* Require --voting-keypair when using release binaries
2019-08-05 10:39:16 -07:00
Michael Vines 56ed033233
Remove unused var 2019-08-04 21:29:20 -07:00
Michael Vines e56efe237c
Move testnet from ec2 tp gcp 2019-08-04 21:02:27 -07:00
Michael Vines 3f0ff45de0
Move edge/beta testnets from ec2 to gcp 2019-08-04 20:42:28 -07:00
Michael Vines 6ec0318bae
Reduce AWS node count 2019-08-03 23:50:52 -07:00
Michael Vines 911dee24c5 Give a unique port range for each validator node (#5397)
automerge
2019-08-01 14:37:59 -07:00
Michael Vines 5212b2716c
Don't rebuild/retest release tags (#5385) 2019-08-01 13:11:42 -07:00
Pankaj Garg 149a63100d
remove no-snapshot option from tds testnet (#5368) 2019-07-31 14:51:54 -07:00
Michael Vines 1d6bafbc77
Move tds to edge (#5366) 2019-07-31 14:18:05 -07:00
Michael Vines bd7e269280 Kill rsync (#5336)
automerge
2019-07-30 22:43:47 -07:00
Michael Vines 8a5045f05c
Bump timeouts for publish docker/tarball builds 2019-07-30 20:09:47 -07:00
Michael Vines 2214d2dbb5
Eject bootstrap-leader support from fullnode.sh (#5301) 2019-07-29 21:25:28 -07:00
Michael Vines 506b305959
Move coverage back to the default queue (#5318) 2019-07-28 22:20:54 -07:00
Michael Vines e83efcfc80
Tidy test-checks.sh (#5319) 2019-07-28 22:19:03 -07:00
sakridge 4f1c881227
Add --use_move mode to bench-tps (#5311)
* Add --use_move mode to bench-tps

substitute for global flag.

* Use cuda queue for coverage build.
2019-07-28 10:43:42 -07:00
Greg Fitzgerald 64c770275b
Integrate Move VM into main build (#5229)
* Integrate Move VM into top-level build

* Switch to protoc-free libra
2019-07-27 06:59:46 -06:00
Michael Vines 5f09aa36b3
Drop code supporting no leader rotation (#5286) 2019-07-26 09:26:27 -07:00
Michael Vines fbfe1a59a6
bump timeout 2019-07-24 13:53:08 -07:00
Michael Vines d647a4ec57
Bump publish-crate.sh timeout 2019-07-23 22:12:34 -07:00
Michael Vines 17b9ea3e3b
Update buildkite-secondary.yml 2019-07-23 07:33:13 -07:00
Michael Vines 88d4d1db7a
Update buildkite.yml 2019-07-23 00:20:05 -07:00
Michael Vines cab4c88c71
Bump timeouts 2019-07-22 23:52:30 -07:00
Michael Vines 4ec5a899f5
Check longer 2019-07-22 23:41:42 -07:00
Michael Vines 2c8e0bcf87
Introduce --config-dir to avoid shipping clear-config.sh (#5241) 2019-07-22 22:59:02 -07:00
Dan Albert a0ccdccff1 Call book/build.sh from docker (#5237)
* Call book/build.sh from docker

* debug

* Revert "debug"

This reverts commit 32986b73b7dd1c8866051ea06544e4140ff0d354.
2019-07-22 21:37:43 -07:00
Dan Albert 735c7c9841
Add manual publish for book and create book-beta (#5112) 2019-07-22 17:45:00 -06:00
TristanDebrunner 038c6ea0a7 Bump solana_libra to v0.0.0.1 (#5225)
automerge
2019-07-22 14:17:06 -07:00
Rob Walker 43bf176fab
more granular check for memoffset ignore in audit (#5219)
* more granular check for memoffset ignore in audit

* debugggin

* debugggin

* debugggin

* debugggin

* debugggin
2019-07-22 13:36:27 -07:00
Greg Fitzgerald 186b514ebb Embed Move (#5150)
automerge
2019-07-22 12:01:52 -07:00
Michael Vines 02c7b89a8f
Update location of TdS external accounts file url 2019-07-21 17:38:15 -07:00
Michael Vines 1b5a332239
Adjustments for appveyor server 2019-07-21 09:21:28 -07:00
Greg Fitzgerald 9b1471acae
Upgrade to Rust 1.36.0 (#5206)
* Upgrade to Rust 1.36.0

* Move test-checks.sh back to stable

* update nightly version to 2019-07-19

* use both nightly and stable for checks
2019-07-20 18:53:16 -06:00
Rob Walker e6b525a614
disable audit until crossbeam epoch release (#5208) 2019-07-20 15:50:26 -07:00
Michael Vines 6969ece2dd
Ensure CI_OS_NAME is set for appveyor server 2019-07-19 20:06:32 -07:00
Dan Albert c95cda51c9
Fix internal node lamport funding and staking allocation logic (#5192)
* Plumb node funding from genesis

* Cleanup naming convention

*  Fix balance vs stake yml file logic

* Lamps not Stakes
2019-07-19 12:51:38 -06:00
Michael Vines 1e1cb7c57c
Select stable rust version (#5180) 2019-07-18 21:19:07 -07:00
Michael Vines 57036fbcc1
Check harder on crates.io for recently published crates (#5136) 2019-07-16 19:09:49 -07:00
Michael Vines 7e60ee39d9
Add missing dash 2019-07-16 07:27:35 -07:00
Dan Albert db7e78bf99
Add node zone and count to ENV (#5100)
* Add node zone and count to ENV
2019-07-14 22:40:18 -06:00
Dan Albert adecd4cfdc
Pull testnet vars up to buildkite env (#5098) 2019-07-14 20:27:49 -06:00
Dan Albert 440d006ec1
Plumb --no-snapshot in from CI (#5077)
* Plumb --no-snapshot in from CI
2019-07-14 13:17:30 -06:00
Michael Vines d2b21ce8d0
Stop trying to publish crates that are unpublishable 2019-07-12 21:53:09 -07:00
Michael Vines b01990d480
Avoid trying to republish crates already on crates.io 2019-07-12 21:43:16 -07:00
Michael Vines d7fdfb7e21
Give publish-crate more time 2019-07-12 20:28:10 -07:00
Rob Walker 0d27515d09
tmp dirs target to farf (#5079) 2019-07-12 18:28:42 -07:00
Dan Albert 5ac173d208
Enable GPUs and secondary disks for TdS net, pull external account file (#5031)
* Enable V100 GPUs over 3 regions for TdS cluster

* Turn on secondary config-local drive for tds net

* Enable long args bypass for GPU machine details

* bypass quoted long arg

* Pull external account file from wget

* typo

* Symlink config-local instead of changing the path variables

* Fix link path
2019-07-12 09:38:47 -06:00
Dan Albert e4861f52e0
Add support for additional disks for config-local (#5030)
* Add support for additional disks for config-local

* Restore wrongly deleted lines

* Shellcheck

* add args in the right place dummy

* Fix nits

* typo

* var naming cleanup

* Add stub function for remaining cloud providers
2019-07-11 16:23:32 -06:00
Michael Vines 41d0db078e
Wait for bootstrap leader to initialize before starting other validators (#5027) 2019-07-10 21:03:48 -07:00
Dan Albert e563a4dda3
Rename tds-testnet to tds (#5008) 2019-07-10 10:26:24 -06:00
Michael Vines aebd70ddce
Move letsencrypt arg to create_args 2019-07-09 21:27:12 -07:00
Michael Vines 7d80cfb17a
Include --letsencrypt ($1) 2019-07-09 20:54:11 -07:00
Michael Vines 0a949677f0 net/ plumbing to manage LetsEncrypt TLS certificates (#4985)
automerge
2019-07-09 15:45:46 -07:00
Dan Albert 1ca7e9f67b
Add testnet-tds support to testnet manager (#4762)
* Add testnet-tds support to testnet scripts
2019-07-09 14:39:55 -06:00
Jack May f9a2254688
Split out Rust BPF no-std stuff (#4968) 2019-07-08 20:28:05 -08:00
Sagar Dhawan 55b8ff72d0
Enable parallel tests to reduce test time (#4919)
* Add crate to serialize some tests

* Ignore unused attribute warning

* Enable parallel run in CI

* Try to fix lograte tests

* Fix interdependent counter tests
2019-07-02 17:35:03 -07:00
Michael Vines 4a10fd3272
Upload all artifacts 2019-06-26 14:37:18 -07:00
Michael Vines 9e2eb9e4f9
Set CI_REPO_SLUG correctly for the solana-secondary pipeline 2019-06-26 14:37:18 -07:00
Michael Vines 36aa876833 Avoid linking with CUDA directly 2019-06-21 15:26:22 -07:00
Jack May e59b53dfa8
BPF rust language updates (#4752) 2019-06-20 16:07:12 -07:00
Michael Vines 6854c64a09 Bump coverage build timeout 2019-06-20 09:24:11 -07:00
Jack May b430762a23
check rust programs (#4688) 2019-06-20 07:43:31 -07:00
Rob Walker f8523db51d
Revert "remove build --all (#4737)" (#4745)
This reverts commit 63503ad589.
2019-06-19 23:21:10 -07:00
Rob Walker 63503ad589
remove build --all (#4737)
* remove build  all

* Update test-stable.sh
2019-06-19 17:36:25 -07:00
Michael Vines 8bd1c57448 Defer CUDA selection to env.sh, also always create env.sh 2019-06-19 08:47:27 -07:00
Michael Vines 5683282c94 Update to solana-perf-libs v0.14.0, with support for both CUDA 10.0 and 10.1 2019-06-18 10:41:03 -07:00
Michael Vines bd633d2b81 Add CI_REPO_SLUG (#4714)
automerge
2019-06-17 20:42:09 -07:00
Jack May 2a7a9fdf03
Re-org SDK dir (#4690) 2019-06-17 11:04:38 -07:00
Jack May b91ad6fd96
Clear C dependency files from cache (#4692) 2019-06-14 19:11:16 -07:00
Michael Vines a016bc2736 Add infra to publish metrics tarball 2019-06-13 10:00:24 -07:00
Michael Vines dd1c3514a8
Use auto hashes-per-tick config for testnet testnet 2019-06-12 08:40:56 -07:00
Michael Vines 0dbe5ee559
Add chacha-sys crate (#4620)
* af9ff9c7f9/src/cpu-crypt

* Add chacha-sys crate

* Remove chacha feature

* Remove erasure feature

* Add .gitignore
2019-06-10 07:14:02 -07:00
Michael Vines 91b23f8316
Switch from solana-install to solana-install-init 2019-06-08 19:24:36 -07:00
Michael Vines 8676b5d40c
Use more -f 2019-06-07 22:18:55 -07:00
Michael Vines 97b9d57b62
shellcheck 2019-06-07 21:35:51 -07:00
Michael Vines 487826a539
Deploy windows updates 2019-06-07 20:46:58 -07:00
Michael Vines 4acb764589
Pick up .exe extension 2019-06-07 20:13:47 -07:00
Michael Vines 9de4c1dcd9
Add slack notification 2019-06-07 19:58:52 -07:00
Michael Vines e8c4302d6d
Add Appveyor CI for Windows release artifacts 2019-06-07 19:47:26 -07:00
Michael Vines a9f73ea321 solana-keygen no longer blindly overwrites a keypair, or assumes "new" (#4599)
automerge
2019-06-07 17:54:54 -07:00
Jack May 66c41b3e8c Enable iter test (#4542)
automerge
2019-06-07 16:44:14 -07:00
Michael Vines 8e46c44f3e
Deploy mac OS solana-install update package to testnets (#4595) 2019-06-07 12:59:58 -07:00
Michael Vines fdaa939892
Bring in Travis CI to build Windows and mac OS release binaries (#4591)
* Bring in Travis CI to build Windows and mac OS release binaries

* Update .travis.yml
2019-06-07 11:32:47 -07:00
Pankaj Garg ead947e710
Change default setting for real PoH in testnet scripts (#4573) 2019-06-06 12:49:46 -07:00
Michael Vines 53275cc678
Introduce normalized CI environment vars: ci/env.sh (#4571) 2019-06-06 12:20:47 -07:00
Michael Vines ee42040e6b Give coverage build more time (#4572)
automerge
2019-06-06 11:07:32 -07:00
Michael Vines 2b98a16ec6
Upgrade to rust stable 1.35.0 (#4568) 2019-06-06 09:24:38 -07:00
Michael Vines aa4a7b0c73
Disable |solana-install| check for edge/beta testnets (#4564)
The release tarball URL changes for these testnets, which causes the
normal |solana-install| check to fail and the testnet is unnecessarily
rebooted.
2019-06-05 15:31:29 -07:00
Michael Vines e3365529de
Enable transaction fees for multinode-demo/ and net/ (#4527)
* Collect fees at the end of a slot

* Enable transaction fees for multinode-demo/ and net/
2019-06-04 14:51:52 -07:00
Dan Albert 41daf1ef0c
Wait for crate to be locatable on crates.io after uploading (#4526)
* Wait for crate to be locatable on crates.io after uploading

* Fix nits and shellcheck

* shellchecker
2019-06-03 19:54:41 -06:00