Commit Graph

1307 Commits

Author SHA1 Message Date
Michael Vines 9d25d7611a Protect against unsupported configurations to prevent non-obvious errors later 2018-07-20 09:47:01 -07:00
Michael Vines 1abefb2c7a Pass expected node count to testnet-sanity 2018-07-20 09:47:01 -07:00
Michael Vines 68ca9b2cb8 Generalize testnet deployment scripts 2018-07-20 09:10:28 -07:00
Michael Vines 17d927ac74 Count testnet nodes as a part of sanity 2018-07-19 12:05:21 -07:00
Michael Vines d76d3162e5
Slow down deployment more 2018-07-19 10:11:04 -07:00
Michael Vines d0a2d46923 Don't shellcheck in target/ 2018-07-19 09:41:09 -07:00
anatoly yakovenko fece91c4d1
Test multi node dynamic network ci (#696)
Buildkite automation for multinode test.  This test is ignored by default because it requires a large cpu machine to run.
2018-07-19 07:50:44 -07:00
Michael Vines b2ea2455e2 Disable rolling updates 2018-07-18 21:16:03 -07:00
Michael Vines fc1dfd86d2 Disable coverage again :-/ 2018-07-18 12:54:50 -07:00
Greg Fitzgerald 6ff46540b6 Install llvm-cov on nightly to revive coverage
Towards #433
2018-07-18 12:52:13 -04:00
Michael Vines dbab8792e4 Use real default value 2018-07-18 08:23:59 -07:00
Michael Vines 4eb676afaa Tunnel SOLANA_DEFAULT_METRICS_RATE into Snap nodes 2018-07-18 08:23:59 -07:00
Michael Vines 85d6627ee6 Deploy in one ssh login in a further attempt to avoid hitting GCP login quota 2018-07-17 20:45:52 -07:00
Michael Vines 611a005ec9 Avoid |wait| as it masks failures 2018-07-17 19:52:39 -07:00
Michael Vines 5b0418793e Keep Snap fullnode/drone logs out of syslog, we're too spammy 2018-07-17 15:08:35 -07:00
Michael Vines 2bd48b4207 Display better deploy logs 2018-07-17 09:10:55 -07:00
Michael Vines fdf94a77b4 CUDA is now configurable 2018-07-16 16:23:45 -07:00
Michael Vines 194a84c8dd Add testnet-sanity.sh 2018-07-16 12:17:39 -07:00
Michael Vines 51d932dad1 Connect validators to the right leader 2018-07-16 11:05:01 -07:00
Michael Vines 561d31cc13 Add support for master.testnet.s.c 2018-07-16 10:08:58 -07:00
Michael Vines 4e177877c9 Add more error checking, better logging, avoid hitting GCP login quota 2018-07-15 09:27:25 -07:00
Michael Vines 60848b9d95 Testnet sanity test failures will now turn the build red 2018-07-14 21:27:27 -07:00
Michael Vines cfb3736372
Update buildkite-snap.yml 2018-07-14 17:55:03 -07:00
Michael Vines e8d23c17ca
timeout++ 2018-07-14 15:51:32 -07:00
Michael Vines 751c1eba32 Run wallet-sanity against the new testnet 2018-07-13 22:21:41 -07:00
Michael Vines b0ead086a1 Fix bad copy'n'paste 2018-07-13 13:04:38 -07:00
Michael Vines 28d24497a3 Wait for the leader to initialize before starting the validators 2018-07-13 12:32:24 -07:00
Michael Vines 7105136595 Enable CUDA for the leader node 2018-07-13 11:36:12 -07:00
Michael Vines 54db379bf2 Refresh in parallel 2018-07-13 11:19:31 -07:00
Michael Vines effbf0b978 Add script to refresh testnet nodes 2018-07-13 11:19:31 -07:00
Michael Vines b538b67524
Bump timeout for stable build
When the CI build machine caches are empty stable occasionally needs more than 20m
2018-07-13 09:17:45 -07:00
Michael Vines 2b0f6355af Tagged snap builds now correctly publish to the beta channel 2018-07-12 23:43:59 -07:00
Greg Fitzgerald 0b66a6626a Use docker image's clippy 2018-07-12 09:40:40 -06:00
Greg Fitzgerald e8be4d7eae Add clippy to CI 2018-07-12 09:40:40 -06:00
Michael Vines 84c28a077a Use custom rust nightly image with cargo-cov and clippy pre-installed 2018-07-12 07:25:56 -06:00
Greg Fitzgerald e3882950cf Run benchmarks from Rust stable CI 2018-07-11 11:18:18 -06:00
Michael Vines 0a34cb8023 Include hh:mm in image name 2018-07-09 23:07:07 -06:00
Michael Vines 227aa38c8a Add image --family arg 2018-07-09 23:02:46 -06:00
Anatoly Yakovenko 3a90f138b2 dynamit network test
* cleaned up fullnode api
* added debug_id to ReplicatedData and crdt for debugging
2018-07-03 14:00:39 -06:00
Michael Vines a9e0b27772 Speed up snap build
1. Use pre-installed host rust toolchain
2. Build reference/performance fullnode in same part to avoid rebuilding libraries
3. Merge scripts into same part
2018-07-01 17:47:51 -07:00
Michael Vines fba494343f Save/restore target/ directory between builds 2018-06-30 22:30:57 -07:00
Michael Vines 0b878eccf8 Map HOME to grant docker containers access to the ~/.cargo registry cache 2018-06-30 21:50:15 -07:00
Michael Vines 98772b16d6 Generalize solana-snap build trigger 2018-06-30 21:50:15 -07:00
Michael Vines bb82ff0c80 Don't wanna wait 2018-06-30 20:05:27 -07:00
Michael Vines 71af03dc98 Skip snap build for PRs if nothing under snap/ is modified
Additionally relegate push snap build to a secondary CI pipeline
2018-06-30 20:05:27 -07:00
Michael Vines d63493a852
Grant the snap build more time 2018-06-30 12:20:22 -07:00
Michael Vines 4ffb5d157a Disable coverage until issue #433 is resolved 2018-06-29 17:36:26 -07:00
Stephen Akridge a094507bb8 Lower default benchmarking numbers to make CI timeout 2018-06-29 07:14:47 -06:00
Rob Walker a5ce578c72 ... 2018-06-26 16:23:41 -06:00
Michael Vines ce361c2cdc Add Snap fullnode daemon 2018-06-26 12:32:33 -07:00
Michael Vines be5f2ef9b9 Consolidate CI jobs 2018-06-24 22:28:24 -07:00
Greg Fitzgerald adfcb79387 Force install cargo-cov 2018-06-24 15:34:30 -06:00
Greg Fitzgerald 73c4c0ac5f Revert "cargo-cov installed by default in nightly?"
This reverts commit 6fc601f696.
2018-06-24 15:34:30 -06:00
Greg Fitzgerald 6fc601f696 cargo-cov installed by default in nightly? 2018-06-24 12:17:42 -06:00
Greg Fitzgerald 07111fb7bb Use llvm-cov instead of gcov
@marco-c called this a hack, but since grcov isn't working
out-of-the-box (panics on call to gcov), we'll take a stab at using
llvm-cov.
2018-06-24 12:17:42 -06:00
Greg Fitzgerald a06d2170b0 No need for rustfmt on nightly 2018-06-24 12:17:42 -06:00
Greg Fitzgerald 7f53ea3bf3 Generate coverage with Rust nightly
Fixes #177

Thanks @marco-c!
2018-06-24 12:17:42 -06:00
Michael Vines b2accd1c2a Run snap build sooner to better mask the delay 2018-06-24 10:24:32 -07:00
Michael Vines 33bbfdbc9b Retry flaky coverage/cuda builds on initial failure 2018-06-23 16:17:25 -07:00
Michael Vines 5de54f8853 Make cuda/erasure build logs public 2018-06-23 16:17:25 -07:00
Michael Vines e4782b19a3 Document GCP setup 2018-06-23 02:12:20 -07:00
Michael Vines ec86b1dffa Adapt to GCP-based CI 2018-06-23 02:12:20 -07:00
Michael Vines 30e03feb5f Add initial CI subsystem documentation 2018-06-22 15:30:29 -07:00
Michael Vines 17e8ad110f Temporarily disable failing CI to get back to green 2018-06-22 11:29:31 -07:00
Michael Vines c4a59896f8 Run test-erasure in a container 2018-06-21 13:00:40 -07:00
Michael Vines 3eb1608403 Skip --user if SOLANA_DOCKER_RUN_NOSETUID is set 2018-06-21 12:24:52 -07:00
Michael Vines 8fde70d4dc Erasure tests do not require a CUDA agent 2018-06-21 11:42:37 -07:00
Michael Vines 5a047833ed Run snap publishing directly on CUDA agent
This is necessary until we build a docker image that also contains a CUDA
installation
2018-06-21 11:42:37 -07:00
Michael Vines f6c28e6be1 Update snapcraft docker image contain snapcraft 2.42.1 2018-06-21 11:42:37 -07:00
Michael Vines 89fc0ad7a9 Add convenience script to download performance libraries 2018-06-20 16:48:32 -07:00
Greg Fitzgerald 1c97bf50b6 Fix nightly
No longer ignore failures in the nightly build.
2018-06-19 17:38:04 -07:00
Michael Vines e592243a09 De-double quote 2018-06-19 13:20:47 -07:00
Michael Vines 85b6e7293c Add cleanup script to manage build agent disk space 2018-06-19 12:22:45 -07:00
Michael Vines 75997e6c08 Allow BUILDKITE_BRANCH in containers 2018-06-18 22:51:30 -07:00
Michael Vines 9040d00110 Package solana as a snap 2018-06-18 17:36:03 -07:00
Michael Vines d4807790ff Add snapcraft login credentials
This file was created as follows:
$ snapcraft export-login --snaps solana --channels beta,edge snapcraft.credentials
$ openssl aes-256-cbc -e -in snapcraft.credentials -out snapcraft.credentials.enc
2018-06-18 17:36:03 -07:00
Michael Vines 3f763f99e2 Fail fast in CI when |cargo fmt| says no 2018-06-15 17:10:00 -07:00
Grimes efb23f7cf9 Ensure stuck builds eventually timeout 2018-06-07 19:08:03 -07:00
Grimes 013f4674de Target cuda agents 2018-06-07 19:08:03 -07:00
Stephen Akridge 074c9af020 Shellcheck again 2018-06-05 15:32:25 -06:00
Stephen Akridge 2da2d4e365 More shellcheck 2018-06-05 15:32:25 -06:00
Stephen Akridge 8eb76ab2a5 Fix shellcheck 2018-06-05 15:32:25 -06:00
Stephen Akridge 0339f90b40 Fix gf-complete url and symlinks 2018-06-05 15:32:25 -06:00
Stephen Akridge 6843b71a0d Debug erasure ci script 2018-06-05 15:32:25 -06:00
Stephen Akridge 634408b5e8 Add erasure build to ci 2018-06-05 15:32:25 -06:00
Stephen Akridge b0eab8729f Add erasure ci script 2018-06-05 15:32:25 -06:00
Greg Fitzgerald 3aa2907bd6 Restore shellcheck 2018-06-01 13:43:38 -06:00
Anatoly Yakovenko 9ac7070e08 fix ci 2018-05-30 14:04:48 -06:00
Anatoly Yakovenko 46059a37eb skip shell check 2018-05-30 14:04:48 -06:00
Grimes 86a50ae9e1 Add RUST_BACKTRACE 2018-05-28 22:23:25 -07:00
Grimes 26153d9919 Avoid docker buildkite plugin, which is not supported by bkrun 2018-05-28 22:23:25 -07:00
Grimes 5af922722f Add local buildkite CI runner 2018-05-28 22:23:25 -07:00
Grimes b70d730b32 Support local .a, skip if unable to find .a 2018-05-28 22:23:25 -07:00
Grimes bf4b856e0c Don't fail if CODECOV_TOKEN is undefined 2018-05-28 22:23:25 -07:00
Grimes 0cf0ae6755 s/label:/name:/g 2018-05-28 22:23:25 -07:00
Grimes 29061cff39 Delint existing shell scripts 2018-05-28 05:18:46 -06:00
Grimes b7eec4c89f Lint shell scripts in CI 2018-05-28 05:18:46 -06:00
Grimes 6e35f54738 Simplify environment blocks 2018-05-26 14:38:26 -07:00
Grimes 089294a85e 'ignored' step failures are no longer ignored 2018-05-26 11:00:20 -07:00
Grimes 25c0b44641 Run ignored build step in docker 2018-05-26 11:00:20 -07:00
Greg Fitzgerald 75659ca042 Light up coverage build 2018-05-26 00:36:50 -06:00
Greg Fitzgerald 8d26be8b89 Run benchmarks in nightly
And name functions the same way as test functions
2018-05-26 00:36:50 -06:00
Greg Fitzgerald af4e95ae0f Only check formatting in stable build 2018-05-26 00:36:50 -06:00
Greg Fitzgerald b43ae748c3
Update publish.sh 2018-05-25 16:08:14 -06:00
Greg Fitzgerald 5a45eef1dc
Exit cleanup (#252)
* Ignore record_stage exit reason. We only really care about panic exit versus graceful exit.
* Ignore coverage build in CI
2018-05-24 10:03:17 -06:00
Michael Vines ae29641a18 Run most CI steps in docker 2018-05-22 23:16:25 -07:00
Michael Vines 34514d65bc Add in-tree buildkite pipeline 2018-05-21 23:43:27 -07:00