Michael Vines
71eb5bdecc
Factor out vm_foreach
2018-07-28 12:37:29 -07:00
Michael Vines
80a02359f7
Add script to audit for security vulnerabilities
2018-07-26 13:42:12 -07:00
Michael Vines
ab3968e3bf
Dedup
2018-07-26 11:45:58 -07:00
Michael Vines
42ebf9502a
Agent cleaning is now performed in a separate pipeline
2018-07-26 11:37:36 -07:00
Michael Vines
bd4fcf4ac6
Clean out stale buildkite agent build directories
2018-07-26 11:37:36 -07:00
Michael Vines
4dceb73909
Reinstall client nodes in the background to speed up deploys
2018-07-26 09:49:00 -07:00
Rob Walker
5115cd7798
large network back to erasure
2018-07-25 20:45:16 -07:00
Michael Vines
4c4659be13
Add more stdout
2018-07-25 16:38:21 -07:00
Michael Vines
1b79fe73a1
Emit a metrics datapoint if bench-tps terminates
2018-07-25 15:55:02 -07:00
Michael Vines
5fa072cf16
Avoid quotes around net name
2018-07-25 15:55:02 -07:00
Stephen Akridge
80ecef2832
Add --sustained to ci testnet deploy script
2018-07-25 10:16:46 -07:00
Michael Vines
dcce475f0b
Progagate logging configuration to client nodes
2018-07-24 21:40:02 -07:00
Rob Walker
8f046cb1f8
disable erasure for large network testing
2018-07-24 16:54:52 -07:00
Michael Vines
735a0ee16d
Switch back to running bench-tps in 10 minute iterations
2018-07-24 15:43:25 -07:00
Rob Walker
940caf7876
test large network with erasure
2018-07-24 13:04:34 -07:00
Michael Vines
782aa7b23b
Cap at 4 threads
2018-07-24 11:35:03 -07:00
Michael Vines
7a71adaa8c
Adjust threads by the number of cpus
2018-07-23 21:17:36 -07:00
Michael Vines
ce8796bc2e
Correctly calculate the expected number of full nodes
2018-07-23 19:55:09 -07:00
Michael Vines
c7e1409f7b
Not so much |set -x|
2018-07-23 19:55:09 -07:00
Michael Vines
9de9379925
Add support more more than 1 client node
2018-07-23 19:34:34 -07:00
Michael Vines
96a6e09050
Enable metrics in the TPS client
2018-07-23 16:51:39 -07:00
Michael Vines
7ebbaaeb2d
Use bench-tps default duration
2018-07-22 16:26:49 -07:00
Michael Vines
5d065133ef
Add data point for testnet startup and shutdown
2018-07-21 23:27:24 -07:00
Michael Vines
d403808564
Restart `solana.bench-tps` every 10 minutes to work around memory leak
...
cc: #728
2018-07-21 19:48:13 -07:00
Michael Vines
3ffdca193d
Rename client-demo to bench-tps catchup
2018-07-21 15:46:03 -07:00
Greg Fitzgerald
637f890b91
Rename client-demo to bench-tps
2018-07-21 11:36:20 -04:00
Michael Vines
009d5adcba
Tell the client to transact for 1 hour blocks
2018-07-20 17:52:19 -07:00
Michael Vines
52c55a0335
Log to /tmp/solana.log for easy runtime inspection of client activity
2018-07-20 17:45:13 -07:00
Michael Vines
120add0e82
Add support for a client node running continuous transactions on the net
2018-07-20 17:07:36 -07:00
Michael Vines
9cf0bd9b88
Adjust variable name
2018-07-20 09:50:24 -07:00
Michael Vines
9d25d7611a
Protect against unsupported configurations to prevent non-obvious errors later
2018-07-20 09:47:01 -07:00
Michael Vines
1abefb2c7a
Pass expected node count to testnet-sanity
2018-07-20 09:47:01 -07:00
Michael Vines
68ca9b2cb8
Generalize testnet deployment scripts
2018-07-20 09:10:28 -07:00
Michael Vines
17d927ac74
Count testnet nodes as a part of sanity
2018-07-19 12:05:21 -07:00
Michael Vines
d76d3162e5
Slow down deployment more
2018-07-19 10:11:04 -07:00
Michael Vines
d0a2d46923
Don't shellcheck in target/
2018-07-19 09:41:09 -07:00
anatoly yakovenko
fece91c4d1
Test multi node dynamic network ci ( #696 )
...
Buildkite automation for multinode test. This test is ignored by default because it requires a large cpu machine to run.
2018-07-19 07:50:44 -07:00
Michael Vines
b2ea2455e2
Disable rolling updates
2018-07-18 21:16:03 -07:00
Michael Vines
fc1dfd86d2
Disable coverage again :-/
2018-07-18 12:54:50 -07:00
Greg Fitzgerald
6ff46540b6
Install llvm-cov on nightly to revive coverage
...
Towards #433
2018-07-18 12:52:13 -04:00
Michael Vines
dbab8792e4
Use real default value
2018-07-18 08:23:59 -07:00
Michael Vines
4eb676afaa
Tunnel SOLANA_DEFAULT_METRICS_RATE into Snap nodes
2018-07-18 08:23:59 -07:00
Michael Vines
85d6627ee6
Deploy in one ssh login in a further attempt to avoid hitting GCP login quota
2018-07-17 20:45:52 -07:00
Michael Vines
611a005ec9
Avoid |wait| as it masks failures
2018-07-17 19:52:39 -07:00
Michael Vines
5b0418793e
Keep Snap fullnode/drone logs out of syslog, we're too spammy
2018-07-17 15:08:35 -07:00
Michael Vines
2bd48b4207
Display better deploy logs
2018-07-17 09:10:55 -07:00
Michael Vines
fdf94a77b4
CUDA is now configurable
2018-07-16 16:23:45 -07:00
Michael Vines
194a84c8dd
Add testnet-sanity.sh
2018-07-16 12:17:39 -07:00
Michael Vines
51d932dad1
Connect validators to the right leader
2018-07-16 11:05:01 -07:00
Michael Vines
561d31cc13
Add support for master.testnet.s.c
2018-07-16 10:08:58 -07:00
Michael Vines
4e177877c9
Add more error checking, better logging, avoid hitting GCP login quota
2018-07-15 09:27:25 -07:00
Michael Vines
60848b9d95
Testnet sanity test failures will now turn the build red
2018-07-14 21:27:27 -07:00
Michael Vines
cfb3736372
Update buildkite-snap.yml
2018-07-14 17:55:03 -07:00
Michael Vines
e8d23c17ca
timeout++
2018-07-14 15:51:32 -07:00
Michael Vines
751c1eba32
Run wallet-sanity against the new testnet
2018-07-13 22:21:41 -07:00
Michael Vines
b0ead086a1
Fix bad copy'n'paste
2018-07-13 13:04:38 -07:00
Michael Vines
28d24497a3
Wait for the leader to initialize before starting the validators
2018-07-13 12:32:24 -07:00
Michael Vines
7105136595
Enable CUDA for the leader node
2018-07-13 11:36:12 -07:00
Michael Vines
54db379bf2
Refresh in parallel
2018-07-13 11:19:31 -07:00
Michael Vines
effbf0b978
Add script to refresh testnet nodes
2018-07-13 11:19:31 -07:00
Michael Vines
b538b67524
Bump timeout for stable build
...
When the CI build machine caches are empty stable occasionally needs more than 20m
2018-07-13 09:17:45 -07:00
Michael Vines
2b0f6355af
Tagged snap builds now correctly publish to the beta channel
2018-07-12 23:43:59 -07:00
Greg Fitzgerald
0b66a6626a
Use docker image's clippy
2018-07-12 09:40:40 -06:00
Greg Fitzgerald
e8be4d7eae
Add clippy to CI
2018-07-12 09:40:40 -06:00
Michael Vines
84c28a077a
Use custom rust nightly image with cargo-cov and clippy pre-installed
2018-07-12 07:25:56 -06:00
Greg Fitzgerald
e3882950cf
Run benchmarks from Rust stable CI
2018-07-11 11:18:18 -06:00
Michael Vines
0a34cb8023
Include hh:mm in image name
2018-07-09 23:07:07 -06:00
Michael Vines
227aa38c8a
Add image --family arg
2018-07-09 23:02:46 -06:00
Anatoly Yakovenko
3a90f138b2
dynamit network test
...
* cleaned up fullnode api
* added debug_id to ReplicatedData and crdt for debugging
2018-07-03 14:00:39 -06:00
Michael Vines
a9e0b27772
Speed up snap build
...
1. Use pre-installed host rust toolchain
2. Build reference/performance fullnode in same part to avoid rebuilding libraries
3. Merge scripts into same part
2018-07-01 17:47:51 -07:00
Michael Vines
fba494343f
Save/restore target/ directory between builds
2018-06-30 22:30:57 -07:00
Michael Vines
0b878eccf8
Map HOME to grant docker containers access to the ~/.cargo registry cache
2018-06-30 21:50:15 -07:00
Michael Vines
98772b16d6
Generalize solana-snap build trigger
2018-06-30 21:50:15 -07:00
Michael Vines
bb82ff0c80
Don't wanna wait
2018-06-30 20:05:27 -07:00
Michael Vines
71af03dc98
Skip snap build for PRs if nothing under snap/ is modified
...
Additionally relegate push snap build to a secondary CI pipeline
2018-06-30 20:05:27 -07:00
Michael Vines
d63493a852
Grant the snap build more time
2018-06-30 12:20:22 -07:00
Michael Vines
4ffb5d157a
Disable coverage until issue #433 is resolved
2018-06-29 17:36:26 -07:00
Stephen Akridge
a094507bb8
Lower default benchmarking numbers to make CI timeout
2018-06-29 07:14:47 -06:00
Rob Walker
a5ce578c72
...
2018-06-26 16:23:41 -06:00
Michael Vines
ce361c2cdc
Add Snap fullnode daemon
2018-06-26 12:32:33 -07:00
Michael Vines
be5f2ef9b9
Consolidate CI jobs
2018-06-24 22:28:24 -07:00
Greg Fitzgerald
adfcb79387
Force install cargo-cov
2018-06-24 15:34:30 -06:00
Greg Fitzgerald
73c4c0ac5f
Revert "cargo-cov installed by default in nightly?"
...
This reverts commit 6fc601f696
.
2018-06-24 15:34:30 -06:00
Greg Fitzgerald
6fc601f696
cargo-cov installed by default in nightly?
2018-06-24 12:17:42 -06:00
Greg Fitzgerald
07111fb7bb
Use llvm-cov instead of gcov
...
@marco-c called this a hack, but since grcov isn't working
out-of-the-box (panics on call to gcov), we'll take a stab at using
llvm-cov.
2018-06-24 12:17:42 -06:00
Greg Fitzgerald
a06d2170b0
No need for rustfmt on nightly
2018-06-24 12:17:42 -06:00
Greg Fitzgerald
7f53ea3bf3
Generate coverage with Rust nightly
...
Fixes #177
Thanks @marco-c!
2018-06-24 12:17:42 -06:00
Michael Vines
b2accd1c2a
Run snap build sooner to better mask the delay
2018-06-24 10:24:32 -07:00
Michael Vines
33bbfdbc9b
Retry flaky coverage/cuda builds on initial failure
2018-06-23 16:17:25 -07:00
Michael Vines
5de54f8853
Make cuda/erasure build logs public
2018-06-23 16:17:25 -07:00
Michael Vines
e4782b19a3
Document GCP setup
2018-06-23 02:12:20 -07:00
Michael Vines
ec86b1dffa
Adapt to GCP-based CI
2018-06-23 02:12:20 -07:00
Michael Vines
30e03feb5f
Add initial CI subsystem documentation
2018-06-22 15:30:29 -07:00
Michael Vines
17e8ad110f
Temporarily disable failing CI to get back to green
2018-06-22 11:29:31 -07:00
Michael Vines
c4a59896f8
Run test-erasure in a container
2018-06-21 13:00:40 -07:00
Michael Vines
3eb1608403
Skip --user if SOLANA_DOCKER_RUN_NOSETUID is set
2018-06-21 12:24:52 -07:00
Michael Vines
8fde70d4dc
Erasure tests do not require a CUDA agent
2018-06-21 11:42:37 -07:00
Michael Vines
5a047833ed
Run snap publishing directly on CUDA agent
...
This is necessary until we build a docker image that also contains a CUDA
installation
2018-06-21 11:42:37 -07:00
Michael Vines
f6c28e6be1
Update snapcraft docker image contain snapcraft 2.42.1
2018-06-21 11:42:37 -07:00
Michael Vines
89fc0ad7a9
Add convenience script to download performance libraries
2018-06-20 16:48:32 -07:00