Rob Walker
1af4cee63b
fix #1079
...
* move gossip/NCP off assuming anything about its address
* use a single socket to send and receive gossip
* remove --addr/-a from CLIs
* rearrange networking utility code
* use Arc<UdpSocket> to share the Sync-safe UdpSocket among threads
* rename TestNode to Node
TODO:
* re-enable 127.0.0.1 as a valid address in crdt
* change repair request/response to a similar, single socket
* pick cloned sockets or Arc<UdpSocket> for all these (rpu uses tryclone())
* update contact_info with network truthiness instead of what the node
says?
2018-08-31 23:21:07 +09:00
Rob Walker
cb52a335bd
re-enable localnet-sanity
2018-08-31 23:21:07 +09:00
Michael Vines
73a0bf8d30
Avoid unbounded /var/tmp growth
2018-08-28 08:11:44 -07:00
Michael Vines
9d53208d68
Use gcloud_DeleteInstances
2018-08-28 08:11:44 -07:00
Michael Vines
c8e3ce26a9
Start of scripts/gcloud.sh
2018-08-27 22:35:14 -07:00
Rob Walker
51d911e3f4
Update testnet-sanity.sh
2018-08-27 15:44:10 -07:00
Michael Vines
bd5c6158ae
Move some common scripts from multinode-demo/ to scripts/
2018-08-27 13:52:38 -07:00
Rob Walker
0efd64df6f
no need for sudo, move ledger copy out of SNAP_DATA
2018-08-28 05:42:05 +09:00
Rob Walker
28bdf346f6
clean up after ledger sanity
2018-08-28 05:42:05 +09:00
anatoly yakovenko
738247ad44
advertise valid gossip address in drone and wallet ( #1066 )
...
* advertize valid gossip address in drone and wallet
get rid of asserts
check for valid ip address
check for valid address
ip address
* tests
* cleanup
* cleanup
* print error
* bump
* disable tests
* disable nightly
2018-08-26 11:36:27 -07:00
anatoly yakovenko
f7c0d30167
Disallow localhost in deployment ( #1064 )
...
* disallow localhost in deployment
* tests
* fmt
* integration tests do not have a flag to check
* fmt
2018-08-25 21:09:18 -07:00
Greg Fitzgerald
db3fb3a27c
Boot criterion ( #1032 )
...
* Revert benchmarks back to libtest
Criterion has too many dependencies, it's execution as slower, and
we didn't see the kind of precision we had hoped for to use it to
block CI builds.
* Ignore benchmarks that take more than a few milliseconds per iteration
* Revert "Ignore benchmarks that take more than a few milliseconds per iteration"
This reverts commit b87cdf6ef4a2549ec09e282014391de695473699.
* Don't run benchmarks in CI
They are already built in the nightly build. Executing them in CI
doesn't add much value until the results are precise enough to act
on.
2018-08-22 08:57:07 -06:00
Rob Walker
0b48aea937
echo commands, use PID (good form)
2018-08-21 11:41:00 +09:00
Rob Walker
cdec0cead2
files have to appear in the snap
2018-08-21 11:41:00 +09:00
Rob Walker
831709ce7e
fixups
2018-08-21 10:36:03 +09:00
Rob Walker
b7b8a31532
make a copy of the ledger for sanity check
...
we can't verify a live ledger, unfortunately, fixes #985
2018-08-21 10:36:03 +09:00
Rob Walker
5aced8224f
Revert "make a copy of the ledger for sanity check"
...
This reverts commit af20a43b77
.
2018-08-21 10:34:52 +09:00
Rob Walker
af20a43b77
make a copy of the ledger for sanity check
...
we can't verify a live ledger, unfortunately, fixes #985
2018-08-21 09:45:52 +09:00
Greg Fitzgerald
39c3280860
Don't block on large network test
2018-08-20 16:48:37 -06:00
Michael Vines
a1ec549630
Pin nightly rust for more controlled updating
2018-08-20 10:55:55 -07:00
Michael Vines
ecddff98f5
Add --nopull argument
2018-08-20 10:55:55 -07:00
Michael Vines
10066d67bf
Add llvm deb repository
2018-08-19 09:01:36 -07:00
Michael Vines
a07f7435c6
\
2018-08-19 08:49:29 -07:00
Michael Vines
d3523ebbe5
Nightly image now derives from stable image
2018-08-19 08:47:59 -07:00
Tyera Eulberg
1bf15ae907
Temporarily disable cargo audit CI failure
2018-08-18 12:29:49 -06:00
Michael Vines
877920e61b
Compute snap channel using ci/channel-info.sh
2018-08-17 23:15:48 -07:00
Michael Vines
3d1e908dad
Add script to fetch latest channel info
2018-08-17 23:15:48 -07:00
Michael Vines
6880c2bef0
Exclude ci/semver_bash/; don't want to diverge from upstream
2018-08-17 23:15:48 -07:00
Michael Vines
78872ffb4b
Vendor https://github.com/cloudflare/semver_bash/tree/c1133faf0e
2018-08-17 23:15:48 -07:00
Michael Vines
229d825fe0
Fix master-perf basename
2018-08-17 21:59:36 -07:00
Michael Vines
edc5fc098e
Make SNAP_CHANNEL more visible in build log
2018-08-17 21:39:54 -07:00
Michael Vines
82e7725a42
Invert logic
2018-08-17 21:16:35 -07:00
Michael Vines
dc61cf1c8d
Keep v0.7 snap off the edge channel
2018-08-17 21:12:10 -07:00
Michael Vines
aba63e2c6c
Log expansion directive must be on its own line
2018-08-17 20:58:14 -07:00
Michael Vines
c2ddd056e2
Add option to skip ledger verification
2018-08-17 20:41:30 -07:00
Rob Walker
7aeef27b99
not quite banishing build.rs, but better
2018-08-16 22:33:31 -07:00
Michael Vines
98d0ef6df5
Add some wget retries
2018-08-16 20:22:49 -07:00
Rob Walker
fc0d7f5982
updated nightly versions
2018-08-16 13:17:29 -07:00
Rob Walker
f697632edb
update clippy install instructions, from here:
...
https://github.com/rust-lang-nursery/rust-clippy
fixes #947 ?
2018-08-16 13:17:29 -07:00
Rob Walker
73797c789b
back to 4 TX threads
2018-08-16 12:02:11 -07:00
Rob Walker
036fcced31
test -t nproc
2018-08-16 12:02:11 -07:00
Rob Walker
1d3157fb80
fixups
2018-08-16 12:02:11 -07:00
Rob Walker
0b11c2e119
restart testnet clients in case airdrop fails
2018-08-16 12:02:11 -07:00
Michael Vines
757dfd36a3
Report errors better in build log
2018-08-14 11:44:26 -07:00
Rob Walker
ab10b7676a
use stable cache
2018-08-13 16:23:30 -07:00
Rob Walker
fa44a71d3e
move bench to a seprate, parallel step
2018-08-13 16:23:30 -07:00
Rob Walker
9e22e23ce6
increase stable timeout until tomorrow
2018-08-13 15:45:50 -07:00
Michael Vines
df5cde74b0
Back out pre-0.7.1 workaround
2018-08-13 12:13:00 -07:00
Michael Vines
c2ba72fe1f
Fix up validator sanity
2018-08-13 10:23:35 -07:00
Michael Vines
d93786c86a
Revert "turn off validator sanity while I work on it"
...
This reverts commit d4304eea28
.
2018-08-13 10:23:35 -07:00
Rob Walker
8eed120c38
add missing backslash
2018-08-10 23:45:08 -07:00
Rob Walker
d4304eea28
turn off validator sanity while I work on it
2018-08-10 14:56:46 -07:00
Rob Walker
7f71e1e09f
fixups
2018-08-10 11:41:31 -07:00
Rob Walker
bb7eccd542
check validator startup in testnet-sanity.sh
2018-08-10 11:41:31 -07:00
Rob Walker
b04c71acd9
check issue 910 in testnet-sanity
2018-08-10 11:41:31 -07:00
Rob Walker
8b41c415b7
add equal sign
2018-08-10 08:05:48 -07:00
Michael Vines
8ca514a5ca
Remove unnecessary :
2018-08-08 22:45:39 -07:00
Michael Vines
b605552079
Record network version in testnet-deploy start datapoint
2018-08-08 22:41:02 -07:00
Michael Vines
74f5538bd3
Verify the ledger as a part of sanity
2018-08-08 16:10:54 -07:00
Pankaj Garg
a6857dbaaa
Updated node count to 230. Increased wmem on CI large
2018-08-08 13:13:18 -07:00
Michael Vines
054298d957
Retry snap install 3 times, sometimes the snap server 503s
2018-08-08 08:56:05 -07:00
Michael Vines
cca240c279
Add SOLANA_NET_NAME, rename SOLANA_NET_URL to SOLANA_NET_ENTRYPOINT
2018-08-08 08:49:30 -07:00
Michael Vines
89f17ceecf
Route setup-args
2018-08-08 08:32:23 -07:00
pgarg66
75854cc234
Update dynamic network test with more nodes ( #904 )
...
- Check for correct OS params in test-large-network.sh
2018-08-08 06:52:57 -07:00
Michael Vines
ecea41a0ab
Install EarlyOOM on testnet nodes
2018-08-07 16:58:46 -07:00
Michael Vines
e3cf1e6598
Bundle metrics_write_datapoint.sh in Snap
2018-08-07 13:35:01 -07:00
pgarg66
16772d3d51
Coalesce multiple blobs if received close together ( #869 )
...
- This helps reduce unnecessary growth of window if small blobs
are received in small space of time
2018-08-07 10:29:57 -07:00
Michael Vines
1c38e40dee
Validate ledger once all the tests complete
2018-08-07 10:00:52 -07:00
Michael Vines
91741e20fa
Add rustc/cargo version check
2018-08-06 09:32:08 -07:00
Michael Vines
a13058b6c4
Look for 3 nodes (1 leader, 2 validators)
2018-08-03 20:30:29 -07:00
Rob Walker
c998199954
fixups, add validator-x to sanity
2018-08-03 15:34:11 -07:00
Michael Vines
15a6179b97
Stop installing rustfmt-preview, it's already present
2018-08-03 14:27:11 -07:00
Michael Vines
83b308983f
Include rustfmt-preview
2018-08-03 14:11:42 -07:00
Rob Walker
f2b1a04bca
cargo fmt fixups
2018-08-03 11:59:25 -07:00
Michael Vines
3e36e6dcf8
Upgrade to rust 1.28
2018-08-03 11:30:40 -07:00
Michael Vines
6feb6a27be
Run localnet-sanity in test-stable-perf
2018-08-03 10:46:48 -07:00
Michael Vines
c230360f4c
Wait until recycled machines are reachable before provisioning them
2018-08-02 22:13:17 -07:00
Michael Vines
a9240a42bf
Delete unreachable validators to cause a fresh one to be spawned
2018-08-02 20:45:29 -07:00
Michael Vines
a7204d5353
Use a local user to avoid GCP login quota limits
2018-08-02 19:43:35 -07:00
Greg Fitzgerald
2366c1ebaf
Enable cargo audit in CI
...
Fixes #772
2018-08-01 16:24:47 -07:00
Michael Vines
2c9d288ca9
Add a CI metric data point upload timeout to prevent CI build stalls
...
5 seconds is somewhat arbitrary, seems like enough
2018-08-01 15:49:48 -07:00
Greg Fitzgerald
bb0aabae75
Add cmake, which is needed to build cargo-audit
2018-08-01 16:43:49 -06:00
Michael Vines
2b259aeb41
testnet now deploys successfully on days of the month < 10
2018-08-01 14:10:52 -07:00
Michael Vines
de7e9b4b4c
Remove retry
...
This was introduced to mask the occasional failure of racy tests. But this is misguided as it helps hid the true problem, the racy test, and it causes tries builds that fail deterministically to retry only to fail once again.
2018-08-01 12:02:39 -07:00
Michael Vines
5d936e5c8a
Trap SIGINT for clean ^C shutdown
2018-07-30 17:15:50 -07:00
Michael Vines
5a40ea3fd7
Only map HOME when in CI
2018-07-30 16:36:26 -07:00
Michael Vines
102510ac0e
Clear apt cache to reduce image size
2018-07-30 16:36:26 -07:00
Michael Vines
2158329058
Switch to docker-rust image
2018-07-30 16:36:26 -07:00
Michael Vines
bc484ffe5f
Add docker-rust image
2018-07-30 16:36:26 -07:00
Michael Vines
6fcf4584d5
Propagate more BUILDKITE environment variables into containers
2018-07-30 16:36:26 -07:00
Michael Vines
1adc83d148
Add localnet-sanity.sh
2018-07-30 16:36:26 -07:00
Michael Vines
416c141775
`export SKIP_INSTALL=1` to reset the network without reinstalling the snap
2018-07-28 18:04:13 -07:00
Michael Vines
4cdb9a73f8
Skip testnet-sanity on manual deploy
2018-07-28 12:37:29 -07:00
Michael Vines
4433730610
Add support for deploying a locally built snap
2018-07-28 12:37:29 -07:00
Michael Vines
71eb5bdecc
Factor out vm_foreach
2018-07-28 12:37:29 -07:00
Michael Vines
80a02359f7
Add script to audit for security vulnerabilities
2018-07-26 13:42:12 -07:00
Michael Vines
ab3968e3bf
Dedup
2018-07-26 11:45:58 -07:00
Michael Vines
42ebf9502a
Agent cleaning is now performed in a separate pipeline
2018-07-26 11:37:36 -07:00
Michael Vines
bd4fcf4ac6
Clean out stale buildkite agent build directories
2018-07-26 11:37:36 -07:00
Michael Vines
4dceb73909
Reinstall client nodes in the background to speed up deploys
2018-07-26 09:49:00 -07:00