Michael Vines
985592cf40
Fix cp args
2019-03-20 14:29:30 -07:00
Michael Vines
791ead6053
Include TARGET in release URL to make room for future targets
2019-03-20 13:54:32 -07:00
Rob Walker
c70412d7bb
move core tests to core ( #3355 )
...
* move core tests to core
* remove window
* fix up flaky tests
* test_entryfication needs a singly-threaded banking_stage
* move core benches to core
* remove unnecessary dependencies
* remove core as a member for now, test it like runtime
* stop running tests twice
* remove duplicate runs of tests in perf
2019-03-18 22:08:21 -07:00
Michael Vines
3ad019a176
Increment stable timeout
2019-03-16 23:56:35 -07:00
Rob Walker
e3ef4f25d3
Update Dockerfile
...
install mscgen (for book art)
2019-03-15 20:44:35 -07:00
Mark
656fb173f9
Extract kvstore into separate crate ( #3327 )
...
* extract kvstore into new crate
* add kvstore crate to CI publishing list
2019-03-15 18:42:47 -05:00
Michael Vines
5f58e9cd6e
Config program - useful for storing/updating simple config items on chain
2019-03-15 16:39:45 -07:00
Michael Vines
c8bbca08f8
Install the install program
2019-03-15 16:30:31 -07:00
Michael Vines
ca4f874f52
Remove ci/run-local.sh
2019-03-15 15:09:25 -07:00
Michael Vines
41b98c603b
Upgrade rust stable to 1.33.0
2019-03-15 09:25:28 -07:00
Michael Vines
5430dd28b6
Update docker-rust to 1.33
2019-03-15 09:25:28 -07:00
Michael Vines
e9d687329b
Only push newly built container
2019-03-15 09:25:28 -07:00
Michael Vines
3ced91319f
Upgrade nightly rust version
2019-03-14 20:22:46 -07:00
Michael Vines
3d1413e619
Preserve original nightly name
2019-03-14 20:22:46 -07:00
Michael Vines
8f25548781
Overhaul cargo/rustc version management
2019-03-14 20:22:46 -07:00
Greg Fitzgerald
9fac3b26ee
Move the design proposals to a separate book
...
Fixes #3262
2019-03-14 10:08:43 -07:00
Michael Vines
34a8d591fa
Switch version file from .txt to .yaml; add target tuple to version.yml
2019-03-13 16:30:07 -07:00
Tyera Eulberg
b7f420412b
Update publish script
2019-03-12 22:05:38 -06:00
Sagar Dhawan
866d3f467f
Fix flag to disable leader-rotation ( #3243 )
2019-03-12 16:35:13 -07:00
Michael Vines
a7d8bfdf8b
Adjust crate list
2019-03-12 14:02:51 -07:00
Michael Vines
3d2b7dd1ef
Move programs/system into runtime/
2019-03-12 11:30:58 -05:00
Michael Vines
5a0416b925
Keep stable dashboard on stable channel at all times
2019-03-11 16:19:16 -07:00
Michael Vines
ba2cdd0bf6
Move testnet/testnet-perf to the stable channel
2019-03-11 16:14:16 -07:00
Michael Vines
a539c9ad67
Restore print ban, and widen the net
2019-03-05 14:09:40 -08:00
Tyera Eulberg
e248efce06
Add programs/system explicitly to CI test suite
2019-03-05 09:33:27 -07:00
Michael Vines
3fc846d789
Try to use the RPC exit API to cleanly exit nodes
2019-03-04 19:58:37 -08:00
Michael Vines
7b49c9f09c
Delete fullnode-config/
2019-03-04 15:49:02 -08:00
Michael Vines
03d6c9a552
Defeature bpf_loader; bpf_{c,rust} features now confined to programs/bpf
2019-03-04 11:02:37 -08:00
Michael Vines
d708982f27
Remove unstable and test feature flags
2019-03-04 09:30:00 -08:00
Michael Vines
534619f72f
Update manifest-path
2019-03-02 22:11:48 -08:00
Greg Fitzgerald
9923c543e8
Fix ci scripts
2019-03-02 22:11:48 -08:00
Greg Fitzgerald
037fcf6b3d
Bump all native programs up a level
...
Don't categorize programs by a single backend.
2019-03-02 22:11:48 -08:00
Michael Vines
cd4bccfd12
Remove snap support
2019-03-02 17:41:09 -08:00
Michael Vines
5f5d779ee1
Move src/ into core/src. Top-level crate is now called solana-workspace
2019-03-02 09:52:18 -08:00
Jack May
b9524217fe
Update rust example to use BPF enabled infrastructure ( #2974 )
2019-02-28 22:05:11 -08:00
Michael Vines
36cdaffe25
Fix indent
2019-02-27 11:11:24 -08:00
Jack May
329382f016
Pull BPF enabled rustc and sysroot into SDK ( #2936 )
2019-02-25 15:35:45 -08:00
Jack May
77ea4cd285
Reapply dependency Band-aid to make CI happy
2019-02-22 15:56:07 -07:00
Jack May
71602fe04b
Fix root package dependencies ( #2899 )
2019-02-22 14:08:25 -08:00
Jack May
3a7008949f
Build all deps ( #2896 )
2019-02-22 09:49:25 -08:00
Jack May
3610768888
Run featurized tests on sub-packages ( #2867 )
2019-02-21 22:38:36 -08:00
Michael Vines
fb904e7a29
Enable CUDA persistence mode to reduce surprises
2019-02-21 19:25:17 -08:00
Tyera Eulberg
18d48f09f8
Plumb blockstreamer name through testnet scripts
2019-02-21 17:24:29 -07:00
Michael Vines
33c7f92f56
Dial down CI timeouts
2019-02-20 16:43:13 -08:00
Greg Fitzgerald
08d7a0d52d
Upgrade to Rust 1.32.0
...
$ rustup update stable
2019-02-18 21:44:09 -07:00
Michael Vines
0dbc33f781
Finish removing getConfirmationTime
2019-02-17 16:27:50 -08:00
Michael Vines
a27e9cb3c2
Add -u option
2019-02-17 10:45:25 -08:00
Michael Vines
10270dcbad
Add an API node to non-perf testnets
2019-02-17 10:39:27 -08:00
Michael Vines
ab6c7f6ca3
/it/ti/
2019-02-16 10:40:47 -08:00
Michael Vines
02c0098d57
Less --verbose by default
2019-02-10 10:19:16 -08:00
Michael Vines
c02625f91a
Ban Default::default()
2019-02-09 10:12:32 -08:00
Michael Vines
6317bec7aa
Avoid empty --features= arg to avoid unnecessary cargo building
2019-02-07 10:42:57 -08:00
Michael Vines
eb3ba5ce2d
tmi: disable --verbose by default. | export V=1| to request verbosity
2019-02-07 10:42:57 -08:00
Greg Fitzgerald
5128d7d6c3
Move runtime.rs into its own crate
2019-02-07 09:46:06 -08:00
Greg Fitzgerald
731e5e1291
Boot lua loader
...
Good fun, but unnecessary and I haven't been updating the rlua
dependency. If someone wants this, it can be developed outside
the solana repo.
2019-02-07 10:25:11 -07:00
Jack May
5f565c92c9
cargo incremental builds breaks Rust BPF, locally disable it ( #2674 )
2019-02-06 13:59:10 -08:00
Michael Vines
afdf0efd31
Disable bpf_rust temporarily
2019-02-06 13:31:35 -08:00
Michael Vines
7fc271ef97
Bump stable timeout
2019-02-06 13:31:35 -08:00
Michael Vines
98e893c69b
Avoid empty --features= arg to avoid unnecessary cargo building
2019-02-02 20:08:49 -08:00
Michael Vines
4aa6695a13
source ulimit-n.sh so it applies to the current shell
2019-02-02 20:08:49 -08:00
Michael Vines
a7e5423ede
Set ulimit -n
2019-02-02 20:08:49 -08:00
Michael Vines
21c09073a1
Add help script to easily run all integration tests
2019-02-01 12:42:46 -08:00
Michael Vines
4fb9c8a547
Bump timeout
2019-02-01 07:11:17 -08:00
Michael Vines
344427c1dc
Update to rust nightly 2019-01-31
2019-02-01 07:11:17 -08:00
Rob Walker
00bb5925e1
use a .gitignore'd file name for transactionCount ( #2609 )
2019-01-30 20:19:10 -08:00
Rob Walker
a0bed5375d
remove println!, add check to keep it out ( #2585 )
...
* remove debugging prints
* remove println!, add check to keep it out
2019-01-29 16:02:03 -08:00
Rob Walker
145fb3675d
check for debugging lint in CI ( #2578 )
...
* check for debugging lint in CI
* nit
* add TODO
2019-01-28 18:32:30 -08:00
Michael Vines
a8ea6471e7
Add ledger-tool tests to CI
2019-01-28 17:08:59 -08:00
Jack May
9abc500269
Fix BPF C tests and run as part of CI ( #2540 )
2019-01-24 12:15:37 -08:00
Rob Walker
6aa80e431d
increase startup timeout for localnet sanity ( #2534 )
2019-01-23 15:06:08 -08:00
Michael Vines
73930b5eac
Unfold log on errors
2019-01-23 07:48:59 -08:00
Michael Vines
fbeba259b3
Reorg tests
2019-01-23 00:02:30 -08:00
Michael Vines
d1bedeae13
Wait for nodes to finish booting before running sanity checks
2019-01-23 00:02:30 -08:00
Michael Vines
8dc9089611
Display confirmation time
2019-01-23 00:02:30 -08:00
Michael Vines
222d2d7953
Verify transaction count as reported by the bootstrap-leader node is advancing
2019-01-23 00:02:30 -08:00
Michael Vines
e3ae10bacc
User-initiated builds now select the correct channel
2019-01-22 14:23:46 -08:00
Michael Vines
fcda94b673
Use beta channel for stable dashboard once a beta tag exists
2019-01-22 12:22:57 -08:00
Michael Vines
dea20248c4
Increase job timeout
2019-01-22 09:35:03 -08:00
Michael Vines
ae90ac238c
Use unique log file for each additional (-x/-X) fullnodes
2019-01-22 08:27:36 -08:00
Michael Vines
3b0ca9f478
Add rolling update test
2019-01-22 08:27:36 -08:00
Michael Vines
61e79e6d02
Add -c to resume a previous run
2019-01-22 08:27:36 -08:00
Michael Vines
1cdab81a3c
Add -R option to restart the cluster incrementally
2019-01-22 08:27:36 -08:00
Michael Vines
dca0ba6a5d
Use -X for dynamic fullnodes, to ensure keypair remains constant during iterations
2019-01-22 08:27:36 -08:00
Michael Vines
3c86f41769
Run buildkite iterations in parallel
2019-01-21 14:04:19 -08:00
Michael Vines
648b6597bf
configure ulimit
2019-01-20 10:54:12 -08:00
Michael Vines
514bf32b99
Enable ledger verification for non-perf testnets
2019-01-19 20:28:56 -08:00
Michael Vines
6282c53fe5
Add iterations with leader rotation enabled and periodic restarts
2019-01-18 13:42:04 -08:00
Michael Vines
dac28e0961
Temporarily ignore wallet sanity failures when leader rotation is enabled
...
This commit should be reverted once https://github.com/solana-labs/solana/issues/2474 is fixed
2019-01-18 13:42:04 -08:00
Michael Vines
443d8ce7c4
Add option to restart the cluster during iterations
2019-01-18 13:42:04 -08:00
Michael Vines
b03d1d8894
Enable integration test logging for better debug on CI failure
2019-01-17 23:14:18 -08:00
Michael Vines
8e4a86e329
Recovery multinode tests
2019-01-17 23:14:18 -08:00
Tyera Eulberg
14267e172d
Add local drone integration test
2019-01-17 15:06:04 -08:00
Michael Vines
825d8ef6c9
Add ability to use the RPC endpoint from a node other than the bootstrap leader
2019-01-17 09:04:57 -08:00
Michael Vines
e4c6e4bf26
Report full node info before starting/updating network
2019-01-16 10:24:00 -08:00
Michael Vines
8783563176
Report full node info before running sanity
2019-01-16 10:24:00 -08:00
Tyera Eulberg
8af61f561b
Improve Wallet coverage ( #2385 )
...
* Add trait for RpcRequestHandler trait for RpcClient and add MockRpcClient for unit tests
* Add request_airdrop integration test
* Add timestamp_tx, witness_tx, and cancel_tx to wallet integration tests; add wallet integration tests to test-stable
* Add test cases
* Ignore plentiful sleeps in unit tests
2019-01-14 00:10:03 -07:00
Michael Vines
780360834d
Iteration testing v0.1
2019-01-13 21:49:09 -08:00
Michael Vines
d28b643c84
localnet-sanity.sh now supports iterations testing
2019-01-13 21:49:09 -08:00
Michael Vines
5d3847d14d
Publish book from both the edge and beta channels
2019-01-12 11:08:29 -08:00
Michael Vines
5b92286568
Remove channel duplication
2019-01-12 11:08:29 -08:00
Michael Vines
c1cd92bbee
Avoid -d arg conflict
...
-D is now "delete"
-d is now "disk type"
2019-01-09 16:39:24 -08:00
Michael Vines
639bed2f6d
Reorder sanity.
...
1. Check for presence of nodes
2. Check for functioning RPC API
3. Then try the wallet
2019-01-09 12:05:30 -08:00
Michael Vines
77794eebdb
Remove |cargo package| sanity step
...
Unfortunately due to our multi-crate repo, as soon as
|./scripts/increment-cargo-version.sh| is run after a release, |cargo
package| will fail for crates that depend on other in-tree crates, as
the new crate version has not yet been published to crates.io.
For now this means that we need to continue flying blind and be prepared
to deal with minor publishing issues on each new release.
2019-01-09 11:59:24 -08:00
Michael Vines
6b46c22b42
Use restart
2019-01-09 11:59:01 -08:00
Michael Vines
64ebd9a194
Add update-to-restart operation. Also try to update before restarting on sanity failures
2019-01-08 21:11:43 -08:00
Michael Vines
35fe08b3bc
Add update support
2019-01-08 21:11:43 -08:00
Michael Vines
5c87ddc80e
nit: hide echo
2019-01-08 21:11:43 -08:00
Michael Vines
1b7598e351
Add retries to RPC API probe
2019-01-08 08:50:51 -08:00
Michael Vines
cd0e08cae5
Add fullnode-config crate
2019-01-07 23:02:32 -08:00
Michael Vines
1490c42d9f
Use docker rust docker image to avoid rocksdb build errors
2019-01-07 23:02:32 -08:00
Michael Vines
789ee9f138
package or publish. Also package on branch builds
2019-01-07 23:02:32 -08:00
Michael Vines
0a981a6606
Double publish crate timeout
2019-01-07 20:46:21 -08:00
Michael Vines
c4ca76e39e
Only check TRIGGERED_BUILDKITE_TAG
2019-01-07 19:56:01 -08:00
Stephen Akridge
d2cb4e003c
Re-enable the --lib tests
2019-01-07 15:28:20 -08:00
Michael Vines
71a2b794b4
Enable info logging on non-perf clusters to aid debug of failures
2019-01-05 08:28:32 -08:00
Michael Vines
373714bf0b
Disable publish snap again
2019-01-04 21:20:33 -08:00
Michael Vines
ee769171b9
Restore publish snap
2019-01-04 20:46:44 -08:00
Michael Vines
ea00c1274e
Add net sanity failure metric
2019-01-04 18:45:55 -08:00
Michael Vines
1a9401e1f3
Permit build on Cargo.{lock,toml} changes
2019-01-03 09:35:11 -08:00
jackcmay
a461c5682d
First stab at Rust BPF ( #2269 )
...
First stab at Rust BPF
2019-01-02 15:12:42 -08:00
Michael Vines
1531a1777a
Add RPC API check
2018-12-24 22:51:36 -08:00
Michael Vines
3a2fa9a650
Enable ledger/validator sanity for non-perf testnets
2018-12-24 22:51:36 -08:00
Michael Vines
95c9fefbd0
Make sanity failure message more visible
2018-12-23 17:30:59 -08:00
Michael Vines
073a48ab85
Restore timeout
2018-12-23 17:30:41 -08:00
Michael Vines
7f2fa8bbcb
Collect and upload network logs
2018-12-23 10:19:10 -08:00
Michael Vines
b46c809544
source ci/upload-ci-artifact.sh
2018-12-22 12:34:30 -08:00
Michael Vines
eb29a2898c
Uplaod net/log/ files as buildkite artifacts
2018-12-22 12:22:58 -08:00
Michael Vines
c3a74e5e63
Avoid unnecessary shellcheck directives
2018-12-22 11:57:47 -08:00
Pankaj Garg
23d3a9ae42
Use CUDA for testnet automation performance calculations ( #2259 )
2018-12-21 04:27:31 -08:00
Pankaj Garg
756156e9db
Use SSD for testnet automation ( #2257 )
2018-12-20 20:13:56 -08:00
Michael Vines
becfd1e9fa
ci/test-stable-perf.sh now runs on macOS
2018-12-20 17:23:22 -08:00
Pankaj Garg
951d6398a0
Rename finality to confirmation ( #2250 )
...
* Rename finality to confirmation
* fix cargo fmt errors
2018-12-20 15:47:48 -08:00
Michael Vines
ddc1082e8c
Stable dashboard can now actually come from the stable channel
2018-12-20 08:04:59 -08:00
Michael Vines
d78f19f8bb
Select correct branch for {testnet,-perf} when using a stable channel tag
2018-12-19 17:46:18 -08:00
Michael Vines
e2225d3b71
Add more Azure details
2018-12-19 16:31:28 -08:00
Pankaj Garg
2fe3402362
Use SSD for perf testnet ( #2227 )
2018-12-19 16:11:26 -08:00
Michael Vines
14a236198f
nit: rename publish-solana-tar.sh to publish-tarball.sh
2018-12-19 14:26:25 -08:00
Michael Vines
cc1b43b90a
Retire GCP setup
2018-12-19 14:26:25 -08:00
Michael Vines
9448f0ce52
Add more Azure CI documentation
2018-12-19 14:26:25 -08:00
Michael Vines
59fdd8f6be
Move wallet airdrop retries into fullnode start script
2018-12-19 13:49:04 -08:00
Michael Vines
7b20318ee4
Run s3cmd in a container to avoid additional CI system dependencies
2018-12-19 13:09:24 -08:00
Michael Vines
c3c955b02e
Build/install native programs within cargo-install-all.sh
2018-12-19 11:53:08 -08:00
Michael Vines
6e56e41461
Document how to create a new Azure CI machine
2018-12-18 23:35:09 -08:00
Michael Vines
d74d5e0e44
nit: prevent shellcheck command from getting expanded by default
2018-12-18 18:44:20 -08:00
Michael Vines
cac08171de
nit: prevent book build from getting expanded by default
2018-12-18 18:44:20 -08:00
Michael Vines
6f6c350781
Skip stable-perf of no .rs files are modified in a PR
2018-12-18 18:44:20 -08:00
Michael Vines
506724fc93
Remove non-standard : anchors
2018-12-18 18:44:20 -08:00
Michael Vines
b4fe70d3d8
Skip bench of no .rs files are modified in a PR
2018-12-18 18:09:59 -08:00
Michael Vines
3efbffe4e3
Run coverage when test-coverage.sh is modified
2018-12-18 18:09:59 -08:00
Michael Vines
b101f40c32
Initial revision
2018-12-18 14:27:37 -08:00
Michael Vines
e8e6c70e19
Remove duplicate _ definitions
2018-12-18 14:25:10 -08:00
Michael Vines
cd6736d70b
Remove duplication between test-stable{,-perf}.sh
2018-12-18 14:02:43 -08:00
Michael Vines
c0dcf67ec8
Move book build into test-checks
2018-12-18 13:03:38 -08:00
Michael Vines
bc52336a1b
affected_files metadata is only available for PR builds
2018-12-18 13:03:38 -08:00
Michael Vines
3bfb052b0a
Overhaul coverage setup
2018-12-18 10:48:06 -08:00
Michael Vines
c71d5a111e
Extract grcov download script
2018-12-18 10:48:06 -08:00
Greg Fitzgerald
437b62c4d9
Upgrade grcov
2018-12-18 10:48:06 -08:00
Michael Vines
cbca0ae264
Remove dead code
2018-12-18 10:48:06 -08:00
Michael Vines
e720070945
Flip && style
2018-12-18 09:56:43 -08:00
Michael Vines
a8ab6f4caf
Preserve stable as default, use +nightly to get nightly
2018-12-18 09:54:47 -08:00
Michael Vines
b7b1884950
Pass BUILDKITE_COMMIT env var into containers
2018-12-18 08:53:39 -08:00
Michael Vines
755064d3e2
Use |cargo +nightly| to avoid assuming nightly is default
2018-12-18 08:44:33 -08:00
Michael Vines
24a984086e
nightly is now 1.33
2018-12-18 08:44:33 -08:00
Michael Vines
4b831d58b7
Don't fiddle with default rust, humans don't like that
2018-12-18 08:44:33 -08:00
Michael Vines
62f36037ea
Pass CI env var into containers
2018-12-18 00:47:41 -08:00
Michael Vines
29776c0283
Publish book only on content changes instead of on every commit
2018-12-17 16:42:22 -08:00
carllin
69d7384cc0
Enable leader rotation on edge testnet ( #2204 )
2018-12-17 16:04:25 -08:00
Michael Vines
dc56bbeec8
Ensure the full workspace is built for coverage
2018-12-17 10:47:32 -08:00
Michael Vines
4be537c51a
Temporarily disable nightly build until it can be fixed
2018-12-17 10:15:38 -08:00
Michael Vines
66c568ba67
Add wallet sanity timeout
2018-12-17 09:58:34 -08:00
Michael Vines
9a5195e79e
Remove CARGO_TARGET_CACHE_NAME, use BUILDKITE_LABEL
2018-12-16 23:05:44 -08:00
Michael Vines
74ee1e5087
Increase the number of files a node may have open at a time
2018-12-15 17:15:22 -08:00
Michael Vines
e5d1bd6589
Drop public suffix on build names
2018-12-15 16:54:23 -08:00
Michael Vines
50e8666a14
Add format-url.sh
2018-12-15 15:10:04 -08:00
Michael Vines
eedc8c7812
Move src/netutil.rs into its own crate
2018-12-14 20:13:34 -08:00
Michael Vines
f0d1ed0cc4
|cargo test --all|
2018-12-14 19:32:04 -08:00
Michael Vines
6ac466c0a4
Move src/logger.rs into logger/ crate to unify logging across the workspace
2018-12-14 13:10:43 -08:00
Michael Vines
f6e3464ab9
bench-tps rebase
2018-12-14 09:38:46 -08:00
Mekagoza
708876e9a7
Fix CI and related issues in bench-tps
...
Rename crate to `solana-bench-tps` in its Cargo.toml
Move crate
Add to ci/publish-crate.sh
2018-12-14 09:38:46 -08:00
Michael Vines
c1ad987b04
Run checks over all crates in the workspace
2018-12-13 23:40:26 -08:00
Michael Vines
9d0b7c6b31
Remove bench_streamer feature
2018-12-13 22:25:27 -08:00
Michael Vines
d489cb1a8b
Desnake upload_ci_artifact for consistency
2018-12-13 22:25:27 -08:00
Michael Vines
0fe6d61036
Move binaries from src/bin into their own crate
2018-12-13 22:25:27 -08:00
Michael Vines
accabca618
Find solana-fullnode-cuda
2018-12-13 20:08:24 -08:00
Michael Vines
647e5d76b0
Move solana-fullnode into fullnode/
2018-12-13 01:45:29 -08:00
Michael Vines
7e4af9382e
Move solana-upload-perf into upload-perf/
2018-12-13 01:06:40 -08:00
Michael Vines
282d4a3563
Move solana-keygen into keygen/
2018-12-13 01:06:40 -08:00
Michael Vines
4b07778609
Add bench_streamer feature to inhibit building solana-bench-streamer by default
...
This program is not currently used in any automation and is fairly slow
to build. Disabling it by default will speed incremental builds.
2018-12-12 16:31:13 -08:00
Michael Vines
bf33d9d703
Disable snap build until #2127 is resolved
2018-12-12 15:13:11 -08:00
Michael Vines
af3ca02e35
Switch testnet-edge from snap to tarball
...
Snap publishing has been failing all day, unclear why. Potentially
revert this commit if/when resolved.
2018-12-11 23:34:41 -08:00
Michael Vines
088bab61a4
Remove |cargo install| duplication
2018-12-11 23:29:05 -08:00
Michael Vines
080d18b06e
Only run publish-crate on release branches, clarify crate ordering
2018-12-11 23:29:05 -08:00
Michael Vines
b5784de33f
Disable leader rotation for testnet-automation until it's ready
2018-12-10 15:23:11 -08:00
Michael Vines
094f0a8be3
Leader rotation flag plumbing
2018-12-10 14:07:59 -08:00
Michael Vines
3d996bf080
Disable leader rotation on CI testnets until it's ready
2018-12-10 14:07:59 -08:00
Michael Vines
4b05ee6811
Add hacky sleep
2018-12-10 14:05:00 -08:00
Michael Vines
9b472d36fc
Add `--path .` to keep new `cargo` content
2018-12-09 18:09:03 -08:00
Greg Fitzgerald
92584bd323
Only run the audit
2018-12-08 23:19:55 -07:00
Rob Walker
586d9ee850
fix some nits ( #2034 )
...
rework maybe_cargo_install(), renamed to cargo_install_unless, updated to take a command to attempt
2018-12-08 19:14:19 -08:00
Michael Vines
f5569e76db
Relocate native programs to deps/ subdirectory of the current executable
...
This layout is `cargo build` compatible, no post-build file moves
required.
2018-12-08 16:31:01 -08:00
Greg Fitzgerald
0a83b17cdd
Upgrade to Rust 1.31.0 ( #2052 )
...
* Upgrade to Rust 1.31.0
* Upgrade nightly
* Fix all clippy warnings
* Revert relaxed version check and update
2018-12-07 20:01:28 -07:00
Michael Vines
fa58da2401
Explicitly specific build variant when installing native programs
2018-12-07 11:32:08 -08:00
Michael Vines
cba9c5619e
Relax stable version check during the transation period between 1.30 and 1.31
2018-12-06 19:44:47 -08:00
Michael Vines
70c149c7da
Rename leader/validator to bootstrap-leader/fullnode
...
Only rsyncing the genesis ledger snuck in here as well
2018-12-06 19:44:47 -08:00
Michael Vines
04a0652614
Generalize net/ from leader/validator to bootstrap-fullnode/fullnode
2018-12-05 17:11:16 -08:00
Michael Vines
632425c7d7
Move native_loader under programs/native/
2018-12-05 14:32:42 -08:00
Michael Vines
7336645501
Move programs into the executable location so native_loader can find them
2018-12-05 10:49:06 -08:00
Michael Vines
424612ea9d
Reduce |ulimit -n| on macOS to max supported amount
2018-12-05 10:49:06 -08:00
Michael Vines
5afafd9146
Update list of crates to publish
2018-12-05 10:49:06 -08:00
Michael Vines
9a4f8199d6
Move system_program out of src/
2018-12-05 10:49:06 -08:00
Michael Vines
e4049f3733
Ensure subshell failures are reported
2018-12-05 10:28:03 -08:00
Michael Vines
8ef73eee51
Reject builds faster: if sanity checks fail don't bother with the rest
2018-12-01 11:43:29 -08:00
Michael Vines
7c3e6e8e86
Move bpf-sdk to sdk/bpf
2018-12-01 10:47:59 -08:00
Rob Walker
3ca826a480
re-enable test_tpu_forwarder ( #1964 )
2018-11-30 13:52:37 -08:00
Michael Vines
29d95328ce
Use non-zero exit on channel determination failure
2018-11-30 08:50:17 -08:00
Rob Walker
3cc0dd0d1e
stabilize testing with --test-threads=1
2018-11-29 12:54:42 -08:00
Stephen Akridge
5c71f2a439
Add ulimit check to stable test suite
...
cargo test needs larger ulimit than default as well.
2018-11-29 11:39:42 -08:00
Jack May
6a2ffafdb9
Update docker-solana location for CI
2018-11-28 16:20:02 -08:00
jackcmay
0c091c1b24
Dockerized LLVM ( #1914 )
...
Optionally build with dockererized custom llvm
2018-11-28 14:41:53 -08:00
Rob Walker
fa4bdb4613
add --no-capture to get some logs from flaky tests
2018-11-27 23:24:20 -08:00
Michael Vines
af1d9345e0
De-dup ci book build
2018-11-26 18:38:57 -08:00
Michael Vines
03ce45d93a
Fix snap build
2018-11-26 18:38:48 -08:00
Michael Vines
58e3dd4cb6
Avoid trying to install svgbob when already installed
2018-11-26 17:18:55 -08:00
Michael Vines
7bf4c08f70
Add BPF C unittest framework
2018-11-26 12:25:29 -08:00
Greg Fitzgerald
69beee5416
Install svgbob
2018-11-26 09:44:19 -08:00
Greg Fitzgerald
2200a31331
Generate book images via Make
2018-11-26 09:44:19 -08:00
Greg Fitzgerald
88e270723f
Move markdown book out of src/
2018-11-26 09:44:19 -08:00
Michael Vines
6e00c6790e
Move testnet metrics dashboard management out of the Grafana UI
2018-11-25 16:10:25 -08:00
Jack May
e6f91269ec
Use --no-tty with apt-key in Docker
2018-11-21 16:45:48 -08:00
Jack May
8d7f380dfd
Remove extra version check
2018-11-21 14:30:26 -08:00
jackcmay
59163e2dd9
Optimize some CI stuff ( #1880 )
...
* CI Optimizations
2018-11-21 12:16:16 -08:00
Michael Vines
7a54dbf7d5
Restore clippy, and run clippy sooner
2018-11-17 15:54:21 -08:00
Michael Vines
591a28d516
Avoid extra commit when publishing book
2018-11-17 10:17:52 -08:00
Michael Vines
903c82d7f1
Add timeouts
2018-11-17 09:09:25 -08:00
Michael Vines
b2e0395f19
Bump release tarball build timeout (ahem rocksdb)
2018-11-17 08:12:03 -08:00
Michael Vines
d96a6b42a5
Move drone into its own crate
2018-11-16 20:42:21 -08:00
Michael Vines
7fe50d6402
Temporarily disable clippy
2018-11-16 19:55:33 -08:00
Michael Vines
6ac5700f2e
Move metrics into its own crate
2018-11-16 15:10:07 -08:00
Michael Vines
e791d0f74d
Drone now returns signed airdrop transactions
2018-11-15 17:13:13 -08:00
Michael Vines
4a3230904e
Specify rpc port
2018-11-15 12:32:15 -08:00
jackcmay
6b6c87e510
Run BPF tests in CI
2018-11-14 17:16:37 -08:00
Michael Vines
bba19ce667
Catch up to solana-genesis tokens argument name change
2018-11-14 09:55:33 -08:00
Michael Vines
9bf2d1d7b4
Publish BPF SDK to a channel-specific URL to ease downstream pickup
2018-11-14 09:36:44 -08:00
Pankaj Garg
66e9d30fda
Change testnet automation to use TAR instead of snap ( #1809 )
2018-11-13 13:33:15 -08:00
Michael Vines
d53077bb3e
Activate perf-libs compatible CUDA env
2018-11-12 22:24:56 -08:00
Michael Vines
2b44d5fb6a
Fix snap PR builds
2018-11-12 22:24:56 -08:00
carllin
dafdab1bbc
Add clang dependency to docker images, update validation checks ( #1794 )
2018-11-12 19:36:36 -08:00
Michael Vines
9e7b9487b0
perf-libs now drives setting CUDA_HOME
2018-11-12 18:49:15 -08:00
Michael Vines
3466f139a4
set -e shuffling
2018-11-11 16:24:36 -08:00
Michael Vines
def7d156f6
codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e'
2018-11-11 16:24:36 -08:00
Michael Vines
33aab094ef
codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash'
2018-11-11 16:24:36 -08:00
Michael Vines
cf6f344ccc
Add CUDA_HOME env var to permit overriding the CUDA install location
2018-11-11 16:24:18 -08:00
Greg Fitzgerald
b670b9bcde
Regenerate identity files in CI
2018-11-11 09:22:52 -07:00
Greg Fitzgerald
cdf1a96e23
Revert "V1 Window/Ledger based on RocksDb ( #1712 )"
...
This reverts commit bfcdec95cb
.
2018-11-09 20:25:53 -07:00
carllin
bfcdec95cb
V1 Window/Ledger based on RocksDb ( #1712 )
...
* Add rocksdb
* Implement new ledger module based on RocksDb
2018-11-09 18:30:26 -08:00
Greg Fitzgerald
0926702269
Fix grcov download on macos and upload gcda/gcdo files for debugging
2018-11-09 11:19:28 -07:00
Greg Fitzgerald
0a85347a0d
Upgrade Rust stable to 1.30.1
...
Fixes `cargo doc`
2018-11-09 07:46:51 -08:00
Michael Vines
eaa8b9cb1e
Publish book
2018-11-09 02:13:59 -07:00
Michael Vines
b0405db5a9
Assign static IPs to {edge,beta}.testnet.solana.com
2018-11-07 20:11:00 -08:00
Michael Vines
f34f0af6b1
Install native programs in the correct location
2018-11-07 19:44:57 -08:00
Michael Vines
22b6cbb4da
Switch testnet to AWS
2018-11-07 18:57:08 -08:00
Michael Vines
25dd5145bb
Switch to us-west-1a, us-west-1b is causing trouble
2018-11-07 18:23:28 -08:00
Michael Vines
3b41eec199
Shuffle AWS regions
2018-11-07 15:00:55 -08:00
Michael Vines
b02b636b36
Support local tarball deploys
2018-11-07 14:44:40 -08:00
Michael Vines
a537154c28
Remove all cuda dependencies from release tarball beyond solana-fullnode-cuda
2018-11-07 14:44:40 -08:00
Michael Vines
812a8bcc6c
Permit release tag tarballs
2018-11-07 10:33:58 -08:00
Michael Vines
63807935cb
Switch testnet/testnet-beta to tarball release
2018-11-07 10:30:02 -08:00
Michael Vines
92a8b646df
Fix tarball publishing for tags
2018-11-07 10:26:19 -08:00
Michael Vines
d9f9e347ab
Delete testnet-master, testnet-master-perf
2018-11-07 10:08:29 -08:00
Greg Fitzgerald
038a46b5ef
Integrate the markdown book into the codebase
...
This implies that the book should describe exactly what is implemented,
and will not lead the way and eventually bitrot as the RFCs do.
2018-11-07 10:58:47 -07:00
Michael Vines
863a0c3f8f
s/edge/beta/
2018-11-07 08:54:32 -08:00
Michael Vines
dd4fb7aa90
Add AWS-based nets
2018-11-07 07:47:39 -08:00
Michael Vines
2af5aad032
Switch testnet/testnet-perf to the latest beta or stable tag
2018-11-07 07:47:39 -08:00
Michael Vines
9027141ff8
Publish release tarballs for tags
2018-11-07 07:47:39 -08:00
Greg Fitzgerald
8be7c13d2d
Stub out architecture book ( #1674 )
...
* Stub out architecture documentation
* Add book HTML generation and book tests to CI
* Add heading
* Better table of contents
* Reference existing documentation
Move ASCII art from code comments into rendered SVG
* Attempt to fix CI
* Add lamport docs
And truncate lines to 80 characters
* Fix links
And reference shorter, newer description of PoH.
* Replace ASCII art with SVG
* Streamline for Pillbox
* Update path before optional install
* Use $CARGO_HOME instead of $HOME
* Delete code
Attempt to describe all data structures without code.
* Boot RPU from docs, add JsonRpcService
Also, use Rust naming conventions in the block diagrams to
minimize the jump from docs to code.
* Latest code uses tick_height
* Rename bob/ folder to art/
A home for any ASCII art
* Import JSON RPC API
* More mdbook docs
* Add Ncp
* Cleanup links
* Move pipelining description into fullnode description
* Move high-level transaction docs into top-level doc
* Delete unused files
2018-11-06 18:00:58 -07:00
Michael Vines
d8d23c9971
Remove unused debug trace
2018-11-06 09:29:39 -08:00
Michael Vines
6b5d12a8bb
Set metrics database correctly
2018-11-06 07:25:18 -08:00
Michael Vines
c4b9d5d8b9
Remove stray line
2018-11-05 20:53:34 -08:00
Michael Vines
52491b467a
Update testnet deploy docs
2018-11-05 19:12:55 -08:00
Michael Vines
7789fda016
Add testnet-manager pipeline
2018-11-05 17:35:30 -08:00
Pankaj Garg
c4346e6191
Add testnet pipeline for prebuilt images ( #1708 )
...
* Add testnet pipeline for prebuilt images
- It'll speed up testnet testing for released images
* removed quotes from variable
* address review comments
* fix testnet automation error
2018-11-05 13:50:33 -08:00
Michael Vines
5a85cc4626
Rename buildkite-snap to buildkite-secondary
2018-11-05 08:47:51 -08:00
Michael Vines
2c74815cc9
ci: correct crates.io publishing order
2018-11-02 15:39:24 -07:00
carllin
298bd6479a
Add first leader to genesis ( #1681 )
...
* Add first leader to genesis entries, consume in genesis.sh
* Set bootstrap leader in the bank on startup, remove instantiation of bootstrap leader from bin/fullnode
* Remove need to initialize bootstrap leader in leader_scheduler, now can be read from genesis entries
* Add separate interface new_with_leader() in mint for creating genesis leader entries
2018-11-02 14:32:05 -07:00
Pankaj Garg
db98f7e0b4
Use env variables to disable validator sanity and ledger verification ( #1675 )
2018-10-31 12:30:33 -07:00
jackcmay
0529f36fde
Run workspace member's tests ( #1666 )
...
Run workspace member's tests
2018-10-30 22:53:36 -07:00
Pankaj Garg
85869552e0
Update testnet scripts to use release tar ball ( #1660 )
...
* Update testnet scripts to use release tar ball
* use curl instead of s3cmd
2018-10-30 18:05:38 -07:00
Pankaj Garg
6f9843c14b
Publish a tarball of Solana release binaries ( #1656 )
...
* Publish a tarball of solana release binaries
* included native programs in Solana release tar
* Remove PR check from publish script
2018-10-30 15:31:52 -07:00
Michael Vines
37213209c5
Create programs/bpf/c/sdk/
2018-10-29 19:10:29 -07:00
Michael Vines
f6b1b5ab37
Remove unnecessary checks
2018-10-29 13:27:52 -07:00
Michael Vines
f12743de38
Create/publish bpf-sdk tarball
2018-10-29 12:54:57 -07:00
Michael Vines
77e10ed757
Add utility to figure the current crate version
2018-10-29 12:54:57 -07:00
Michael Vines
f671b7f63f
Publish root crate too
2018-10-25 17:16:18 -07:00
Michael Vines
a340b18b19
Upgrade to rust 1.30
2018-10-25 17:13:41 -07:00
Michael Vines
160cff4a30
Check for TRIGGERED_BUILDKITE_TAG
2018-10-25 16:37:54 -07:00
Michael Vines
1733beabf7
mv common/ sdk/
2018-10-25 13:26:10 -07:00
Michael Vines
471d8f6ff9
Fix up the version references to all other internal crates
2018-10-25 12:54:32 -07:00
Michael Vines
b982595c73
Add version check and rustup
2018-10-24 19:48:58 -07:00
Rob Walker
4ea422bcec
run integration tests serially
2018-10-17 11:37:10 -07:00
Greg Fitzgerald
6074e4f962
Attempt to stabilize the test suite
...
The integration tests are allowed to open sockets, so running them
in parallel may cause "Too many open files" errors. This patch
runs the unit tests in parallel and the integration test serially.
2018-10-17 11:37:10 -07:00
Greg Fitzgerald
5b4d4b97bc
Upgrade to latest stable Rust, 1.29.2
2018-10-15 09:54:24 -06:00
Michael Vines
c5180c8092
Permit RUST_LOG overrides
2018-10-14 12:40:37 -07:00
Pankaj Garg
e5ab9a856c
Upload bench output as build artifacts ( #1478 )
...
* Upload bench output as build artifacts
* Fix tags types
* Pull previous stats from metrics
* Change the default branch for comparison
* Fix formatting
* Fix build errors
* Address review comments
* Dedup some common code
* Add eval for channel info to find branch name
2018-10-12 15:13:10 -07:00
Michael Vines
5c523716aa
Ship native programs
2018-10-10 16:49:48 -07:00
Pankaj Garg
c240bb12ae
Change buildkite agent for testnet automation
2018-10-09 15:04:55 -07:00
Pankaj Garg
29a8823db1
Env variables for testnet-automation parameters ( #1455 )
...
- This will enable us to create custom pipelines for field events
2018-10-09 11:50:56 -07:00
Pankaj Garg
a80955eacb
Change format of data for TPS/Finality metrics in testnet automation ( #1446 )
...
* Change format of data for TPS/Finality metrics in testnet automation
* Revert number of nodes for testnet automation
* Split python command to its own script
* Fix python command line arguments
2018-10-09 10:35:01 -07:00
Pankaj Garg
0a39722719
Add support to trigger testnet from a PR ( #1434 )
...
* Add support for different node counts
* Update variable names
* Delete network even after failures
* Add array for node counts
* Changed number of nodes to a space separated string of numbers
* Adjust number of nodes
* Snap will not be published if the env variable DO_NOT_PUBLISH_SNAP is set
* Address review comments
* Replaced influx db URL
2018-10-05 16:32:05 -07:00
Greg Fitzgerald
9c0fa4d1d2
Upload coverage HTML reports ( #1421 )
...
Uploads two reports to Buildkite, one from cargo-cov and one from lcov via grcov. The lcov one is busted on linux and is what we need to bring codecov.io back up again. It works great on macos if you wanted to generate them locally and prefer lcov HTML reports.
* Also comment out non-coverage build to speed things up.
2018-10-05 10:17:35 -07:00
Michael Vines
beb4536841
Run a fullnode+drone automatically when the container starts up
2018-10-02 18:09:35 -07:00
Michael Vines
ad5fcf778f
Publish minimal Solana docker images to dockerhub
2018-10-02 16:57:48 -07:00
Michael Vines
83b000ae88
Remove SNAP_ prefix
2018-10-02 16:57:48 -07:00
Greg Fitzgerald
94459deb94
Disable codecov.io reporting
2018-09-28 19:19:16 -07:00
Greg Fitzgerald
660af84b8d
Use the same versions of llvm-cov and libprofile
2018-09-28 19:19:16 -07:00
Greg Fitzgerald
7b31020903
Add back llvm-dev for llvm-cov
2018-09-28 19:19:16 -07:00
Greg Fitzgerald
9a4143b4d9
Upgrade llvm-dev and boot kcov
...
Need clang-dev, not llvm-dev because cargo-cov looks for libprofile
in a clang installation directory.
2018-09-28 19:19:16 -07:00
Greg Fitzgerald
aebc47ad55
Attempt coverage reporting
2018-09-28 19:19:16 -07:00
Greg Fitzgerald
5bc01cd51a
Revive code coverage
2018-09-28 19:19:16 -07:00
Greg Fitzgerald
19a7ff0c43
Pin down nightly in benchmark build
2018-09-28 19:29:50 -06:00
Greg Fitzgerald
5f18403199
Upgrade nightly
2018-09-28 19:29:50 -06:00
Tyera Eulberg
9f325fca09
Re-enable cargo audit
2018-09-28 17:53:41 -06:00
Tyera Eulberg
10d08acefa
Reenable cargo audit
2018-09-28 17:53:41 -06:00
Tyera Eulberg
52d50e6bc4
Update for new solana-jsonrpc
2018-09-28 17:53:41 -06:00
Stephen Akridge
aa2a3fe201
Add chacha module to encrypt ledger files
2018-09-28 14:23:37 -07:00
Greg Fitzgerald
485ba093b3
Install kcov to CI environment
2018-09-28 11:20:27 -06:00
Michael Vines
8d92232949
Specify zone
2018-09-28 07:32:49 -07:00
Michael Vines
e4d8c094a4
Include -z when deleting network
2018-09-27 21:27:09 -07:00
Greg Fitzgerald
675ff64094
Fail CI on clippy warnings
2018-09-27 16:21:12 -06:00
Greg Fitzgerald
f9fe6a0f72
Move clippy to Rust stable
2018-09-27 16:21:12 -06:00
Greg Fitzgerald
8d007bd7f7
Upgrade rustc and add clippy to stable
2018-09-27 16:21:12 -06:00
Stephen Akridge
6cdbdfbbcb
Enable bench and fix upload-perf
2018-09-27 14:16:56 -07:00
Pankaj Garg
35e6343d61
Update testnet-deploy script to configure GPUs for leader node ( #1379 )
2018-09-27 13:42:24 -07:00
Michael Vines
afc764752c
Permit testnets without a GPU
2018-09-26 10:37:41 -07:00
sakridge
3e76efe97e
Fix bench compilation ( #1311 )
2018-09-24 10:40:42 -07:00
Michael Vines
e5e325154b
Add --shell argument
2018-09-24 08:05:47 -07:00
Michael Vines
67f1fbab5f
Treat rustc warnings as errors in CI
2018-09-20 19:46:20 -07:00
sakridge
2981076a14
Add solana-upload-perf to parse json from bench and upload to influx ( #1166 )
2018-09-19 13:16:55 -07:00
Michael Vines
3ca80c676c
Disable large-network until it's fixed
2018-09-14 20:13:17 -07:00
Michael Vines
a344eb7dd0
Upgrade rust stable to 1.29
2018-09-14 16:37:49 -07:00
Michael Vines
f06113500d
bench-tps/net sanity: add ability to check for unexpected extra nodes
2018-09-12 15:38:57 -07:00
Rob Walker
97c3125a78
improve localnet-sanity's robustness ( #1160 )
...
* fix poll_gossip_for_leader() loop to actually wait
for 30 seconds
* reduce reuseaddr use to only when necessary,
try to avoid already bound sockets
* move nat.rs to netutil.rs
* add gossip tracing to thin_client and bench-tps
2018-09-09 04:50:43 +09:00
Michael Vines
a77aca75b2
Add NO_VALIDATOR_SANITY back
2018-09-07 22:37:05 -07:00
Michael Vines
b1b03ec13b
Refine docker image tagging to avoid breaking stabilization branches on updates
2018-09-07 18:42:25 -07:00
Rob Walker
51b27779c9
client changes for TODOs and looping ( #1138 )
...
* remove client.sh from snap
* default to ephemeral instead of ~/.config key
* rework CLI for bench-tps
* remote multinode-demo stuff from remote-client.sh
* remove multinode-demo from remote-sanity and localnet-sanity
2018-09-08 07:07:10 +09:00
Michael Vines
0d945e6a92
Groom testnet-sanity logging
2018-09-07 12:45:48 -07:00
Michael Vines
e51445d857
🙃
2018-09-07 12:24:34 -07:00
Michael Vines
ee682d5bc3
Move wallet-sanity.sh out of multinode-demo/
2018-09-07 12:01:43 -07:00
Michael Vines
506a81e8cc
Assume -y
2018-09-07 12:01:43 -07:00
Michael Vines
88298bf321
Add -n option
2018-09-07 12:01:43 -07:00
Michael Vines
533ebc17f2
Install multilog automatically on a CI machine
2018-09-07 11:56:23 -07:00
Michael Vines
e088833b81
s/create/start/
2018-09-06 21:07:11 -07:00
Michael Vines
b1bacf12a6
Add some log sections
2018-09-06 20:38:11 -07:00
Michael Vines
66ff602659
Rewrite ci/testnet-{deploy,sanity}.sh in terms of net/ primitives
2018-09-06 19:54:39 -07:00
Michael Vines
072d0b67e4
Send deploy metrics to the testnet-specific database
2018-09-06 08:30:03 -07:00
Michael Vines
6560b0e2cc
s/whoami/id -un/
2018-09-05 14:26:21 -07:00
Michael Vines
449d7042f0
Configure metrics correctly
2018-09-05 09:02:02 -07:00
Michael Vines
43b4207101
Run oom-monitor in net/ testnets
2018-09-05 09:02:02 -07:00
Michael Vines
c81c19234f
Improve incremental speed of docker cargo builds outside of CI
2018-09-05 09:02:02 -07:00
Greg Fitzgerald
cf2626a1c5
Update instructions to upgrade nightly docker image
2018-09-04 20:56:40 -06:00
Greg Fitzgerald
68c72d6f34
Fix nightly build
2018-09-04 20:56:40 -06:00
Greg Fitzgerald
65f78905cd
Install cargo-cov on latest nightly
2018-09-04 20:56:40 -06:00
Michael Vines
b4a7a18334
Update README.md
2018-09-04 13:29:00 -07:00
Rob Walker
61abee204f
don't check for snap mode in common.sh, is only relevant to snap daemons ( #1113 )
...
snap mode is for daemons, remove it from client (i.e. common.sh)
supply leader info to client via snap
2018-09-04 14:31:54 +09:00
Rob Walker
e834c76b40
--count => --num-nodes
2018-09-04 07:07:25 +09:00
Rob Walker
d1f1cbe88f
leader-address=>leader-ip
2018-09-01 04:38:18 +09:00
Rob Walker
a4e7b6e90c
more fixups for client.sh changes
2018-09-01 03:33:21 +09:00
Rob Walker
fbc7c9c431
fix client_start to deal with new client.sh
2018-09-01 03:23:05 +09:00
Rob Walker
8b248dcf09
specify port
2018-09-01 02:56:24 +09:00
Rob Walker
4938aad939
fixups
2018-09-01 02:21:46 +09:00
Rob Walker
7e882dfe62
inform all snaps where the network is
2018-09-01 02:21:46 +09:00
Rob Walker
9d1eb4f9ea
remove 'localhost' leader (redundant, un-dig-friendly)
2018-08-31 23:21:07 +09:00
Rob Walker
176e806d94
rework of netwrk rendezvous
...
* rename NodeInfo field of Node from "data" to "info"
(touches a lot of files)
* update client to use gossip to find leader, a la drone
* rework multinode scripts
* move more stuff into rust
* added usage to all
* no more rsync unless you're a validator (TODO: whack that, too)
* fullnode doesn't bail if drone isn't up yet, just keeps trying
* drone doesn't bail if network isn't up yet, just keeps trying
2018-08-31 23:21:07 +09:00
Rob Walker
63e44dcc35
continue rendezvous refactor for gossip and repair
...
* remove trailing whitespace in ci/audit.sh
* code review fixups
* rename GOSSIP_PORT_RANGE => SOLANA_PORT_RANGE
* remove out-of-date TODO in localnet-sanity.sh
* remove features=test and code that was using it (localhost prohibitions in
crdt) added TODO in crdt.rs, maybe we should boot localhost in production
networks?
* boot tvu_window from NodeInfo: instead, send repair requests from the repair
socket (to gossip on peer) and answer repair requests via the sockaddr
from the repair request
* remove various unused pub functions
* banish SocketAddr parse().unwrap() to a macro that can also accept simpler stuff
2018-08-31 23:21:07 +09:00
Rob Walker
1af4cee63b
fix #1079
...
* move gossip/NCP off assuming anything about its address
* use a single socket to send and receive gossip
* remove --addr/-a from CLIs
* rearrange networking utility code
* use Arc<UdpSocket> to share the Sync-safe UdpSocket among threads
* rename TestNode to Node
TODO:
* re-enable 127.0.0.1 as a valid address in crdt
* change repair request/response to a similar, single socket
* pick cloned sockets or Arc<UdpSocket> for all these (rpu uses tryclone())
* update contact_info with network truthiness instead of what the node
says?
2018-08-31 23:21:07 +09:00
Rob Walker
cb52a335bd
re-enable localnet-sanity
2018-08-31 23:21:07 +09:00
Michael Vines
73a0bf8d30
Avoid unbounded /var/tmp growth
2018-08-28 08:11:44 -07:00
Michael Vines
9d53208d68
Use gcloud_DeleteInstances
2018-08-28 08:11:44 -07:00
Michael Vines
c8e3ce26a9
Start of scripts/gcloud.sh
2018-08-27 22:35:14 -07:00
Rob Walker
51d911e3f4
Update testnet-sanity.sh
2018-08-27 15:44:10 -07:00
Michael Vines
bd5c6158ae
Move some common scripts from multinode-demo/ to scripts/
2018-08-27 13:52:38 -07:00
Rob Walker
0efd64df6f
no need for sudo, move ledger copy out of SNAP_DATA
2018-08-28 05:42:05 +09:00
Rob Walker
28bdf346f6
clean up after ledger sanity
2018-08-28 05:42:05 +09:00
anatoly yakovenko
738247ad44
advertise valid gossip address in drone and wallet ( #1066 )
...
* advertize valid gossip address in drone and wallet
get rid of asserts
check for valid ip address
check for valid address
ip address
* tests
* cleanup
* cleanup
* print error
* bump
* disable tests
* disable nightly
2018-08-26 11:36:27 -07:00
anatoly yakovenko
f7c0d30167
Disallow localhost in deployment ( #1064 )
...
* disallow localhost in deployment
* tests
* fmt
* integration tests do not have a flag to check
* fmt
2018-08-25 21:09:18 -07:00
Greg Fitzgerald
db3fb3a27c
Boot criterion ( #1032 )
...
* Revert benchmarks back to libtest
Criterion has too many dependencies, it's execution as slower, and
we didn't see the kind of precision we had hoped for to use it to
block CI builds.
* Ignore benchmarks that take more than a few milliseconds per iteration
* Revert "Ignore benchmarks that take more than a few milliseconds per iteration"
This reverts commit b87cdf6ef4a2549ec09e282014391de695473699.
* Don't run benchmarks in CI
They are already built in the nightly build. Executing them in CI
doesn't add much value until the results are precise enough to act
on.
2018-08-22 08:57:07 -06:00
Rob Walker
0b48aea937
echo commands, use PID (good form)
2018-08-21 11:41:00 +09:00
Rob Walker
cdec0cead2
files have to appear in the snap
2018-08-21 11:41:00 +09:00
Rob Walker
831709ce7e
fixups
2018-08-21 10:36:03 +09:00
Rob Walker
b7b8a31532
make a copy of the ledger for sanity check
...
we can't verify a live ledger, unfortunately, fixes #985
2018-08-21 10:36:03 +09:00
Rob Walker
5aced8224f
Revert "make a copy of the ledger for sanity check"
...
This reverts commit af20a43b77
.
2018-08-21 10:34:52 +09:00
Rob Walker
af20a43b77
make a copy of the ledger for sanity check
...
we can't verify a live ledger, unfortunately, fixes #985
2018-08-21 09:45:52 +09:00
Greg Fitzgerald
39c3280860
Don't block on large network test
2018-08-20 16:48:37 -06:00
Michael Vines
a1ec549630
Pin nightly rust for more controlled updating
2018-08-20 10:55:55 -07:00
Michael Vines
ecddff98f5
Add --nopull argument
2018-08-20 10:55:55 -07:00
Michael Vines
10066d67bf
Add llvm deb repository
2018-08-19 09:01:36 -07:00
Michael Vines
a07f7435c6
\
2018-08-19 08:49:29 -07:00
Michael Vines
d3523ebbe5
Nightly image now derives from stable image
2018-08-19 08:47:59 -07:00
Tyera Eulberg
1bf15ae907
Temporarily disable cargo audit CI failure
2018-08-18 12:29:49 -06:00
Michael Vines
877920e61b
Compute snap channel using ci/channel-info.sh
2018-08-17 23:15:48 -07:00
Michael Vines
3d1e908dad
Add script to fetch latest channel info
2018-08-17 23:15:48 -07:00
Michael Vines
6880c2bef0
Exclude ci/semver_bash/; don't want to diverge from upstream
2018-08-17 23:15:48 -07:00
Michael Vines
78872ffb4b
Vendor https://github.com/cloudflare/semver_bash/tree/c1133faf0e
2018-08-17 23:15:48 -07:00
Michael Vines
229d825fe0
Fix master-perf basename
2018-08-17 21:59:36 -07:00
Michael Vines
edc5fc098e
Make SNAP_CHANNEL more visible in build log
2018-08-17 21:39:54 -07:00
Michael Vines
82e7725a42
Invert logic
2018-08-17 21:16:35 -07:00
Michael Vines
dc61cf1c8d
Keep v0.7 snap off the edge channel
2018-08-17 21:12:10 -07:00
Michael Vines
aba63e2c6c
Log expansion directive must be on its own line
2018-08-17 20:58:14 -07:00
Michael Vines
c2ddd056e2
Add option to skip ledger verification
2018-08-17 20:41:30 -07:00
Rob Walker
7aeef27b99
not quite banishing build.rs, but better
2018-08-16 22:33:31 -07:00
Michael Vines
98d0ef6df5
Add some wget retries
2018-08-16 20:22:49 -07:00
Rob Walker
fc0d7f5982
updated nightly versions
2018-08-16 13:17:29 -07:00
Rob Walker
f697632edb
update clippy install instructions, from here:
...
https://github.com/rust-lang-nursery/rust-clippy
fixes #947 ?
2018-08-16 13:17:29 -07:00
Rob Walker
73797c789b
back to 4 TX threads
2018-08-16 12:02:11 -07:00
Rob Walker
036fcced31
test -t nproc
2018-08-16 12:02:11 -07:00
Rob Walker
1d3157fb80
fixups
2018-08-16 12:02:11 -07:00
Rob Walker
0b11c2e119
restart testnet clients in case airdrop fails
2018-08-16 12:02:11 -07:00
Michael Vines
757dfd36a3
Report errors better in build log
2018-08-14 11:44:26 -07:00
Rob Walker
ab10b7676a
use stable cache
2018-08-13 16:23:30 -07:00
Rob Walker
fa44a71d3e
move bench to a seprate, parallel step
2018-08-13 16:23:30 -07:00
Rob Walker
9e22e23ce6
increase stable timeout until tomorrow
2018-08-13 15:45:50 -07:00
Michael Vines
df5cde74b0
Back out pre-0.7.1 workaround
2018-08-13 12:13:00 -07:00
Michael Vines
c2ba72fe1f
Fix up validator sanity
2018-08-13 10:23:35 -07:00
Michael Vines
d93786c86a
Revert "turn off validator sanity while I work on it"
...
This reverts commit d4304eea28
.
2018-08-13 10:23:35 -07:00
Rob Walker
8eed120c38
add missing backslash
2018-08-10 23:45:08 -07:00
Rob Walker
d4304eea28
turn off validator sanity while I work on it
2018-08-10 14:56:46 -07:00
Rob Walker
7f71e1e09f
fixups
2018-08-10 11:41:31 -07:00
Rob Walker
bb7eccd542
check validator startup in testnet-sanity.sh
2018-08-10 11:41:31 -07:00
Rob Walker
b04c71acd9
check issue 910 in testnet-sanity
2018-08-10 11:41:31 -07:00
Rob Walker
8b41c415b7
add equal sign
2018-08-10 08:05:48 -07:00
Michael Vines
8ca514a5ca
Remove unnecessary :
2018-08-08 22:45:39 -07:00
Michael Vines
b605552079
Record network version in testnet-deploy start datapoint
2018-08-08 22:41:02 -07:00
Michael Vines
74f5538bd3
Verify the ledger as a part of sanity
2018-08-08 16:10:54 -07:00
Pankaj Garg
a6857dbaaa
Updated node count to 230. Increased wmem on CI large
2018-08-08 13:13:18 -07:00
Michael Vines
054298d957
Retry snap install 3 times, sometimes the snap server 503s
2018-08-08 08:56:05 -07:00
Michael Vines
cca240c279
Add SOLANA_NET_NAME, rename SOLANA_NET_URL to SOLANA_NET_ENTRYPOINT
2018-08-08 08:49:30 -07:00
Michael Vines
89f17ceecf
Route setup-args
2018-08-08 08:32:23 -07:00
pgarg66
75854cc234
Update dynamic network test with more nodes ( #904 )
...
- Check for correct OS params in test-large-network.sh
2018-08-08 06:52:57 -07:00
Michael Vines
ecea41a0ab
Install EarlyOOM on testnet nodes
2018-08-07 16:58:46 -07:00
Michael Vines
e3cf1e6598
Bundle metrics_write_datapoint.sh in Snap
2018-08-07 13:35:01 -07:00
pgarg66
16772d3d51
Coalesce multiple blobs if received close together ( #869 )
...
- This helps reduce unnecessary growth of window if small blobs
are received in small space of time
2018-08-07 10:29:57 -07:00
Michael Vines
1c38e40dee
Validate ledger once all the tests complete
2018-08-07 10:00:52 -07:00
Michael Vines
91741e20fa
Add rustc/cargo version check
2018-08-06 09:32:08 -07:00
Michael Vines
a13058b6c4
Look for 3 nodes (1 leader, 2 validators)
2018-08-03 20:30:29 -07:00
Rob Walker
c998199954
fixups, add validator-x to sanity
2018-08-03 15:34:11 -07:00
Michael Vines
15a6179b97
Stop installing rustfmt-preview, it's already present
2018-08-03 14:27:11 -07:00
Michael Vines
83b308983f
Include rustfmt-preview
2018-08-03 14:11:42 -07:00
Rob Walker
f2b1a04bca
cargo fmt fixups
2018-08-03 11:59:25 -07:00
Michael Vines
3e36e6dcf8
Upgrade to rust 1.28
2018-08-03 11:30:40 -07:00
Michael Vines
6feb6a27be
Run localnet-sanity in test-stable-perf
2018-08-03 10:46:48 -07:00
Michael Vines
c230360f4c
Wait until recycled machines are reachable before provisioning them
2018-08-02 22:13:17 -07:00
Michael Vines
a9240a42bf
Delete unreachable validators to cause a fresh one to be spawned
2018-08-02 20:45:29 -07:00
Michael Vines
a7204d5353
Use a local user to avoid GCP login quota limits
2018-08-02 19:43:35 -07:00
Greg Fitzgerald
2366c1ebaf
Enable cargo audit in CI
...
Fixes #772
2018-08-01 16:24:47 -07:00
Michael Vines
2c9d288ca9
Add a CI metric data point upload timeout to prevent CI build stalls
...
5 seconds is somewhat arbitrary, seems like enough
2018-08-01 15:49:48 -07:00
Greg Fitzgerald
bb0aabae75
Add cmake, which is needed to build cargo-audit
2018-08-01 16:43:49 -06:00
Michael Vines
2b259aeb41
testnet now deploys successfully on days of the month < 10
2018-08-01 14:10:52 -07:00
Michael Vines
de7e9b4b4c
Remove retry
...
This was introduced to mask the occasional failure of racy tests. But this is misguided as it helps hid the true problem, the racy test, and it causes tries builds that fail deterministically to retry only to fail once again.
2018-08-01 12:02:39 -07:00
Michael Vines
5d936e5c8a
Trap SIGINT for clean ^C shutdown
2018-07-30 17:15:50 -07:00
Michael Vines
5a40ea3fd7
Only map HOME when in CI
2018-07-30 16:36:26 -07:00
Michael Vines
102510ac0e
Clear apt cache to reduce image size
2018-07-30 16:36:26 -07:00
Michael Vines
2158329058
Switch to docker-rust image
2018-07-30 16:36:26 -07:00
Michael Vines
bc484ffe5f
Add docker-rust image
2018-07-30 16:36:26 -07:00
Michael Vines
6fcf4584d5
Propagate more BUILDKITE environment variables into containers
2018-07-30 16:36:26 -07:00
Michael Vines
1adc83d148
Add localnet-sanity.sh
2018-07-30 16:36:26 -07:00
Michael Vines
416c141775
`export SKIP_INSTALL=1` to reset the network without reinstalling the snap
2018-07-28 18:04:13 -07:00
Michael Vines
4cdb9a73f8
Skip testnet-sanity on manual deploy
2018-07-28 12:37:29 -07:00
Michael Vines
4433730610
Add support for deploying a locally built snap
2018-07-28 12:37:29 -07:00
Michael Vines
71eb5bdecc
Factor out vm_foreach
2018-07-28 12:37:29 -07:00
Michael Vines
80a02359f7
Add script to audit for security vulnerabilities
2018-07-26 13:42:12 -07:00
Michael Vines
ab3968e3bf
Dedup
2018-07-26 11:45:58 -07:00
Michael Vines
42ebf9502a
Agent cleaning is now performed in a separate pipeline
2018-07-26 11:37:36 -07:00
Michael Vines
bd4fcf4ac6
Clean out stale buildkite agent build directories
2018-07-26 11:37:36 -07:00
Michael Vines
4dceb73909
Reinstall client nodes in the background to speed up deploys
2018-07-26 09:49:00 -07:00
Rob Walker
5115cd7798
large network back to erasure
2018-07-25 20:45:16 -07:00
Michael Vines
4c4659be13
Add more stdout
2018-07-25 16:38:21 -07:00
Michael Vines
1b79fe73a1
Emit a metrics datapoint if bench-tps terminates
2018-07-25 15:55:02 -07:00
Michael Vines
5fa072cf16
Avoid quotes around net name
2018-07-25 15:55:02 -07:00
Stephen Akridge
80ecef2832
Add --sustained to ci testnet deploy script
2018-07-25 10:16:46 -07:00
Michael Vines
dcce475f0b
Progagate logging configuration to client nodes
2018-07-24 21:40:02 -07:00
Rob Walker
8f046cb1f8
disable erasure for large network testing
2018-07-24 16:54:52 -07:00
Michael Vines
735a0ee16d
Switch back to running bench-tps in 10 minute iterations
2018-07-24 15:43:25 -07:00
Rob Walker
940caf7876
test large network with erasure
2018-07-24 13:04:34 -07:00
Michael Vines
782aa7b23b
Cap at 4 threads
2018-07-24 11:35:03 -07:00
Michael Vines
7a71adaa8c
Adjust threads by the number of cpus
2018-07-23 21:17:36 -07:00
Michael Vines
ce8796bc2e
Correctly calculate the expected number of full nodes
2018-07-23 19:55:09 -07:00
Michael Vines
c7e1409f7b
Not so much |set -x|
2018-07-23 19:55:09 -07:00
Michael Vines
9de9379925
Add support more more than 1 client node
2018-07-23 19:34:34 -07:00
Michael Vines
96a6e09050
Enable metrics in the TPS client
2018-07-23 16:51:39 -07:00
Michael Vines
7ebbaaeb2d
Use bench-tps default duration
2018-07-22 16:26:49 -07:00
Michael Vines
5d065133ef
Add data point for testnet startup and shutdown
2018-07-21 23:27:24 -07:00
Michael Vines
d403808564
Restart `solana.bench-tps` every 10 minutes to work around memory leak
...
cc: #728
2018-07-21 19:48:13 -07:00
Michael Vines
3ffdca193d
Rename client-demo to bench-tps catchup
2018-07-21 15:46:03 -07:00
Greg Fitzgerald
637f890b91
Rename client-demo to bench-tps
2018-07-21 11:36:20 -04:00
Michael Vines
009d5adcba
Tell the client to transact for 1 hour blocks
2018-07-20 17:52:19 -07:00
Michael Vines
52c55a0335
Log to /tmp/solana.log for easy runtime inspection of client activity
2018-07-20 17:45:13 -07:00
Michael Vines
120add0e82
Add support for a client node running continuous transactions on the net
2018-07-20 17:07:36 -07:00
Michael Vines
9cf0bd9b88
Adjust variable name
2018-07-20 09:50:24 -07:00
Michael Vines
9d25d7611a
Protect against unsupported configurations to prevent non-obvious errors later
2018-07-20 09:47:01 -07:00
Michael Vines
1abefb2c7a
Pass expected node count to testnet-sanity
2018-07-20 09:47:01 -07:00
Michael Vines
68ca9b2cb8
Generalize testnet deployment scripts
2018-07-20 09:10:28 -07:00