Commit Graph

1118 Commits

Author SHA1 Message Date
Michael Vines 458ae3fdac Switch to instances with AVX-512 if possible for better interop with dev machines (#4328)
automerge
2019-05-17 20:06:07 -07:00
Rob Walker 431cc82032
add Transaction::partial_sign() (#4333)
* add partial sign

* nits
2019-05-17 18:55:57 -07:00
Jack May 9271ba0039
Cleanup Rust BPF program building (#4318) 2019-05-16 17:35:42 -07:00
Rob Walker 87414de3e2
switch over to passive stakes (#4295)
* add failing test

* switch over to passive stakes

* test multiple stakers
2019-05-16 08:23:31 -07:00
Michael Vines 915956b94b Remove disable leader rotation option (#4299)
automerge
2019-05-15 15:16:45 -07:00
Sagar Dhawan 5e91f8f59d
Update reported tx count to exclude errors (#4201) 2019-05-13 13:23:52 -07:00
Michael Vines 06378d6db6
Refine killNode logging 2019-05-12 21:21:31 -07:00
Michael Vines 1dce5976cf
Disable node restart in localnet-sanity.sh 2019-05-12 21:21:31 -07:00
Michael Vines 1afccb7351
Add more regions to the testnet 2019-05-11 14:12:13 -07:00
Jack May f567877d1d
Cleanup metrics (#4230) 2019-05-10 08:33:58 -07:00
Rob Walker a80176496d
add /target/ to .gitignore files for all crates (#4217)
* add /target/ to .gitignore files for all crates

* shellcheck
2019-05-08 12:15:05 -07:00
Michael Vines f690c64375
Disable solana-upload-perf until performance can be debugged (#4210) 2019-05-07 23:02:09 -07:00
Michael Vines b0f2220ef6
Fix solana-upload-perf log folding. Upload bench output too (#4208) 2019-05-07 22:30:42 -07:00
Michael Vines 908b48bf0e
Increase test-stable build timeout 2019-05-07 22:23:43 -07:00
Michael Vines 2621aeee82
Set default wallet rpc port correctly 2019-05-07 11:37:51 -07:00
Michael Vines 88fdba5aca
Temp: bump test-bench timeout 2019-05-06 10:00:00 -07:00
Michael Vines 9b50583641
wallet: add --url, remove --host/--rpc-host/--rpc-port/-rpc-tls (#4153)
Also by default the wallet now talks to testnet.solana.com instead of
localhost
2019-05-06 07:38:26 -07:00
Michael Vines 7fe3c75c6b
Add a node-specific ip echo service to remove dependency on ifconfig.co (#4137) 2019-05-03 11:01:35 -07:00
Michael Vines c8ed41167a
Factor tune_system() out of multinode-demo/ (#4138)
* Remove x bit from ulimit-n.sh

* Factor tune_system() out of multinode-demo/
2019-05-03 10:40:02 -07:00
Rob Walker ffb15578ce
remove cargo install cargo-audit from CI (#4123) 2019-05-02 15:35:47 -07:00
Rob Walker abcbbb925f
push latest, too (#4131) 2019-05-02 15:33:08 -07:00
Rob Walker 059755fe59
install mdbook and svgbob_cli (#4128) 2019-05-02 15:32:31 -07:00
Rob Walker 37b5c6afaa
install cargo audit (#4122) 2019-05-02 13:16:21 -07:00
Rob Walker 7f75cc8906
update nightly to 2019-05-01 (#4111)
* update nightly to 2019-05-01

* cargo fmt

* cargo fmt

* increase bench timeout
2019-05-01 20:08:42 -07:00
Rob Walker a7d18125d3
install grcov (#4097) 2019-05-01 14:27:17 -07:00
Michael Vines 21f845ed39
Use more -w 2019-04-30 09:57:14 -07:00
Michael Vines 7a369df9a7
Add flag to skip slow extras when deploying a large testnet 2019-04-30 09:26:50 -07:00
Michael Vines d21fa4a177
v0.14: various net/ fixes for large clusters (#4080)
* net.sh: Add -F to discard validator nodes that didn't bootup successfully

* Relax sanity node count when validator bootup failure is permitted

* Less sanity for testnet-demo

* net.sh: Add -F to discard validator nodes that didn't bootup successfully
2019-04-29 21:38:32 -07:00
Jack May c545e812d0
Expand bank benches to include async/sync and native_loader (#4026) 2019-04-29 13:09:11 -07:00
Michael Vines c3ec5ad846
testnet-demo: use more low quota nodes 2019-04-29 12:18:39 -07:00
Michael Vines e2e55f81d0
Increase testnet-demo node count a little 2019-04-29 09:09:55 -07:00
Michael Vines 0cc3956693
testnet-demo now runs across more GCE zones (#4053)
* testnet-demo now runs across more GCE zones

* Save zone info to config file

* Add geoip whitelist for common data centers

* Skip more of start

* Include -x for config

* Fetch private key from first validator node if necessary

* Correct -r propagation
2019-04-28 19:50:52 -07:00
Michael Vines 0b7269b64e
Switch testnet-demo to influxcloud 2019-04-27 22:12:50 -07:00
Michael Vines 457a2d948b
Correct us-central1-b zone name 2019-04-27 21:43:18 -07:00
Michael Vines 528bdf34fd
testnet-demo: skip over validator nodes that fail to boot 2019-04-27 21:34:23 -07:00
Michael Vines 9c1fd55768
testnet-demo: add more GCE zones, remove client 2019-04-27 16:52:09 -07:00
Michael Vines 4a5837a286
Add " 2019-04-27 07:41:21 -07:00
Michael Vines d36af917ea
Swap testnet-beta and testnet configuration 2019-04-26 23:24:35 -07:00
Michael Vines c81733b41a
Add testnet-demo configuration 2019-04-26 22:59:26 -07:00
Michael Vines b6558a2ef3
Remove created lockfile 2019-04-26 21:36:20 -07:00
Michael Vines 634d8e25ee
testnet-deploy.sh updates 2019-04-26 21:29:42 -07:00
Michael Vines fea212e64e
Initialize stopNetwork var 2019-04-26 21:10:36 -07:00
Dan Albert 3e678511d2
Add enable/disable key value pairs into the steps block (#4018) 2019-04-26 14:26:05 -06:00
Michael Vines 4ce2105548 Switch from a S3 URL to release.solana.com for release assets (#4017)
automerge
2019-04-26 13:06:55 -07:00
Dan Albert 08f0fb1e14
Implement working lockfile for testnet lockout (#4013) 2019-04-26 11:22:23 -06:00
Dan Albert f5f5281f85
Add on-demand functionality to all testnets (#4003)
* Add on-demand functionality to all testnets
2019-04-26 10:02:23 -06:00
Michael Vines 1684a7bd18
Move validators from testnet-beta to testnet (#4011)
* Move validators from testnet-beta to testnet

* Move testnet influxdb datasource to influxcloud
2019-04-26 09:02:12 -07:00
Michael Vines 0add5c1dc8
Move testnet buildkite env variables back into the tree (#3989) 2019-04-25 11:44:58 -07:00
Michael Vines 6293d324db
Spellnig 2019-04-24 07:39:29 -07:00
Michael Vines c1ecfec3b0
Bump stable build timeout 2019-04-23 20:29:14 -07:00
Michael Vines 05bcb7f292
Add stop node command to solana-gossip (#3928) 2019-04-22 14:51:20 -07:00
Pankaj Garg 060793f451
Fix testnet automation scripts (#3886)
- missing machine type since change in gce.sh
2019-04-18 15:12:35 -07:00
Dan Albert 901c74b653
Add packages and fix publish script (#3839)
* Add packages and fix publish script

* Fixup
2019-04-18 09:24:18 -06:00
Michael Vines 9ccd362461
Correct ./net.sh sanity argument order 2019-04-17 18:10:38 -07:00
Michael Vines 78d5ace754
Refactor multinode-demo/ scripts to avoid shipping fullnode-x.sh (#3835) 2019-04-17 18:03:58 -07:00
Pankaj Garg a2c8e3952f
Fixes to TPS calculation and reporting (#3836)
Fixes to TPS calculations and reporting
2019-04-17 15:37:01 -07:00
Michael Vines beb8c7914e
Disable testnet-sanity ledger verification, too slow 2019-04-17 15:19:37 -07:00
Michael Vines e03215c4c0
Remove iterations with leader rotation disabled 2019-04-17 15:07:51 -07:00
Michael Vines ca36a6f4e0
Run sanity only in the zone that contains the bootstrap leader and blockstreamer nodes (#3828) 2019-04-17 14:25:40 -07:00
Greg Fitzgerald 51a2988bb2
Revert "Rename programs to instruction_processors (#3789)" (#3824)
This reverts commit 34344982a9.
2019-04-17 15:05:49 -06:00
Michael Vines eb185b9ea5
testnet-beta sanity no longer tries to check inactive zones 2019-04-17 09:30:41 -07:00
Amr Ali 34344982a9
Rename programs to instruction_processors (#3789)
* Rename programs to instruction_processors

* Updates around the code base to support instruction_processors rename

* Kabab instruction_processors

* Update Cargo.toml files and scripts to use instruction-processors

* Update Cargo.toml to use instruction-processors

* Update CI scripts to use instruction-processors
2019-04-16 22:39:00 +02:00
Michael Vines 63d66ece57
net/ testnet nodes now stake more lamports (#3812)
* Add --bootstrap-leader-lamports

* Generalize --no-stake into --stake NUM

* Use a large stake for net/ fullnodes

* Setup vote account before starting fullnode to avoid mixed log output
2019-04-16 13:03:01 -07:00
Pankaj Garg 8d613f3977
Selectively deploy beta testnet to GCE/AWS or both clouds (#3805) 2019-04-16 10:40:30 -07:00
Michael Vines c67cc694ae
Remove stake from `./net sanity` ephemeral validator (#3797) 2019-04-15 21:42:25 -07:00
Pankaj Garg 819a0c5c7e
Update testnet automation script to reflect changes in metrics (#3779) 2019-04-15 18:56:04 -07:00
Greg Fitzgerald 80f3568062
Upgrade to Rust 1.34.0 (#3781)
* Upgrade to Rust 1.34.0

* Remove redundant closures

Thanks Clippy!
2019-04-15 15:56:08 -06:00
Michael Vines 5e2831f09e Disable cluster restart attempt 2019-04-15 09:59:53 -07:00
Michael Vines 6c9fba058b Reenable validator sanity check for testnet-{beta,edge} 2019-04-15 08:58:29 -07:00
Michael Vines f6aa90e193 Add fullnode --dynamic-port-range option 2019-04-14 07:08:29 -07:00
Michael Vines 5b438d917d Create fullnode-x.sh wrapper script for use with |solana-install run ...| 2019-04-12 17:08:18 -07:00
Michael Vines 2f1b0bf4f5 Add solana-install deployments to the testnets 2019-04-11 10:03:35 -07:00
Rob Walker 58a049ebe5
pick up logs as artifacts (#3721) 2019-04-10 17:05:39 -07:00
Dan Albert a5254a3f7a
Add TESTNET_TAG Env var to buildkite (#3692)
* Add TESTNET_TAG Env var to buildkite
2019-04-09 13:00:45 -07:00
Michael Vines 6ac919c71a Set warn log level only for perf testnets 2019-04-09 11:09:16 -07:00
Pankaj Garg 72b7419e1c
Define list of valid cloud regions for GCE and AWS (#3670) 2019-04-07 14:29:09 -07:00
Pankaj Garg 7baff0920c Propagate cloud env variables to buildkite job 2019-04-07 11:48:25 -07:00
Pankaj Garg d9ecc278b4
Configure cloud zones and nodes from buildkite for beta testnet (#3666) 2019-04-07 08:25:34 -07:00
Pankaj Garg 89efe67e73 Fix the ordering of beta testnet zones 2019-04-05 17:53:31 -07:00
Greg Fitzgerald c3654b0f65 Add sdk benches to ci
And add `-a` to `tee` for more reliable copypasta.
2019-04-05 17:58:11 -06:00
Dan Albert 3fcca5bc0a Suppress shellcheck array expansion warnings 2019-04-05 13:25:14 -07:00
Dan Albert 9d4c6f6aaa Appease shellcheck 2019-04-05 13:25:14 -07:00
Dan Albert d570b08134 Clean up array expansion 2019-04-05 13:25:14 -07:00
Dan Albert 8b6d7129f3 Fix option flag lettering 2019-04-05 13:25:14 -07:00
Dan Albert 50444181c5 Fix arg array ordering and rename network-name option 2019-04-05 13:25:14 -07:00
Dan Albert 0c51f156ae Reverse order of zone arg array building 2019-04-05 13:25:14 -07:00
Dan Albert fe2fb40d88 Add multi-region deploy functionality 2019-04-05 13:25:14 -07:00
Dan Albert 9ba0439593 Add multi-region deploy functionality 2019-04-05 13:25:14 -07:00
Pankaj Garg b33a1fa019 Fix clippy errors 2019-04-05 12:22:10 -07:00
Pankaj Garg 63fd4222aa Fix testnet sanity check for beta testnet 2019-04-05 12:22:10 -07:00
Pankaj Garg ed78c8d3bb Fix beta testnet launch script 2019-04-04 15:16:01 -07:00
Pankaj Garg ef1e5db0ee Force delete all beta testnet nodes before restarting them 2019-04-03 17:58:54 -07:00
Pankaj Garg 2e4acba579 Remove second block streamer from testnet beta 2019-04-02 15:15:11 -07:00
Pankaj Garg f441177840 Deploy beta testnet with 100 nodes across AWS and GCP 2019-04-02 11:21:57 -07:00
Tyera Eulberg 92c66a411b Remove bench-tps converge-only 2019-04-01 23:05:25 -06:00
Tyera Eulberg af97ad3d68 Add solana-gossip module 2019-04-01 23:05:25 -06:00
Pankaj Garg cb3adea94f Increase node count in beta testnet 2019-04-01 11:06:24 -07:00
Stephen Akridge 981e057363 Just test features in core 2019-03-28 21:40:52 -07:00
Pankaj Garg 1d48c4dd45 enable leader rotation in beta testnet 2019-03-28 13:44:44 -07:00
Pankaj Garg c09e0eb536 propagate TESTNET_DB_HOST env variable to next step in buildkite 2019-03-26 14:40:18 -07:00
Pankaj Garg 0d90dfae1a Add provisions to specify a database server in testnet manager buildkite 2019-03-26 14:40:18 -07:00
Pankaj Garg e1c0425c2b Remove rewards crate from publishing script 2019-03-25 20:19:58 -07:00
Greg Fitzgerald 573dec63da Fix runtime benches 2019-03-25 14:32:01 -06:00
Greg Fitzgerald 028b9da0da Revert "Move the design proposals to a separate book"
This reverts commit 4ca18d6b9affbc574d1b3d3d230230b057f8fde3.
2019-03-23 14:04:34 -06:00
Greg Fitzgerald 74cea2748c Revert "Publish design proposals"
This reverts commit fb44e2bf48.
2019-03-23 14:04:34 -06:00
Michael Vines 6113b64fee Include multinode-demo scripts in release tarball 2019-03-21 22:09:44 -07:00
Greg Fitzgerald 2b00a42b06 Boot Rewards program 2019-03-21 12:07:20 -06:00
Michael Vines fb44e2bf48 Publish design proposals 2019-03-21 10:54:59 -06:00
Michael Vines 63aadc4905 Turn top-level Cargo.toml into a virtual manifest 2019-03-21 08:47:58 -07:00
Michael Vines 402a733cd7 Upload tarball as a github release asset 2019-03-20 21:39:35 -07:00
Michael Vines 78be3652de Add script to upload github release assets 2019-03-20 21:39:35 -07:00
Michael Vines b03d9884a3 Ensure current crate versions match the tag before publishing to crates.io 2019-03-20 20:51:58 -07:00
Michael Vines 799085a105 Remove dead code 2019-03-20 20:51:58 -07:00
Michael Vines d4bcc4d474
🐳 2019-03-20 16:21:47 -07:00
Michael Vines 985592cf40
Fix cp args 2019-03-20 14:29:30 -07:00
Michael Vines 791ead6053 Include TARGET in release URL to make room for future targets 2019-03-20 13:54:32 -07:00
Rob Walker c70412d7bb
move core tests to core (#3355)
* move core tests to core

* remove window

* fix up flaky tests

* test_entryfication needs a singly-threaded banking_stage

* move core benches to core

* remove unnecessary dependencies

* remove core as a member for now, test it like runtime

* stop running tests twice

* remove duplicate runs of tests in perf
2019-03-18 22:08:21 -07:00
Michael Vines 3ad019a176 Increment stable timeout 2019-03-16 23:56:35 -07:00
Rob Walker e3ef4f25d3
Update Dockerfile
install mscgen (for book art)
2019-03-15 20:44:35 -07:00
Mark 656fb173f9
Extract kvstore into separate crate (#3327)
* extract kvstore into new crate

* add kvstore crate to CI publishing list
2019-03-15 18:42:47 -05:00
Michael Vines 5f58e9cd6e Config program - useful for storing/updating simple config items on chain 2019-03-15 16:39:45 -07:00
Michael Vines c8bbca08f8 Install the install program 2019-03-15 16:30:31 -07:00
Michael Vines ca4f874f52
Remove ci/run-local.sh 2019-03-15 15:09:25 -07:00
Michael Vines 41b98c603b Upgrade rust stable to 1.33.0 2019-03-15 09:25:28 -07:00
Michael Vines 5430dd28b6 Update docker-rust to 1.33 2019-03-15 09:25:28 -07:00
Michael Vines e9d687329b Only push newly built container 2019-03-15 09:25:28 -07:00
Michael Vines 3ced91319f Upgrade nightly rust version 2019-03-14 20:22:46 -07:00
Michael Vines 3d1413e619 Preserve original nightly name 2019-03-14 20:22:46 -07:00
Michael Vines 8f25548781 Overhaul cargo/rustc version management 2019-03-14 20:22:46 -07:00
Greg Fitzgerald 9fac3b26ee Move the design proposals to a separate book
Fixes #3262
2019-03-14 10:08:43 -07:00
Michael Vines 34a8d591fa Switch version file from .txt to .yaml; add target tuple to version.yml 2019-03-13 16:30:07 -07:00
Tyera Eulberg b7f420412b Update publish script 2019-03-12 22:05:38 -06:00
Sagar Dhawan 866d3f467f
Fix flag to disable leader-rotation (#3243) 2019-03-12 16:35:13 -07:00
Michael Vines a7d8bfdf8b Adjust crate list 2019-03-12 14:02:51 -07:00
Michael Vines 3d2b7dd1ef Move programs/system into runtime/ 2019-03-12 11:30:58 -05:00
Michael Vines 5a0416b925
Keep stable dashboard on stable channel at all times 2019-03-11 16:19:16 -07:00
Michael Vines ba2cdd0bf6
Move testnet/testnet-perf to the stable channel 2019-03-11 16:14:16 -07:00
Michael Vines a539c9ad67 Restore print ban, and widen the net 2019-03-05 14:09:40 -08:00
Tyera Eulberg e248efce06 Add programs/system explicitly to CI test suite 2019-03-05 09:33:27 -07:00
Michael Vines 3fc846d789 Try to use the RPC exit API to cleanly exit nodes 2019-03-04 19:58:37 -08:00
Michael Vines 7b49c9f09c Delete fullnode-config/ 2019-03-04 15:49:02 -08:00
Michael Vines 03d6c9a552 Defeature bpf_loader; bpf_{c,rust} features now confined to programs/bpf 2019-03-04 11:02:37 -08:00
Michael Vines d708982f27 Remove unstable and test feature flags 2019-03-04 09:30:00 -08:00
Michael Vines 534619f72f Update manifest-path 2019-03-02 22:11:48 -08:00
Greg Fitzgerald 9923c543e8 Fix ci scripts 2019-03-02 22:11:48 -08:00
Greg Fitzgerald 037fcf6b3d Bump all native programs up a level
Don't categorize programs by a single backend.
2019-03-02 22:11:48 -08:00
Michael Vines cd4bccfd12 Remove snap support 2019-03-02 17:41:09 -08:00
Michael Vines 5f5d779ee1 Move src/ into core/src. Top-level crate is now called solana-workspace 2019-03-02 09:52:18 -08:00
Jack May b9524217fe
Update rust example to use BPF enabled infrastructure (#2974) 2019-02-28 22:05:11 -08:00
Michael Vines 36cdaffe25
Fix indent 2019-02-27 11:11:24 -08:00
Jack May 329382f016
Pull BPF enabled rustc and sysroot into SDK (#2936) 2019-02-25 15:35:45 -08:00
Jack May 77ea4cd285 Reapply dependency Band-aid to make CI happy 2019-02-22 15:56:07 -07:00
Jack May 71602fe04b
Fix root package dependencies (#2899) 2019-02-22 14:08:25 -08:00
Jack May 3a7008949f
Build all deps (#2896) 2019-02-22 09:49:25 -08:00
Jack May 3610768888
Run featurized tests on sub-packages (#2867) 2019-02-21 22:38:36 -08:00
Michael Vines fb904e7a29 Enable CUDA persistence mode to reduce surprises 2019-02-21 19:25:17 -08:00
Tyera Eulberg 18d48f09f8 Plumb blockstreamer name through testnet scripts 2019-02-21 17:24:29 -07:00
Michael Vines 33c7f92f56 Dial down CI timeouts 2019-02-20 16:43:13 -08:00
Greg Fitzgerald 08d7a0d52d Upgrade to Rust 1.32.0
$ rustup update stable
2019-02-18 21:44:09 -07:00
Michael Vines 0dbc33f781 Finish removing getConfirmationTime 2019-02-17 16:27:50 -08:00
Michael Vines a27e9cb3c2
Add -u option 2019-02-17 10:45:25 -08:00
Michael Vines 10270dcbad Add an API node to non-perf testnets 2019-02-17 10:39:27 -08:00
Michael Vines ab6c7f6ca3 /it/ti/ 2019-02-16 10:40:47 -08:00
Michael Vines 02c0098d57 Less --verbose by default 2019-02-10 10:19:16 -08:00
Michael Vines c02625f91a Ban Default::default() 2019-02-09 10:12:32 -08:00
Michael Vines 6317bec7aa Avoid empty --features= arg to avoid unnecessary cargo building 2019-02-07 10:42:57 -08:00
Michael Vines eb3ba5ce2d tmi: disable --verbose by default. | export V=1| to request verbosity 2019-02-07 10:42:57 -08:00
Greg Fitzgerald 5128d7d6c3 Move runtime.rs into its own crate 2019-02-07 09:46:06 -08:00
Greg Fitzgerald 731e5e1291 Boot lua loader
Good fun, but unnecessary and I haven't been updating the rlua
dependency. If someone wants this, it can be developed outside
the solana repo.
2019-02-07 10:25:11 -07:00
Jack May 5f565c92c9
cargo incremental builds breaks Rust BPF, locally disable it (#2674) 2019-02-06 13:59:10 -08:00
Michael Vines afdf0efd31 Disable bpf_rust temporarily 2019-02-06 13:31:35 -08:00
Michael Vines 7fc271ef97 Bump stable timeout 2019-02-06 13:31:35 -08:00
Michael Vines 98e893c69b Avoid empty --features= arg to avoid unnecessary cargo building 2019-02-02 20:08:49 -08:00
Michael Vines 4aa6695a13 source ulimit-n.sh so it applies to the current shell 2019-02-02 20:08:49 -08:00
Michael Vines a7e5423ede Set ulimit -n 2019-02-02 20:08:49 -08:00
Michael Vines 21c09073a1 Add help script to easily run all integration tests 2019-02-01 12:42:46 -08:00
Michael Vines 4fb9c8a547 Bump timeout 2019-02-01 07:11:17 -08:00
Michael Vines 344427c1dc Update to rust nightly 2019-01-31 2019-02-01 07:11:17 -08:00
Rob Walker 00bb5925e1
use a .gitignore'd file name for transactionCount (#2609) 2019-01-30 20:19:10 -08:00
Rob Walker a0bed5375d
remove println!, add check to keep it out (#2585)
* remove debugging prints

* remove println!, add check to keep it out
2019-01-29 16:02:03 -08:00
Rob Walker 145fb3675d
check for debugging lint in CI (#2578)
* check for debugging lint in CI
* nit
* add TODO
2019-01-28 18:32:30 -08:00
Michael Vines a8ea6471e7 Add ledger-tool tests to CI 2019-01-28 17:08:59 -08:00
Jack May 9abc500269
Fix BPF C tests and run as part of CI (#2540) 2019-01-24 12:15:37 -08:00
Rob Walker 6aa80e431d
increase startup timeout for localnet sanity (#2534) 2019-01-23 15:06:08 -08:00
Michael Vines 73930b5eac
Unfold log on errors 2019-01-23 07:48:59 -08:00
Michael Vines fbeba259b3 Reorg tests 2019-01-23 00:02:30 -08:00
Michael Vines d1bedeae13 Wait for nodes to finish booting before running sanity checks 2019-01-23 00:02:30 -08:00
Michael Vines 8dc9089611 Display confirmation time 2019-01-23 00:02:30 -08:00
Michael Vines 222d2d7953 Verify transaction count as reported by the bootstrap-leader node is advancing 2019-01-23 00:02:30 -08:00
Michael Vines e3ae10bacc
User-initiated builds now select the correct channel 2019-01-22 14:23:46 -08:00
Michael Vines fcda94b673
Use beta channel for stable dashboard once a beta tag exists 2019-01-22 12:22:57 -08:00
Michael Vines dea20248c4
Increase job timeout 2019-01-22 09:35:03 -08:00
Michael Vines ae90ac238c Use unique log file for each additional (-x/-X) fullnodes 2019-01-22 08:27:36 -08:00
Michael Vines 3b0ca9f478 Add rolling update test 2019-01-22 08:27:36 -08:00
Michael Vines 61e79e6d02 Add -c to resume a previous run 2019-01-22 08:27:36 -08:00
Michael Vines 1cdab81a3c Add -R option to restart the cluster incrementally 2019-01-22 08:27:36 -08:00
Michael Vines dca0ba6a5d Use -X for dynamic fullnodes, to ensure keypair remains constant during iterations 2019-01-22 08:27:36 -08:00
Michael Vines 3c86f41769 Run buildkite iterations in parallel 2019-01-21 14:04:19 -08:00
Michael Vines 648b6597bf
configure ulimit 2019-01-20 10:54:12 -08:00
Michael Vines 514bf32b99
Enable ledger verification for non-perf testnets 2019-01-19 20:28:56 -08:00
Michael Vines 6282c53fe5 Add iterations with leader rotation enabled and periodic restarts 2019-01-18 13:42:04 -08:00
Michael Vines dac28e0961 Temporarily ignore wallet sanity failures when leader rotation is enabled
This commit should be reverted once https://github.com/solana-labs/solana/issues/2474 is fixed
2019-01-18 13:42:04 -08:00
Michael Vines 443d8ce7c4 Add option to restart the cluster during iterations 2019-01-18 13:42:04 -08:00
Michael Vines b03d1d8894 Enable integration test logging for better debug on CI failure 2019-01-17 23:14:18 -08:00
Michael Vines 8e4a86e329 Recovery multinode tests 2019-01-17 23:14:18 -08:00
Tyera Eulberg 14267e172d Add local drone integration test 2019-01-17 15:06:04 -08:00
Michael Vines 825d8ef6c9 Add ability to use the RPC endpoint from a node other than the bootstrap leader 2019-01-17 09:04:57 -08:00
Michael Vines e4c6e4bf26 Report full node info before starting/updating network 2019-01-16 10:24:00 -08:00
Michael Vines 8783563176 Report full node info before running sanity 2019-01-16 10:24:00 -08:00
Tyera Eulberg 8af61f561b
Improve Wallet coverage (#2385)
* Add trait for RpcRequestHandler trait for RpcClient and add MockRpcClient for unit tests

* Add request_airdrop integration test

* Add timestamp_tx, witness_tx, and cancel_tx to wallet integration tests; add wallet integration tests to test-stable

* Add test cases

* Ignore plentiful sleeps in unit tests
2019-01-14 00:10:03 -07:00
Michael Vines 780360834d Iteration testing v0.1 2019-01-13 21:49:09 -08:00
Michael Vines d28b643c84 localnet-sanity.sh now supports iterations testing 2019-01-13 21:49:09 -08:00
Michael Vines 5d3847d14d Publish book from both the edge and beta channels 2019-01-12 11:08:29 -08:00
Michael Vines 5b92286568 Remove channel duplication 2019-01-12 11:08:29 -08:00
Michael Vines c1cd92bbee Avoid -d arg conflict
-D is now "delete"
-d is now "disk type"
2019-01-09 16:39:24 -08:00
Michael Vines 639bed2f6d Reorder sanity.
1. Check for presence of nodes
2. Check for functioning RPC API
3. Then try the wallet
2019-01-09 12:05:30 -08:00
Michael Vines 77794eebdb Remove |cargo package| sanity step
Unfortunately due to our multi-crate repo, as soon as
|./scripts/increment-cargo-version.sh| is run after a release, |cargo
package| will fail for crates that depend on other in-tree crates, as
the new crate version has not yet been published to crates.io.
For now this means that we need to continue flying blind and be prepared
to deal with minor publishing issues on each new release.
2019-01-09 11:59:24 -08:00
Michael Vines 6b46c22b42 Use restart 2019-01-09 11:59:01 -08:00
Michael Vines 64ebd9a194 Add update-to-restart operation. Also try to update before restarting on sanity failures 2019-01-08 21:11:43 -08:00
Michael Vines 35fe08b3bc Add update support 2019-01-08 21:11:43 -08:00
Michael Vines 5c87ddc80e nit: hide echo 2019-01-08 21:11:43 -08:00
Michael Vines 1b7598e351 Add retries to RPC API probe 2019-01-08 08:50:51 -08:00
Michael Vines cd0e08cae5 Add fullnode-config crate 2019-01-07 23:02:32 -08:00
Michael Vines 1490c42d9f Use docker rust docker image to avoid rocksdb build errors 2019-01-07 23:02:32 -08:00
Michael Vines 789ee9f138 package or publish. Also package on branch builds 2019-01-07 23:02:32 -08:00
Michael Vines 0a981a6606
Double publish crate timeout 2019-01-07 20:46:21 -08:00
Michael Vines c4ca76e39e
Only check TRIGGERED_BUILDKITE_TAG 2019-01-07 19:56:01 -08:00
Stephen Akridge d2cb4e003c Re-enable the --lib tests 2019-01-07 15:28:20 -08:00
Michael Vines 71a2b794b4
Enable info logging on non-perf clusters to aid debug of failures 2019-01-05 08:28:32 -08:00
Michael Vines 373714bf0b
Disable publish snap again 2019-01-04 21:20:33 -08:00
Michael Vines ee769171b9
Restore publish snap 2019-01-04 20:46:44 -08:00
Michael Vines ea00c1274e Add net sanity failure metric 2019-01-04 18:45:55 -08:00
Michael Vines 1a9401e1f3 Permit build on Cargo.{lock,toml} changes 2019-01-03 09:35:11 -08:00
jackcmay a461c5682d
First stab at Rust BPF (#2269)
First stab at Rust BPF
2019-01-02 15:12:42 -08:00
Michael Vines 1531a1777a Add RPC API check 2018-12-24 22:51:36 -08:00
Michael Vines 3a2fa9a650 Enable ledger/validator sanity for non-perf testnets 2018-12-24 22:51:36 -08:00
Michael Vines 95c9fefbd0
Make sanity failure message more visible 2018-12-23 17:30:59 -08:00
Michael Vines 073a48ab85
Restore timeout 2018-12-23 17:30:41 -08:00
Michael Vines 7f2fa8bbcb Collect and upload network logs 2018-12-23 10:19:10 -08:00
Michael Vines b46c809544
source ci/upload-ci-artifact.sh 2018-12-22 12:34:30 -08:00
Michael Vines eb29a2898c
Uplaod net/log/ files as buildkite artifacts 2018-12-22 12:22:58 -08:00
Michael Vines c3a74e5e63
Avoid unnecessary shellcheck directives 2018-12-22 11:57:47 -08:00
Pankaj Garg 23d3a9ae42
Use CUDA for testnet automation performance calculations (#2259) 2018-12-21 04:27:31 -08:00
Pankaj Garg 756156e9db
Use SSD for testnet automation (#2257) 2018-12-20 20:13:56 -08:00
Michael Vines becfd1e9fa ci/test-stable-perf.sh now runs on macOS 2018-12-20 17:23:22 -08:00
Pankaj Garg 951d6398a0
Rename finality to confirmation (#2250)
* Rename finality to confirmation

* fix cargo fmt errors
2018-12-20 15:47:48 -08:00
Michael Vines ddc1082e8c
Stable dashboard can now actually come from the stable channel 2018-12-20 08:04:59 -08:00
Michael Vines d78f19f8bb
Select correct branch for {testnet,-perf} when using a stable channel tag 2018-12-19 17:46:18 -08:00
Michael Vines e2225d3b71 Add more Azure details 2018-12-19 16:31:28 -08:00
Pankaj Garg 2fe3402362
Use SSD for perf testnet (#2227) 2018-12-19 16:11:26 -08:00
Michael Vines 14a236198f nit: rename publish-solana-tar.sh to publish-tarball.sh 2018-12-19 14:26:25 -08:00
Michael Vines cc1b43b90a Retire GCP setup 2018-12-19 14:26:25 -08:00
Michael Vines 9448f0ce52 Add more Azure CI documentation 2018-12-19 14:26:25 -08:00
Michael Vines 59fdd8f6be Move wallet airdrop retries into fullnode start script 2018-12-19 13:49:04 -08:00
Michael Vines 7b20318ee4 Run s3cmd in a container to avoid additional CI system dependencies 2018-12-19 13:09:24 -08:00
Michael Vines c3c955b02e Build/install native programs within cargo-install-all.sh 2018-12-19 11:53:08 -08:00
Michael Vines 6e56e41461 Document how to create a new Azure CI machine 2018-12-18 23:35:09 -08:00
Michael Vines d74d5e0e44 nit: prevent shellcheck command from getting expanded by default 2018-12-18 18:44:20 -08:00
Michael Vines cac08171de nit: prevent book build from getting expanded by default 2018-12-18 18:44:20 -08:00
Michael Vines 6f6c350781 Skip stable-perf of no .rs files are modified in a PR 2018-12-18 18:44:20 -08:00
Michael Vines 506724fc93 Remove non-standard : anchors 2018-12-18 18:44:20 -08:00
Michael Vines b4fe70d3d8 Skip bench of no .rs files are modified in a PR 2018-12-18 18:09:59 -08:00
Michael Vines 3efbffe4e3 Run coverage when test-coverage.sh is modified 2018-12-18 18:09:59 -08:00
Michael Vines b101f40c32
Initial revision 2018-12-18 14:27:37 -08:00
Michael Vines e8e6c70e19
Remove duplicate _ definitions 2018-12-18 14:25:10 -08:00
Michael Vines cd6736d70b Remove duplication between test-stable{,-perf}.sh 2018-12-18 14:02:43 -08:00
Michael Vines c0dcf67ec8 Move book build into test-checks 2018-12-18 13:03:38 -08:00
Michael Vines bc52336a1b affected_files metadata is only available for PR builds 2018-12-18 13:03:38 -08:00
Michael Vines 3bfb052b0a Overhaul coverage setup 2018-12-18 10:48:06 -08:00
Michael Vines c71d5a111e Extract grcov download script 2018-12-18 10:48:06 -08:00
Greg Fitzgerald 437b62c4d9 Upgrade grcov 2018-12-18 10:48:06 -08:00
Michael Vines cbca0ae264 Remove dead code 2018-12-18 10:48:06 -08:00
Michael Vines e720070945
Flip && style 2018-12-18 09:56:43 -08:00
Michael Vines a8ab6f4caf
Preserve stable as default, use +nightly to get nightly 2018-12-18 09:54:47 -08:00
Michael Vines b7b1884950
Pass BUILDKITE_COMMIT env var into containers 2018-12-18 08:53:39 -08:00
Michael Vines 755064d3e2 Use |cargo +nightly| to avoid assuming nightly is default 2018-12-18 08:44:33 -08:00
Michael Vines 24a984086e nightly is now 1.33 2018-12-18 08:44:33 -08:00
Michael Vines 4b831d58b7 Don't fiddle with default rust, humans don't like that 2018-12-18 08:44:33 -08:00
Michael Vines 62f36037ea
Pass CI env var into containers 2018-12-18 00:47:41 -08:00
Michael Vines 29776c0283 Publish book only on content changes instead of on every commit 2018-12-17 16:42:22 -08:00
carllin 69d7384cc0
Enable leader rotation on edge testnet (#2204) 2018-12-17 16:04:25 -08:00
Michael Vines dc56bbeec8 Ensure the full workspace is built for coverage 2018-12-17 10:47:32 -08:00
Michael Vines 4be537c51a
Temporarily disable nightly build until it can be fixed 2018-12-17 10:15:38 -08:00
Michael Vines 66c568ba67 Add wallet sanity timeout 2018-12-17 09:58:34 -08:00
Michael Vines 9a5195e79e Remove CARGO_TARGET_CACHE_NAME, use BUILDKITE_LABEL 2018-12-16 23:05:44 -08:00
Michael Vines 74ee1e5087 Increase the number of files a node may have open at a time 2018-12-15 17:15:22 -08:00
Michael Vines e5d1bd6589 Drop public suffix on build names 2018-12-15 16:54:23 -08:00
Michael Vines 50e8666a14 Add format-url.sh 2018-12-15 15:10:04 -08:00
Michael Vines eedc8c7812 Move src/netutil.rs into its own crate 2018-12-14 20:13:34 -08:00
Michael Vines f0d1ed0cc4 |cargo test --all| 2018-12-14 19:32:04 -08:00
Michael Vines 6ac466c0a4 Move src/logger.rs into logger/ crate to unify logging across the workspace 2018-12-14 13:10:43 -08:00
Michael Vines f6e3464ab9 bench-tps rebase 2018-12-14 09:38:46 -08:00
Mekagoza 708876e9a7 Fix CI and related issues in bench-tps
Rename crate to `solana-bench-tps` in its Cargo.toml

Move crate

Add to ci/publish-crate.sh
2018-12-14 09:38:46 -08:00
Michael Vines c1ad987b04 Run checks over all crates in the workspace 2018-12-13 23:40:26 -08:00
Michael Vines 9d0b7c6b31 Remove bench_streamer feature 2018-12-13 22:25:27 -08:00
Michael Vines d489cb1a8b Desnake upload_ci_artifact for consistency 2018-12-13 22:25:27 -08:00
Michael Vines 0fe6d61036 Move binaries from src/bin into their own crate 2018-12-13 22:25:27 -08:00
Michael Vines accabca618 Find solana-fullnode-cuda 2018-12-13 20:08:24 -08:00
Michael Vines 647e5d76b0 Move solana-fullnode into fullnode/ 2018-12-13 01:45:29 -08:00
Michael Vines 7e4af9382e Move solana-upload-perf into upload-perf/ 2018-12-13 01:06:40 -08:00
Michael Vines 282d4a3563 Move solana-keygen into keygen/ 2018-12-13 01:06:40 -08:00
Michael Vines 4b07778609 Add bench_streamer feature to inhibit building solana-bench-streamer by default
This program is not currently used in any automation and is fairly slow
to build.  Disabling it by default will speed incremental builds.
2018-12-12 16:31:13 -08:00
Michael Vines bf33d9d703
Disable snap build until #2127 is resolved 2018-12-12 15:13:11 -08:00
Michael Vines af3ca02e35
Switch testnet-edge from snap to tarball
Snap publishing has been failing all day, unclear why.  Potentially
revert this commit if/when resolved.
2018-12-11 23:34:41 -08:00
Michael Vines 088bab61a4 Remove |cargo install| duplication 2018-12-11 23:29:05 -08:00
Michael Vines 080d18b06e Only run publish-crate on release branches, clarify crate ordering 2018-12-11 23:29:05 -08:00
Michael Vines b5784de33f Disable leader rotation for testnet-automation until it's ready 2018-12-10 15:23:11 -08:00
Michael Vines 094f0a8be3 Leader rotation flag plumbing 2018-12-10 14:07:59 -08:00
Michael Vines 3d996bf080 Disable leader rotation on CI testnets until it's ready 2018-12-10 14:07:59 -08:00
Michael Vines 4b05ee6811 Add hacky sleep 2018-12-10 14:05:00 -08:00
Michael Vines 9b472d36fc
Add `--path .` to keep new `cargo` content 2018-12-09 18:09:03 -08:00
Greg Fitzgerald 92584bd323 Only run the audit 2018-12-08 23:19:55 -07:00
Rob Walker 586d9ee850
fix some nits (#2034)
rework maybe_cargo_install(), renamed to cargo_install_unless, updated to take a command to attempt
2018-12-08 19:14:19 -08:00
Michael Vines f5569e76db Relocate native programs to deps/ subdirectory of the current executable
This layout is `cargo build` compatible, no post-build file moves
required.
2018-12-08 16:31:01 -08:00
Greg Fitzgerald 0a83b17cdd
Upgrade to Rust 1.31.0 (#2052)
* Upgrade to Rust 1.31.0
* Upgrade nightly
* Fix all clippy warnings
* Revert relaxed version check and update
2018-12-07 20:01:28 -07:00
Michael Vines fa58da2401 Explicitly specific build variant when installing native programs 2018-12-07 11:32:08 -08:00
Michael Vines cba9c5619e Relax stable version check during the transation period between 1.30 and 1.31 2018-12-06 19:44:47 -08:00
Michael Vines 70c149c7da Rename leader/validator to bootstrap-leader/fullnode
Only rsyncing the genesis ledger snuck in here as well
2018-12-06 19:44:47 -08:00
Michael Vines 04a0652614 Generalize net/ from leader/validator to bootstrap-fullnode/fullnode 2018-12-05 17:11:16 -08:00
Michael Vines 632425c7d7 Move native_loader under programs/native/ 2018-12-05 14:32:42 -08:00
Michael Vines 7336645501 Move programs into the executable location so native_loader can find them 2018-12-05 10:49:06 -08:00
Michael Vines 424612ea9d Reduce |ulimit -n| on macOS to max supported amount 2018-12-05 10:49:06 -08:00
Michael Vines 5afafd9146 Update list of crates to publish 2018-12-05 10:49:06 -08:00
Michael Vines 9a4f8199d6 Move system_program out of src/ 2018-12-05 10:49:06 -08:00
Michael Vines e4049f3733 Ensure subshell failures are reported 2018-12-05 10:28:03 -08:00
Michael Vines 8ef73eee51 Reject builds faster: if sanity checks fail don't bother with the rest 2018-12-01 11:43:29 -08:00
Michael Vines 7c3e6e8e86 Move bpf-sdk to sdk/bpf 2018-12-01 10:47:59 -08:00
Rob Walker 3ca826a480
re-enable test_tpu_forwarder (#1964) 2018-11-30 13:52:37 -08:00
Michael Vines 29d95328ce
Use non-zero exit on channel determination failure 2018-11-30 08:50:17 -08:00
Rob Walker 3cc0dd0d1e stabilize testing with --test-threads=1 2018-11-29 12:54:42 -08:00
Stephen Akridge 5c71f2a439 Add ulimit check to stable test suite
cargo test needs larger ulimit than default as well.
2018-11-29 11:39:42 -08:00
Jack May 6a2ffafdb9 Update docker-solana location for CI 2018-11-28 16:20:02 -08:00
jackcmay 0c091c1b24
Dockerized LLVM (#1914)
Optionally build with dockererized custom llvm
2018-11-28 14:41:53 -08:00
Rob Walker fa4bdb4613 add --no-capture to get some logs from flaky tests 2018-11-27 23:24:20 -08:00
Michael Vines af1d9345e0 De-dup ci book build 2018-11-26 18:38:57 -08:00
Michael Vines 03ce45d93a Fix snap build 2018-11-26 18:38:48 -08:00
Michael Vines 58e3dd4cb6 Avoid trying to install svgbob when already installed 2018-11-26 17:18:55 -08:00
Michael Vines 7bf4c08f70 Add BPF C unittest framework 2018-11-26 12:25:29 -08:00
Greg Fitzgerald 69beee5416 Install svgbob 2018-11-26 09:44:19 -08:00
Greg Fitzgerald 2200a31331 Generate book images via Make 2018-11-26 09:44:19 -08:00
Greg Fitzgerald 88e270723f Move markdown book out of src/ 2018-11-26 09:44:19 -08:00
Michael Vines 6e00c6790e Move testnet metrics dashboard management out of the Grafana UI 2018-11-25 16:10:25 -08:00
Jack May e6f91269ec Use --no-tty with apt-key in Docker 2018-11-21 16:45:48 -08:00
Jack May 8d7f380dfd Remove extra version check 2018-11-21 14:30:26 -08:00
jackcmay 59163e2dd9
Optimize some CI stuff (#1880)
* CI Optimizations
2018-11-21 12:16:16 -08:00
Michael Vines 7a54dbf7d5 Restore clippy, and run clippy sooner 2018-11-17 15:54:21 -08:00
Michael Vines 591a28d516
Avoid extra commit when publishing book 2018-11-17 10:17:52 -08:00
Michael Vines 903c82d7f1
Add timeouts 2018-11-17 09:09:25 -08:00
Michael Vines b2e0395f19
Bump release tarball build timeout (ahem rocksdb) 2018-11-17 08:12:03 -08:00
Michael Vines d96a6b42a5 Move drone into its own crate 2018-11-16 20:42:21 -08:00
Michael Vines 7fe50d6402 Temporarily disable clippy 2018-11-16 19:55:33 -08:00
Michael Vines 6ac5700f2e Move metrics into its own crate 2018-11-16 15:10:07 -08:00
Michael Vines e791d0f74d Drone now returns signed airdrop transactions 2018-11-15 17:13:13 -08:00
Michael Vines 4a3230904e Specify rpc port 2018-11-15 12:32:15 -08:00
jackcmay 6b6c87e510
Run BPF tests in CI 2018-11-14 17:16:37 -08:00
Michael Vines bba19ce667
Catch up to solana-genesis tokens argument name change 2018-11-14 09:55:33 -08:00
Michael Vines 9bf2d1d7b4 Publish BPF SDK to a channel-specific URL to ease downstream pickup 2018-11-14 09:36:44 -08:00
Pankaj Garg 66e9d30fda
Change testnet automation to use TAR instead of snap (#1809) 2018-11-13 13:33:15 -08:00
Michael Vines d53077bb3e Activate perf-libs compatible CUDA env 2018-11-12 22:24:56 -08:00
Michael Vines 2b44d5fb6a Fix snap PR builds 2018-11-12 22:24:56 -08:00
carllin dafdab1bbc
Add clang dependency to docker images, update validation checks (#1794) 2018-11-12 19:36:36 -08:00
Michael Vines 9e7b9487b0 perf-libs now drives setting CUDA_HOME 2018-11-12 18:49:15 -08:00
Michael Vines 3466f139a4 set -e shuffling 2018-11-11 16:24:36 -08:00
Michael Vines def7d156f6 codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e' 2018-11-11 16:24:36 -08:00
Michael Vines 33aab094ef codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash' 2018-11-11 16:24:36 -08:00
Michael Vines cf6f344ccc Add CUDA_HOME env var to permit overriding the CUDA install location 2018-11-11 16:24:18 -08:00
Greg Fitzgerald b670b9bcde Regenerate identity files in CI 2018-11-11 09:22:52 -07:00
Greg Fitzgerald cdf1a96e23 Revert "V1 Window/Ledger based on RocksDb (#1712)"
This reverts commit bfcdec95cb.
2018-11-09 20:25:53 -07:00
carllin bfcdec95cb
V1 Window/Ledger based on RocksDb (#1712)
* Add rocksdb

* Implement new ledger module based on RocksDb
2018-11-09 18:30:26 -08:00
Greg Fitzgerald 0926702269 Fix grcov download on macos and upload gcda/gcdo files for debugging 2018-11-09 11:19:28 -07:00
Greg Fitzgerald 0a85347a0d Upgrade Rust stable to 1.30.1
Fixes `cargo doc`
2018-11-09 07:46:51 -08:00
Michael Vines eaa8b9cb1e Publish book 2018-11-09 02:13:59 -07:00
Michael Vines b0405db5a9
Assign static IPs to {edge,beta}.testnet.solana.com 2018-11-07 20:11:00 -08:00
Michael Vines f34f0af6b1
Install native programs in the correct location 2018-11-07 19:44:57 -08:00
Michael Vines 22b6cbb4da
Switch testnet to AWS 2018-11-07 18:57:08 -08:00
Michael Vines 25dd5145bb
Switch to us-west-1a, us-west-1b is causing trouble 2018-11-07 18:23:28 -08:00
Michael Vines 3b41eec199
Shuffle AWS regions 2018-11-07 15:00:55 -08:00
Michael Vines b02b636b36
Support local tarball deploys 2018-11-07 14:44:40 -08:00
Michael Vines a537154c28
Remove all cuda dependencies from release tarball beyond solana-fullnode-cuda 2018-11-07 14:44:40 -08:00
Michael Vines 812a8bcc6c
Permit release tag tarballs 2018-11-07 10:33:58 -08:00
Michael Vines 63807935cb
Switch testnet/testnet-beta to tarball release 2018-11-07 10:30:02 -08:00
Michael Vines 92a8b646df
Fix tarball publishing for tags 2018-11-07 10:26:19 -08:00
Michael Vines d9f9e347ab
Delete testnet-master, testnet-master-perf 2018-11-07 10:08:29 -08:00
Greg Fitzgerald 038a46b5ef Integrate the markdown book into the codebase
This implies that the book should describe exactly what is implemented,
and will not lead the way and eventually bitrot as the RFCs do.
2018-11-07 10:58:47 -07:00
Michael Vines 863a0c3f8f
s/edge/beta/ 2018-11-07 08:54:32 -08:00
Michael Vines dd4fb7aa90 Add AWS-based nets 2018-11-07 07:47:39 -08:00
Michael Vines 2af5aad032 Switch testnet/testnet-perf to the latest beta or stable tag 2018-11-07 07:47:39 -08:00
Michael Vines 9027141ff8 Publish release tarballs for tags 2018-11-07 07:47:39 -08:00
Greg Fitzgerald 8be7c13d2d
Stub out architecture book (#1674)
* Stub out architecture documentation

* Add book HTML generation and book tests to CI

* Add heading

* Better table of contents

* Reference existing documentation

Move ASCII art from code comments into rendered SVG

* Attempt to fix CI

* Add lamport docs

And truncate lines to 80 characters

* Fix links

And reference shorter, newer description of PoH.

* Replace ASCII art with SVG

* Streamline for Pillbox

* Update path before optional install

* Use $CARGO_HOME instead of $HOME

* Delete code

Attempt to describe all data structures without code.

* Boot RPU from docs, add JsonRpcService

Also, use Rust naming conventions in the block diagrams to
minimize the jump from docs to code.

* Latest code uses tick_height

* Rename bob/ folder to art/

A home for any ASCII art

* Import JSON RPC API

* More mdbook docs

* Add Ncp

* Cleanup links

* Move pipelining description into fullnode description

* Move high-level transaction docs into top-level doc

* Delete unused files
2018-11-06 18:00:58 -07:00
Michael Vines d8d23c9971
Remove unused debug trace 2018-11-06 09:29:39 -08:00
Michael Vines 6b5d12a8bb
Set metrics database correctly 2018-11-06 07:25:18 -08:00
Michael Vines c4b9d5d8b9
Remove stray line 2018-11-05 20:53:34 -08:00
Michael Vines 52491b467a
Update testnet deploy docs 2018-11-05 19:12:55 -08:00
Michael Vines 7789fda016 Add testnet-manager pipeline 2018-11-05 17:35:30 -08:00
Pankaj Garg c4346e6191
Add testnet pipeline for prebuilt images (#1708)
* Add testnet pipeline for prebuilt images

- It'll speed up testnet testing for released images

* removed quotes from variable

* address review comments

* fix testnet automation error
2018-11-05 13:50:33 -08:00
Michael Vines 5a85cc4626
Rename buildkite-snap to buildkite-secondary 2018-11-05 08:47:51 -08:00
Michael Vines 2c74815cc9
ci: correct crates.io publishing order 2018-11-02 15:39:24 -07:00
carllin 298bd6479a
Add first leader to genesis (#1681)
* Add first leader to genesis entries, consume in genesis.sh

* Set bootstrap leader in the bank on startup, remove instantiation of bootstrap leader from bin/fullnode

* Remove need to initialize bootstrap leader in leader_scheduler, now can be read from genesis entries

* Add separate interface new_with_leader() in mint for creating genesis leader entries
2018-11-02 14:32:05 -07:00
Pankaj Garg db98f7e0b4
Use env variables to disable validator sanity and ledger verification (#1675) 2018-10-31 12:30:33 -07:00
jackcmay 0529f36fde
Run workspace member's tests (#1666)
Run workspace member's tests
2018-10-30 22:53:36 -07:00
Pankaj Garg 85869552e0
Update testnet scripts to use release tar ball (#1660)
* Update testnet scripts to use release tar ball

* use curl instead of s3cmd
2018-10-30 18:05:38 -07:00
Pankaj Garg 6f9843c14b
Publish a tarball of Solana release binaries (#1656)
* Publish a tarball of solana release binaries

* included native programs in Solana release tar

* Remove PR check from publish script
2018-10-30 15:31:52 -07:00
Michael Vines 37213209c5 Create programs/bpf/c/sdk/ 2018-10-29 19:10:29 -07:00
Michael Vines f6b1b5ab37
Remove unnecessary checks 2018-10-29 13:27:52 -07:00
Michael Vines f12743de38 Create/publish bpf-sdk tarball 2018-10-29 12:54:57 -07:00
Michael Vines 77e10ed757 Add utility to figure the current crate version 2018-10-29 12:54:57 -07:00
Michael Vines f671b7f63f
Publish root crate too 2018-10-25 17:16:18 -07:00
Michael Vines a340b18b19 Upgrade to rust 1.30 2018-10-25 17:13:41 -07:00
Michael Vines 160cff4a30
Check for TRIGGERED_BUILDKITE_TAG 2018-10-25 16:37:54 -07:00
Michael Vines 1733beabf7 mv common/ sdk/ 2018-10-25 13:26:10 -07:00
Michael Vines 471d8f6ff9 Fix up the version references to all other internal crates 2018-10-25 12:54:32 -07:00
Michael Vines b982595c73 Add version check and rustup 2018-10-24 19:48:58 -07:00
Rob Walker 4ea422bcec run integration tests serially 2018-10-17 11:37:10 -07:00
Greg Fitzgerald 6074e4f962 Attempt to stabilize the test suite
The integration tests are allowed to open sockets, so running them
in parallel may cause "Too many open files" errors. This patch
runs the unit tests in parallel and the integration test serially.
2018-10-17 11:37:10 -07:00
Greg Fitzgerald 5b4d4b97bc Upgrade to latest stable Rust, 1.29.2 2018-10-15 09:54:24 -06:00
Michael Vines c5180c8092 Permit RUST_LOG overrides 2018-10-14 12:40:37 -07:00
Pankaj Garg e5ab9a856c
Upload bench output as build artifacts (#1478)
* Upload bench output as build artifacts

* Fix tags types

* Pull previous stats from metrics

* Change the default branch for comparison

* Fix formatting

* Fix build errors

* Address review comments

* Dedup some common code

* Add eval for channel info to find branch name
2018-10-12 15:13:10 -07:00
Michael Vines 5c523716aa Ship native programs 2018-10-10 16:49:48 -07:00
Pankaj Garg c240bb12ae Change buildkite agent for testnet automation 2018-10-09 15:04:55 -07:00
Pankaj Garg 29a8823db1
Env variables for testnet-automation parameters (#1455)
- This will enable us to create custom pipelines for field events
2018-10-09 11:50:56 -07:00
Pankaj Garg a80955eacb
Change format of data for TPS/Finality metrics in testnet automation (#1446)
* Change format of data for TPS/Finality metrics in testnet automation

* Revert number of nodes for testnet automation

* Split python command to its own script

* Fix python command line arguments
2018-10-09 10:35:01 -07:00
Pankaj Garg 0a39722719
Add support to trigger testnet from a PR (#1434)
* Add support for different node counts

* Update variable names

* Delete network even after failures

* Add array for node counts

* Changed number of nodes to a space separated string of numbers

* Adjust number of nodes

* Snap will not be published if the env variable DO_NOT_PUBLISH_SNAP is set

* Address review comments

* Replaced influx db URL
2018-10-05 16:32:05 -07:00
Greg Fitzgerald 9c0fa4d1d2
Upload coverage HTML reports (#1421)
Uploads two reports to Buildkite, one from cargo-cov and one from lcov via grcov.  The lcov one is busted on linux and is what we need to bring codecov.io back up again. It works great on macos if you wanted to generate them locally and prefer lcov HTML reports.

* Also comment out non-coverage build to speed things up.
2018-10-05 10:17:35 -07:00
Michael Vines beb4536841
Run a fullnode+drone automatically when the container starts up 2018-10-02 18:09:35 -07:00
Michael Vines ad5fcf778f Publish minimal Solana docker images to dockerhub 2018-10-02 16:57:48 -07:00
Michael Vines 83b000ae88 Remove SNAP_ prefix 2018-10-02 16:57:48 -07:00
Greg Fitzgerald 94459deb94 Disable codecov.io reporting 2018-09-28 19:19:16 -07:00
Greg Fitzgerald 660af84b8d Use the same versions of llvm-cov and libprofile 2018-09-28 19:19:16 -07:00
Greg Fitzgerald 7b31020903 Add back llvm-dev for llvm-cov 2018-09-28 19:19:16 -07:00
Greg Fitzgerald 9a4143b4d9 Upgrade llvm-dev and boot kcov
Need clang-dev, not llvm-dev because cargo-cov looks for libprofile
in a clang installation directory.
2018-09-28 19:19:16 -07:00
Greg Fitzgerald aebc47ad55 Attempt coverage reporting 2018-09-28 19:19:16 -07:00
Greg Fitzgerald 5bc01cd51a Revive code coverage 2018-09-28 19:19:16 -07:00
Greg Fitzgerald 19a7ff0c43 Pin down nightly in benchmark build 2018-09-28 19:29:50 -06:00
Greg Fitzgerald 5f18403199 Upgrade nightly 2018-09-28 19:29:50 -06:00
Tyera Eulberg 9f325fca09 Re-enable cargo audit 2018-09-28 17:53:41 -06:00
Tyera Eulberg 10d08acefa Reenable cargo audit 2018-09-28 17:53:41 -06:00
Tyera Eulberg 52d50e6bc4 Update for new solana-jsonrpc 2018-09-28 17:53:41 -06:00
Stephen Akridge aa2a3fe201 Add chacha module to encrypt ledger files 2018-09-28 14:23:37 -07:00
Greg Fitzgerald 485ba093b3 Install kcov to CI environment 2018-09-28 11:20:27 -06:00
Michael Vines 8d92232949
Specify zone 2018-09-28 07:32:49 -07:00
Michael Vines e4d8c094a4
Include -z when deleting network 2018-09-27 21:27:09 -07:00
Greg Fitzgerald 675ff64094 Fail CI on clippy warnings 2018-09-27 16:21:12 -06:00
Greg Fitzgerald f9fe6a0f72 Move clippy to Rust stable 2018-09-27 16:21:12 -06:00
Greg Fitzgerald 8d007bd7f7 Upgrade rustc and add clippy to stable 2018-09-27 16:21:12 -06:00
Stephen Akridge 6cdbdfbbcb Enable bench and fix upload-perf 2018-09-27 14:16:56 -07:00
Pankaj Garg 35e6343d61
Update testnet-deploy script to configure GPUs for leader node (#1379) 2018-09-27 13:42:24 -07:00
Michael Vines afc764752c Permit testnets without a GPU 2018-09-26 10:37:41 -07:00
sakridge 3e76efe97e
Fix bench compilation (#1311) 2018-09-24 10:40:42 -07:00
Michael Vines e5e325154b Add --shell argument 2018-09-24 08:05:47 -07:00
Michael Vines 67f1fbab5f Treat rustc warnings as errors in CI 2018-09-20 19:46:20 -07:00