Commit Graph

113 Commits

Author SHA1 Message Date
Dan Albert 611d2fa75d
Add single region TPS report testcases (#9609)
automerge
2020-04-22 11:05:05 -07:00
Michael Vines 45ff1f2379
dos: Tidy up clap argument handling, and adapt to newer solana-dos arguments (#9633)
* Tidy up clap argument handling

* Adapt to newer solana-dos arguments
2020-04-21 16:58:30 -07:00
carllin 111a86f3ec
Added no superminority and isolated node test cases (#9306)
Co-authored-by: Carl <carl@solana.com>
2020-04-21 15:35:48 -07:00
Dan Albert c6da2ab0de
Fix automation stake parser (#9403)
Co-authored-by: publish-docs.sh <maintainers@solana.com>
2020-04-10 15:42:38 -06:00
Michael Vines 8e5ac1338f
Update baseline version 2020-04-08 12:14:18 -07:00
Michael Vines bfea3572ea
Fix solana-dos arguments 2020-04-06 08:28:45 -07:00
Dan Albert 691a3c6087
Add single testcase to run entire TPS report (#9143) 2020-04-01 10:29:18 -06:00
Dan Albert 74aed5cb58
Fix offline stake ops test script (#9130) 2020-03-27 12:20:32 -06:00
sakridge bca769111f
Dos all the things (#8914)
* Dos all the things

* Use solana-dos for gossip dos test
2020-03-20 12:55:38 -07:00
Dan Albert 90c9462dd4
Automated test framework can run scripts on launched clusters. Add offline stake operations test case and script. (#8510)
automerge
2020-03-18 14:57:19 -07:00
Dan Albert b0c524765e
Update gce-5-node-3-partition.yml 2020-03-18 14:07:09 -07:00
Dan Albert 0641244378
Add genesis token counter test to system test (#8824)
automerge
2020-03-16 12:09:18 -07:00
Dan Albert c3c4c9326b
Refactor system tests dir structure (#8865)
automerge
2020-03-14 18:37:37 -07:00
Michael Vines 29fb79382c Rework validator vote account defaults to half voting fees 2020-03-13 20:13:33 -07:00
Dan Albert bdb7b73b8a
Add longer running performance tests and new partition testcase (#8773)
* Add 1 hour perf stability tests to colo and GCE

* Add GCE full loss partition testcase to automation
2020-03-11 16:42:52 -07:00
Michael Vines 5f5824d78d Rework cluster metrics dashboard to support the modern clusters 2020-03-11 14:14:56 -07:00
Dan Albert 87c507fdbe
Refactor system test automation (#8780) 2020-03-10 23:38:50 -07:00
Dan Albert a0ed3261c9
Automated tests should use dedicated colo nodes (#8766)
automerge
2020-03-10 12:25:16 -07:00
Dan Albert 595c96b262
Plumb pre-emptibility and associated overrides into colo allocation and automated testing (#8754)
automerge
2020-03-10 11:25:44 -07:00
Dan Albert d303e6b94e
Override GCE self-destruct timer in automation (#8728) 2020-03-09 18:02:07 -07:00
Dan Albert ea010be5cb
Wait for stake distribution before starting clients (#8692) 2020-03-09 10:57:51 -07:00
Dan Albert f2b0e2f418
Add slot rate check to automation framework (#8676) 2020-03-05 23:58:31 -08:00
Michael Vines 9bcca268a3 Add simple gossip DoS test 2020-02-14 22:40:35 -07:00
Michael Vines 2542d5dd42 Bump baseline version to 0.23.4, improve error reporting 2020-02-12 11:59:12 -07:00
Michael Vines ad43babe3d ABI sanity test for running edge,beta,stable validators together 2020-02-11 21:21:31 -07:00
Dan Albert a2a2f1c2d2
Add new colo test cases using reduced node count (#8078)
automerge
2020-01-31 18:02:48 -08:00
Dan Albert 605623baf5 Report last tower distance and add partition testcase (#7929)
automerge
2020-01-24 16:37:19 -08:00
Dan Albert 15193d0e1f Ensure all GCE nightly tests use dedicated instances (#7944)
automerge
2020-01-23 10:17:12 -08:00
Dan Albert 7587656cf6
Implement automated partition testing (#7222) 2020-01-22 13:46:50 -05:00
Greg Fitzgerald 3aabeb2b81
Rename bootstrap leader (#7906)
* Rename bootstrap leader to bootstrap validator

It's a normal validator as soon as other validators enter the
leader schedule.

* cargo fmt

* Fix build

Thanks @CriesofCarrots!
2020-01-22 09:22:09 -07:00
Michael Vines 356f246a74 Remove get-/show- prefix from cli commands 2020-01-21 08:43:07 -07:00
Dan Albert cccaacee36 Wait for stake distribution in automation (#7883)
automerge
2020-01-20 13:32:37 -08:00
Dan Albert e16ccf8cf8
Remove extraneous header text in test result posts 2019-12-18 10:13:36 -05:00
Dan Albert 6a8f6fb3cc Update testnet testcases to point at new buildkite agent queues (#7544)
automerge
2019-12-17 20:32:31 -08:00
Dan Albert 107360a001
Refactor system-test dir structure and add stability test (#7530) 2019-12-17 14:58:10 -05:00
Dan Albert 5792f5bfb5
Increase tx_count to 20k for all 5 node testcases (#7348) 2019-12-10 14:18:41 -05:00
Dan Albert 7c3be2ec9a
Add 30k txcount Colo GPU testcase (#7314) 2019-12-05 21:17:16 -05:00
Dan Albert f4a089cc26
Allow delay between validator booting and client start (#7297)
* Allow delay between validator booting and client start
2019-12-05 21:03:26 -05:00
Dan Albert dbbd9663b2
Consolidate error messaging into result detail (#6950) 2019-11-14 11:18:38 -05:00
Dan Albert a28a34f61c
Clean up DB names in automation (#6949) 2019-11-14 10:20:10 -05:00
Dan Albert 96d47c51a1
Tighten up AWS testcases (#6948) 2019-11-14 10:17:50 -05:00
Dan Albert f27c11ccd8
Add Azure testnet to automation (#6911)
* Add Azure testnet to automation
2019-11-14 09:14:53 -05:00
Dan Albert f83254d760
Update Iftop command in testnet automation (#6908)
* Update iftop command
2019-11-13 14:41:42 -05:00
Dan Albert 4b1e9ada18
Fix busted failure messaging for slack app uploading (#6928)
* Add informative failure message

* Correctly expand variable names inside failed command string
2019-11-13 13:04:14 -05:00
Michael Vines fcc2874591
Remove/address some TODOs (#6923) 2019-11-13 09:43:15 -07:00
Dan Albert 73e3fc7c4f
Add packet loss analyzer to testnet automation (#6715)
* Add packet loss analyzer to testnet automation
2019-11-12 14:51:36 -05:00
Dan Albert 2688ae614c
Add public IP address option to automation (#6899)
* Add public IP address option to automation

* Make public IP use the default behavior
2019-11-12 13:55:19 -05:00
Dan Albert a23c6177d5
Use reusable provider-specific testnet keypairs (#6866)
* Use reusable provider-specific testnet keypairs

* shellcheck
2019-11-11 12:08:22 -07:00
Dan Albert 596d30661a
Echo failed command to results app (#6859) 2019-11-11 09:37:11 -07:00
Dan Albert 59adc25c23
Implement non-GPU mode testcase for colo (#6856) 2019-11-09 09:38:06 -07:00
Dan Albert 3a616de47b
Implementation of AWS support in automation (#6602)
* Implementation of AWS support in automation

* Add 10 node testcase

* Add cleanup for ec2 provider and single zone testcase
2019-10-31 12:00:10 -06:00
Dan Albert 9ee65009cd
Implement allowing validator boot failure into automation (#6589)
* Pass allow boot failures through create AND start

* Extend sleep timeout to all nodes

* Add 100 node testcase

* Reduce consistent sleep
2019-10-28 16:43:40 -06:00
Dan Albert ff34bfebde
Define 10, 25, 50 node testcases (#6557) 2019-10-25 11:43:53 -06:00
Dan Albert 43c0103e4c
Enforce machine type definition on GCE (#6555) 2019-10-25 08:10:25 -06:00
Dan Albert dadcb632d8
Specify machine type without necessarily enabling GPU (#6529)
* Specifiy machine type without necessarily enabling GPU

* Make long arg, extend --enable-gpu to automation

* Set machine types only in one place

* Fixup

* Fixup flag in automation

* Typo

* shellcheck
2019-10-24 15:12:25 -06:00
Dan Albert 39fc677781
Add 5 node GCE test cases (#6524)
* Add 5 node GCE test cases

* shell check
2019-10-23 22:05:05 -06:00
Dan Albert 01fe7c90a5
Do not break build on missing curl results (#6516) 2019-10-23 11:04:15 -06:00
Dan Albert 7d650eff8d
Match TPS stats to Grafana dashboard (#6506)
* Match TPS stats to Grafana dashboard

* Add label names
2019-10-22 16:27:26 -06:00
Dan Albert 4f25013954
Explicitly define commit SHA (#6499) 2019-10-22 13:55:58 -06:00
Dan Albert 1b1980ad49
Rename TEST_DURATION to TEST_DURATION_SECONDS (#6493) 2019-10-21 23:24:46 -04:00
Dan Albert 18feba2431
ADDITIONAL_FLAGS not handling multiple flags correctly (#6492)
* Fix ADDITIONAL_FLAGS parsing to handle multiple flags

* shellcheck
2019-10-21 23:17:41 -04:00
Dan Albert 00809a67c0
Push perf test results to slack app (#6371)
* Add script to publish testnet results to slack

* Obscure webhook URL

* fixup

* Replace read with cat redirection

* Turn back on net restart

* Pick nits

* Make symlink before trying to delete its contents

* Display test config in slack and pick Trents nit not to maybe rm -rf /*

* Clean up results print

* Minor nits

* Turn the test settings back up to 11

* typo

* Shellcheck

* Just a few more fields

* fix payload formatting

* Del clear-config.sh

* Mount secondary

* Add commit SHA link and Grafana time range URL

* Add fancy buttons instead of text URLs

* Tighten up test config display

* Fixup display nits

* chellsheck

* Rebase and fix typo
2019-10-21 20:00:17 -04:00
Dan Albert 60e8cf5a47
Implement nightly performance tests (#6140)
* Implement nightly performance tests on colo
2019-10-10 11:12:13 -04:00