Commit Graph

556 Commits

Author SHA1 Message Date
Michael Vines 3efbffe4e3 Run coverage when test-coverage.sh is modified 2018-12-18 18:09:59 -08:00
Michael Vines b101f40c32
Initial revision 2018-12-18 14:27:37 -08:00
Michael Vines e8e6c70e19
Remove duplicate _ definitions 2018-12-18 14:25:10 -08:00
Michael Vines cd6736d70b Remove duplication between test-stable{,-perf}.sh 2018-12-18 14:02:43 -08:00
Michael Vines c0dcf67ec8 Move book build into test-checks 2018-12-18 13:03:38 -08:00
Michael Vines bc52336a1b affected_files metadata is only available for PR builds 2018-12-18 13:03:38 -08:00
Michael Vines 3bfb052b0a Overhaul coverage setup 2018-12-18 10:48:06 -08:00
Michael Vines c71d5a111e Extract grcov download script 2018-12-18 10:48:06 -08:00
Greg Fitzgerald 437b62c4d9 Upgrade grcov 2018-12-18 10:48:06 -08:00
Michael Vines cbca0ae264 Remove dead code 2018-12-18 10:48:06 -08:00
Michael Vines e720070945
Flip && style 2018-12-18 09:56:43 -08:00
Michael Vines a8ab6f4caf
Preserve stable as default, use +nightly to get nightly 2018-12-18 09:54:47 -08:00
Michael Vines b7b1884950
Pass BUILDKITE_COMMIT env var into containers 2018-12-18 08:53:39 -08:00
Michael Vines 755064d3e2 Use |cargo +nightly| to avoid assuming nightly is default 2018-12-18 08:44:33 -08:00
Michael Vines 24a984086e nightly is now 1.33 2018-12-18 08:44:33 -08:00
Michael Vines 4b831d58b7 Don't fiddle with default rust, humans don't like that 2018-12-18 08:44:33 -08:00
Michael Vines 62f36037ea
Pass CI env var into containers 2018-12-18 00:47:41 -08:00
Michael Vines 29776c0283 Publish book only on content changes instead of on every commit 2018-12-17 16:42:22 -08:00
carllin 69d7384cc0
Enable leader rotation on edge testnet (#2204) 2018-12-17 16:04:25 -08:00
Michael Vines dc56bbeec8 Ensure the full workspace is built for coverage 2018-12-17 10:47:32 -08:00
Michael Vines 4be537c51a
Temporarily disable nightly build until it can be fixed 2018-12-17 10:15:38 -08:00
Michael Vines 66c568ba67 Add wallet sanity timeout 2018-12-17 09:58:34 -08:00
Michael Vines 9a5195e79e Remove CARGO_TARGET_CACHE_NAME, use BUILDKITE_LABEL 2018-12-16 23:05:44 -08:00
Michael Vines 74ee1e5087 Increase the number of files a node may have open at a time 2018-12-15 17:15:22 -08:00
Michael Vines e5d1bd6589 Drop public suffix on build names 2018-12-15 16:54:23 -08:00
Michael Vines 50e8666a14 Add format-url.sh 2018-12-15 15:10:04 -08:00
Michael Vines eedc8c7812 Move src/netutil.rs into its own crate 2018-12-14 20:13:34 -08:00
Michael Vines f0d1ed0cc4 |cargo test --all| 2018-12-14 19:32:04 -08:00
Michael Vines 6ac466c0a4 Move src/logger.rs into logger/ crate to unify logging across the workspace 2018-12-14 13:10:43 -08:00
Michael Vines f6e3464ab9 bench-tps rebase 2018-12-14 09:38:46 -08:00
Mekagoza 708876e9a7 Fix CI and related issues in bench-tps
Rename crate to `solana-bench-tps` in its Cargo.toml

Move crate

Add to ci/publish-crate.sh
2018-12-14 09:38:46 -08:00
Michael Vines c1ad987b04 Run checks over all crates in the workspace 2018-12-13 23:40:26 -08:00
Michael Vines 9d0b7c6b31 Remove bench_streamer feature 2018-12-13 22:25:27 -08:00
Michael Vines d489cb1a8b Desnake upload_ci_artifact for consistency 2018-12-13 22:25:27 -08:00
Michael Vines 0fe6d61036 Move binaries from src/bin into their own crate 2018-12-13 22:25:27 -08:00
Michael Vines accabca618 Find solana-fullnode-cuda 2018-12-13 20:08:24 -08:00
Michael Vines 647e5d76b0 Move solana-fullnode into fullnode/ 2018-12-13 01:45:29 -08:00
Michael Vines 7e4af9382e Move solana-upload-perf into upload-perf/ 2018-12-13 01:06:40 -08:00
Michael Vines 282d4a3563 Move solana-keygen into keygen/ 2018-12-13 01:06:40 -08:00
Michael Vines 4b07778609 Add bench_streamer feature to inhibit building solana-bench-streamer by default
This program is not currently used in any automation and is fairly slow
to build.  Disabling it by default will speed incremental builds.
2018-12-12 16:31:13 -08:00
Michael Vines bf33d9d703
Disable snap build until #2127 is resolved 2018-12-12 15:13:11 -08:00
Michael Vines af3ca02e35
Switch testnet-edge from snap to tarball
Snap publishing has been failing all day, unclear why.  Potentially
revert this commit if/when resolved.
2018-12-11 23:34:41 -08:00
Michael Vines 088bab61a4 Remove |cargo install| duplication 2018-12-11 23:29:05 -08:00
Michael Vines 080d18b06e Only run publish-crate on release branches, clarify crate ordering 2018-12-11 23:29:05 -08:00
Michael Vines b5784de33f Disable leader rotation for testnet-automation until it's ready 2018-12-10 15:23:11 -08:00
Michael Vines 094f0a8be3 Leader rotation flag plumbing 2018-12-10 14:07:59 -08:00
Michael Vines 3d996bf080 Disable leader rotation on CI testnets until it's ready 2018-12-10 14:07:59 -08:00
Michael Vines 4b05ee6811 Add hacky sleep 2018-12-10 14:05:00 -08:00
Michael Vines 9b472d36fc
Add `--path .` to keep new `cargo` content 2018-12-09 18:09:03 -08:00
Greg Fitzgerald 92584bd323 Only run the audit 2018-12-08 23:19:55 -07:00
Rob Walker 586d9ee850
fix some nits (#2034)
rework maybe_cargo_install(), renamed to cargo_install_unless, updated to take a command to attempt
2018-12-08 19:14:19 -08:00
Michael Vines f5569e76db Relocate native programs to deps/ subdirectory of the current executable
This layout is `cargo build` compatible, no post-build file moves
required.
2018-12-08 16:31:01 -08:00
Greg Fitzgerald 0a83b17cdd
Upgrade to Rust 1.31.0 (#2052)
* Upgrade to Rust 1.31.0
* Upgrade nightly
* Fix all clippy warnings
* Revert relaxed version check and update
2018-12-07 20:01:28 -07:00
Michael Vines fa58da2401 Explicitly specific build variant when installing native programs 2018-12-07 11:32:08 -08:00
Michael Vines cba9c5619e Relax stable version check during the transation period between 1.30 and 1.31 2018-12-06 19:44:47 -08:00
Michael Vines 70c149c7da Rename leader/validator to bootstrap-leader/fullnode
Only rsyncing the genesis ledger snuck in here as well
2018-12-06 19:44:47 -08:00
Michael Vines 04a0652614 Generalize net/ from leader/validator to bootstrap-fullnode/fullnode 2018-12-05 17:11:16 -08:00
Michael Vines 632425c7d7 Move native_loader under programs/native/ 2018-12-05 14:32:42 -08:00
Michael Vines 7336645501 Move programs into the executable location so native_loader can find them 2018-12-05 10:49:06 -08:00
Michael Vines 424612ea9d Reduce |ulimit -n| on macOS to max supported amount 2018-12-05 10:49:06 -08:00
Michael Vines 5afafd9146 Update list of crates to publish 2018-12-05 10:49:06 -08:00
Michael Vines 9a4f8199d6 Move system_program out of src/ 2018-12-05 10:49:06 -08:00
Michael Vines e4049f3733 Ensure subshell failures are reported 2018-12-05 10:28:03 -08:00
Michael Vines 8ef73eee51 Reject builds faster: if sanity checks fail don't bother with the rest 2018-12-01 11:43:29 -08:00
Michael Vines 7c3e6e8e86 Move bpf-sdk to sdk/bpf 2018-12-01 10:47:59 -08:00
Rob Walker 3ca826a480
re-enable test_tpu_forwarder (#1964) 2018-11-30 13:52:37 -08:00
Michael Vines 29d95328ce
Use non-zero exit on channel determination failure 2018-11-30 08:50:17 -08:00
Rob Walker 3cc0dd0d1e stabilize testing with --test-threads=1 2018-11-29 12:54:42 -08:00
Stephen Akridge 5c71f2a439 Add ulimit check to stable test suite
cargo test needs larger ulimit than default as well.
2018-11-29 11:39:42 -08:00
Jack May 6a2ffafdb9 Update docker-solana location for CI 2018-11-28 16:20:02 -08:00
jackcmay 0c091c1b24
Dockerized LLVM (#1914)
Optionally build with dockererized custom llvm
2018-11-28 14:41:53 -08:00
Rob Walker fa4bdb4613 add --no-capture to get some logs from flaky tests 2018-11-27 23:24:20 -08:00
Michael Vines af1d9345e0 De-dup ci book build 2018-11-26 18:38:57 -08:00
Michael Vines 03ce45d93a Fix snap build 2018-11-26 18:38:48 -08:00
Michael Vines 58e3dd4cb6 Avoid trying to install svgbob when already installed 2018-11-26 17:18:55 -08:00
Michael Vines 7bf4c08f70 Add BPF C unittest framework 2018-11-26 12:25:29 -08:00
Greg Fitzgerald 69beee5416 Install svgbob 2018-11-26 09:44:19 -08:00
Greg Fitzgerald 2200a31331 Generate book images via Make 2018-11-26 09:44:19 -08:00
Greg Fitzgerald 88e270723f Move markdown book out of src/ 2018-11-26 09:44:19 -08:00
Michael Vines 6e00c6790e Move testnet metrics dashboard management out of the Grafana UI 2018-11-25 16:10:25 -08:00
Jack May e6f91269ec Use --no-tty with apt-key in Docker 2018-11-21 16:45:48 -08:00
Jack May 8d7f380dfd Remove extra version check 2018-11-21 14:30:26 -08:00
jackcmay 59163e2dd9
Optimize some CI stuff (#1880)
* CI Optimizations
2018-11-21 12:16:16 -08:00
Michael Vines 7a54dbf7d5 Restore clippy, and run clippy sooner 2018-11-17 15:54:21 -08:00
Michael Vines 591a28d516
Avoid extra commit when publishing book 2018-11-17 10:17:52 -08:00
Michael Vines 903c82d7f1
Add timeouts 2018-11-17 09:09:25 -08:00
Michael Vines b2e0395f19
Bump release tarball build timeout (ahem rocksdb) 2018-11-17 08:12:03 -08:00
Michael Vines d96a6b42a5 Move drone into its own crate 2018-11-16 20:42:21 -08:00
Michael Vines 7fe50d6402 Temporarily disable clippy 2018-11-16 19:55:33 -08:00
Michael Vines 6ac5700f2e Move metrics into its own crate 2018-11-16 15:10:07 -08:00
Michael Vines e791d0f74d Drone now returns signed airdrop transactions 2018-11-15 17:13:13 -08:00
Michael Vines 4a3230904e Specify rpc port 2018-11-15 12:32:15 -08:00
jackcmay 6b6c87e510
Run BPF tests in CI 2018-11-14 17:16:37 -08:00
Michael Vines bba19ce667
Catch up to solana-genesis tokens argument name change 2018-11-14 09:55:33 -08:00
Michael Vines 9bf2d1d7b4 Publish BPF SDK to a channel-specific URL to ease downstream pickup 2018-11-14 09:36:44 -08:00
Pankaj Garg 66e9d30fda
Change testnet automation to use TAR instead of snap (#1809) 2018-11-13 13:33:15 -08:00
Michael Vines d53077bb3e Activate perf-libs compatible CUDA env 2018-11-12 22:24:56 -08:00
Michael Vines 2b44d5fb6a Fix snap PR builds 2018-11-12 22:24:56 -08:00
carllin dafdab1bbc
Add clang dependency to docker images, update validation checks (#1794) 2018-11-12 19:36:36 -08:00
Michael Vines 9e7b9487b0 perf-libs now drives setting CUDA_HOME 2018-11-12 18:49:15 -08:00
Michael Vines 3466f139a4 set -e shuffling 2018-11-11 16:24:36 -08:00
Michael Vines def7d156f6 codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e' 2018-11-11 16:24:36 -08:00
Michael Vines 33aab094ef codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash' 2018-11-11 16:24:36 -08:00
Michael Vines cf6f344ccc Add CUDA_HOME env var to permit overriding the CUDA install location 2018-11-11 16:24:18 -08:00
Greg Fitzgerald b670b9bcde Regenerate identity files in CI 2018-11-11 09:22:52 -07:00
Greg Fitzgerald cdf1a96e23 Revert "V1 Window/Ledger based on RocksDb (#1712)"
This reverts commit bfcdec95cb.
2018-11-09 20:25:53 -07:00
carllin bfcdec95cb
V1 Window/Ledger based on RocksDb (#1712)
* Add rocksdb

* Implement new ledger module based on RocksDb
2018-11-09 18:30:26 -08:00
Greg Fitzgerald 0926702269 Fix grcov download on macos and upload gcda/gcdo files for debugging 2018-11-09 11:19:28 -07:00
Greg Fitzgerald 0a85347a0d Upgrade Rust stable to 1.30.1
Fixes `cargo doc`
2018-11-09 07:46:51 -08:00
Michael Vines eaa8b9cb1e Publish book 2018-11-09 02:13:59 -07:00
Michael Vines b0405db5a9
Assign static IPs to {edge,beta}.testnet.solana.com 2018-11-07 20:11:00 -08:00
Michael Vines f34f0af6b1
Install native programs in the correct location 2018-11-07 19:44:57 -08:00
Michael Vines 22b6cbb4da
Switch testnet to AWS 2018-11-07 18:57:08 -08:00
Michael Vines 25dd5145bb
Switch to us-west-1a, us-west-1b is causing trouble 2018-11-07 18:23:28 -08:00
Michael Vines 3b41eec199
Shuffle AWS regions 2018-11-07 15:00:55 -08:00
Michael Vines b02b636b36
Support local tarball deploys 2018-11-07 14:44:40 -08:00
Michael Vines a537154c28
Remove all cuda dependencies from release tarball beyond solana-fullnode-cuda 2018-11-07 14:44:40 -08:00
Michael Vines 812a8bcc6c
Permit release tag tarballs 2018-11-07 10:33:58 -08:00
Michael Vines 63807935cb
Switch testnet/testnet-beta to tarball release 2018-11-07 10:30:02 -08:00
Michael Vines 92a8b646df
Fix tarball publishing for tags 2018-11-07 10:26:19 -08:00
Michael Vines d9f9e347ab
Delete testnet-master, testnet-master-perf 2018-11-07 10:08:29 -08:00
Greg Fitzgerald 038a46b5ef Integrate the markdown book into the codebase
This implies that the book should describe exactly what is implemented,
and will not lead the way and eventually bitrot as the RFCs do.
2018-11-07 10:58:47 -07:00
Michael Vines 863a0c3f8f
s/edge/beta/ 2018-11-07 08:54:32 -08:00
Michael Vines dd4fb7aa90 Add AWS-based nets 2018-11-07 07:47:39 -08:00
Michael Vines 2af5aad032 Switch testnet/testnet-perf to the latest beta or stable tag 2018-11-07 07:47:39 -08:00
Michael Vines 9027141ff8 Publish release tarballs for tags 2018-11-07 07:47:39 -08:00
Greg Fitzgerald 8be7c13d2d
Stub out architecture book (#1674)
* Stub out architecture documentation

* Add book HTML generation and book tests to CI

* Add heading

* Better table of contents

* Reference existing documentation

Move ASCII art from code comments into rendered SVG

* Attempt to fix CI

* Add lamport docs

And truncate lines to 80 characters

* Fix links

And reference shorter, newer description of PoH.

* Replace ASCII art with SVG

* Streamline for Pillbox

* Update path before optional install

* Use $CARGO_HOME instead of $HOME

* Delete code

Attempt to describe all data structures without code.

* Boot RPU from docs, add JsonRpcService

Also, use Rust naming conventions in the block diagrams to
minimize the jump from docs to code.

* Latest code uses tick_height

* Rename bob/ folder to art/

A home for any ASCII art

* Import JSON RPC API

* More mdbook docs

* Add Ncp

* Cleanup links

* Move pipelining description into fullnode description

* Move high-level transaction docs into top-level doc

* Delete unused files
2018-11-06 18:00:58 -07:00
Michael Vines d8d23c9971
Remove unused debug trace 2018-11-06 09:29:39 -08:00
Michael Vines 6b5d12a8bb
Set metrics database correctly 2018-11-06 07:25:18 -08:00
Michael Vines c4b9d5d8b9
Remove stray line 2018-11-05 20:53:34 -08:00
Michael Vines 52491b467a
Update testnet deploy docs 2018-11-05 19:12:55 -08:00
Michael Vines 7789fda016 Add testnet-manager pipeline 2018-11-05 17:35:30 -08:00
Pankaj Garg c4346e6191
Add testnet pipeline for prebuilt images (#1708)
* Add testnet pipeline for prebuilt images

- It'll speed up testnet testing for released images

* removed quotes from variable

* address review comments

* fix testnet automation error
2018-11-05 13:50:33 -08:00
Michael Vines 5a85cc4626
Rename buildkite-snap to buildkite-secondary 2018-11-05 08:47:51 -08:00
Michael Vines 2c74815cc9
ci: correct crates.io publishing order 2018-11-02 15:39:24 -07:00
carllin 298bd6479a
Add first leader to genesis (#1681)
* Add first leader to genesis entries, consume in genesis.sh

* Set bootstrap leader in the bank on startup, remove instantiation of bootstrap leader from bin/fullnode

* Remove need to initialize bootstrap leader in leader_scheduler, now can be read from genesis entries

* Add separate interface new_with_leader() in mint for creating genesis leader entries
2018-11-02 14:32:05 -07:00
Pankaj Garg db98f7e0b4
Use env variables to disable validator sanity and ledger verification (#1675) 2018-10-31 12:30:33 -07:00
jackcmay 0529f36fde
Run workspace member's tests (#1666)
Run workspace member's tests
2018-10-30 22:53:36 -07:00
Pankaj Garg 85869552e0
Update testnet scripts to use release tar ball (#1660)
* Update testnet scripts to use release tar ball

* use curl instead of s3cmd
2018-10-30 18:05:38 -07:00
Pankaj Garg 6f9843c14b
Publish a tarball of Solana release binaries (#1656)
* Publish a tarball of solana release binaries

* included native programs in Solana release tar

* Remove PR check from publish script
2018-10-30 15:31:52 -07:00
Michael Vines 37213209c5 Create programs/bpf/c/sdk/ 2018-10-29 19:10:29 -07:00
Michael Vines f6b1b5ab37
Remove unnecessary checks 2018-10-29 13:27:52 -07:00
Michael Vines f12743de38 Create/publish bpf-sdk tarball 2018-10-29 12:54:57 -07:00
Michael Vines 77e10ed757 Add utility to figure the current crate version 2018-10-29 12:54:57 -07:00
Michael Vines f671b7f63f
Publish root crate too 2018-10-25 17:16:18 -07:00
Michael Vines a340b18b19 Upgrade to rust 1.30 2018-10-25 17:13:41 -07:00
Michael Vines 160cff4a30
Check for TRIGGERED_BUILDKITE_TAG 2018-10-25 16:37:54 -07:00
Michael Vines 1733beabf7 mv common/ sdk/ 2018-10-25 13:26:10 -07:00
Michael Vines 471d8f6ff9 Fix up the version references to all other internal crates 2018-10-25 12:54:32 -07:00
Michael Vines b982595c73 Add version check and rustup 2018-10-24 19:48:58 -07:00