Pankaj Garg
2fe3402362
Use SSD for perf testnet ( #2227 )
2018-12-19 16:11:26 -08:00
Michael Vines
14a236198f
nit: rename publish-solana-tar.sh to publish-tarball.sh
2018-12-19 14:26:25 -08:00
Michael Vines
cc1b43b90a
Retire GCP setup
2018-12-19 14:26:25 -08:00
Michael Vines
9448f0ce52
Add more Azure CI documentation
2018-12-19 14:26:25 -08:00
Michael Vines
59fdd8f6be
Move wallet airdrop retries into fullnode start script
2018-12-19 13:49:04 -08:00
Michael Vines
7b20318ee4
Run s3cmd in a container to avoid additional CI system dependencies
2018-12-19 13:09:24 -08:00
Michael Vines
c3c955b02e
Build/install native programs within cargo-install-all.sh
2018-12-19 11:53:08 -08:00
Michael Vines
6e56e41461
Document how to create a new Azure CI machine
2018-12-18 23:35:09 -08:00
Michael Vines
d74d5e0e44
nit: prevent shellcheck command from getting expanded by default
2018-12-18 18:44:20 -08:00
Michael Vines
cac08171de
nit: prevent book build from getting expanded by default
2018-12-18 18:44:20 -08:00
Michael Vines
6f6c350781
Skip stable-perf of no .rs files are modified in a PR
2018-12-18 18:44:20 -08:00
Michael Vines
506724fc93
Remove non-standard : anchors
2018-12-18 18:44:20 -08:00
Michael Vines
b4fe70d3d8
Skip bench of no .rs files are modified in a PR
2018-12-18 18:09:59 -08:00
Michael Vines
3efbffe4e3
Run coverage when test-coverage.sh is modified
2018-12-18 18:09:59 -08:00
Michael Vines
b101f40c32
Initial revision
2018-12-18 14:27:37 -08:00
Michael Vines
e8e6c70e19
Remove duplicate _ definitions
2018-12-18 14:25:10 -08:00
Michael Vines
cd6736d70b
Remove duplication between test-stable{,-perf}.sh
2018-12-18 14:02:43 -08:00
Michael Vines
c0dcf67ec8
Move book build into test-checks
2018-12-18 13:03:38 -08:00
Michael Vines
bc52336a1b
affected_files metadata is only available for PR builds
2018-12-18 13:03:38 -08:00
Michael Vines
3bfb052b0a
Overhaul coverage setup
2018-12-18 10:48:06 -08:00
Michael Vines
c71d5a111e
Extract grcov download script
2018-12-18 10:48:06 -08:00
Greg Fitzgerald
437b62c4d9
Upgrade grcov
2018-12-18 10:48:06 -08:00
Michael Vines
cbca0ae264
Remove dead code
2018-12-18 10:48:06 -08:00
Michael Vines
e720070945
Flip && style
2018-12-18 09:56:43 -08:00
Michael Vines
a8ab6f4caf
Preserve stable as default, use +nightly to get nightly
2018-12-18 09:54:47 -08:00
Michael Vines
b7b1884950
Pass BUILDKITE_COMMIT env var into containers
2018-12-18 08:53:39 -08:00
Michael Vines
755064d3e2
Use |cargo +nightly| to avoid assuming nightly is default
2018-12-18 08:44:33 -08:00
Michael Vines
24a984086e
nightly is now 1.33
2018-12-18 08:44:33 -08:00
Michael Vines
4b831d58b7
Don't fiddle with default rust, humans don't like that
2018-12-18 08:44:33 -08:00
Michael Vines
62f36037ea
Pass CI env var into containers
2018-12-18 00:47:41 -08:00
Michael Vines
29776c0283
Publish book only on content changes instead of on every commit
2018-12-17 16:42:22 -08:00
carllin
69d7384cc0
Enable leader rotation on edge testnet ( #2204 )
2018-12-17 16:04:25 -08:00
Michael Vines
dc56bbeec8
Ensure the full workspace is built for coverage
2018-12-17 10:47:32 -08:00
Michael Vines
4be537c51a
Temporarily disable nightly build until it can be fixed
2018-12-17 10:15:38 -08:00
Michael Vines
66c568ba67
Add wallet sanity timeout
2018-12-17 09:58:34 -08:00
Michael Vines
9a5195e79e
Remove CARGO_TARGET_CACHE_NAME, use BUILDKITE_LABEL
2018-12-16 23:05:44 -08:00
Michael Vines
74ee1e5087
Increase the number of files a node may have open at a time
2018-12-15 17:15:22 -08:00
Michael Vines
e5d1bd6589
Drop public suffix on build names
2018-12-15 16:54:23 -08:00
Michael Vines
50e8666a14
Add format-url.sh
2018-12-15 15:10:04 -08:00
Michael Vines
eedc8c7812
Move src/netutil.rs into its own crate
2018-12-14 20:13:34 -08:00
Michael Vines
f0d1ed0cc4
|cargo test --all|
2018-12-14 19:32:04 -08:00
Michael Vines
6ac466c0a4
Move src/logger.rs into logger/ crate to unify logging across the workspace
2018-12-14 13:10:43 -08:00
Michael Vines
f6e3464ab9
bench-tps rebase
2018-12-14 09:38:46 -08:00
Mekagoza
708876e9a7
Fix CI and related issues in bench-tps
...
Rename crate to `solana-bench-tps` in its Cargo.toml
Move crate
Add to ci/publish-crate.sh
2018-12-14 09:38:46 -08:00
Michael Vines
c1ad987b04
Run checks over all crates in the workspace
2018-12-13 23:40:26 -08:00
Michael Vines
9d0b7c6b31
Remove bench_streamer feature
2018-12-13 22:25:27 -08:00
Michael Vines
d489cb1a8b
Desnake upload_ci_artifact for consistency
2018-12-13 22:25:27 -08:00
Michael Vines
0fe6d61036
Move binaries from src/bin into their own crate
2018-12-13 22:25:27 -08:00
Michael Vines
accabca618
Find solana-fullnode-cuda
2018-12-13 20:08:24 -08:00
Michael Vines
647e5d76b0
Move solana-fullnode into fullnode/
2018-12-13 01:45:29 -08:00
Michael Vines
7e4af9382e
Move solana-upload-perf into upload-perf/
2018-12-13 01:06:40 -08:00
Michael Vines
282d4a3563
Move solana-keygen into keygen/
2018-12-13 01:06:40 -08:00
Michael Vines
4b07778609
Add bench_streamer feature to inhibit building solana-bench-streamer by default
...
This program is not currently used in any automation and is fairly slow
to build. Disabling it by default will speed incremental builds.
2018-12-12 16:31:13 -08:00
Michael Vines
bf33d9d703
Disable snap build until #2127 is resolved
2018-12-12 15:13:11 -08:00
Michael Vines
af3ca02e35
Switch testnet-edge from snap to tarball
...
Snap publishing has been failing all day, unclear why. Potentially
revert this commit if/when resolved.
2018-12-11 23:34:41 -08:00
Michael Vines
088bab61a4
Remove |cargo install| duplication
2018-12-11 23:29:05 -08:00
Michael Vines
080d18b06e
Only run publish-crate on release branches, clarify crate ordering
2018-12-11 23:29:05 -08:00
Michael Vines
b5784de33f
Disable leader rotation for testnet-automation until it's ready
2018-12-10 15:23:11 -08:00
Michael Vines
094f0a8be3
Leader rotation flag plumbing
2018-12-10 14:07:59 -08:00
Michael Vines
3d996bf080
Disable leader rotation on CI testnets until it's ready
2018-12-10 14:07:59 -08:00
Michael Vines
4b05ee6811
Add hacky sleep
2018-12-10 14:05:00 -08:00
Michael Vines
9b472d36fc
Add `--path .` to keep new `cargo` content
2018-12-09 18:09:03 -08:00
Greg Fitzgerald
92584bd323
Only run the audit
2018-12-08 23:19:55 -07:00
Rob Walker
586d9ee850
fix some nits ( #2034 )
...
rework maybe_cargo_install(), renamed to cargo_install_unless, updated to take a command to attempt
2018-12-08 19:14:19 -08:00
Michael Vines
f5569e76db
Relocate native programs to deps/ subdirectory of the current executable
...
This layout is `cargo build` compatible, no post-build file moves
required.
2018-12-08 16:31:01 -08:00
Greg Fitzgerald
0a83b17cdd
Upgrade to Rust 1.31.0 ( #2052 )
...
* Upgrade to Rust 1.31.0
* Upgrade nightly
* Fix all clippy warnings
* Revert relaxed version check and update
2018-12-07 20:01:28 -07:00
Michael Vines
fa58da2401
Explicitly specific build variant when installing native programs
2018-12-07 11:32:08 -08:00
Michael Vines
cba9c5619e
Relax stable version check during the transation period between 1.30 and 1.31
2018-12-06 19:44:47 -08:00
Michael Vines
70c149c7da
Rename leader/validator to bootstrap-leader/fullnode
...
Only rsyncing the genesis ledger snuck in here as well
2018-12-06 19:44:47 -08:00
Michael Vines
04a0652614
Generalize net/ from leader/validator to bootstrap-fullnode/fullnode
2018-12-05 17:11:16 -08:00
Michael Vines
632425c7d7
Move native_loader under programs/native/
2018-12-05 14:32:42 -08:00
Michael Vines
7336645501
Move programs into the executable location so native_loader can find them
2018-12-05 10:49:06 -08:00
Michael Vines
424612ea9d
Reduce |ulimit -n| on macOS to max supported amount
2018-12-05 10:49:06 -08:00
Michael Vines
5afafd9146
Update list of crates to publish
2018-12-05 10:49:06 -08:00
Michael Vines
9a4f8199d6
Move system_program out of src/
2018-12-05 10:49:06 -08:00
Michael Vines
e4049f3733
Ensure subshell failures are reported
2018-12-05 10:28:03 -08:00
Michael Vines
8ef73eee51
Reject builds faster: if sanity checks fail don't bother with the rest
2018-12-01 11:43:29 -08:00
Michael Vines
7c3e6e8e86
Move bpf-sdk to sdk/bpf
2018-12-01 10:47:59 -08:00
Rob Walker
3ca826a480
re-enable test_tpu_forwarder ( #1964 )
2018-11-30 13:52:37 -08:00
Michael Vines
29d95328ce
Use non-zero exit on channel determination failure
2018-11-30 08:50:17 -08:00
Rob Walker
3cc0dd0d1e
stabilize testing with --test-threads=1
2018-11-29 12:54:42 -08:00
Stephen Akridge
5c71f2a439
Add ulimit check to stable test suite
...
cargo test needs larger ulimit than default as well.
2018-11-29 11:39:42 -08:00
Jack May
6a2ffafdb9
Update docker-solana location for CI
2018-11-28 16:20:02 -08:00
jackcmay
0c091c1b24
Dockerized LLVM ( #1914 )
...
Optionally build with dockererized custom llvm
2018-11-28 14:41:53 -08:00
Rob Walker
fa4bdb4613
add --no-capture to get some logs from flaky tests
2018-11-27 23:24:20 -08:00
Michael Vines
af1d9345e0
De-dup ci book build
2018-11-26 18:38:57 -08:00
Michael Vines
03ce45d93a
Fix snap build
2018-11-26 18:38:48 -08:00
Michael Vines
58e3dd4cb6
Avoid trying to install svgbob when already installed
2018-11-26 17:18:55 -08:00
Michael Vines
7bf4c08f70
Add BPF C unittest framework
2018-11-26 12:25:29 -08:00
Greg Fitzgerald
69beee5416
Install svgbob
2018-11-26 09:44:19 -08:00
Greg Fitzgerald
2200a31331
Generate book images via Make
2018-11-26 09:44:19 -08:00
Greg Fitzgerald
88e270723f
Move markdown book out of src/
2018-11-26 09:44:19 -08:00
Michael Vines
6e00c6790e
Move testnet metrics dashboard management out of the Grafana UI
2018-11-25 16:10:25 -08:00
Jack May
e6f91269ec
Use --no-tty with apt-key in Docker
2018-11-21 16:45:48 -08:00
Jack May
8d7f380dfd
Remove extra version check
2018-11-21 14:30:26 -08:00
jackcmay
59163e2dd9
Optimize some CI stuff ( #1880 )
...
* CI Optimizations
2018-11-21 12:16:16 -08:00
Michael Vines
7a54dbf7d5
Restore clippy, and run clippy sooner
2018-11-17 15:54:21 -08:00
Michael Vines
591a28d516
Avoid extra commit when publishing book
2018-11-17 10:17:52 -08:00
Michael Vines
903c82d7f1
Add timeouts
2018-11-17 09:09:25 -08:00
Michael Vines
b2e0395f19
Bump release tarball build timeout (ahem rocksdb)
2018-11-17 08:12:03 -08:00
Michael Vines
d96a6b42a5
Move drone into its own crate
2018-11-16 20:42:21 -08:00
Michael Vines
7fe50d6402
Temporarily disable clippy
2018-11-16 19:55:33 -08:00
Michael Vines
6ac5700f2e
Move metrics into its own crate
2018-11-16 15:10:07 -08:00
Michael Vines
e791d0f74d
Drone now returns signed airdrop transactions
2018-11-15 17:13:13 -08:00
Michael Vines
4a3230904e
Specify rpc port
2018-11-15 12:32:15 -08:00
jackcmay
6b6c87e510
Run BPF tests in CI
2018-11-14 17:16:37 -08:00
Michael Vines
bba19ce667
Catch up to solana-genesis tokens argument name change
2018-11-14 09:55:33 -08:00
Michael Vines
9bf2d1d7b4
Publish BPF SDK to a channel-specific URL to ease downstream pickup
2018-11-14 09:36:44 -08:00
Pankaj Garg
66e9d30fda
Change testnet automation to use TAR instead of snap ( #1809 )
2018-11-13 13:33:15 -08:00
Michael Vines
d53077bb3e
Activate perf-libs compatible CUDA env
2018-11-12 22:24:56 -08:00
Michael Vines
2b44d5fb6a
Fix snap PR builds
2018-11-12 22:24:56 -08:00
carllin
dafdab1bbc
Add clang dependency to docker images, update validation checks ( #1794 )
2018-11-12 19:36:36 -08:00
Michael Vines
9e7b9487b0
perf-libs now drives setting CUDA_HOME
2018-11-12 18:49:15 -08:00
Michael Vines
3466f139a4
set -e shuffling
2018-11-11 16:24:36 -08:00
Michael Vines
def7d156f6
codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e'
2018-11-11 16:24:36 -08:00
Michael Vines
33aab094ef
codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash'
2018-11-11 16:24:36 -08:00
Michael Vines
cf6f344ccc
Add CUDA_HOME env var to permit overriding the CUDA install location
2018-11-11 16:24:18 -08:00
Greg Fitzgerald
b670b9bcde
Regenerate identity files in CI
2018-11-11 09:22:52 -07:00
Greg Fitzgerald
cdf1a96e23
Revert "V1 Window/Ledger based on RocksDb ( #1712 )"
...
This reverts commit bfcdec95cb
.
2018-11-09 20:25:53 -07:00
carllin
bfcdec95cb
V1 Window/Ledger based on RocksDb ( #1712 )
...
* Add rocksdb
* Implement new ledger module based on RocksDb
2018-11-09 18:30:26 -08:00
Greg Fitzgerald
0926702269
Fix grcov download on macos and upload gcda/gcdo files for debugging
2018-11-09 11:19:28 -07:00
Greg Fitzgerald
0a85347a0d
Upgrade Rust stable to 1.30.1
...
Fixes `cargo doc`
2018-11-09 07:46:51 -08:00
Michael Vines
eaa8b9cb1e
Publish book
2018-11-09 02:13:59 -07:00
Michael Vines
b0405db5a9
Assign static IPs to {edge,beta}.testnet.solana.com
2018-11-07 20:11:00 -08:00
Michael Vines
f34f0af6b1
Install native programs in the correct location
2018-11-07 19:44:57 -08:00
Michael Vines
22b6cbb4da
Switch testnet to AWS
2018-11-07 18:57:08 -08:00
Michael Vines
25dd5145bb
Switch to us-west-1a, us-west-1b is causing trouble
2018-11-07 18:23:28 -08:00
Michael Vines
3b41eec199
Shuffle AWS regions
2018-11-07 15:00:55 -08:00
Michael Vines
b02b636b36
Support local tarball deploys
2018-11-07 14:44:40 -08:00
Michael Vines
a537154c28
Remove all cuda dependencies from release tarball beyond solana-fullnode-cuda
2018-11-07 14:44:40 -08:00
Michael Vines
812a8bcc6c
Permit release tag tarballs
2018-11-07 10:33:58 -08:00
Michael Vines
63807935cb
Switch testnet/testnet-beta to tarball release
2018-11-07 10:30:02 -08:00
Michael Vines
92a8b646df
Fix tarball publishing for tags
2018-11-07 10:26:19 -08:00
Michael Vines
d9f9e347ab
Delete testnet-master, testnet-master-perf
2018-11-07 10:08:29 -08:00
Greg Fitzgerald
038a46b5ef
Integrate the markdown book into the codebase
...
This implies that the book should describe exactly what is implemented,
and will not lead the way and eventually bitrot as the RFCs do.
2018-11-07 10:58:47 -07:00
Michael Vines
863a0c3f8f
s/edge/beta/
2018-11-07 08:54:32 -08:00
Michael Vines
dd4fb7aa90
Add AWS-based nets
2018-11-07 07:47:39 -08:00
Michael Vines
2af5aad032
Switch testnet/testnet-perf to the latest beta or stable tag
2018-11-07 07:47:39 -08:00
Michael Vines
9027141ff8
Publish release tarballs for tags
2018-11-07 07:47:39 -08:00
Greg Fitzgerald
8be7c13d2d
Stub out architecture book ( #1674 )
...
* Stub out architecture documentation
* Add book HTML generation and book tests to CI
* Add heading
* Better table of contents
* Reference existing documentation
Move ASCII art from code comments into rendered SVG
* Attempt to fix CI
* Add lamport docs
And truncate lines to 80 characters
* Fix links
And reference shorter, newer description of PoH.
* Replace ASCII art with SVG
* Streamline for Pillbox
* Update path before optional install
* Use $CARGO_HOME instead of $HOME
* Delete code
Attempt to describe all data structures without code.
* Boot RPU from docs, add JsonRpcService
Also, use Rust naming conventions in the block diagrams to
minimize the jump from docs to code.
* Latest code uses tick_height
* Rename bob/ folder to art/
A home for any ASCII art
* Import JSON RPC API
* More mdbook docs
* Add Ncp
* Cleanup links
* Move pipelining description into fullnode description
* Move high-level transaction docs into top-level doc
* Delete unused files
2018-11-06 18:00:58 -07:00
Michael Vines
d8d23c9971
Remove unused debug trace
2018-11-06 09:29:39 -08:00
Michael Vines
6b5d12a8bb
Set metrics database correctly
2018-11-06 07:25:18 -08:00
Michael Vines
c4b9d5d8b9
Remove stray line
2018-11-05 20:53:34 -08:00
Michael Vines
52491b467a
Update testnet deploy docs
2018-11-05 19:12:55 -08:00
Michael Vines
7789fda016
Add testnet-manager pipeline
2018-11-05 17:35:30 -08:00
Pankaj Garg
c4346e6191
Add testnet pipeline for prebuilt images ( #1708 )
...
* Add testnet pipeline for prebuilt images
- It'll speed up testnet testing for released images
* removed quotes from variable
* address review comments
* fix testnet automation error
2018-11-05 13:50:33 -08:00
Michael Vines
5a85cc4626
Rename buildkite-snap to buildkite-secondary
2018-11-05 08:47:51 -08:00
Michael Vines
2c74815cc9
ci: correct crates.io publishing order
2018-11-02 15:39:24 -07:00
carllin
298bd6479a
Add first leader to genesis ( #1681 )
...
* Add first leader to genesis entries, consume in genesis.sh
* Set bootstrap leader in the bank on startup, remove instantiation of bootstrap leader from bin/fullnode
* Remove need to initialize bootstrap leader in leader_scheduler, now can be read from genesis entries
* Add separate interface new_with_leader() in mint for creating genesis leader entries
2018-11-02 14:32:05 -07:00
Pankaj Garg
db98f7e0b4
Use env variables to disable validator sanity and ledger verification ( #1675 )
2018-10-31 12:30:33 -07:00