4be537c51a
Temporarily disable nightly build until it can be fixed
2018-12-17 10:15:38 -08:00
66c568ba67
Add wallet sanity timeout
2018-12-17 09:58:34 -08:00
9a5195e79e
Remove CARGO_TARGET_CACHE_NAME, use BUILDKITE_LABEL
2018-12-16 23:05:44 -08:00
74ee1e5087
Increase the number of files a node may have open at a time
2018-12-15 17:15:22 -08:00
e5d1bd6589
Drop public suffix on build names
2018-12-15 16:54:23 -08:00
50e8666a14
Add format-url.sh
2018-12-15 15:10:04 -08:00
eedc8c7812
Move src/netutil.rs into its own crate
2018-12-14 20:13:34 -08:00
f0d1ed0cc4
|cargo test --all|
2018-12-14 19:32:04 -08:00
6ac466c0a4
Move src/logger.rs into logger/ crate to unify logging across the workspace
2018-12-14 13:10:43 -08:00
f6e3464ab9
bench-tps rebase
2018-12-14 09:38:46 -08:00
708876e9a7
Fix CI and related issues in bench-tps
...
Rename crate to `solana-bench-tps` in its Cargo.toml
Move crate
Add to ci/publish-crate.sh
2018-12-14 09:38:46 -08:00
c1ad987b04
Run checks over all crates in the workspace
2018-12-13 23:40:26 -08:00
9d0b7c6b31
Remove bench_streamer feature
2018-12-13 22:25:27 -08:00
d489cb1a8b
Desnake upload_ci_artifact for consistency
2018-12-13 22:25:27 -08:00
0fe6d61036
Move binaries from src/bin into their own crate
2018-12-13 22:25:27 -08:00
accabca618
Find solana-fullnode-cuda
2018-12-13 20:08:24 -08:00
647e5d76b0
Move solana-fullnode into fullnode/
2018-12-13 01:45:29 -08:00
7e4af9382e
Move solana-upload-perf into upload-perf/
2018-12-13 01:06:40 -08:00
282d4a3563
Move solana-keygen into keygen/
2018-12-13 01:06:40 -08:00
4b07778609
Add bench_streamer feature to inhibit building solana-bench-streamer by default
...
This program is not currently used in any automation and is fairly slow
to build. Disabling it by default will speed incremental builds.
2018-12-12 16:31:13 -08:00
bf33d9d703
Disable snap build until #2127 is resolved
2018-12-12 15:13:11 -08:00
af3ca02e35
Switch testnet-edge from snap to tarball
...
Snap publishing has been failing all day, unclear why. Potentially
revert this commit if/when resolved.
2018-12-11 23:34:41 -08:00
088bab61a4
Remove |cargo install| duplication
2018-12-11 23:29:05 -08:00
080d18b06e
Only run publish-crate on release branches, clarify crate ordering
2018-12-11 23:29:05 -08:00
b5784de33f
Disable leader rotation for testnet-automation until it's ready
2018-12-10 15:23:11 -08:00
094f0a8be3
Leader rotation flag plumbing
2018-12-10 14:07:59 -08:00
3d996bf080
Disable leader rotation on CI testnets until it's ready
2018-12-10 14:07:59 -08:00
4b05ee6811
Add hacky sleep
2018-12-10 14:05:00 -08:00
9b472d36fc
Add `--path .` to keep new `cargo` content
2018-12-09 18:09:03 -08:00
92584bd323
Only run the audit
2018-12-08 23:19:55 -07:00
586d9ee850
fix some nits ( #2034 )
...
rework maybe_cargo_install(), renamed to cargo_install_unless, updated to take a command to attempt
2018-12-08 19:14:19 -08:00
f5569e76db
Relocate native programs to deps/ subdirectory of the current executable
...
This layout is `cargo build` compatible, no post-build file moves
required.
2018-12-08 16:31:01 -08:00
0a83b17cdd
Upgrade to Rust 1.31.0 ( #2052 )
...
* Upgrade to Rust 1.31.0
* Upgrade nightly
* Fix all clippy warnings
* Revert relaxed version check and update
2018-12-07 20:01:28 -07:00
fa58da2401
Explicitly specific build variant when installing native programs
2018-12-07 11:32:08 -08:00
cba9c5619e
Relax stable version check during the transation period between 1.30 and 1.31
2018-12-06 19:44:47 -08:00
70c149c7da
Rename leader/validator to bootstrap-leader/fullnode
...
Only rsyncing the genesis ledger snuck in here as well
2018-12-06 19:44:47 -08:00
04a0652614
Generalize net/ from leader/validator to bootstrap-fullnode/fullnode
2018-12-05 17:11:16 -08:00
632425c7d7
Move native_loader under programs/native/
2018-12-05 14:32:42 -08:00
7336645501
Move programs into the executable location so native_loader can find them
2018-12-05 10:49:06 -08:00
424612ea9d
Reduce |ulimit -n| on macOS to max supported amount
2018-12-05 10:49:06 -08:00
5afafd9146
Update list of crates to publish
2018-12-05 10:49:06 -08:00
9a4f8199d6
Move system_program out of src/
2018-12-05 10:49:06 -08:00
e4049f3733
Ensure subshell failures are reported
2018-12-05 10:28:03 -08:00
8ef73eee51
Reject builds faster: if sanity checks fail don't bother with the rest
2018-12-01 11:43:29 -08:00
7c3e6e8e86
Move bpf-sdk to sdk/bpf
2018-12-01 10:47:59 -08:00
3ca826a480
re-enable test_tpu_forwarder ( #1964 )
2018-11-30 13:52:37 -08:00
29d95328ce
Use non-zero exit on channel determination failure
2018-11-30 08:50:17 -08:00
3cc0dd0d1e
stabilize testing with --test-threads=1
2018-11-29 12:54:42 -08:00
5c71f2a439
Add ulimit check to stable test suite
...
cargo test needs larger ulimit than default as well.
2018-11-29 11:39:42 -08:00
6a2ffafdb9
Update docker-solana location for CI
2018-11-28 16:20:02 -08:00
0c091c1b24
Dockerized LLVM ( #1914 )
...
Optionally build with dockererized custom llvm
2018-11-28 14:41:53 -08:00
fa4bdb4613
add --no-capture to get some logs from flaky tests
2018-11-27 23:24:20 -08:00
af1d9345e0
De-dup ci book build
2018-11-26 18:38:57 -08:00
03ce45d93a
Fix snap build
2018-11-26 18:38:48 -08:00
58e3dd4cb6
Avoid trying to install svgbob when already installed
2018-11-26 17:18:55 -08:00
7bf4c08f70
Add BPF C unittest framework
2018-11-26 12:25:29 -08:00
69beee5416
Install svgbob
2018-11-26 09:44:19 -08:00
2200a31331
Generate book images via Make
2018-11-26 09:44:19 -08:00
88e270723f
Move markdown book out of src/
2018-11-26 09:44:19 -08:00
6e00c6790e
Move testnet metrics dashboard management out of the Grafana UI
2018-11-25 16:10:25 -08:00
e6f91269ec
Use --no-tty with apt-key in Docker
2018-11-21 16:45:48 -08:00
8d7f380dfd
Remove extra version check
2018-11-21 14:30:26 -08:00
59163e2dd9
Optimize some CI stuff ( #1880 )
...
* CI Optimizations
2018-11-21 12:16:16 -08:00
7a54dbf7d5
Restore clippy, and run clippy sooner
2018-11-17 15:54:21 -08:00
591a28d516
Avoid extra commit when publishing book
2018-11-17 10:17:52 -08:00
903c82d7f1
Add timeouts
2018-11-17 09:09:25 -08:00
b2e0395f19
Bump release tarball build timeout (ahem rocksdb)
2018-11-17 08:12:03 -08:00
d96a6b42a5
Move drone into its own crate
2018-11-16 20:42:21 -08:00
7fe50d6402
Temporarily disable clippy
2018-11-16 19:55:33 -08:00
6ac5700f2e
Move metrics into its own crate
2018-11-16 15:10:07 -08:00
e791d0f74d
Drone now returns signed airdrop transactions
2018-11-15 17:13:13 -08:00
4a3230904e
Specify rpc port
2018-11-15 12:32:15 -08:00
6b6c87e510
Run BPF tests in CI
2018-11-14 17:16:37 -08:00
bba19ce667
Catch up to solana-genesis tokens argument name change
2018-11-14 09:55:33 -08:00
9bf2d1d7b4
Publish BPF SDK to a channel-specific URL to ease downstream pickup
2018-11-14 09:36:44 -08:00
66e9d30fda
Change testnet automation to use TAR instead of snap ( #1809 )
2018-11-13 13:33:15 -08:00
d53077bb3e
Activate perf-libs compatible CUDA env
2018-11-12 22:24:56 -08:00
2b44d5fb6a
Fix snap PR builds
2018-11-12 22:24:56 -08:00
dafdab1bbc
Add clang dependency to docker images, update validation checks ( #1794 )
2018-11-12 19:36:36 -08:00
9e7b9487b0
perf-libs now drives setting CUDA_HOME
2018-11-12 18:49:15 -08:00
3466f139a4
set -e shuffling
2018-11-11 16:24:36 -08:00
def7d156f6
codemod --extensions sh '#!/usr/bin/env bash -e' '#!/usr/bin/env bash\nset -e'
2018-11-11 16:24:36 -08:00
33aab094ef
codemod --extensions sh '#!/bin/bash' '#!/usr/bin/env bash'
2018-11-11 16:24:36 -08:00
cf6f344ccc
Add CUDA_HOME env var to permit overriding the CUDA install location
2018-11-11 16:24:18 -08:00
b670b9bcde
Regenerate identity files in CI
2018-11-11 09:22:52 -07:00
cdf1a96e23
Revert "V1 Window/Ledger based on RocksDb ( #1712 )"
...
This reverts commit bfcdec95cb
2018-11-09 20:25:53 -07:00
bfcdec95cb
V1 Window/Ledger based on RocksDb ( #1712 )
...
* Add rocksdb
* Implement new ledger module based on RocksDb
2018-11-09 18:30:26 -08:00
0926702269
Fix grcov download on macos and upload gcda/gcdo files for debugging
2018-11-09 11:19:28 -07:00
0a85347a0d
Upgrade Rust stable to 1.30.1
...
Fixes `cargo doc`
2018-11-09 07:46:51 -08:00
eaa8b9cb1e
Publish book
2018-11-09 02:13:59 -07:00
b0405db5a9
Assign static IPs to {edge,beta}.testnet.solana.com
2018-11-07 20:11:00 -08:00
f34f0af6b1
Install native programs in the correct location
2018-11-07 19:44:57 -08:00
22b6cbb4da
Switch testnet to AWS
2018-11-07 18:57:08 -08:00
25dd5145bb
Switch to us-west-1a, us-west-1b is causing trouble
2018-11-07 18:23:28 -08:00
3b41eec199
Shuffle AWS regions
2018-11-07 15:00:55 -08:00
b02b636b36
Support local tarball deploys
2018-11-07 14:44:40 -08:00
a537154c28
Remove all cuda dependencies from release tarball beyond solana-fullnode-cuda
2018-11-07 14:44:40 -08:00
812a8bcc6c
Permit release tag tarballs
2018-11-07 10:33:58 -08:00
63807935cb
Switch testnet/testnet-beta to tarball release
2018-11-07 10:30:02 -08:00
92a8b646df
Fix tarball publishing for tags
2018-11-07 10:26:19 -08:00
d9f9e347ab
Delete testnet-master, testnet-master-perf
2018-11-07 10:08:29 -08:00
038a46b5ef
Integrate the markdown book into the codebase
...
This implies that the book should describe exactly what is implemented,
and will not lead the way and eventually bitrot as the RFCs do.
2018-11-07 10:58:47 -07:00
863a0c3f8f
s/edge/beta/
2018-11-07 08:54:32 -08:00
dd4fb7aa90
Add AWS-based nets
2018-11-07 07:47:39 -08:00
2af5aad032
Switch testnet/testnet-perf to the latest beta or stable tag
2018-11-07 07:47:39 -08:00
9027141ff8
Publish release tarballs for tags
2018-11-07 07:47:39 -08:00
8be7c13d2d
Stub out architecture book ( #1674 )
...
* Stub out architecture documentation
* Add book HTML generation and book tests to CI
* Add heading
* Better table of contents
* Reference existing documentation
Move ASCII art from code comments into rendered SVG
* Attempt to fix CI
* Add lamport docs
And truncate lines to 80 characters
* Fix links
And reference shorter, newer description of PoH.
* Replace ASCII art with SVG
* Streamline for Pillbox
* Update path before optional install
* Use $CARGO_HOME instead of $HOME
* Delete code
Attempt to describe all data structures without code.
* Boot RPU from docs, add JsonRpcService
Also, use Rust naming conventions in the block diagrams to
minimize the jump from docs to code.
* Latest code uses tick_height
* Rename bob/ folder to art/
A home for any ASCII art
* Import JSON RPC API
* More mdbook docs
* Add Ncp
* Cleanup links
* Move pipelining description into fullnode description
* Move high-level transaction docs into top-level doc
* Delete unused files
2018-11-06 18:00:58 -07:00
d8d23c9971
Remove unused debug trace
2018-11-06 09:29:39 -08:00
6b5d12a8bb
Set metrics database correctly
2018-11-06 07:25:18 -08:00
c4b9d5d8b9
Remove stray line
2018-11-05 20:53:34 -08:00
52491b467a
Update testnet deploy docs
2018-11-05 19:12:55 -08:00
7789fda016
Add testnet-manager pipeline
2018-11-05 17:35:30 -08:00
c4346e6191
Add testnet pipeline for prebuilt images ( #1708 )
...
* Add testnet pipeline for prebuilt images
- It'll speed up testnet testing for released images
* removed quotes from variable
* address review comments
* fix testnet automation error
2018-11-05 13:50:33 -08:00
5a85cc4626
Rename buildkite-snap to buildkite-secondary
2018-11-05 08:47:51 -08:00
2c74815cc9
ci: correct crates.io publishing order
2018-11-02 15:39:24 -07:00
298bd6479a
Add first leader to genesis ( #1681 )
...
* Add first leader to genesis entries, consume in genesis.sh
* Set bootstrap leader in the bank on startup, remove instantiation of bootstrap leader from bin/fullnode
* Remove need to initialize bootstrap leader in leader_scheduler, now can be read from genesis entries
* Add separate interface new_with_leader() in mint for creating genesis leader entries
2018-11-02 14:32:05 -07:00
db98f7e0b4
Use env variables to disable validator sanity and ledger verification ( #1675 )
2018-10-31 12:30:33 -07:00
0529f36fde
Run workspace member's tests ( #1666 )
...
Run workspace member's tests
2018-10-30 22:53:36 -07:00
85869552e0
Update testnet scripts to use release tar ball ( #1660 )
...
* Update testnet scripts to use release tar ball
* use curl instead of s3cmd
2018-10-30 18:05:38 -07:00
6f9843c14b
Publish a tarball of Solana release binaries ( #1656 )
...
* Publish a tarball of solana release binaries
* included native programs in Solana release tar
* Remove PR check from publish script
2018-10-30 15:31:52 -07:00
37213209c5
Create programs/bpf/c/sdk/
2018-10-29 19:10:29 -07:00
f6b1b5ab37
Remove unnecessary checks
2018-10-29 13:27:52 -07:00
f12743de38
Create/publish bpf-sdk tarball
2018-10-29 12:54:57 -07:00
77e10ed757
Add utility to figure the current crate version
2018-10-29 12:54:57 -07:00
f671b7f63f
Publish root crate too
2018-10-25 17:16:18 -07:00
a340b18b19
Upgrade to rust 1.30
2018-10-25 17:13:41 -07:00
160cff4a30
Check for TRIGGERED_BUILDKITE_TAG
2018-10-25 16:37:54 -07:00
1733beabf7
mv common/ sdk/
2018-10-25 13:26:10 -07:00
471d8f6ff9
Fix up the version references to all other internal crates
2018-10-25 12:54:32 -07:00
b982595c73
Add version check and rustup
2018-10-24 19:48:58 -07:00
4ea422bcec
run integration tests serially
2018-10-17 11:37:10 -07:00
6074e4f962
Attempt to stabilize the test suite
...
The integration tests are allowed to open sockets, so running them
in parallel may cause "Too many open files" errors. This patch
runs the unit tests in parallel and the integration test serially.
2018-10-17 11:37:10 -07:00
5b4d4b97bc
Upgrade to latest stable Rust, 1.29.2
2018-10-15 09:54:24 -06:00
c5180c8092
Permit RUST_LOG overrides
2018-10-14 12:40:37 -07:00
e5ab9a856c
Upload bench output as build artifacts ( #1478 )
...
* Upload bench output as build artifacts
* Fix tags types
* Pull previous stats from metrics
* Change the default branch for comparison
* Fix formatting
* Fix build errors
* Address review comments
* Dedup some common code
* Add eval for channel info to find branch name
2018-10-12 15:13:10 -07:00
5c523716aa
Ship native programs
2018-10-10 16:49:48 -07:00
c240bb12ae
Change buildkite agent for testnet automation
2018-10-09 15:04:55 -07:00
29a8823db1
Env variables for testnet-automation parameters ( #1455 )
...
- This will enable us to create custom pipelines for field events
2018-10-09 11:50:56 -07:00
a80955eacb
Change format of data for TPS/Finality metrics in testnet automation ( #1446 )
...
* Change format of data for TPS/Finality metrics in testnet automation
* Revert number of nodes for testnet automation
* Split python command to its own script
* Fix python command line arguments
2018-10-09 10:35:01 -07:00
0a39722719
Add support to trigger testnet from a PR ( #1434 )
...
* Add support for different node counts
* Update variable names
* Delete network even after failures
* Add array for node counts
* Changed number of nodes to a space separated string of numbers
* Adjust number of nodes
* Snap will not be published if the env variable DO_NOT_PUBLISH_SNAP is set
* Address review comments
* Replaced influx db URL
2018-10-05 16:32:05 -07:00
9c0fa4d1d2
Upload coverage HTML reports ( #1421 )
...
Uploads two reports to Buildkite, one from cargo-cov and one from lcov via grcov. The lcov one is busted on linux and is what we need to bring codecov.io back up again. It works great on macos if you wanted to generate them locally and prefer lcov HTML reports.
* Also comment out non-coverage build to speed things up.
2018-10-05 10:17:35 -07:00
beb4536841
Run a fullnode+drone automatically when the container starts up
2018-10-02 18:09:35 -07:00
ad5fcf778f
Publish minimal Solana docker images to dockerhub
2018-10-02 16:57:48 -07:00
83b000ae88
Remove SNAP_ prefix
2018-10-02 16:57:48 -07:00
94459deb94
Disable codecov.io reporting
2018-09-28 19:19:16 -07:00
660af84b8d
Use the same versions of llvm-cov and libprofile
2018-09-28 19:19:16 -07:00
7b31020903
Add back llvm-dev for llvm-cov
2018-09-28 19:19:16 -07:00
9a4143b4d9
Upgrade llvm-dev and boot kcov
...
Need clang-dev, not llvm-dev because cargo-cov looks for libprofile
in a clang installation directory.
2018-09-28 19:19:16 -07:00
aebc47ad55
Attempt coverage reporting
2018-09-28 19:19:16 -07:00
5bc01cd51a
Revive code coverage
2018-09-28 19:19:16 -07:00
Michael Vines
Mekagoza
Greg Fitzgerald
Rob Walker
Stephen Akridge
Jack May
Pankaj Garg
carllin