Go to file
behzad nouri 293414f482
pads last erasure batch with empty data shreds (#639)
For duplicate blocks prevention we want to verify that the last erasure
batch was sufficiently propagated through turbine. This requires
additional bookkeeping because, depending on the erasure coding schema,
the entire batch might be recovered from only a few coding shreds.

In order to simplify above, this commit instead ensures that the last
erasure batch has >= 32 data shreds so that the batch cannot be
recovered unless 32+ shreds are received from turbine or repair.
2024-04-11 14:50:43 +00:00
.buildkite ci: merge docker images (#35078) 2024-02-07 15:17:33 +08:00
.github ci: remove increment-cargo-version-on-release.yml (#494) 2024-04-01 10:41:21 +08:00
account-decoder Simd 118: extend EpochRewards sysvar (#428) 2024-03-27 19:24:06 -06:00
accounts-bench SVM: Move `RentCollector` to sdk (#35122) 2024-02-07 16:38:42 -08:00
accounts-cluster-bench consensus: add dev-context-only-utils to tower (#687) 2024-04-09 16:39:57 -07:00
accounts-db Removes write version from store-tool (#722) 2024-04-11 10:09:36 -04:00
banking-bench Support --block-production-method in banking-bench (#269) 2024-03-22 09:12:21 -07:00
banks-client Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
banks-interface RPC: Add inner instructions to simulate transaction response (#34313) 2023-12-16 12:49:22 +00:00
banks-server Rename `SanitizedMessage::try_from` to `try_from_legacy_message` (#35338) 2024-02-29 08:25:22 +08:00
bench-streamer BankingStage Forwarding Filter (#685) 2024-04-09 23:12:26 +00:00
bench-tps consensus: add dev-context-only-utils to tower (#687) 2024-04-09 16:39:57 -07:00
bloom ConcurrentBloomInterval (#34486) 2024-01-02 08:21:36 -08:00
bucket_map Fix typos (#34459) 2023-12-21 13:06:00 -07:00
cargo-registry [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
cd
ci Introduce SchedulingStateMachine for unified scheduler (#129) 2024-04-05 08:58:33 +09:00
clap-utils clap-utils: Add more compute unit helpers (#440) 2024-03-28 01:58:20 +01:00
clap-v3-utils [clap-v3-utils] Fix deprecation message of `is_valid_pubkey` and `is_valid_signer` to `allow_all()` (#531) 2024-04-03 07:16:53 +09:00
cli Fix typo (#745) 2024-04-10 22:52:51 -06:00
cli-config [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
cli-output Fix typo (#745) 2024-04-10 22:52:51 -06:00
client client: Timeout resends during `send_and_confirm_in_parallel` (#358) 2024-03-22 12:10:00 +01:00
client-test Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
connection-cache don't sign X.509 certs (#34896) 2024-01-28 16:17:46 -08:00
core pads last erasure batch with empty data shreds (#639) 2024-04-11 14:50:43 +00:00
cost-model Make CostTracker aware of inflight transactions (#437) 2024-03-29 07:34:12 -05:00
docs Fixes typo in validator requirements (#680) 2024-04-09 10:46:53 -05:00
dos consensus: add dev-context-only-utils to tower (#687) 2024-04-09 16:39:57 -07:00
download-utils Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
entry Share the threadpool for tx execution and entry verifification (#216) 2024-03-27 16:33:21 -05:00
faucet [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
frozen-abi frozen-abi-macro: use `log` from `solana_frozen_abi` (#153) 2024-03-23 07:38:57 -05:00
genesis genesis: Skip inserting genesis accounts for Development clusters (#35266) 2024-02-22 14:42:35 -06:00
genesis-utils Move accounts-db code to its own crate (#32766) 2023-08-09 13:03:36 -07:00
geyser-plugin-interface [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
geyser-plugin-manager CI: Add windows clippy job and fix clippy errors (#330) 2024-03-20 13:21:00 +01:00
gossip pads last erasure batch with empty data shreds (#639) 2024-04-11 14:50:43 +00:00
inline-spl Remove duplicated token ids and use a shared inline-spl crate (#456) 2024-04-01 14:31:04 +02:00
install bump nix to 0.28.0 (#628) 2024-04-11 12:03:23 +08:00
keygen [keygen] Remove deprecated functions from the `grind` command (#490) 2024-04-02 11:11:05 +09:00
ledger pads last erasure batch with empty data shreds (#639) 2024-04-11 14:50:43 +00:00
ledger-tool program-runtime: hoist `RuntimeConfig` up to SVM (#630) 2024-04-07 10:45:57 -05:00
local-cluster pads last erasure batch with empty data shreds (#639) 2024-04-11 14:50:43 +00:00
log-analyzer Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
logger [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
measure Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
memory-management Moves a clippy attribute (#194) 2024-03-12 07:46:23 -04:00
merkle-root-bench Move accounts-db code to its own crate (#32766) 2023-08-09 13:03:36 -07:00
merkle-tree removes outdated matches crate from dependencies (#33172) 2023-09-07 12:52:57 +00:00
metrics Remove ability to submit metrics with no fields (#35133) 2024-02-16 11:10:15 -08:00
multinode-demo Net script fix for expected shred version (#280) 2024-03-18 13:54:07 -07:00
net Net script fix for expected shred version (#280) 2024-03-18 13:54:07 -07:00
net-shaper Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
net-utils bump nix to 0.28.0 (#628) 2024-04-11 12:03:23 +08:00
notifier [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
perf bump nix to 0.28.0 (#628) 2024-04-11 12:03:23 +08:00
poh Share the threadpool for tx execution and entry verifification (#216) 2024-03-27 16:33:21 -05:00
poh-bench Share the threadpool for tx execution and entry verifification (#216) 2024-03-27 16:33:21 -05:00
program-runtime program-runtime: hoist `RuntimeConfig` up to SVM (#630) 2024-04-07 10:45:57 -05:00
program-test program-test: move test-case to dev-dependencies (#710) 2024-04-10 10:22:28 -05:00
programs bump nix to 0.28.0 (#628) 2024-04-11 12:03:23 +08:00
pubsub-client [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
quic-client Rename and uniquify QUIC thread names (#28) 2024-03-05 12:09:17 -06:00
rayon-threadlimit chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
rbpf-cli [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
remote-wallet [clap-v3-utils] Deprecate signer source validation (#33802) 2024-01-06 08:19:54 +09:00
rpc feat: include replaced blockhash in RPC simulation response (#380) 2024-04-06 17:27:10 +08:00
rpc-client feat: include replaced blockhash in RPC simulation response (#380) 2024-04-06 17:27:10 +08:00
rpc-client-api feat: include replaced blockhash in RPC simulation response (#380) 2024-04-06 17:27:10 +08:00
rpc-client-nonce-utils clippy: Automated fixes for Rust 1.77.0 (#390) 2024-03-22 13:48:46 -04:00
rpc-test feat: include replaced blockhash in RPC simulation response (#380) 2024-04-06 17:27:10 +08:00
runtime Remove overly restrictive check_account_access for partitioned epoch rewards (#631) 2024-04-09 21:55:45 -06:00
runtime-transaction add requested limits to static meta (#34361) 2023-12-15 18:39:19 -06:00
scripts Update cargo metadata to Anza (#635) 2024-04-10 14:29:48 +08:00
sdk blockstore: scaffolding for chained merkle root conflict detection (#719) 2024-04-10 22:46:33 +00:00
send-transaction-service rpc-sts: add config options for stake-weighted qos (#197) 2024-03-20 11:13:50 -06:00
stake-accounts explicitly sets fee rate to zero for stake-accounts tests (#34848) 2024-01-19 09:17:31 -06:00
storage-bigtable Bigtable: update google proto files and allow configuration of max_message_size (#34740) 2024-01-10 21:20:15 -07:00
storage-proto ledger-tool: read bigtable entries (#34266) 2023-11-30 21:33:04 +00:00
streamer bump nix to 0.28.0 (#628) 2024-04-11 12:03:23 +08:00
svm Add unit test for `add_builtin` (#720) 2024-04-11 11:13:23 -03:00
system-test [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
test-validator program-runtime: hoist `RuntimeConfig` up to SVM (#630) 2024-04-07 10:45:57 -05:00
thin-client Deprecate `ThinClient` and remove `ThinClient` from `bench-tps` (#35365) 2024-03-01 12:14:52 -08:00
tokens SDK: refactor `Signer` and `Signers` traits (#34984) 2024-03-01 12:34:32 +01:00
tpu-client Async connection creation in connection cache (#33302) 2023-09-25 18:17:47 -07:00
transaction-dos consensus: add dev-context-only-utils to tower (#687) 2024-04-09 16:39:57 -07:00
transaction-metrics-tracker transaction performance tracking -- streamer stage (#257) 2024-04-04 13:19:13 -07:00
transaction-status vote: add TowerSync ix (#365) 2024-04-02 10:02:10 -07:00
turbine pads last erasure batch with empty data shreds (#639) 2024-04-11 14:50:43 +00:00
udp-client Quic update identity (#33865) 2023-12-08 14:53:19 +08:00
unified-scheduler-logic Introduce SchedulingStateMachine for unified scheduler (#129) 2024-04-05 08:58:33 +09:00
unified-scheduler-pool Introduce SchedulingStateMachine for unified scheduler (#129) 2024-04-05 08:58:33 +09:00
upload-perf chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
validator program-runtime: hoist `RuntimeConfig` up to SVM (#630) 2024-04-07 10:45:57 -05:00
version [anza migration] Sets client id to Agave (#163) 2024-03-12 07:46:41 -04:00
vote vote: add TowerSync ix (#365) 2024-04-02 10:02:10 -07:00
watchtower [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
web3.js Add link to new web3.js repo (#30096) 2023-02-27 10:23:54 -06:00
wen-restart wen_restart: Find the bank hash of the heaviest fork, replay if necessary. (#420) 2024-04-07 16:17:52 -07:00
zk-keygen [zk-keygen] Remove deprecated functions (#599) 2024-04-11 07:52:57 +09:00
zk-token-sdk ElGamal: add From impls; deprecate from/to_bytes (#246) 2024-04-05 08:47:07 +09:00
.clippy.toml
.codecov.yml Add .codecov.yml with checks disabled (#30666) 2023-03-10 20:11:22 +09:00
.gitignore git: ignore all `target/` directories (#34705) 2024-01-09 12:30:11 +01:00
.mergify.yml [anza migration] ci: fix path (#8) 2024-03-03 12:31:24 +08:00
CHANGELOG.md changelog: add entry for new simulate tx replacement blockhash (#623) 2024-04-06 22:21:44 +08:00
CONTRIBUTING.md Update cargo metadata to Anza (#635) 2024-04-10 14:29:48 +08:00
Cargo.lock bump nix to 0.28.0 (#628) 2024-04-11 12:03:23 +08:00
Cargo.toml bump nix to 0.28.0 (#628) 2024-04-11 12:03:23 +08:00
LICENSE Correct LICENSE to conform with https://apache.org/licenses/LICENSE-2.0 (#31860) 2023-05-31 03:06:42 +00:00
README.md [anza migration] ci (#5) 2024-03-03 12:31:24 +08:00
RELEASE.md Update RELEASE.md to reflect current release process (#444) 2024-03-28 13:13:27 -05:00
SECURITY.md Update SECURITY.md (#35048) 2024-02-05 11:13:04 -07:00
cargo
cargo-build-bpf
cargo-build-sbf
cargo-test-bpf
cargo-test-sbf
fetch-perf-libs.sh
fetch-spl.sh spl: Bump token-2022 and friends (#33453) 2023-09-29 19:12:06 +02:00
nextest.toml ci: move solana-cargo-build-sbf to nextest (#33257) 2023-09-15 14:24:43 +00:00
run.sh [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
rust-toolchain.toml Upgrades Rust to 1.76.0 (#35148) 2024-02-09 03:19:56 +00:00
rustfmt.toml
test-abi.sh
vercel.json

README.md

Solana

Solana crate Solana documentation Build status codecov

Building

1. Install rustc, cargo and rustfmt.

$ curl https://sh.rustup.rs -sSf | sh
$ source $HOME/.cargo/env
$ rustup component add rustfmt

When building the master branch, please make sure you are using the latest stable rust version by running:

$ rustup update

When building a specific release branch, you should check the rust version in ci/rust-version.sh and if necessary, install that version by running:

$ rustup install VERSION

Note that if this is not the latest rust version on your machine, cargo commands may require an override in order to use the correct version.

On Linux systems you may need to install libssl-dev, pkg-config, zlib1g-dev, protobuf etc.

On Ubuntu:

$ sudo apt-get update
$ sudo apt-get install libssl-dev libudev-dev pkg-config zlib1g-dev llvm clang cmake make libprotobuf-dev protobuf-compiler

On Fedora:

$ sudo dnf install openssl-devel systemd-devel pkg-config zlib-devel llvm clang cmake make protobuf-devel protobuf-compiler perl-core

2. Download the source code.

$ git clone https://github.com/solana-labs/solana.git
$ cd solana

3. Build.

$ ./cargo build

Testing

Run the test suite:

$ ./cargo test

Starting a local testnet

Start your own testnet locally, instructions are in the online docs.

Accessing the remote development cluster

  • devnet - stable public cluster for development accessible via devnet.solana.com. Runs 24/7. Learn more about the public clusters

Benchmarking

First, install the nightly build of rustc. cargo bench requires the use of the unstable features only available in the nightly build.

$ rustup install nightly

Run the benchmarks:

$ cargo +nightly bench

Release Process

The release process for this project is described here.

Code coverage

To generate code coverage statistics:

$ scripts/coverage.sh
$ open target/cov/lcov-local/index.html

Why coverage? While most see coverage as a code quality metric, we see it primarily as a developer productivity metric. When a developer makes a change to the codebase, presumably it's a solution to some problem. Our unit-test suite is how we encode the set of problems the codebase solves. Running the test suite should indicate that your change didn't infringe on anyone else's solutions. Adding a test protects your solution from future changes. Say you don't understand why a line of code exists, try deleting it and running the unit-tests. The nearest test failure should tell you what problem was solved by that code. If no test fails, go ahead and submit a Pull Request that asks, "what problem is solved by this code?" On the other hand, if a test does fail and you can think of a better way to solve the same problem, a Pull Request with your solution would most certainly be welcome! Likewise, if rewriting a test can better communicate what code it's protecting, please send us that patch!