Go to file
Wen bfe44d95f4
Wen restart aggregate last voted fork slots (#33892)
* Push and aggregate RestartLastVotedForkSlots.

* Fix API and lint errors.

* Reduce clutter.

* Put my own LastVotedForkSlots into the aggregate.

* Write LastVotedForkSlots aggregate progress into local file.

* Fix typo and name constants.

* Fix flaky test.

* Clarify the comments.

* - Use constant for wait_for_supermajority
- Avoid waiting after first shred when repair is in wen_restart

* Fix delay_after_first_shred and remove loop in wen_restart.

* Read wen_restart slots inside the loop instead.

* Discard turbine shreds while in wen_restart in windows insert rather than
shred_fetch_stage.

* Use the new Gossip API.

* Rename slots_to_repair_for_wen_restart and a few others.

* Rename a few more and list all states.

* Pipe exit down to aggregate loop so we can exit early.

* Fix import of RestartLastVotedForkSlots.

* Use the new method to generate test bank.

* Make linter happy.

* Use new bank constructor for tests.

* Fix a bad merge.

* - add new const for wen_restart
- fix the test to cover more cases
- add generate_repairs_for_slot_not_throtted_by_tick and
  generate_repairs_for_slot_throtted_by_tick to make it readable

* Add initialize and put the main logic into a loop.

* Change aggregate interface and other fixes.

* Add failure tests and tests for state transition.

* Add more tests and add ability to recover from written records in
last_voted_fork_slots_aggregate.

* Various name changes.

* We don't really care what type of error is returned.

* Wait on expected progress message in proto file instead of sleep.

* Code reorganization and cleanup.

* Make linter happy.

* Add WenRestartError.

* Split WenRestartErrors into separate erros per state.

* Revert "Split WenRestartErrors into separate erros per state."

This reverts commit 4c920cb8f8d492707560441912351cca779129f6.

* Use individual functions when testing for failures.

* Move initialization errors into initialize().

* Use anyhow instead of thiserror to generate backtrace for error.

* Add missing Cargo.lock.

* Add error log when last_vote is missing in the tower storage.

* Change error log info.

* Change test to match exact error.
2024-03-01 18:52:47 -08:00
.buildkite ci: merge docker images (#35078) 2024-02-07 15:17:33 +08:00
.github ci: update anchor downstream project (#35274) 2024-02-21 22:30:55 +08:00
account-decoder Revert "Support json parsing of epoch-rewards partition data sysvar accounts (#34914)" 2024-02-05 19:54:19 -07:00
accounts-bench SVM: Move `RentCollector` to sdk (#35122) 2024-02-07 16:38:42 -08:00
accounts-cluster-bench accounts-cluster-bench: Break early when a max-accounts limit is reached (#34922) 2024-01-25 19:46:43 +00:00
accounts-db [TieredStorage] rent_epoch() returns 0 for zero-lamport accounts (#35344) 2024-03-01 15:18:12 -08:00
banking-bench Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
banks-client Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
banks-interface RPC: Add inner instructions to simulate transaction response (#34313) 2023-12-16 12:49:22 +00:00
banks-server Rename `SanitizedMessage::try_from` to `try_from_legacy_message` (#35338) 2024-02-29 08:25:22 +08:00
bench-streamer Give streamer::receiver() threads unique names (#35369) 2024-03-01 13:36:08 -06:00
bench-tps Deprecate `ThinClient` and remove `ThinClient` from `bench-tps` (#35365) 2024-03-01 12:14:52 -08:00
bloom ConcurrentBloomInterval (#34486) 2024-01-02 08:21:36 -08:00
bucket_map Fix typos (#34459) 2023-12-21 13:06:00 -07:00
cargo-registry Cleanup cargo registry code (#33879) 2023-10-26 12:58:20 -07:00
cd
ci Build `transfer-hook` for downstream project (#35245) 2024-02-21 14:21:12 -03:00
clap-utils clap-utils: Forbid multiple values for `--signer` (#34482) 2024-01-05 21:25:50 +01:00
clap-v3-utils [clap-v3-utils] Add functions to parse directly from `SignerSource` (#34678) 2024-01-25 06:27:02 +09:00
cli SDK: refactor `Signer` and `Signers` traits (#34984) 2024-03-01 12:34:32 +01:00
cli-config [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
cli-output Cli: Return final transaction signature in solana program deploy (#34931) 2024-01-25 22:25:03 +00:00
client Deprecate `ThinClient` and remove `ThinClient` from `bench-tps` (#35365) 2024-03-01 12:14:52 -08:00
client-test Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
connection-cache don't sign X.509 certs (#34896) 2024-01-28 16:17:46 -08:00
core Wen restart aggregate last voted fork slots (#33892) 2024-03-01 18:52:47 -08:00
cost-model Feature Impl: cost model uses number of requested write locks (#34820) 2024-01-22 09:22:49 -08:00
docs Fix typos (#35234) 2024-02-19 15:51:13 +00:00
dos Increase loaded accounts data size when padding program is used (#33219) 2023-09-13 11:20:40 +02:00
download-utils Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
entry removes outdated matches crate from dependencies (#33172) 2023-09-07 12:52:57 +00:00
faucet preliminaries for bumping nightly to 2023-08-25 (#33047) 2023-08-29 23:05:35 +00:00
frozen-abi hash: Use `finalize().into()` instead of `try_into()` for hash results (#35300) 2024-02-23 19:31:32 -07:00
genesis genesis: Skip inserting genesis accounts for Development clusters (#35266) 2024-02-22 14:42:35 -06:00
genesis-utils Move accounts-db code to its own crate (#32766) 2023-08-09 13:03:36 -07:00
geyser-plugin-interface [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
geyser-plugin-manager Fix typos (#35234) 2024-02-19 15:51:13 +00:00
gossip Give streamer::receiver() threads unique names (#35369) 2024-03-01 13:36:08 -06:00
install clippy: Removes ineffective open options (#34599) 2023-12-27 22:20:17 -05:00
keygen Show error instead of panic on passphrase mismatch during solana-keygen (#35072) 2024-02-06 15:32:06 -05:00
ledger Uses purge_all_bank_snapshots() (#35380) 2024-03-01 07:11:38 -05:00
ledger-tool Split runtime utilities out of stake_state.rs (#35386) 2024-03-01 09:08:55 -07:00
local-cluster local-cluster: fix flaky optimistic_confirmation tests (#35356) 2024-02-29 12:05:20 -08:00
log-analyzer Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
logger clippy: Removes ineffective open options (#34599) 2023-12-27 22:20:17 -05:00
measure Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
memory-management Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
merkle-root-bench Move accounts-db code to its own crate (#32766) 2023-08-09 13:03:36 -07:00
merkle-tree removes outdated matches crate from dependencies (#33172) 2023-09-07 12:52:57 +00:00
metrics Remove ability to submit metrics with no fields (#35133) 2024-02-16 11:10:15 -08:00
multinode-demo use staked connection for bench-tps in net scripts (#34767) 2024-01-13 18:50:27 +01:00
net Deprecate `ThinClient` and remove `ThinClient` from `bench-tps` (#35365) 2024-03-01 12:14:52 -08:00
net-shaper Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
net-utils Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
notifier chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
perf Fix typos (#34459) 2023-12-21 13:06:00 -07:00
poh Fix typos (#34459) 2023-12-21 13:06:00 -07:00
poh-bench Upgrades Rust to 1.72.0 & nightly-2023-08-25 (#32961) 2023-09-01 07:26:13 +00:00
program-runtime Add limit to looping in banking-stage (#35342) 2024-02-28 17:36:45 -08:00
program-test SVM: Move SVM code to its own crate folder (#35119) 2024-02-06 16:06:32 -08:00
programs Wen restart aggregate last voted fork slots (#33892) 2024-03-01 18:52:47 -08:00
pubsub-client [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
quic-client don't sign X.509 certs (#34896) 2024-01-28 16:17:46 -08:00
rayon-threadlimit chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
rbpf-cli rbpf-cli: fix deprecation notice (#31743) 2023-05-22 04:47:05 -05:00
remote-wallet [clap-v3-utils] Deprecate signer source validation (#33802) 2024-01-06 08:19:54 +09:00
rpc Rename `SanitizedMessage::try_from` to `try_from_legacy_message` (#35338) 2024-02-29 08:25:22 +08:00
rpc-client [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
rpc-client-api RPC: Add inner instructions to simulate transaction response (#34313) 2023-12-16 12:49:22 +00:00
rpc-client-nonce-utils chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
rpc-test clippy: Replaces .get(0) with .first() (#34048) 2023-11-13 17:22:17 -05:00
runtime Remove unnecessary unwrap from `simulate_transaction_unchecked()` (#35375) 2024-03-01 13:37:51 -08:00
runtime-transaction add requested limits to static meta (#34361) 2023-12-15 18:39:19 -06:00
scripts ci: update anchor downstream project (#35274) 2024-02-21 22:30:55 +08:00
sdk Removes cap_accounts_data_size_per_block feature (#35381) 2024-03-01 14:22:25 -05:00
send-transaction-service Remove ability to submit metrics with no fields (#35133) 2024-02-16 11:10:15 -08:00
stake-accounts explicitly sets fee rate to zero for stake-accounts tests (#34848) 2024-01-19 09:17:31 -06:00
storage-bigtable Bigtable: update google proto files and allow configuration of max_message_size (#34740) 2024-01-10 21:20:15 -07:00
storage-proto ledger-tool: read bigtable entries (#34266) 2023-11-30 21:33:04 +00:00
streamer Give streamer::receiver() threads unique names (#35369) 2024-03-01 13:36:08 -06:00
svm Add more unit tests to SVM (#35383) 2024-03-01 16:04:08 -03:00
system-test Fix typos (#34459) 2023-12-21 13:06:00 -07:00
test-validator SVM: Move SVM code to its own crate folder (#35119) 2024-02-06 16:06:32 -08:00
thin-client Deprecate `ThinClient` and remove `ThinClient` from `bench-tps` (#35365) 2024-03-01 12:14:52 -08:00
tokens SDK: refactor `Signer` and `Signers` traits (#34984) 2024-03-01 12:34:32 +01:00
tpu-client Async connection creation in connection cache (#33302) 2023-09-25 18:17:47 -07:00
transaction-dos Fix typos (#34459) 2023-12-21 13:06:00 -07:00
transaction-status Add `Message::is_maybe_writable` (#35340) 2024-02-29 10:27:33 +08:00
turbine removes feature-gated code revising turbine epoch stakes for shreds propagation (#35226) 2024-02-20 16:04:32 +00:00
udp-client Quic update identity (#33865) 2023-12-08 14:53:19 +08:00
unified-scheduler-logic Introduce primitive threading in unified scheduler (#34676) 2024-01-24 12:46:16 +09:00
unified-scheduler-pool Add --unified-scheduler-handler-threads (#35195) 2024-02-22 09:05:17 +09:00
upload-perf chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
validator Add --unified-scheduler-handler-threads (#35195) 2024-02-22 09:05:17 +09:00
version ci: test-checks.sh all sbf code & use nightly only (#30602) 2023-03-13 14:28:34 +09:00
vote gossip: notify state machine of duplicate proofs (#32963) 2024-01-26 07:58:37 -08:00
watchtower docs: fix typo in watchtower/README.md (#33771) 2023-10-19 17:28:04 +02:00
web3.js Add link to new web3.js repo (#30096) 2023-02-27 10:23:54 -06:00
wen-restart Wen restart aggregate last voted fork slots (#33892) 2024-03-01 18:52:47 -08:00
zk-keygen [clap-v3-utils] Deprecate signer source validation (#33802) 2024-01-06 08:19:54 +09:00
zk-token-sdk [zk-token-sdk] Use checked arithmetic when processing transfer amount (#34130) 2024-01-24 22:27:03 +09:00
.clippy.toml
.codecov.yml Add .codecov.yml with checks disabled (#30666) 2023-03-10 20:11:22 +09:00
.gitignore git: ignore all `target/` directories (#34705) 2024-01-09 12:30:11 +01:00
.mergify.yml Updates mergify backport actions for new minor version (#34921) 2024-01-23 22:29:21 -05:00
.travis.yml chore: remove Explorer build scripts from the Monorepo (#30262) 2023-02-10 17:25:32 -06:00
CHANGELOG.md move changelog note of default central-scheduler (#35217) 2024-02-23 11:13:23 -08:00
CONTRIBUTING.md [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
Cargo.lock Wen restart aggregate last voted fork slots (#33892) 2024-03-01 18:52:47 -08:00
Cargo.toml build(deps): bump log from 0.4.20 to 0.4.21 (#35370) 2024-03-01 00:51:44 +08:00
LICENSE Correct LICENSE to conform with https://apache.org/licenses/LICENSE-2.0 (#31860) 2023-05-31 03:06:42 +00:00
README.md [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
RELEASE.md CI: add check for explicit spl-token-cli version (#34430) 2023-12-14 10:18:34 -07:00
SECURITY.md Update SECURITY.md (#35048) 2024-02-05 11:13:04 -07:00
cargo
cargo-build-bpf replace ./cargo with cargo in sbf/bpf build scripts (#29371) 2022-12-22 20:17:11 +01:00
cargo-build-sbf replace ./cargo with cargo in sbf/bpf build scripts (#29371) 2022-12-22 20:17:11 +01:00
cargo-test-bpf replace ./cargo with cargo in sbf/bpf build scripts (#29371) 2022-12-22 20:17:11 +01:00
cargo-test-sbf replace ./cargo with cargo in sbf/bpf build scripts (#29371) 2022-12-22 20:17:11 +01:00
fetch-perf-libs.sh
fetch-spl.sh spl: Bump token-2022 and friends (#33453) 2023-09-29 19:12:06 +02:00
nextest.toml ci: move solana-cargo-build-sbf to nextest (#33257) 2023-09-15 14:24:43 +00:00
run.sh [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
rust-toolchain.toml Upgrades Rust to 1.76.0 (#35148) 2024-02-09 03:19:56 +00:00
rustfmt.toml
test-abi.sh
vercel.json

README.md

Solana

Solana crate Solana documentation Build status codecov

Building

1. Install rustc, cargo and rustfmt.

$ curl https://sh.rustup.rs -sSf | sh
$ source $HOME/.cargo/env
$ rustup component add rustfmt

When building the master branch, please make sure you are using the latest stable rust version by running:

$ rustup update

When building a specific release branch, you should check the rust version in ci/rust-version.sh and if necessary, install that version by running:

$ rustup install VERSION

Note that if this is not the latest rust version on your machine, cargo commands may require an override in order to use the correct version.

On Linux systems you may need to install libssl-dev, pkg-config, zlib1g-dev, protobuf etc.

On Ubuntu:

$ sudo apt-get update
$ sudo apt-get install libssl-dev libudev-dev pkg-config zlib1g-dev llvm clang cmake make libprotobuf-dev protobuf-compiler

On Fedora:

$ sudo dnf install openssl-devel systemd-devel pkg-config zlib-devel llvm clang cmake make protobuf-devel protobuf-compiler perl-core

2. Download the source code.

$ git clone https://github.com/solana-labs/solana.git
$ cd solana

3. Build.

$ ./cargo build

Testing

Run the test suite:

$ ./cargo test

Starting a local testnet

Start your own testnet locally, instructions are in the online docs.

Accessing the remote development cluster

  • devnet - stable public cluster for development accessible via devnet.solana.com. Runs 24/7. Learn more about the public clusters

Benchmarking

First, install the nightly build of rustc. cargo bench requires the use of the unstable features only available in the nightly build.

$ rustup install nightly

Run the benchmarks:

$ cargo +nightly bench

Release Process

The release process for this project is described here.

Code coverage

To generate code coverage statistics:

$ scripts/coverage.sh
$ open target/cov/lcov-local/index.html

Why coverage? While most see coverage as a code quality metric, we see it primarily as a developer productivity metric. When a developer makes a change to the codebase, presumably it's a solution to some problem. Our unit-test suite is how we encode the set of problems the codebase solves. Running the test suite should indicate that your change didn't infringe on anyone else's solutions. Adding a test protects your solution from future changes. Say you don't understand why a line of code exists, try deleting it and running the unit-tests. The nearest test failure should tell you what problem was solved by that code. If no test fails, go ahead and submit a Pull Request that asks, "what problem is solved by this code?" On the other hand, if a test does fail and you can think of a better way to solve the same problem, a Pull Request with your solution would most certainly be welcome! Likewise, if rewriting a test can better communicate what code it's protecting, please send us that patch!

Disclaimer

All claims, content, designs, algorithms, estimates, roadmaps, specifications, and performance measurements described in this project are done with the Solana Labs, Inc. (“SL”) good faith efforts. It is up to the reader to check and validate their accuracy and truthfulness. Furthermore, nothing in this project constitutes a solicitation for investment.

Any content produced by SL or developer resources that SL provides are for educational and inspirational purposes only. SL does not encourage, induce or sanction the deployment, integration or use of any such applications (including the code comprising the Solana blockchain protocol) in violation of applicable laws or regulations and hereby prohibits any such deployment, integration or use. This includes the use of any such applications by the reader (a) in violation of export control or sanctions laws of the United States or any other applicable jurisdiction, (b) if the reader is located in or ordinarily resident in a country or territory subject to comprehensive sanctions administered by the U.S. Office of Foreign Assets Control (OFAC), or (c) if the reader is or is working on behalf of a Specially Designated National (SDN) or a person subject to similar blocking or denied party prohibitions.

The reader should be aware that U.S. export control and sanctions laws prohibit U.S. persons (and other persons that are subject to such laws) from transacting with persons in certain countries and territories or that are on the SDN list. Accordingly, there is a risk to individuals that other persons using any of the code contained in this repo, or a derivation thereof, may be sanctioned persons and that transactions with such persons would be a violation of U.S. export controls and sanctions law.