Go to file
Wen 6f72258e3e
Vote refresh fix when outside slothash (#29948)
* When there are too many pubkeys in one slot, kick the one with lowest
stake out.

* Cache last_root to reduce read locks we need.

* Use slots_in_epoch to limit number of slots in the map.

* Fix lint errors.

* Only cache stake and slots per epoch once per epoch.

* Revert "Only cache stake and slots per epoch once per epoch."

This reverts commit 8658aad0083456794b4c4403adaf9c74d1a71d09.

* Vote at the tip of current fork if last vote is outside SlotHash
of the tip and last vote expired.

* Add unittest when last vote is outside slothash, we should vote at the tip
of the current fork.

* Revert "Use slots_in_epoch to limit number of slots in the map."

This reverts commit 93574f57a48d2a70fbbc0f62fa8810d3b6bee0af.

* Revert "Cache last_root to reduce read locks we need."

This reverts commit bb114ec2b62cb9c0207328b19c415f6116be0f1c.

* Revert "When there are too many pubkeys in one slot, kick the one with lowest"

This reverts commit 711e29a6a025fd4f11fbc97dcbbe90e4832be04c.

* Move new vote generation when last vote is outside slothash into the
main path, this actually makes more sense since we don't select where
to vote in two different places, and all the vote generation logic
is seamlessly inherited.

* - Move vote refresh to be behind select vote and do not refresh vote if a new
  vote is selected.
- Check whether last vote is inside slothash inside select_vote_and_reset_forks
- rename slot_within_slothash to is_in_slothashes_history
- remove one unittest for now, more tests will be added in a separate CL

* Remove new test, it will be in another file.

* Add is_in_slot_hashes_history test in the new file.

* Add unittest for the case when last vote is outside slot hashes.

* Small improvements and more unittests.

* Fix bad merge.

* Update docs/src/terminology.md

Co-authored-by: mvines <mvines@gmail.com>

* Put SwitchForkDecision::FailedSwitchThreshold logic into separate function.

* Make linter happy.

---------

Co-authored-by: mvines <mvines@gmail.com>
2023-06-26 18:21:24 -07:00
.buildkite ci: discard misleading `cargo uninstall` errors in bk post-checkout hook (#32139) 2023-06-14 16:01:48 -06:00
.github Patch ntapi to restore windows build (#31961) 2023-06-05 16:51:43 +09:00
account-decoder Simd 47 syscall sysvar last restart slot (#31957) 2023-06-16 20:14:02 +00:00
accounts-bench pass include_slot_in_hash through hash calcs to allow rehashing if hash is not stored (#31579) 2023-05-11 13:23:29 -07:00
accounts-cluster-bench Clean up Spl type conversions (#31845) 2023-05-30 14:34:38 -06:00
banking-bench separates out connection-cache metrics for different protocols (#31803) 2023-05-25 14:48:22 +00:00
banks-client ci: update cargo.toml (#31934) 2023-06-02 15:08:07 +00:00
banks-interface banks-client: Add `get_fee_for_message` (#31703) 2023-05-18 23:31:02 +02:00
banks-server Cleanup - require_static_program_ids_in_transaction (#31767) 2023-06-07 17:12:41 +02:00
bench-streamer uses Duration type instead of untyped ..._ms: u64 (#30971) 2023-03-31 15:42:49 +00:00
bench-tps Funding transactions must specify data limit (#32131) 2023-06-15 18:53:04 +00:00
bloom chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
bucket_map remove compiler warning (#32081) 2023-06-12 13:48:17 -07:00
cd Create continuous delivery directory and add readme with canary details. (#27683) 2022-09-13 14:33:49 -05:00
ci Add rust-version field to solana-program to prevent the accidental use of unsupported platform-tools versions (#32232) 2023-06-23 21:48:56 -07:00
clap-utils Cli: add `find-program-derived-address` command (#30370) 2023-04-17 16:17:40 +09:00
clap-v3-utils [clap-v3-utils, sdk, zk-token-sdk] Split `EncodableKey` into `EncodableKey` + `SeedDerivable` (#31668) 2023-05-17 17:42:35 +09:00
cli Enable partitioned epoch reward by feature id (#32174) 2023-06-20 12:12:50 -05:00
cli-config chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
cli-output Add skip rate to docs and adjust block-production to use the term ski… (#32230) 2023-06-21 16:38:46 -07:00
client removes redundant NewConnectionConfig trait (#31979) 2023-06-06 21:28:29 +00:00
client-test Pass Arc<AtomicBool> by value, not by reference. (#31916) 2023-06-01 17:25:48 -07:00
connection-cache removes redundant NewConnectionConfig trait (#31979) 2023-06-06 21:28:29 +00:00
core Vote refresh fix when outside slothash (#29948) 2023-06-26 18:21:24 -07:00
docs Add skip rate to docs and adjust block-production to use the term ski… (#32230) 2023-06-21 16:38:46 -07:00
dos removes outdated tvu_forward socket (#32101) 2023-06-20 20:50:16 +00:00
download-utils Enforce a minimum of 1 on full and incremental snapshot retention (#30968) 2023-03-30 10:16:36 -05:00
entry Cleanup - require_static_program_ids_in_transaction (#31767) 2023-06-07 17:12:41 +02:00
faucet ci: treewide: deny used_underscore_binding (#31319) 2023-04-27 10:10:16 +09:00
frozen-abi Bump block-buffer from 0.9.0 to 0.10.4 (#31606) 2023-05-18 11:47:27 -07:00
genesis Bumps base64 from 0.13.1 to 0.21.0. (#31522) 2023-05-11 11:34:58 -07:00
genesis-utils Reconfigure genesis hash download and check (#30949) 2023-04-10 11:46:56 -07:00
geyser-plugin-interface Update discord invite links (#30909) 2023-03-29 09:14:22 -07:00
geyser-plugin-manager GeyserPluginService: Use common `exit` flag. (#31915) 2023-06-01 11:20:59 -07:00
gossip removes outdated tvu_forward socket (#32101) 2023-06-20 20:50:16 +00:00
install Cargo.toml: winapi: List used features (#31417) 2023-04-29 01:23:15 -07:00
keygen [keygen] Use workspace version for `tempfile` (#31722) 2023-05-19 10:50:00 +09:00
ledger Don't look up snapshot archives twice in load_bank_forks() (#32279) 2023-06-26 16:31:56 -04:00
ledger-tool Replace boot_from_local_state with use_snapshot_archives_at_startup (#32260) 2023-06-26 12:44:25 -04:00
local-cluster Add constant for disabled snapshot interval (#32236) 2023-06-26 12:26:56 -05:00
log-analyzer chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
logger chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
measure ci: deflake `Measurement` tests (#31812) 2023-05-25 12:46:46 -06:00
memory-management chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
merkle-root-bench chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
merkle-tree chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
metrics chore: remove unused code (#32195) 2023-06-20 10:48:44 +08:00
multinode-demo bench-tps: rename tx_count arg to tx-count for consistency (#31213) 2023-04-17 10:59:39 -07:00
net Adjust mmap and FD count for net scripts (#31728) 2023-05-19 18:13:11 +00:00
net-shaper chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
net-utils adds quic receiver to shred-fetch-stage (#31576) 2023-06-12 13:16:27 +00:00
notifier chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
perf check simple vote could have 1 or 2 signatures when creating sanitized transaction (#31807) 2023-05-25 15:45:15 -05:00
poh Fix panic in record() (#31978) 2023-06-07 18:40:46 -04:00
poh-bench chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
program-runtime Move message_processor to program-runtime (#32268) 2023-06-24 15:55:39 -07:00
program-test Restrict access to Bank's HardForks (#32180) 2023-06-20 23:44:43 -05:00
programs Introduces fs_err to snapshot_utils (#32266) 2023-06-26 13:14:27 -04:00
pubsub-client improve pubsub error handling (#31669) 2023-05-19 16:46:09 +00:00
quic-client adds code-path broadcasting shreds using QUIC (#31610) 2023-06-12 22:58:27 +00:00
rayon-threadlimit chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
rbpf-cli rbpf-cli: fix deprecation notice (#31743) 2023-05-22 04:47:05 -05:00
remote-wallet chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
rpc Cleanup - require_static_program_ids_in_transaction (#31767) 2023-06-07 17:12:41 +02:00
rpc-client Bumps base64 from 0.13.1 to 0.21.0. (#31522) 2023-05-11 11:34:58 -07:00
rpc-client-api adds tpu_quic field to RpcContactInfo (#31310) 2023-04-22 20:18:58 +00:00
rpc-client-nonce-utils chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
rpc-test separates out connection-cache metrics for different protocols (#31803) 2023-05-25 14:48:22 +00:00
runtime Vote refresh fix when outside slothash (#29948) 2023-06-26 18:21:24 -07:00
scripts Bump patched ntapi from v0.3.6 to v0.3.7 (#31981) 2023-06-06 13:33:57 +09:00
sdk Add rust-version field to solana-program to prevent the accidental use of unsupported platform-tools versions (#32232) 2023-06-23 21:48:56 -07:00
send-transaction-service Fixing send-transaction-service using quic, tpu address is wrong (#31899) 2023-06-02 09:25:23 -07:00
stake-accounts chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
storage-bigtable bigtable: Adjust logging and condense counters (#31661) 2023-05-15 21:48:00 -05:00
storage-proto add ProgramExecutionTemporarilyRestricted error (#31796) 2023-06-06 14:13:41 -07:00
streamer Remove a unnecessary sleep in run server (#32216) 2023-06-22 15:18:05 -07:00
system-test Update queried metric to determine tps in system tests (#31531) 2023-05-08 10:37:23 -05:00
test-validator specifies protocol in contact-info get-socket api (#31602) 2023-05-12 16:16:20 +00:00
thin-client removes redundant NewConnectionConfig trait (#31979) 2023-06-06 21:28:29 +00:00
tokens Clean up Spl type conversions (#31845) 2023-05-30 14:34:38 -06:00
tpu-client removes redundant NewConnectionConfig trait (#31979) 2023-06-06 21:28:29 +00:00
transaction-dos makes sockets in LegacyContactInfo private (#31248) 2023-04-21 15:39:16 +00:00
transaction-status Cleanup - require_static_program_ids_in_transaction (#31767) 2023-06-07 17:12:41 +02:00
turbine moves turbine to a separate crate out of solana/core (#32226) 2023-06-22 16:22:11 +00:00
udp-client removes redundant NewConnectionConfig trait (#31979) 2023-06-06 21:28:29 +00:00
upload-perf chore: workspace inheritance (#29893) 2023-02-23 22:01:54 +08:00
validator Add constant for disabled snapshot interval (#32236) 2023-06-26 12:26:56 -05:00
version ci: test-checks.sh all sbf code & use nightly only (#30602) 2023-03-13 14:28:34 +09:00
watchtower Add --active-stake-alert-threshold to watchtower (#31858) 2023-05-29 23:33:11 +00:00
web3.js Add link to new web3.js repo (#30096) 2023-02-27 10:23:54 -06:00
zk-keygen [zk-token-sdk] Make `ElGamalKeypair` fields private (#32190) 2023-06-22 10:28:13 +09:00
zk-token-sdk [zk-token-proof] Fix doc typo (#32270) 2023-06-24 15:24:22 -07:00
.clippy.toml Fix all remaining clippy warnings 2018-07-12 09:40:40 -06:00
.codecov.yml Add .codecov.yml with checks disabled (#30666) 2023-03-10 20:11:22 +09:00
.gitignore Ingest duplicate proofs sent through Gossip (#29227) 2023-01-19 13:00:56 -08:00
.mergify.yml Add Mergify rules for v1.16 backport (#31875) 2023-05-30 15:07:05 -05:00
.travis.yml chore: remove Explorer build scripts from the Monorepo (#30262) 2023-02-10 17:25:32 -06:00
CONTRIBUTING.md contributing: Is your PR easy to say "yes" to? (#31059) 2023-04-06 08:43:22 -04:00
Cargo.lock Introduces fs_err to snapshot_utils (#32266) 2023-06-26 13:14:27 -04:00
Cargo.toml Introduces fs_err to snapshot_utils (#32266) 2023-06-26 13:14:27 -04:00
LICENSE Correct LICENSE to conform with https://apache.org/licenses/LICENSE-2.0 (#31860) 2023-05-31 03:06:42 +00:00
README.md update disclaimer 2023-01-30 17:40:53 -05:00
RELEASE.md RELEASE.md cleanup (#28007) 2022-09-24 20:30:25 -06:00
SECURITY.md SECURITY.md: Require exploit PoC for submission consideration (#31113) 2023-04-11 19:32:48 -06:00
cargo Speed up net.sh builds (#16360) 2021-04-07 14:45:03 +08:00
cargo-build-bpf replace ./cargo with cargo in sbf/bpf build scripts (#29371) 2022-12-22 20:17:11 +01:00
cargo-build-sbf replace ./cargo with cargo in sbf/bpf build scripts (#29371) 2022-12-22 20:17:11 +01:00
cargo-test-bpf replace ./cargo with cargo in sbf/bpf build scripts (#29371) 2022-12-22 20:17:11 +01:00
cargo-test-sbf replace ./cargo with cargo in sbf/bpf build scripts (#29371) 2022-12-22 20:17:11 +01:00
fetch-perf-libs.sh Take v0.19.3 of perf libs which improves sigverify perf 2x (#11894) 2020-08-28 12:34:25 -07:00
fetch-spl.sh Upgrade to token-2022 0.6.0 (#30353) 2023-03-10 10:32:19 +09:00
nextest.toml ci: run stable tests partially (#31151) 2023-04-21 14:51:17 +08:00
run.sh add some guidance in place of `./run.sh` 2021-09-11 14:49:17 -06:00
rust-toolchain.toml Upgrades Rust to 1.69.0 (#31336) 2023-04-25 10:22:38 -04:00
rustfmt.toml Add rustfmt.toml and `cargo fmt` (#23238) 2022-02-19 13:32:29 +08:00
test-abi.sh Update frozen_abi hashes 2020-10-24 08:37:55 -07:00
vercel.json removing the "autoJobCancelation": false 2021-10-07 20:49:58 +05:30

README.md

Solana

Solana crate Solana documentation Build status codecov

Building

1. Install rustc, cargo and rustfmt.

$ curl https://sh.rustup.rs -sSf | sh
$ source $HOME/.cargo/env
$ rustup component add rustfmt

When building the master branch, please make sure you are using the latest stable rust version by running:

$ rustup update

When building a specific release branch, you should check the rust version in ci/rust-version.sh and if necessary, install that version by running:

$ rustup install VERSION

Note that if this is not the latest rust version on your machine, cargo commands may require an override in order to use the correct version.

On Linux systems you may need to install libssl-dev, pkg-config, zlib1g-dev, protobuf etc.

On Ubuntu:

$ sudo apt-get update
$ sudo apt-get install libssl-dev libudev-dev pkg-config zlib1g-dev llvm clang cmake make libprotobuf-dev protobuf-compiler

On Fedora:

$ sudo dnf install openssl-devel systemd-devel pkg-config zlib-devel llvm clang cmake make protobuf-devel protobuf-compiler perl-core

2. Download the source code.

$ git clone https://github.com/solana-labs/solana.git
$ cd solana

3. Build.

$ ./cargo build

Testing

Run the test suite:

$ ./cargo test

Starting a local testnet

Start your own testnet locally, instructions are in the online docs.

Accessing the remote development cluster

  • devnet - stable public cluster for development accessible via devnet.solana.com. Runs 24/7. Learn more about the public clusters

Benchmarking

First, install the nightly build of rustc. cargo bench requires the use of the unstable features only available in the nightly build.

$ rustup install nightly

Run the benchmarks:

$ cargo +nightly bench

Release Process

The release process for this project is described here.

Code coverage

To generate code coverage statistics:

$ scripts/coverage.sh
$ open target/cov/lcov-local/index.html

Why coverage? While most see coverage as a code quality metric, we see it primarily as a developer productivity metric. When a developer makes a change to the codebase, presumably it's a solution to some problem. Our unit-test suite is how we encode the set of problems the codebase solves. Running the test suite should indicate that your change didn't infringe on anyone else's solutions. Adding a test protects your solution from future changes. Say you don't understand why a line of code exists, try deleting it and running the unit-tests. The nearest test failure should tell you what problem was solved by that code. If no test fails, go ahead and submit a Pull Request that asks, "what problem is solved by this code?" On the other hand, if a test does fail and you can think of a better way to solve the same problem, a Pull Request with your solution would most certainly be welcome! Likewise, if rewriting a test can better communicate what code it's protecting, please send us that patch!

Disclaimer

All claims, content, designs, algorithms, estimates, roadmaps, specifications, and performance measurements described in this project are done with the Solana Labs, Inc. (“SL”) good faith efforts. It is up to the reader to check and validate their accuracy and truthfulness. Furthermore, nothing in this project constitutes a solicitation for investment.

Any content produced by SL or developer resources that SL provides are for educational and inspirational purposes only. SL does not encourage, induce or sanction the deployment, integration or use of any such applications (including the code comprising the Solana blockchain protocol) in violation of applicable laws or regulations and hereby prohibits any such deployment, integration or use. This includes the use of any such applications by the reader (a) in violation of export control or sanctions laws of the United States or any other applicable jurisdiction, (b) if the reader is located in or ordinarily resident in a country or territory subject to comprehensive sanctions administered by the U.S. Office of Foreign Assets Control (OFAC), or (c) if the reader is or is working on behalf of a Specially Designated National (SDN) or a person subject to similar blocking or denied party prohibitions.

The reader should be aware that U.S. export control and sanctions laws prohibit U.S. persons (and other persons that are subject to such laws) from transacting with persons in certain countries and territories or that are on the SDN list. Accordingly, there is a risk to individuals that other persons using any of the code contained in this repo, or a derivation thereof, may be sanctioned persons and that transactions with such persons would be a violation of U.S. export controls and sanctions law.