Go to file
Yueh-Hsuan Chiang 62d2a4cd88
Make ShredStorageType::RocksLevel public (#23272)
#### Summary of Changes
This PR adds two hidden arguments to the validator that allow users to use RocksDB's FIFO compaction for storing shreds.

        --shred-storage <SHRED_STORAGE>
            EXPERIMENTAL: Controls how RocksDB compacts shreds.  *WARNING*: You will lose your ledger data
            when you switch between options. Possible values are: 'level': stores shreds using RocksDB's default (level)
            compaction. 'fifo': stores shreds under RocksDB's FIFO compaction. This option is more efficient on
            disk-write-bytes of the ledger store. [default: level]  [possible values: level, fifo]

        --shred-storage-size <SHRED_STORAGE_SIZE_BYTES>
            The shred storage size in bytes. The suggested value is 50% of your ledger storage size in bytes. [default:
            268435456000]
2022-03-03 12:43:58 -08:00
.buildkite
.github added PAT token 2022-03-03 16:24:09 +05:30
.travis
account-decoder chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
accounts-bench
accounts-cluster-bench
accountsdb-plugin-interface
accountsdb-plugin-manager chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
banking-bench
banks-client
banks-interface
banks-server
bench-streamer
bench-tps chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
bloom
book/src/proposals
bucket_map
ci
clap-utils
cli chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
cli-config
cli-output chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
client chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
client-test chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
core Make ShredStorageType::RocksLevel public (#23272) 2022-03-03 12:43:58 -08:00
docs
dos
download-utils
entry
explorer testing latest changes on explorer (#23470) 2022-03-03 16:48:18 +05:30
faucet
frozen-abi
genesis chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
genesis-utils
gossip chore: bump lru from 0.7.2 to 0.7.3 (#23462) 2022-03-03 12:01:49 -07:00
install
keygen
ledger Make ShredStorageType::RocksLevel public (#23272) 2022-03-03 12:43:58 -08:00
ledger-tool chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
local-cluster Make ShredStorageType::RocksLevel public (#23272) 2022-03-03 12:43:58 -08:00
log-analyzer chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
logger
measure
merkle-root-bench
merkle-tree
metrics
multinode-demo
net
net-shaper chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
net-utils
notifier
perf
poh
poh-bench
program-runtime Rename `AccountsDataMeter::consume` (#23037) 2022-03-03 12:23:06 -06:00
program-test
programs chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
rayon-threadlimit
rbpf-cli chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
remote-wallet
replica-lib
replica-node
rpc chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
rpc-test chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
runtime new counter data point for unexpected rent_epoch (#23449) 2022-03-03 09:09:31 -06:00
scripts
sdk chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
send-transaction-service
stake-accounts
storage-bigtable
storage-proto
streamer
sys-tuner
system-test
test-validator chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
tokens
transaction-dos
transaction-status chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
upload-perf chore: bump serde_json from 1.0.78 to 1.0.79 (#23461) 2022-03-02 23:38:06 -07:00
validator Make ShredStorageType::RocksLevel public (#23272) 2022-03-03 12:43:58 -08:00
version
watchtower
web3.js
zk-token-sdk zk-token-sdk: change variable names to use suffix rather than prefix (#23474) 2022-03-03 15:07:27 -05:00
.clippy.toml
.codecov.yml
.gitignore
.mergify.yml
.travis.yml
CONTRIBUTING.md
Cargo.lock chore: bump lru from 0.7.2 to 0.7.3 (#23462) 2022-03-03 12:01:49 -07:00
Cargo.toml
LICENSE
README.md
RELEASE.md
SECURITY.md
cargo
cargo-build-bpf
cargo-test-bpf
fetch-perf-libs.sh
fetch-spl.sh
run.sh
rustfmt.toml
test-abi.sh
vercel.json

README.md

Solana

Solana crate Solana documentation Build status codecov

Building

1. Install rustc, cargo and rustfmt.

$ curl https://sh.rustup.rs -sSf | sh
$ source $HOME/.cargo/env
$ rustup component add rustfmt

When building the master branch, please make sure you are using the latest stable rust version by running:

$ rustup update

When building a specific release branch, you should check the rust version in ci/rust-version.sh and if necessary, install that version by running:

$ rustup install VERSION

Note that if this is not the latest rust version on your machine, cargo commands may require an override in order to use the correct version.

On Linux systems you may need to install libssl-dev, pkg-config, zlib1g-dev, etc. On Ubuntu:

$ sudo apt-get update
$ sudo apt-get install libssl-dev libudev-dev pkg-config zlib1g-dev llvm clang make

2. Download the source code.

$ git clone https://github.com/solana-labs/solana.git
$ cd solana

3. Build.

$ cargo build

Testing

Run the test suite:

$ cargo test

Starting a local testnet

Start your own testnet locally, instructions are in the online docs.

Accessing the remote development cluster

  • devnet - stable public cluster for development accessible via devnet.solana.com. Runs 24/7. Learn more about the public clusters

Benchmarking

First, install the nightly build of rustc. cargo bench requires the use of the unstable features only available in the nightly build.

$ rustup install nightly

Run the benchmarks:

$ cargo +nightly bench

Release Process

The release process for this project is described here.

Code coverage

To generate code coverage statistics:

$ scripts/coverage.sh
$ open target/cov/lcov-local/index.html

Why coverage? While most see coverage as a code quality metric, we see it primarily as a developer productivity metric. When a developer makes a change to the codebase, presumably it's a solution to some problem. Our unit-test suite is how we encode the set of problems the codebase solves. Running the test suite should indicate that your change didn't infringe on anyone else's solutions. Adding a test protects your solution from future changes. Say you don't understand why a line of code exists, try deleting it and running the unit-tests. The nearest test failure should tell you what problem was solved by that code. If no test fails, go ahead and submit a Pull Request that asks, "what problem is solved by this code?" On the other hand, if a test does fail and you can think of a better way to solve the same problem, a Pull Request with your solution would most certainly be welcome! Likewise, if rewriting a test can better communicate what code it's protecting, please send us that patch!

Disclaimer

All claims, content, designs, algorithms, estimates, roadmaps, specifications, and performance measurements described in this project are done with the Solana Foundation's ("SF") good faith efforts. It is up to the reader to check and validate their accuracy and truthfulness. Furthermore, nothing in this project constitutes a solicitation for investment.

Any content produced by SF or developer resources that SF provides are for educational and inspirational purposes only. SF does not encourage, induce or sanction the deployment, integration or use of any such applications (including the code comprising the Solana blockchain protocol) in violation of applicable laws or regulations and hereby prohibits any such deployment, integration or use. This includes the use of any such applications by the reader (a) in violation of export control or sanctions laws of the United States or any other applicable jurisdiction, (b) if the reader is located in or ordinarily resident in a country or territory subject to comprehensive sanctions administered by the U.S. Office of Foreign Assets Control (OFAC), or (c) if the reader is or is working on behalf of a Specially Designated National (SDN) or a person subject to similar blocking or denied party prohibitions.

The reader should be aware that U.S. export control and sanctions laws prohibit U.S. persons (and other persons that are subject to such laws) from transacting with persons in certain countries and territories or that are on the SDN list. As a project-based primarily on open-source software, it is possible that such sanctioned persons may nevertheless bypass prohibitions, obtain the code comprising the Solana blockchain protocol (or other project code or applications) and deploy, integrate, or otherwise use it. Accordingly, there is a risk to individuals that other persons using the Solana blockchain protocol may be sanctioned persons and that transactions with such persons would be a violation of U.S. export controls and sanctions law. This risk applies to individuals, organizations, and other ecosystem participants that deploy, integrate, or use the Solana blockchain protocol code directly (e.g., as a node operator), and individuals that transact on the Solana blockchain through light clients, third party interfaces, and/or wallet software.