Go to file
Yueh-Hsuan Chiang 6441209682
[TieredStorage] TieredStorageFile -> TieredReadonlyFile and TieredWritableFIle (#260)
#### Problem
TieredStorageFile struct currently offers new_readonly() and new_writable()
to allow both read and write work-load to share the same struct.  However,
as we need the writer to use BufWriter to improve performance as well as
enable Hasher on writes.  There is a need to refactor TieredStorageFile to
split its usage for read-only and writable.

#### Summary of Changes
Refactor TieredStorageFile to TieredReadonlyFIle and TieredWritableFile.

#### Test Plan
Existing tiered-storage tests.
2024-03-18 12:24:19 -07:00
.buildkite ci: merge docker images (#35078) 2024-02-07 15:17:33 +08:00
.github ci: remove unused Github Actions (#124) 2024-03-12 11:42:21 +08:00
account-decoder Revert "Support json parsing of epoch-rewards partition data sysvar accounts (#34914)" 2024-02-05 19:54:19 -07:00
accounts-bench SVM: Move `RentCollector` to sdk (#35122) 2024-02-07 16:38:42 -08:00
accounts-cluster-bench accounts-cluster-bench: Break early when a max-accounts limit is reached (#34922) 2024-01-25 19:46:43 +00:00
accounts-db [TieredStorage] TieredStorageFile -> TieredReadonlyFile and TieredWritableFIle (#260) 2024-03-18 12:24:19 -07:00
banking-bench Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
banks-client Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
banks-interface RPC: Add inner instructions to simulate transaction response (#34313) 2023-12-16 12:49:22 +00:00
banks-server Rename `SanitizedMessage::try_from` to `try_from_legacy_message` (#35338) 2024-02-29 08:25:22 +08:00
bench-streamer Give streamer::receiver() threads unique names (#35369) 2024-03-01 13:36:08 -06:00
bench-tps [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
bloom ConcurrentBloomInterval (#34486) 2024-01-02 08:21:36 -08:00
bucket_map Fix typos (#34459) 2023-12-21 13:06:00 -07:00
cargo-registry [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
cd
ci [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
clap-utils clap-utils: Forbid multiple values for `--signer` (#34482) 2024-01-05 21:25:50 +01:00
clap-v3-utils [clap-v3-utils] Add functions to parse directly from `SignerSource` (#34678) 2024-01-25 06:27:02 +09:00
cli relax stake split destination check (#162) 2024-03-14 11:43:34 -06:00
cli-config [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
cli-output Cli: improve vote-account vote-authority display (#95) 2024-03-06 07:23:32 +00:00
client Remove `ThinClient` from `dos/` (#117) 2024-03-11 18:19:48 -04:00
client-test Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
connection-cache don't sign X.509 certs (#34896) 2024-01-28 16:17:46 -08:00
core Remove public visibility of program cache from bank (#279) 2024-03-17 15:29:20 -07:00
cost-model add precompile signature metrics to cost tracker (#133) 2024-03-08 00:48:35 +00:00
docs [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
dos [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
download-utils Use BankForks on tests - Part 3 (#34248) 2023-12-01 13:47:22 -03:00
entry
faucet [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
frozen-abi Removes redundant imports (#193) 2024-03-12 14:25:59 +08:00
genesis genesis: Skip inserting genesis accounts for Development clusters (#35266) 2024-02-22 14:42:35 -06:00
genesis-utils
geyser-plugin-interface [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
geyser-plugin-manager Use tokio directly instead of jsonrpc_server_utils's re-export (#116) 2024-03-06 14:49:32 -06:00
gossip Fix gossip contact trace (#241) 2024-03-14 19:43:59 +01:00
install [solana-install-init] Optimize error message for Windows user permission installation (#234) 2024-03-18 17:58:28 +01:00
keygen Show error instead of panic on passphrase mismatch during solana-keygen (#35072) 2024-02-06 15:32:06 -05:00
ledger Remove public visibility of program cache from bank (#279) 2024-03-17 15:29:20 -07:00
ledger-tool Remove public visibility of program cache from bank (#279) 2024-03-17 15:29:20 -07:00
local-cluster fix typo (#264) 2024-03-15 16:20:30 -05:00
log-analyzer
logger [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
measure
memory-management Moves a clippy attribute (#194) 2024-03-12 07:46:23 -04:00
merkle-root-bench
merkle-tree
metrics Remove ability to submit metrics with no fields (#35133) 2024-02-16 11:10:15 -08:00
multinode-demo Use agave prefix in scripts for pre-installed binaries (#155) 2024-03-08 17:02:21 +00:00
net [anza migration]: fix download link for net scripts (#219) 2024-03-13 12:17:08 +08:00
net-shaper
net-utils Name previously unnamed thread pool threads (#104) 2024-03-06 17:03:02 -06:00
notifier [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
perf frozen-abi: Remove proc_macro_hygiene featurization (#109) 2024-03-06 15:32:05 +01:00
poh Fix typos (#34459) 2023-12-21 13:06:00 -07:00
poh-bench
program-runtime Loaded program test robustness (#59) 2024-03-13 08:21:54 -07:00
program-test [SVM] Move RuntimeConfig to program-runtime (#96) 2024-03-07 10:16:16 -08:00
programs vote: deprecate unused legacy vote tx plumbing (#274) 2024-03-15 22:21:52 -07:00
pubsub-client [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
quic-client Rename and uniquify QUIC thread names (#28) 2024-03-05 12:09:17 -06:00
rayon-threadlimit
rbpf-cli [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
remote-wallet [clap-v3-utils] Deprecate signer source validation (#33802) 2024-01-06 08:19:54 +09:00
rpc rpc: disable BigTable with header (#226) 2024-03-13 17:46:48 -06:00
rpc-client [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
rpc-client-api Rpc: add support for minimum context slot to `getBlocks(WithLimit)` endpoints (#191) 2024-03-11 23:59:18 -06:00
rpc-client-nonce-utils
rpc-test clippy: Replaces .get(0) with .first() (#34048) 2023-11-13 17:22:17 -05:00
runtime Remove public visibility of program cache from bank (#279) 2024-03-17 15:29:20 -07:00
runtime-transaction add requested limits to static meta (#34361) 2023-12-15 18:39:19 -06:00
scripts [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
sdk vote: deprecate unused legacy vote tx plumbing (#274) 2024-03-15 22:21:52 -07:00
send-transaction-service Remove ability to submit metrics with no fields (#35133) 2024-02-16 11:10:15 -08:00
stake-accounts explicitly sets fee rate to zero for stake-accounts tests (#34848) 2024-01-19 09:17:31 -06:00
storage-bigtable Bigtable: update google proto files and allow configuration of max_message_size (#34740) 2024-01-10 21:20:15 -07:00
storage-proto ledger-tool: read bigtable entries (#34266) 2023-11-30 21:33:04 +00:00
streamer Make the quic server connection table use an async lock, reducing thrashing (#293) 2024-03-18 12:05:00 -07:00
svm SVM: Eliminate filter_executable_program_accounts from pub interface (#214) 2024-03-13 09:15:24 -07:00
system-test [anza migration] rename crates (#10) 2024-03-03 12:31:24 +08:00
test-validator [SVM] Move RuntimeConfig to program-runtime (#96) 2024-03-07 10:16:16 -08:00
thin-client Deprecate `ThinClient` and remove `ThinClient` from `bench-tps` (#35365) 2024-03-01 12:14:52 -08:00
tokens SDK: refactor `Signer` and `Signers` traits (#34984) 2024-03-01 12:34:32 +01:00
tpu-client
transaction-dos [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
transaction-status Add `Message::is_maybe_writable` (#35340) 2024-02-29 10:27:33 +08:00
turbine adds api to obtain the parent node in the turbine retransmit tree (#115) 2024-03-07 17:56:40 +00:00
udp-client Quic update identity (#33865) 2023-12-08 14:53:19 +08:00
unified-scheduler-logic Introduce primitive threading in unified scheduler (#34676) 2024-01-24 12:46:16 +09:00
unified-scheduler-pool Remove public visibility of program cache from bank (#279) 2024-03-17 15:29:20 -07:00
upload-perf
validator [anza migration] fix: use the correct log filter for non-unix (#245) 2024-03-15 11:27:16 +08:00
version [anza migration] Sets client id to Agave (#163) 2024-03-12 07:46:41 -04:00
vote gossip: notify state machine of duplicate proofs (#32963) 2024-01-26 07:58:37 -08:00
watchtower [anza migration]: add 'agave=info' to default log level (#223) 2024-03-14 20:35:33 +08:00
web3.js
wen-restart Wen_restart: check block full using blockstore (#250) 2024-03-14 20:45:03 -07:00
zk-keygen [clap-v3-utils] Deprecate signer source validation (#33802) 2024-01-06 08:19:54 +09:00
zk-token-sdk [zk-token-sdk] Implement `FromStr` for `ElGamalPubkey`, `ElGamalCiphertext`, and `AeCiphertext` (#130) 2024-03-15 09:09:41 +09:00
.clippy.toml
.codecov.yml
.gitignore git: ignore all `target/` directories (#34705) 2024-01-09 12:30:11 +01:00
.mergify.yml [anza migration] ci: fix path (#8) 2024-03-03 12:31:24 +08:00
CHANGELOG.md update changelog and remove deprecated label on `gossip_service::get_client()` (#227) 2024-03-13 13:26:54 -07:00
CONTRIBUTING.md [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
Cargo.lock remove raptor coding experiments (#255) 2024-03-14 22:01:15 -06:00
Cargo.toml build(deps): bump hidapi from 2.6.0 to 2.6.1 (#237) 2024-03-15 01:42:32 +08:00
LICENSE
README.md [anza migration] ci (#5) 2024-03-03 12:31:24 +08:00
RELEASE.md CI: add check for explicit spl-token-cli version (#34430) 2023-12-14 10:18:34 -07:00
SECURITY.md Update SECURITY.md (#35048) 2024-02-05 11:13:04 -07:00
cargo
cargo-build-bpf
cargo-build-sbf
cargo-test-bpf
cargo-test-sbf
fetch-perf-libs.sh
fetch-spl.sh
nextest.toml
run.sh [docs] updated readme and fix links (#34565) 2024-01-03 09:06:06 -05:00
rust-toolchain.toml Upgrades Rust to 1.76.0 (#35148) 2024-02-09 03:19:56 +00:00
rustfmt.toml
test-abi.sh
vercel.json

README.md

Solana

Solana crate Solana documentation Build status codecov

Building

1. Install rustc, cargo and rustfmt.

$ curl https://sh.rustup.rs -sSf | sh
$ source $HOME/.cargo/env
$ rustup component add rustfmt

When building the master branch, please make sure you are using the latest stable rust version by running:

$ rustup update

When building a specific release branch, you should check the rust version in ci/rust-version.sh and if necessary, install that version by running:

$ rustup install VERSION

Note that if this is not the latest rust version on your machine, cargo commands may require an override in order to use the correct version.

On Linux systems you may need to install libssl-dev, pkg-config, zlib1g-dev, protobuf etc.

On Ubuntu:

$ sudo apt-get update
$ sudo apt-get install libssl-dev libudev-dev pkg-config zlib1g-dev llvm clang cmake make libprotobuf-dev protobuf-compiler

On Fedora:

$ sudo dnf install openssl-devel systemd-devel pkg-config zlib-devel llvm clang cmake make protobuf-devel protobuf-compiler perl-core

2. Download the source code.

$ git clone https://github.com/solana-labs/solana.git
$ cd solana

3. Build.

$ ./cargo build

Testing

Run the test suite:

$ ./cargo test

Starting a local testnet

Start your own testnet locally, instructions are in the online docs.

Accessing the remote development cluster

  • devnet - stable public cluster for development accessible via devnet.solana.com. Runs 24/7. Learn more about the public clusters

Benchmarking

First, install the nightly build of rustc. cargo bench requires the use of the unstable features only available in the nightly build.

$ rustup install nightly

Run the benchmarks:

$ cargo +nightly bench

Release Process

The release process for this project is described here.

Code coverage

To generate code coverage statistics:

$ scripts/coverage.sh
$ open target/cov/lcov-local/index.html

Why coverage? While most see coverage as a code quality metric, we see it primarily as a developer productivity metric. When a developer makes a change to the codebase, presumably it's a solution to some problem. Our unit-test suite is how we encode the set of problems the codebase solves. Running the test suite should indicate that your change didn't infringe on anyone else's solutions. Adding a test protects your solution from future changes. Say you don't understand why a line of code exists, try deleting it and running the unit-tests. The nearest test failure should tell you what problem was solved by that code. If no test fails, go ahead and submit a Pull Request that asks, "what problem is solved by this code?" On the other hand, if a test does fail and you can think of a better way to solve the same problem, a Pull Request with your solution would most certainly be welcome! Likewise, if rewriting a test can better communicate what code it's protecting, please send us that patch!