project-serum
/
solana
mirror of https://github.com/project-serum/solana.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
6,122 Commits 46 Branches 233 Tags 108 MiB
Commit Graph

689 Commits

Author SHA1 Message Date
Rob Walker 417e8d5064
fix blocktree_processor test_process_entries_stress (#4967) 2019-07-08 18:11:58 -07:00
Trent Nelson 1feb9bea21
Harden Merkle Tree against second pre-image attacks (#4925) 
* merkle-tree: Harden against second pre-image attacks

* core/chacha: Bump test golden hash
 2019-07-08 19:00:06 -06:00
Trent Nelson c5ba2e0883 bank_forks test stability (#4959) 
automerge
 2019-07-08 15:55:49 -07:00
Rob Walker eb4edd75e6
make bank commit_credits non public (#4944) 
* make bank commit_credits non pub

* track down create() failure

* move bank_client to process_transaction(), which commits credits
 2019-07-08 15:37:54 -07:00
Sagar Dhawan bb6bcd79c0
Handle replicator errors without panicking (#4955) 
* Handle replicator errors without panicking

* Unwelcome println
 2019-07-08 12:43:35 -07:00
Sagar Dhawan ef7022d638
Refactor replicators to not block on startup (#4932) 
* Refactor replicators to not block on startup

* Ignore setup failure
 2019-07-08 10:17:25 -07:00
carllin 2aac094f63
Ensure blobs are deserializable without unwrapping (#4948) 
* Return result from deserializing blobs in blocktree instead of assuming deserialization will succeed

* Mark bad deserialization as dead fork

* Add test for corrupted blobs in blocktree and replay_stage
 2019-07-07 14:37:12 -07:00
carllin fc180f4cbf
Halve stake of malicious validator (#4937) 2019-07-05 15:45:39 -07:00
dependabot-preview[bot] db13b52e6a Bump serde_json from 1.0.39 to 1.0.40 (#4881) 
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.39 to 1.0.40.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.39...v1.0.40)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-07-03 16:15:56 -06:00
Rob Walker 2ec5d2c7f5
start local_cluster nodes from genesis blocks (#4928) 2019-07-03 14:03:52 -07:00
Sagar Dhawan 55b8ff72d0
Enable parallel tests to reduce test time (#4919) 
* Add crate to serialize some tests

* Ignore unused attribute warning

* Enable parallel run in CI

* Try to fix lograte tests

* Fix interdependent counter tests
 2019-07-02 17:35:03 -07:00
Rob Walker 12ef0c25b5 change vote commission to u8 (from u32) (#4887) 
automerge
 2019-07-02 14:18:11 -07:00
Pankaj Garg 3615445a12
Broadcast run for injecting fake blobs in turbine (#4889) 
* Broadcast run for injecting fake blobs in turbine

* address review comments

* new local cluster test that uses fake blob broadcast

* added a test to make sure tvu_peers ordering is guaranteed
 2019-07-01 17:54:03 -07:00
Sagar Dhawan 65adce65fa
Always send pull responses to the origin addr (#4894) 2019-07-01 16:49:05 -07:00
carllin c1953dca8f
Cleanup some of banking stage (#4878) 
* Add committable transactions that cause errors like InstructionErrors back to retryable list on MaxHeightReached

* Remove unnecessary logic

* Add comments/renaming for clarity
 2019-07-01 12:14:40 -07:00
Tyera Eulberg d7ed3b8024 Add RPC api to return program accounts (#4876) 
automerge
 2019-06-29 09:59:07 -07:00
sakridge a89589a1d5
Add Measure abstraction over measuring time intervals (#4851) 
Allows one to swap in different implementations. This provides
the normal Insant::now() -> .elapsed() path.
 2019-06-29 15:34:49 +02:00
carllin 75b494d4a3 Lower warn to info, fetch from validator root instead of root + 1 (#4870) 
* Lower warn to info, fetch from validator root instead of root + 1

* b/c -> because
 2019-06-28 16:17:20 -07:00
dependabot-preview[bot] f0191a98ab Bump serde from 1.0.93 to 1.0.94 (#4864) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.93 to 1.0.94.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.93...v1.0.94)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-28 15:07:16 -07:00
sakridge 0fa1af5d47
Cleanup num_threads() and batch_limit numbers (#4852) 2019-06-28 10:55:24 +02:00
Tyera Eulberg 66552d7047
Credit-Only Accounts: Cache account balance for thread-safe load/store (#4691) 
* Implement CreditOnlyLocks

* Update credit-only atomic on account load

* Update credit-only atomic after bank.freeze_lock; store credits if all credit-only lock references are dropped

* Commit credit-only credits on bank freeze

* Update core to CreditAccountLocks

* Impl credit-only in System Transfer

* Rework CreditAccountLocks, test, and fix bugs

* Review comments: Pass CreditAccountLocks by reference; Tighten up insert block

* Only store credits on completed slot

* Check balance in bench_exchange funding to ensure commit_credits has completed

* Add is_debitable info to KeyedAccount meta to pass into programs

* Reinstate CreditOnlyLocks check on lock_account

* Rework CreditAccountLocks to remove strong_count usage

* Add multi-threaded credit-only locks test

* Improve RwLocks usage

* Review comments: panic if bad things happen; tighter code

* Assert lock_accounts race does not happen

* Revert panic if bad things happen; not a bad thing
 2019-06-27 17:25:10 -04:00
dependabot-preview[bot] 979df17328 Bump serde_derive from 1.0.93 to 1.0.94 (#4856) 
Bumps [serde_derive](https://github.com/serde-rs/serde) from 1.0.93 to 1.0.94.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.93...v1.0.94)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-27 13:18:19 -07:00
carllin 6cec61dcfc
Re-enable tests (#4848) 2019-06-27 12:09:14 -07:00
sakridge a9b044f0ab
Fix banking_stage benchmark sends (#4850) 
Only one big batch was being sent so only 1
thread active at a time in the benchmark.
 2019-06-27 10:37:33 +02:00
sakridge fbea9d8621
Page-pin packet memory for cuda (#4250) 
* Page-pin packet memory for cuda

Bring back recyclers and pin offset buffers

* Add packet recycler to streamer

* Add set_pinnable to sigverify vecs to pin them

* Add packets reset test

* Add test for recycler and reduce the gc lock critical section
* Add comments/tests to cuda_runtime

* Add recycler to recv_blobs path.

* Add trace/names for debug and PacketsRecycler to bench-streamer

* Predict realloc and unpin beforehand.

* Add helper to reserve and pin

* Cap buffered packets length

* Call cuda wrapper functions
 2019-06-27 09:32:32 +02:00
carllin 97c97db97e
Fix early exit clearing all buffered packets (#4810) 2019-06-26 22:39:50 -07:00
carllin 9a52b01171
Change to crossbeam channel in banking_threads VerifiedReceiver (#4822) 
* Add crossbeam channel instead of channel in banking_stage
 2019-06-26 18:42:27 -07:00
Sagar Dhawan df1c473341
Add storage point tracking and tie in storage rewards to economics (#4824) 
* Add storage point tracking and tie in storage rewards to epochs and economics

* Prevent validators from updating their validations for a segment

* Fix test

* Retain syscall scoping for readability

* Update Credits to own epoch tracking
 2019-06-26 10:40:03 -07:00
Rob Walker 8a64e1ddc3
add fee burning (#4818) 2019-06-26 10:13:21 -07:00
dependabot-preview[bot] eb47538a82 Bump chrono from 0.4.6 to 0.4.7 (#4812) 
Bumps [chrono](https://github.com/chronotope/chrono) from 0.4.6 to 0.4.7.
- [Release notes](https://github.com/chronotope/chrono/releases)
- [Changelog](https://github.com/chronotope/chrono/blob/master/CHANGELOG.md)
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.6...v0.4.7)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-26 07:58:41 -06:00
Justin Starry 861d6468ca Stake weighted pruning for the gossip network (#4769) 
* Stake weighted pruning

* Fix compile error

* Fix clippy errors

* Add helper for creating a connected staked network

* Bug fixes and test groundwork

* Small refactor

* Anatoly's feedback and tests

* Doc updates

* @rob-solana's feedback

* Fix test bug and add log trace

* @rob-solana's feedback
 2019-06-26 00:30:16 -07:00
carllin d6737b8cc9
Set epoch schedule in set_root in leader schedule cache (#4821) 2019-06-26 00:19:48 -07:00
Trent Nelson f20ba423ca
Merklize PoH TX mixin hash (#4644) 2019-06-25 14:44:27 -06:00
Sathish 9e7f618cff Set proper count value for account stores (#4797) 
* set count values for store accounts

* Use AppendVecId type
 2019-06-25 07:21:45 -07:00
Sagar Dhawan 74a06e4230
Update thinclient to resend the same tx until its blockhash expires (#4807) 2019-06-24 16:46:34 -07:00
Pankaj Garg 3f8ff23125
Forward transactions to the leader for next Nth slot (#4806) 
* review comments
 2019-06-24 15:56:50 -07:00
anatoly yakovenko 29611fb61d
tower consensus naming (#4598) 
s/locktower/tower/g
 2019-06-24 13:41:23 -07:00
Michael Vines 206e62271b Ignore flaky test_two_unbalanced_stakes (#4794) 
automerge
 2019-06-23 20:55:43 -07:00
dependabot-preview[bot] 4e78354ab6 Bump serde_derive from 1.0.92 to 1.0.93 (#4790) 
Bumps [serde_derive](https://github.com/serde-rs/serde) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.92...v1.0.93)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-23 20:23:41 -07:00
dependabot-preview[bot] 0e1480b84e Bump serde from 1.0.92 to 1.0.93 (#4791) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.92...v1.0.93)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-23 17:23:41 -07:00
Sagar Dhawan 11992946a4
Add storage reward pools (#4779) 2019-06-22 17:18:35 -07:00
Dan Albert 9911942dbd Increment cargo.toml files to v0.17.0 2019-06-22 04:35:25 +00:00
Trent Nelson 8acbb4ab2f Bank cap rpc (#4774) 
* core/rpc: Name magic number for minted lamports in tests genesis block

* core/rpc: Expose bank::capitalization() via getSolTotalSupply RPC method

* book: Add entry for getTotalSupply RPC method
 2019-06-21 21:00:26 -07:00
Rob Walker a49f5378e2
rewrite vote credits redemption to eat from rewards_pools on an epoch-sensitive basis (#4775) 
* move redemption to rewards pools

* rewrite redemption, touch a few other things

* re-establish test coverage
 2019-06-21 20:43:24 -07:00
Michael Vines f39e74f0d7 serde the full FeeCalculator (#4778) 
automerge
 2019-06-21 17:23:26 -07:00
Sagar Dhawan 22b767308a
Add insturctions to run a replicator on testnet (#4733) 2019-06-21 16:32:23 -07:00
Michael Vines 36aa876833 Avoid linking with CUDA directly 2019-06-21 15:26:22 -07:00
carllin 06ba0b7279
Remove holding cluster_info lock while forwarding packets (#4773) 2019-06-21 15:21:49 -07:00
Sagar Dhawan da925142d1 Update replicator ports and silence socket timeout on windows (#4770) 
automerge
 2019-06-21 11:28:52 -07:00
dependabot-preview[bot] deb83cdef6 Bump rayon from 1.0.3 to 1.1.0 (#4729) 
automerge
 2019-06-21 09:32:41 -07:00
dependabot-preview[bot] 20db335aed Bump reqwest from 0.9.17 to 0.9.18 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.9.17 to 0.9.18.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.17...v0.9.18)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-21 08:50:49 -07:00
Michael Vines 36c9e22e3d Revert "Dynamic erasure (#4653)" 
This reverts commit ada4d16c4c.
 2019-06-20 20:53:03 -07:00
Mark E. Sinclair ada4d16c4c
Dynamic erasure (#4653) 
Remove erasure-related constants

Remove unneeded `Iterator::collect` call

Document erasure module

Randomize coding blobs used for repair
 2019-06-20 20:27:41 -05:00
carllin aacb38864c
Mark dead forks in replay stage (#4715) 
* Add DeadSlots column family

* Filter dead forks from get_slots_since

* Mark erroring slots as dead in replay stage, add test

* Mark dead forks in progress instead of removing them

* Fix logging process_entries failures in replay_stage

* Unignore test_fail_entry_verification_leader
 2019-06-20 15:50:41 -07:00
Michael Vines 4a32bc48d2 ignore unstable test_repairman_catchup 2019-06-20 09:24:11 -07:00
Pankaj Garg 9800e09431
Thread pool for par_iter in EntrySlice::verify (#4732) 
* Use thread pool for entry verify par iter

* some performance metrics

* check batch size and use CPU for smaller batches
 2019-06-19 16:31:32 -07:00
carllin 61483c18ca
Change seed for retransmit to use blob signature (#4727) 
* Switch seed for retransmit to use blob signature

* Use seed_len

* Use last bytes of signature as seed instead of first bytes
 2019-06-19 15:36:06 -07:00
Rob Walker 41fbdc6e08
use stake (#4721) 2019-06-19 11:54:52 -07:00
carllin 46bb79df29
Support for custom BroadcastStage in local cluster tests (#4716) 
* Refactor BroadcastStage to support custom implementations, add FailEntryVerificationBroadcastRun implementation

* Plumb switch on broadcast type through validator

* Add test for validator generating non-verifiable entries to local_cluster

* Fix bad initializers

* Refactor broadcast run code into utils
 2019-06-19 00:13:19 -07:00
dependabot-preview[bot] 2da7c7fbd3 Bump nix from 0.14.0 to 0.14.1 (#4642) 
automerge
 2019-06-18 11:36:26 -07:00
Michael Vines 5683282c94 Update to solana-perf-libs v0.14.0, with support for both CUDA 10.0 and 10.1 2019-06-18 10:41:03 -07:00
Sathish Ambley 8b41a5d725 periodically save config in separate folders 2019-06-17 22:48:27 -07:00
Sathish Ambley 7fd879b417 Restart validator nodes from snapshots 2019-06-17 22:48:27 -07:00
Sathish Ambley dc5c6e7cf8 validator restart 2019-06-17 22:48:27 -07:00
Michael Vines feeaad619a Avoid panic if no rpc peers exist 2019-06-17 19:47:45 -07:00
sakridge 9cafd1f85e
Change check_txs to ignore recv errors and re-enable test (#4593) 
Use more chunks to avoid duplicate signature failures:
Duplicate signatures can occur because bank.clear_signatures()
can occur before the bank has actually committed the signatures
to the status cache and then error out on the next set of transactions.
 2019-06-17 19:04:21 -07:00
Sagar Dhawan cc48773b03 Add "download from replicator" utility (#4709) 
automerge
 2019-06-17 18:12:13 -07:00
Sagar Dhawan 8fbf0e2d9f
Update replicators to use the storage blockhash to generate offsets (#4712) 2019-06-17 16:39:26 -07:00
Michael Vines 5bf87de136 Add obvious log message indicating CUDA feature state 2019-06-17 11:01:55 -07:00
Michael Vines 97a136ea20 Set rustc-cfg=cuda explicitly, also code cleanup 2019-06-17 11:01:55 -07:00
Rob Walker 4c6a6d63bf
add MiningPools, fund validator MiningPools from inflation (#4676) 
* add MiningPool fund validator MinigPools from inflation

* fixup

* finish rename of MINIMUM_SLOT_LENGTH to MINIMUM_SLOTS_PER_EPOCH

* deterministic miningpool location

* point_value, not credit_value... use f64
 2019-06-14 11:38:37 -07:00
Sagar Dhawan 119467df59
Add storage mining pool to genesis and implement automatic reward redeeming (#4683) 
* Add storage mining pool to genesis and implement automatic reward collection

* Address review comments
 2019-06-13 22:30:51 -07:00
Sagar Dhawan b1ac8f933b
Fix storage program space issues and limit storage transaction data (#4677) 2019-06-13 17:53:54 -07:00
Michael Vines 8628f33d0b Fix HostId field in the testnet dashboard 2019-06-13 16:09:09 -07:00
carllin 8c1b9a0b67
Data plane verification (#4639) 
* Add signature to blob

* Change Signable trait to support returning references to signable data

* Add signing to broadcast

* Verify signatures in window_service

* Add testing for signatures to erasure

* Add RPC for getting current slot, consume RPC call in test_repairman_catchup for more deterministic results
 2019-06-12 16:43:05 -07:00
Michael Vines d807217be7
Simplify and camelCase getEpochVoteAccounts RPC API (#4658) 
* Simplify and camelCase getEpochVoteAccounts RPC API

* Set a commission for testing
 2019-06-12 14:12:08 -07:00
Sagar Dhawan 8019bff391 Fixes for storage program and rework storage stage (#4654) 
automerge
 2019-06-11 18:27:47 -07:00
Rob Walker 697228a484
rpc vote_accounts by ecurrent pocch, not stakers epoch (#4651) 2019-06-11 16:57:47 -07:00
Rob Walker 3217a1d70c
use highest staked node as bootstrap leader, remove bootstrap_leader from genesis_block (#4635) 
* use highest staked node as bootstrap leader, remove bootstrap_leader from genesis_block

* clippy

* fixup

* fixup
 2019-06-11 11:44:58 -07:00
dependabot-preview[bot] 1d957b6b80 Bump byteorder from 1.3.1 to 1.3.2 (#4641) 
Bumps [byteorder](https://github.com/BurntSushi/byteorder) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/BurntSushi/byteorder/releases)
- [Changelog](https://github.com/BurntSushi/byteorder/blob/master/CHANGELOG.md)
- [Commits](https://github.com/BurntSushi/byteorder/compare/1.3.1...1.3.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-11 11:21:26 -07:00
Rob Walker e56430c9fb
make runtime depend on bpf_loader (#4601) 
* make runtime depend on bpf_loader

* remove vote redundancy, move bpf_loader to genesis, export program\! from bpf_loader crate

* move bpf_loader specification into genesis

* bpf tests to use genesis with bpf

* need to avoid depending on programs, except for macros
 2019-06-11 10:27:22 -07:00
Michael Vines e4d8ea11ac
Make lamports_per_signature dynamic based on cluster load (#4562) 
* Make lamports_per_signature dynamic based on cluster load

* Move transaction-fees.md to implemented
 2019-06-10 22:18:32 -07:00
carllin a4035a3c65
Remove record locks and parent locks from accounts (#4633) 
* Revert "Fix parent record locks usage in child banks (#4159)"

This reverts commit 69eeb7cf08.

* Revert "Fix DuplicateSignatures caused by races on frozen banks (#3819)"

This reverts commit 083090817a.

* Remove unused imports
 2019-06-10 22:05:46 -07:00
dependabot-preview[bot] 64d63966c7 Bump jsonrpc crates to 12.0.0 (#4553) 
* Bump jsonrpc-pubsub from 11.0.0 to 12.0.0

Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc) from 11.0.0 to 12.0.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/commits/v12.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Update all jsonrpc crates
 2019-06-10 13:22:57 -06:00
Rob Walker a18c0e34f4
add activate_stake to stake_api (#4600) 2019-06-10 12:17:29 -07:00
Michael Vines 0dbe5ee559
Add chacha-sys crate (#4620) 
* af9ff9c7f9/src/cpu-crypt

* Add chacha-sys crate

* Remove chacha feature

* Remove erasure feature

* Add .gitignore
 2019-06-10 07:14:02 -07:00
TristanDebrunner 0c4cb76acf
Add GPU based PoH verification (#4524) 
* Add GPU poh verify

* Switch to single PoH verify function

* Add EntrySlice verify tests with hashes and txs

* Add poh-verify benchmarks
 2019-06-08 10:21:43 -06:00
Pankaj Garg ac6dbf8f04
Broadcast blobs even if the peers have no stake (#4597) 2019-06-07 14:12:27 -07:00
carllin c9d63204eb
Replace unneeded seqcst with relaxed on atomic operations (#4587) 2019-06-06 23:53:21 -07:00
Michael Vines cfab54511b Ignore bench_banking_stage_multi_accounts (#4590) 
automerge
 2019-06-06 21:47:07 -07:00
Pankaj Garg 194491ae96
Removed some dead code (#4563) 
* Removed some dead code

* remove dead code from Replicator
 2019-06-06 14:26:12 -07:00
anatoly yakovenko 82df267ec9
s/avalanche/turbine (#4561) 
* s/avalanche/turbine/g
 2019-06-06 12:48:40 -07:00
Michael Vines 51aacfe3ca
Use pure-rust reed-solomon-erasure for windows (#4548) 2019-06-04 21:49:27 -07:00
Michael Vines 8ec5a47027
Add EntryWriter::write() stub for windows (#4546) 2019-06-04 20:15:37 -07:00
carllin 5bd3eb4557
Up number of threads (#4541) 2019-06-04 18:01:28 -07:00
dependabot-preview[bot] e9cb4a12dc Bump serde_derive from 1.0.91 to 1.0.92 (#4505) 
automerge
 2019-06-04 15:48:23 -07:00
Sagar Dhawan de5cad9211
Add account owner to Storage Accounts (#4537) 
* Add account owner to Storage Accounts

* Fix tests
 2019-06-04 14:52:52 -07:00
dependabot-preview[bot] ce2ce76958 Bump serde from 1.0.91 to 1.0.92 (#4504) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.91 to 1.0.92.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.91...v1.0.92)
 2019-06-04 14:32:09 -07:00
dependabot-preview[bot] d77c98530f Bump libc from 0.2.55 to 0.2.58 (#4514) 
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.55 to 0.2.58.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.55...0.2.58)
 2019-06-04 14:31:06 -07:00
Michael Vines 3635a68129 solana-install now compiles for Windows (#4531) 
automerge
 2019-06-04 08:51:20 -07:00