blockworks-foundation
/
solana
mirror of https://github.com/blockworks-foundation/solana.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
6,033 Commits 168 Branches 497 Tags 539 MiB
Commit Graph

674 Commits

Author SHA1 Message Date
Tyera Eulberg d7ed3b8024 Add RPC api to return program accounts (#4876) 
automerge
 2019-06-29 09:59:07 -07:00
sakridge a89589a1d5
Add Measure abstraction over measuring time intervals (#4851) 
Allows one to swap in different implementations. This provides
the normal Insant::now() -> .elapsed() path.
 2019-06-29 15:34:49 +02:00
carllin 75b494d4a3 Lower warn to info, fetch from validator root instead of root + 1 (#4870) 
* Lower warn to info, fetch from validator root instead of root + 1

* b/c -> because
 2019-06-28 16:17:20 -07:00
dependabot-preview[bot] f0191a98ab Bump serde from 1.0.93 to 1.0.94 (#4864) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.93 to 1.0.94.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.93...v1.0.94)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-28 15:07:16 -07:00
sakridge 0fa1af5d47
Cleanup num_threads() and batch_limit numbers (#4852) 2019-06-28 10:55:24 +02:00
Tyera Eulberg 66552d7047
Credit-Only Accounts: Cache account balance for thread-safe load/store (#4691) 
* Implement CreditOnlyLocks

* Update credit-only atomic on account load

* Update credit-only atomic after bank.freeze_lock; store credits if all credit-only lock references are dropped

* Commit credit-only credits on bank freeze

* Update core to CreditAccountLocks

* Impl credit-only in System Transfer

* Rework CreditAccountLocks, test, and fix bugs

* Review comments: Pass CreditAccountLocks by reference; Tighten up insert block

* Only store credits on completed slot

* Check balance in bench_exchange funding to ensure commit_credits has completed

* Add is_debitable info to KeyedAccount meta to pass into programs

* Reinstate CreditOnlyLocks check on lock_account

* Rework CreditAccountLocks to remove strong_count usage

* Add multi-threaded credit-only locks test

* Improve RwLocks usage

* Review comments: panic if bad things happen; tighter code

* Assert lock_accounts race does not happen

* Revert panic if bad things happen; not a bad thing
 2019-06-27 17:25:10 -04:00
dependabot-preview[bot] 979df17328 Bump serde_derive from 1.0.93 to 1.0.94 (#4856) 
Bumps [serde_derive](https://github.com/serde-rs/serde) from 1.0.93 to 1.0.94.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.93...v1.0.94)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-27 13:18:19 -07:00
carllin 6cec61dcfc
Re-enable tests (#4848) 2019-06-27 12:09:14 -07:00
sakridge a9b044f0ab
Fix banking_stage benchmark sends (#4850) 
Only one big batch was being sent so only 1
thread active at a time in the benchmark.
 2019-06-27 10:37:33 +02:00
sakridge fbea9d8621
Page-pin packet memory for cuda (#4250) 
* Page-pin packet memory for cuda

Bring back recyclers and pin offset buffers

* Add packet recycler to streamer

* Add set_pinnable to sigverify vecs to pin them

* Add packets reset test

* Add test for recycler and reduce the gc lock critical section
* Add comments/tests to cuda_runtime

* Add recycler to recv_blobs path.

* Add trace/names for debug and PacketsRecycler to bench-streamer

* Predict realloc and unpin beforehand.

* Add helper to reserve and pin

* Cap buffered packets length

* Call cuda wrapper functions
 2019-06-27 09:32:32 +02:00
carllin 97c97db97e
Fix early exit clearing all buffered packets (#4810) 2019-06-26 22:39:50 -07:00
carllin 9a52b01171
Change to crossbeam channel in banking_threads VerifiedReceiver (#4822) 
* Add crossbeam channel instead of channel in banking_stage
 2019-06-26 18:42:27 -07:00
Sagar Dhawan df1c473341
Add storage point tracking and tie in storage rewards to economics (#4824) 
* Add storage point tracking and tie in storage rewards to epochs and economics

* Prevent validators from updating their validations for a segment

* Fix test

* Retain syscall scoping for readability

* Update Credits to own epoch tracking
 2019-06-26 10:40:03 -07:00
Rob Walker 8a64e1ddc3
add fee burning (#4818) 2019-06-26 10:13:21 -07:00
dependabot-preview[bot] eb47538a82 Bump chrono from 0.4.6 to 0.4.7 (#4812) 
Bumps [chrono](https://github.com/chronotope/chrono) from 0.4.6 to 0.4.7.
- [Release notes](https://github.com/chronotope/chrono/releases)
- [Changelog](https://github.com/chronotope/chrono/blob/master/CHANGELOG.md)
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.6...v0.4.7)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-26 07:58:41 -06:00
Justin Starry 861d6468ca Stake weighted pruning for the gossip network (#4769) 
* Stake weighted pruning

* Fix compile error

* Fix clippy errors

* Add helper for creating a connected staked network

* Bug fixes and test groundwork

* Small refactor

* Anatoly's feedback and tests

* Doc updates

* @rob-solana's feedback

* Fix test bug and add log trace

* @rob-solana's feedback
 2019-06-26 00:30:16 -07:00
carllin d6737b8cc9
Set epoch schedule in set_root in leader schedule cache (#4821) 2019-06-26 00:19:48 -07:00
Trent Nelson f20ba423ca
Merklize PoH TX mixin hash (#4644) 2019-06-25 14:44:27 -06:00
Sathish 9e7f618cff Set proper count value for account stores (#4797) 
* set count values for store accounts

* Use AppendVecId type
 2019-06-25 07:21:45 -07:00
Sagar Dhawan 74a06e4230
Update thinclient to resend the same tx until its blockhash expires (#4807) 2019-06-24 16:46:34 -07:00
Pankaj Garg 3f8ff23125
Forward transactions to the leader for next Nth slot (#4806) 
* review comments
 2019-06-24 15:56:50 -07:00
anatoly yakovenko 29611fb61d
tower consensus naming (#4598) 
s/locktower/tower/g
 2019-06-24 13:41:23 -07:00
Michael Vines 206e62271b Ignore flaky test_two_unbalanced_stakes (#4794) 
automerge
 2019-06-23 20:55:43 -07:00
dependabot-preview[bot] 4e78354ab6 Bump serde_derive from 1.0.92 to 1.0.93 (#4790) 
Bumps [serde_derive](https://github.com/serde-rs/serde) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.92...v1.0.93)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-23 20:23:41 -07:00
dependabot-preview[bot] 0e1480b84e Bump serde from 1.0.92 to 1.0.93 (#4791) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.92...v1.0.93)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-23 17:23:41 -07:00
Sagar Dhawan 11992946a4
Add storage reward pools (#4779) 2019-06-22 17:18:35 -07:00
Dan Albert 9911942dbd Increment cargo.toml files to v0.17.0 2019-06-22 04:35:25 +00:00
Trent Nelson 8acbb4ab2f Bank cap rpc (#4774) 
* core/rpc: Name magic number for minted lamports in tests genesis block

* core/rpc: Expose bank::capitalization() via getSolTotalSupply RPC method

* book: Add entry for getTotalSupply RPC method
 2019-06-21 21:00:26 -07:00
Rob Walker a49f5378e2
rewrite vote credits redemption to eat from rewards_pools on an epoch-sensitive basis (#4775) 
* move redemption to rewards pools

* rewrite redemption, touch a few other things

* re-establish test coverage
 2019-06-21 20:43:24 -07:00
Michael Vines f39e74f0d7 serde the full FeeCalculator (#4778) 
automerge
 2019-06-21 17:23:26 -07:00
Sagar Dhawan 22b767308a
Add insturctions to run a replicator on testnet (#4733) 2019-06-21 16:32:23 -07:00
Michael Vines 36aa876833 Avoid linking with CUDA directly 2019-06-21 15:26:22 -07:00
carllin 06ba0b7279
Remove holding cluster_info lock while forwarding packets (#4773) 2019-06-21 15:21:49 -07:00
Sagar Dhawan da925142d1 Update replicator ports and silence socket timeout on windows (#4770) 
automerge
 2019-06-21 11:28:52 -07:00
dependabot-preview[bot] deb83cdef6 Bump rayon from 1.0.3 to 1.1.0 (#4729) 
automerge
 2019-06-21 09:32:41 -07:00
dependabot-preview[bot] 20db335aed Bump reqwest from 0.9.17 to 0.9.18 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.9.17 to 0.9.18.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.17...v0.9.18)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-21 08:50:49 -07:00
Michael Vines 36c9e22e3d Revert "Dynamic erasure (#4653)" 
This reverts commit ada4d16c4c.
 2019-06-20 20:53:03 -07:00
Mark E. Sinclair ada4d16c4c
Dynamic erasure (#4653) 
Remove erasure-related constants

Remove unneeded `Iterator::collect` call

Document erasure module

Randomize coding blobs used for repair
 2019-06-20 20:27:41 -05:00
carllin aacb38864c
Mark dead forks in replay stage (#4715) 
* Add DeadSlots column family

* Filter dead forks from get_slots_since

* Mark erroring slots as dead in replay stage, add test

* Mark dead forks in progress instead of removing them

* Fix logging process_entries failures in replay_stage

* Unignore test_fail_entry_verification_leader
 2019-06-20 15:50:41 -07:00
Michael Vines 4a32bc48d2 ignore unstable test_repairman_catchup 2019-06-20 09:24:11 -07:00
Pankaj Garg 9800e09431
Thread pool for par_iter in EntrySlice::verify (#4732) 
* Use thread pool for entry verify par iter

* some performance metrics

* check batch size and use CPU for smaller batches
 2019-06-19 16:31:32 -07:00
carllin 61483c18ca
Change seed for retransmit to use blob signature (#4727) 
* Switch seed for retransmit to use blob signature

* Use seed_len

* Use last bytes of signature as seed instead of first bytes
 2019-06-19 15:36:06 -07:00
Rob Walker 41fbdc6e08
use stake (#4721) 2019-06-19 11:54:52 -07:00
carllin 46bb79df29
Support for custom BroadcastStage in local cluster tests (#4716) 
* Refactor BroadcastStage to support custom implementations, add FailEntryVerificationBroadcastRun implementation

* Plumb switch on broadcast type through validator

* Add test for validator generating non-verifiable entries to local_cluster

* Fix bad initializers

* Refactor broadcast run code into utils
 2019-06-19 00:13:19 -07:00
dependabot-preview[bot] 2da7c7fbd3 Bump nix from 0.14.0 to 0.14.1 (#4642) 
automerge
 2019-06-18 11:36:26 -07:00
Michael Vines 5683282c94 Update to solana-perf-libs v0.14.0, with support for both CUDA 10.0 and 10.1 2019-06-18 10:41:03 -07:00
Sathish Ambley 8b41a5d725 periodically save config in separate folders 2019-06-17 22:48:27 -07:00
Sathish Ambley 7fd879b417 Restart validator nodes from snapshots 2019-06-17 22:48:27 -07:00
Sathish Ambley dc5c6e7cf8 validator restart 2019-06-17 22:48:27 -07:00
Michael Vines feeaad619a Avoid panic if no rpc peers exist 2019-06-17 19:47:45 -07:00
sakridge 9cafd1f85e
Change check_txs to ignore recv errors and re-enable test (#4593) 
Use more chunks to avoid duplicate signature failures:
Duplicate signatures can occur because bank.clear_signatures()
can occur before the bank has actually committed the signatures
to the status cache and then error out on the next set of transactions.
 2019-06-17 19:04:21 -07:00
Sagar Dhawan cc48773b03 Add "download from replicator" utility (#4709) 
automerge
 2019-06-17 18:12:13 -07:00
Sagar Dhawan 8fbf0e2d9f
Update replicators to use the storage blockhash to generate offsets (#4712) 2019-06-17 16:39:26 -07:00
Michael Vines 5bf87de136 Add obvious log message indicating CUDA feature state 2019-06-17 11:01:55 -07:00
Michael Vines 97a136ea20 Set rustc-cfg=cuda explicitly, also code cleanup 2019-06-17 11:01:55 -07:00
Rob Walker 4c6a6d63bf
add MiningPools, fund validator MiningPools from inflation (#4676) 
* add MiningPool fund validator MinigPools from inflation

* fixup

* finish rename of MINIMUM_SLOT_LENGTH to MINIMUM_SLOTS_PER_EPOCH

* deterministic miningpool location

* point_value, not credit_value... use f64
 2019-06-14 11:38:37 -07:00
Sagar Dhawan 119467df59
Add storage mining pool to genesis and implement automatic reward redeeming (#4683) 
* Add storage mining pool to genesis and implement automatic reward collection

* Address review comments
 2019-06-13 22:30:51 -07:00
Sagar Dhawan b1ac8f933b
Fix storage program space issues and limit storage transaction data (#4677) 2019-06-13 17:53:54 -07:00
Michael Vines 8628f33d0b Fix HostId field in the testnet dashboard 2019-06-13 16:09:09 -07:00
carllin 8c1b9a0b67
Data plane verification (#4639) 
* Add signature to blob

* Change Signable trait to support returning references to signable data

* Add signing to broadcast

* Verify signatures in window_service

* Add testing for signatures to erasure

* Add RPC for getting current slot, consume RPC call in test_repairman_catchup for more deterministic results
 2019-06-12 16:43:05 -07:00
Michael Vines d807217be7
Simplify and camelCase getEpochVoteAccounts RPC API (#4658) 
* Simplify and camelCase getEpochVoteAccounts RPC API

* Set a commission for testing
 2019-06-12 14:12:08 -07:00
Sagar Dhawan 8019bff391 Fixes for storage program and rework storage stage (#4654) 
automerge
 2019-06-11 18:27:47 -07:00
Rob Walker 697228a484
rpc vote_accounts by ecurrent pocch, not stakers epoch (#4651) 2019-06-11 16:57:47 -07:00
Rob Walker 3217a1d70c
use highest staked node as bootstrap leader, remove bootstrap_leader from genesis_block (#4635) 
* use highest staked node as bootstrap leader, remove bootstrap_leader from genesis_block

* clippy

* fixup

* fixup
 2019-06-11 11:44:58 -07:00
dependabot-preview[bot] 1d957b6b80 Bump byteorder from 1.3.1 to 1.3.2 (#4641) 
Bumps [byteorder](https://github.com/BurntSushi/byteorder) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/BurntSushi/byteorder/releases)
- [Changelog](https://github.com/BurntSushi/byteorder/blob/master/CHANGELOG.md)
- [Commits](https://github.com/BurntSushi/byteorder/compare/1.3.1...1.3.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2019-06-11 11:21:26 -07:00
Rob Walker e56430c9fb
make runtime depend on bpf_loader (#4601) 
* make runtime depend on bpf_loader

* remove vote redundancy, move bpf_loader to genesis, export program\! from bpf_loader crate

* move bpf_loader specification into genesis

* bpf tests to use genesis with bpf

* need to avoid depending on programs, except for macros
 2019-06-11 10:27:22 -07:00
Michael Vines e4d8ea11ac
Make lamports_per_signature dynamic based on cluster load (#4562) 
* Make lamports_per_signature dynamic based on cluster load

* Move transaction-fees.md to implemented
 2019-06-10 22:18:32 -07:00
carllin a4035a3c65
Remove record locks and parent locks from accounts (#4633) 
* Revert "Fix parent record locks usage in child banks (#4159)"

This reverts commit 69eeb7cf08.

* Revert "Fix DuplicateSignatures caused by races on frozen banks (#3819)"

This reverts commit 083090817a.

* Remove unused imports
 2019-06-10 22:05:46 -07:00
dependabot-preview[bot] 64d63966c7 Bump jsonrpc crates to 12.0.0 (#4553) 
* Bump jsonrpc-pubsub from 11.0.0 to 12.0.0

Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc) from 11.0.0 to 12.0.0.
- [Release notes](https://github.com/paritytech/jsonrpc/releases)
- [Commits](https://github.com/paritytech/jsonrpc/commits/v12.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Update all jsonrpc crates
 2019-06-10 13:22:57 -06:00
Rob Walker a18c0e34f4
add activate_stake to stake_api (#4600) 2019-06-10 12:17:29 -07:00
Michael Vines 0dbe5ee559
Add chacha-sys crate (#4620) 
* af9ff9c7f9/src/cpu-crypt

* Add chacha-sys crate

* Remove chacha feature

* Remove erasure feature

* Add .gitignore
 2019-06-10 07:14:02 -07:00
TristanDebrunner 0c4cb76acf
Add GPU based PoH verification (#4524) 
* Add GPU poh verify

* Switch to single PoH verify function

* Add EntrySlice verify tests with hashes and txs

* Add poh-verify benchmarks
 2019-06-08 10:21:43 -06:00
Pankaj Garg ac6dbf8f04
Broadcast blobs even if the peers have no stake (#4597) 2019-06-07 14:12:27 -07:00
carllin c9d63204eb
Replace unneeded seqcst with relaxed on atomic operations (#4587) 2019-06-06 23:53:21 -07:00
Michael Vines cfab54511b Ignore bench_banking_stage_multi_accounts (#4590) 
automerge
 2019-06-06 21:47:07 -07:00
Pankaj Garg 194491ae96
Removed some dead code (#4563) 
* Removed some dead code

* remove dead code from Replicator
 2019-06-06 14:26:12 -07:00
anatoly yakovenko 82df267ec9
s/avalanche/turbine (#4561) 
* s/avalanche/turbine/g
 2019-06-06 12:48:40 -07:00
Michael Vines 51aacfe3ca
Use pure-rust reed-solomon-erasure for windows (#4548) 2019-06-04 21:49:27 -07:00
Michael Vines 8ec5a47027
Add EntryWriter::write() stub for windows (#4546) 2019-06-04 20:15:37 -07:00
carllin 5bd3eb4557
Up number of threads (#4541) 2019-06-04 18:01:28 -07:00
dependabot-preview[bot] e9cb4a12dc Bump serde_derive from 1.0.91 to 1.0.92 (#4505) 
automerge
 2019-06-04 15:48:23 -07:00
Sagar Dhawan de5cad9211
Add account owner to Storage Accounts (#4537) 
* Add account owner to Storage Accounts

* Fix tests
 2019-06-04 14:52:52 -07:00
dependabot-preview[bot] ce2ce76958 Bump serde from 1.0.91 to 1.0.92 (#4504) 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.91 to 1.0.92.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.91...v1.0.92)
 2019-06-04 14:32:09 -07:00
dependabot-preview[bot] d77c98530f Bump libc from 0.2.55 to 0.2.58 (#4514) 
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.55 to 0.2.58.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.55...0.2.58)
 2019-06-04 14:31:06 -07:00
Michael Vines 3635a68129 solana-install now compiles for Windows (#4531) 
automerge
 2019-06-04 08:51:20 -07:00
Pankaj Garg 70a16e91a5
Randomize avalanche broadcast peer table for each blob (#4529) 
* fix clippy warnings
 2019-06-03 20:38:05 -07:00
Sagar Dhawan a77775cb58 Move validation submissions into its own fn (#4528) 
automerge
 2019-06-03 18:27:06 -07:00
Sagar Dhawan 167e15a5ae
Update replicator sampling and proof generation (#4522) 
* Update replicator sampling and proof generation

* Clippy
 2019-06-03 17:27:28 -07:00
Rob Walker c56052ff16
remove from_account from stake_instruction (#4502) 2019-06-03 09:04:51 -07:00
Pankaj Garg 3574469052
Add random distribution for avalanche peers (#4493) 
* Add random distribution for avalanche peers

* fix clippy warnings

* bug fixes

* nits
 2019-06-01 07:55:43 -07:00
Rob Walker 028e111fbc
remove payer from vote instructions (#4475) 2019-05-31 11:45:17 -07:00
Sathish 182096dc1a
Create bank snapshots (#4244) 
* Revert "Revert "Create bank snapshots (#3671)" (#4243)"

This reverts commit 81fa69d347.

* keep saved and unsaved copies of status cache

* fix format check

* bench for status cache serialize

* misc cleanup

* remove appendvec storage on purge

* fix accounts restore

* cleanup

* Pass snapshot path as args

* Fix clippy
 2019-05-30 21:31:35 -07:00
Sagar Dhawan b8aff218e2 Shutdown all services before bailing replicator init (#4487) 
automerge
 2019-05-30 14:36:47 -07:00
carllin 045d4d5294
Unignore test test_repairman_catchup (#4484) 2019-05-30 13:21:12 -07:00
Michael Vines 39b40dfff8
Remove runtime dependency on storage (#4480) 2019-05-30 10:54:28 -07:00
carllin c82f4a1b6d
Unignore test_repairman_catchup 2019-05-29 21:59:41 -07:00
Michael Vines 7a021dff05
Beautify Cargo.tomls with |cargo tomlfmt| (#4477) 2019-05-29 18:30:49 -07:00
carllin 348c2263ba
Remove genesis blockhash (#4471) 
* Remove genesis blockhash

* Remove genesis blockhash from tests

* Fix golden
 2019-05-29 17:29:02 -07:00
Pankaj Garg b5324063f1
Use thread pools for rayon par_iter (#4473) 
* Use thread pools for rayon par_iter

* address review comments

* cleanup
 2019-05-29 17:16:36 -07:00
Sagar Dhawan 6ed071c4dd
Fix storage stage operating on empty slots (#4474) 
* Fix storage stage operating on empty slots

* Reduce fn argument count

* Fix tests
 2019-05-29 15:01:20 -07:00