Michael Vines
ea6e042a6f
Move vote_program out of src/
2018-12-05 10:49:06 -08:00
Michael Vines
a594f56c02
Add token_program.rs to sdk/
2018-12-05 10:49:06 -08:00
Michael Vines
e6fa74fe69
Remove custom Error enum, just use ProgramError
2018-12-05 10:49:06 -08:00
Michael Vines
9a4f8199d6
Move system_program out of src/
2018-12-05 10:49:06 -08:00
Michael Vines
ae0be1e857
Remove bpf_loader.rs
2018-12-05 10:49:06 -08:00
Michael Vines
d010cac8a5
Remove token_program.rs
2018-12-05 10:49:06 -08:00
Michael Vines
63a758508a
Add sdk native_loader.rs
2018-12-05 10:49:06 -08:00
Stephen Akridge
c1c2f1f0a9
Cleanup ad-hoc rpc address formation
...
Lots of places where we are forming rpc addresses.
2018-12-03 18:13:55 -08:00
Michael Vines
777a0a858e
Move ProgramError into sdk/
2018-12-03 13:50:00 -08:00
Michael Vines
68e99c18c0
Remove duplicate SYSTEM_PROGRAM_ID
2018-12-03 13:50:00 -08:00
Michael Vines
c99f93e40a
Remove signature.rs indirection
2018-12-03 13:50:00 -08:00
carllin
4ae58cc854
Change range of leader scheduler to match current broadcasts ( #1920 )
2018-12-03 00:10:43 -08:00
Sagar Dhawan
b21facab7b
Add metrics for prune messages ( #1981 )
2018-12-01 14:05:40 -08:00
Sagar Dhawan
34c3a0cc1f
Add signature verification to gossip ( #1937 )
2018-12-01 12:00:30 -08:00
Pankaj Garg
549bfe7412
Vote signing JSON RPC service ( #1965 )
...
* Vote signing JSON RPC service
- barebone service that listens for RPC requests
* Daemon for vote signer service
* Add request APIs for JSON RPC
* Cleanup of cargo dependencies
* Fix compiler error
2018-11-30 15:07:08 -08:00
Rob Walker
3ca826a480
re-enable test_tpu_forwarder ( #1964 )
2018-11-30 13:52:37 -08:00
Michael Vines
bad0b55ab6
Expose which keys signed the Transaction in the SDK
2018-11-30 08:16:23 -08:00
Michael Vines
0878bd53d9
Delete stub src/transaction.rs
2018-11-29 23:07:57 -08:00
Stephen Akridge
de910e1169
Make test_pubkey_distribution faster
...
multi-thread pubkey histogram generation.
2018-11-29 17:37:37 -08:00
Stephen Akridge
9684737de7
Add wait before checking confirm again
...
Otherwise we can quickly check that we
have no signature 4 times in a row.
2018-11-29 15:32:58 -08:00
Stephen Akridge
ecc87ab1aa
Add a an optional timeout to thin_client
...
Such that a negative test like test_transaction_count doesn't
have to wait num_retries * default_timeout.
2018-11-29 13:53:40 -08:00
Michael Vines
fa359c6fc4
Merge vote new and register transactions
2018-11-29 12:31:34 -08:00
Stephen Akridge
8cc751d1cc
Improve RPC service startup error messages with actual error
...
Error always fixed to message about ports but that's not the only
error that can occur.
2018-11-29 11:39:42 -08:00
Stephen Akridge
978fd6858f
Move replicator_startup_test to integration test set
...
Sometimes fails when run multithreaded with other tests.
2018-11-29 11:39:42 -08:00
Michael Vines
41689256c6
Ensure key[0] is signed
2018-11-29 10:26:46 -08:00
Pankaj Garg
194e3100a9
Additional checks in test_bank_checkpoint_zero_balance ( #1943 )
2018-11-28 12:40:34 -08:00
Rob Walker
8ad4464d4b
add tests for other "from" indexes signing (or not)
2018-11-28 07:56:04 -08:00
Rob Walker
e7b0a736f5
verify signature is on the from account
2018-11-28 07:56:04 -08:00
Rob Walker
167eb01735
optimize bench-tps and rpc_request to work on crappy WSL boxes
2018-11-27 22:45:08 -08:00
Michael Vines
8fb5d72b13
Make insufficient tokens message more helpful
2018-11-27 17:37:25 -08:00
Pankaj Garg
8947c5a4aa
Set account to default if the balance reaches 0 in a checkpoint bank ( #1932 )
...
Fixes : #1931
2018-11-27 14:17:29 -08:00
Greg Fitzgerald
a7562c9be1
Extract execute_transaction() from the bank
2018-11-27 12:35:52 -07:00
Greg Fitzgerald
08dc169f94
Hoist load_loaders()
...
This makes execute_transactions() stateless.
2018-11-27 12:35:52 -07:00
Greg Fitzgerald
f549d8ac74
Hoist loading of loaders
...
This might cause a TPS boost in batched BPF transactions, since
now it'll only clone its account once per transaction instead of
once per instruction.
2018-11-27 12:35:52 -07:00
Greg Fitzgerald
1ac7536286
Pass executable_accounts into with_subset()
2018-11-27 12:35:52 -07:00
Greg Fitzgerald
88e270723f
Move markdown book out of src/
2018-11-26 09:44:19 -08:00
Michael Vines
a13e25f083
Ignore flaky test_tpu_forwarder
2018-11-26 09:27:21 -08:00
Greg Fitzgerald
3d3a30e200
Fix mdbook test
2018-11-26 07:51:10 -08:00
Greg Fitzgerald
76b83ac0f4
Move testnet demos into the book
...
Have git readme focus on fullnode development and the book focus on
users.
2018-11-26 07:51:10 -08:00
Greg Fitzgerald
903a9bfd05
s/contract/program/
2018-11-26 08:20:42 -07:00
Greg Fitzgerald
655ee1a64b
Fix typos
2018-11-26 08:20:42 -07:00
Greg Fitzgerald
e0e6c3fdb2
Extract execute_instruction() to seed new runtime module
...
Fixes #1528
2018-11-26 08:20:42 -07:00
Greg Fitzgerald
31f00974f2
Hoist the lookup of executable accounts
2018-11-26 08:20:42 -07:00
Greg Fitzgerald
c3218bb9c2
Hoist tick_height
2018-11-26 08:20:42 -07:00
Greg Fitzgerald
d2972024de
Uppercase acronyms
...
Looks like there will be very little Rust code in the markdown book
so switching back to English capitalization conventions.
2018-11-25 22:58:07 -07:00
Greg Fitzgerald
dc0a2ca656
Move disclaimer down a bit
...
Odd to see a disclaimer before knowing anything about what you're reading
2018-11-25 20:27:35 -07:00
Greg Fitzgerald
c3fb9d5549
Cleanup book ( #1904 )
...
* Cleanup book
* Distinguish upstream from downstream validators
* Add BroadcastStage to Fullnode/Tpu diagrams
* First attempt to re-describe the runtime
* Reorg book
Push back details of the fullnode implementation
2018-11-25 16:58:38 -07:00
Sathish
f5b5c54d7d
Update condition for nosigverify ( #1903 )
2018-11-25 13:11:07 -08:00
Sathish
9f0b06bb86
Filter out leader node while retransmitting blobs ( #1894 )
2018-11-24 20:33:49 -08:00
carllin
57a384d6a0
Rocks db window service ( #1888 )
...
* Add db_window module for windowing functions from RocksDb
* Replace window with db_window functions in window_service
* Fix tests
* Make note of change in db_window
* Create RocksDb ledger in bin/fullnode
* Make db_ledger functions generic
* Add db_ledger to bin/replicator
2018-11-24 19:32:33 -08:00
Greg Fitzgerald
69802e141f
Add the story of how this codebase came to be
2018-11-24 14:39:53 -07:00
Greg Fitzgerald
6fc02b7424
Detect legacy programs upfront
2018-11-24 11:56:51 -07:00
Greg Fitzgerald
30cdd85028
Implement the same interface in all builtin programs
2018-11-24 11:56:51 -07:00
Greg Fitzgerald
871dd47019
Extract the part of execute_instruction that should only return a ProgramError
...
TODO: hoist load_executable_accounts() and then change
process_instruction() to return ProgramError.
2018-11-24 11:56:51 -07:00
Greg Fitzgerald
37f8dd57e2
Extract ProgramError from BankError
2018-11-24 11:56:51 -07:00
Greg Fitzgerald
f827bfd83f
Remove instruction index parameter
2018-11-24 11:56:51 -07:00
Greg Fitzgerald
b3af930153
Rename process_transaction to process_instruction
2018-11-24 11:56:51 -07:00
Greg Fitzgerald
cd488b7d07
Hoist program static methods to top-level functions
2018-11-24 11:56:51 -07:00
Rob Walker
e2373ff51a
add nosigverify command line option to ease debug
2018-11-23 16:55:04 -08:00
Greg Fitzgerald
b3d2c900cd
Rename BudgetState to BudgetProgram
2018-11-23 13:25:17 -07:00
Michael Vines
d5adec20a3
get_ip_addr: Fall back to loopback if no better option exists
2018-11-23 13:24:41 -05:00
carllin
942256a647
Add db_ledger benchmarks ( #1875 )
...
* Add db_ledger benchmarks
* ignore benches in CI, due to timeouts
2018-11-23 06:12:43 -08:00
carllin
a3321a5d80
Fix endianess in db_ledger to account for the default byte-comparator used by Rocksdb ( #1885 )
2018-11-22 01:35:19 -08:00
carllin
521de13571
Add maximum repair length to db_window ( #1886 )
...
* Add maximum repair length to db_window
2018-11-21 23:44:49 -08:00
Greg Fitzgerald
3abf6a8a30
Reorg the markdown book to cater to app devs
...
First, talk about how a client interacts with Solana to do useful
things. Then describe how the fullnode you're talking to works and
why it's so very fast. Last, why that fullnode you don't trust
does what you asked it to anyway.
2018-11-21 15:49:57 -08:00
jackcmay
59163e2dd9
Optimize some CI stuff ( #1880 )
...
* CI Optimizations
2018-11-21 12:16:16 -08:00
carllin
d9dabdfc74
Rocks db window utils ( #1851 )
...
* Implement new ledger module based on RocksDb
* Add db_window module for windowing functions from RocksDb
2018-11-19 23:20:18 -08:00
Rob Walker
6b910d1bd4
add tpu_forwarding, simplify ClusterInfo::new() from Result<Self> to Self
2018-11-19 20:45:49 -08:00
Rob Walker
bbd9ea8c00
Delete settings.rs.foo
2018-11-19 13:39:08 -08:00
Anatoly Yakovenko
fc67a968e8
Use known keys in the unit test to avoid random false positives.
2018-11-19 13:41:24 -07:00
Rob Walker
3d113611cc
remove Result<> return from ClusterInfo::new() ( #1869 )
...
strip Result<> for ClusterInfo::new()
2018-11-19 11:25:14 -08:00
Sagar Dhawan
07667771ef
Fix Gossip Pushes going to invalid addresses ( #1858 )
2018-11-17 19:57:28 -08:00
Michael Vines
3822c29415
Route program_id to program entrypoint
2018-11-17 19:42:03 -08:00
Greg Fitzgerald
ff386d6585
Add disclaimer to markdown book
...
copy-paste from readme
2018-11-17 19:56:08 -07:00
Greg Fitzgerald
88ddb31477
teminology cleanup: leader slots and voting rounds
2018-11-17 18:56:13 -07:00
Greg Fitzgerald
077d1a41f1
Add too book
2018-11-17 18:56:13 -07:00
Greg Fitzgerald
857ab8662e
backticks and missing variable descriptions
2018-11-17 18:56:13 -07:00
Greg Fitzgerald
a17f9bd0f4
Work towards adding leader rotation to the book
2018-11-17 18:56:13 -07:00
Greg Fitzgerald
f4b9e93b11
Migrate storage RFC to book
2018-11-17 18:55:08 -07:00
Greg Fitzgerald
2c11bf2e66
Various book cleanup
...
* Merge Leader and Validator diagrams
* New sdk-tools diagram
* Move terminology to just after introduction
* Purge use of LAMPORT as an acronym
* Add notes about persistent storage
2018-11-17 17:50:29 -08:00
Michael Vines
719e14b30a
Add an explicit state of a reserved signature
...
An RPC client that fetches the signature status before the bank finishes
executing the corresponding Transaction should receive SignatureNotFound
instead of Confirmed
2018-11-17 16:40:23 -08:00
Michael Vines
d1f01b5209
Fix clippy lint
2018-11-17 15:54:21 -08:00
Michael Vines
d96a6b42a5
Move drone into its own crate
2018-11-16 20:42:21 -08:00
carllin
cf95708c18
Set drone address to always be the initial network entry point ( #1847 )
...
* Set drone address to always be the initial network entry point, so that even when leaders rotate the client can still find the drone
* Extract drone address as a separate argument to bench-tps
* Add drone port to client.sh instead of setting it in bench-tps
* Add drone entrypoint to scripts
* Fix build error
2018-11-16 19:56:26 -08:00
Michael Vines
e1c7b99450
Accounts get kicked if no tokens
2018-11-16 18:53:37 -08:00
Sagar Dhawan
12ae7b9a6b
Add test for tvu POH verification ( #1844 )
2018-11-16 15:48:10 -08:00
Michael Vines
6ac5700f2e
Move metrics into its own crate
2018-11-16 15:10:07 -08:00
Michael Vines
a0dd8617be
Remove airdrop from fullnode
2018-11-16 13:25:55 -08:00
Rob Walker
1576072edb
remove spurious eprintln!()
2018-11-16 10:21:58 -08:00
carllin
03d206a7ca
Check for valid tvu, not tpu in broadcast ( #1836 )
2018-11-15 23:30:22 -08:00
Sathish
c973de1d76
Decouple log and metrics rate ( #1839 )
...
Use separate env for log and metrics rate.
Set default log level to WARN if unset.
2018-11-15 22:27:16 -08:00
Stephen Akridge
71336965a6
Limit targets to 4 in bench-tps
...
Transaction got bigger so can only fit 4 targets in a
Transaction now.
2018-11-15 20:25:07 -08:00
Michael Vines
e791d0f74d
Drone now returns signed airdrop transactions
2018-11-15 17:13:13 -08:00
Stephen Akridge
3543a9a49f
Add check for missing signature with fee'ed transaction
...
And update fetch-perf-libs version
2018-11-15 16:23:13 -08:00
Stephen Akridge
7dd198a99e
Change signed_key to index into account_keys
...
If index is within the signed keys range.
2018-11-15 16:23:13 -08:00
Stephen Akridge
e048116ab2
Remove signed_keys
...
Use first signatures.len() of account_keys for signing
2018-11-15 16:23:13 -08:00
Stephen Akridge
cda9ad8565
Multiple signatures for transactions
...
With multiple instructions in a TX may need
multiple signatures.
Fixes #1531
2018-11-15 16:23:13 -08:00
carllin
928f375683
Rocks db ( #1792 )
...
* Add rocksdb crate
* Implement new ledger module based on RocksDb
2018-11-15 15:53:31 -08:00
Rob Walker
d3e521f70e
accept other socket errors, ignore unless out of tries ( #1835 )
2018-11-15 15:49:37 -08:00
Michael Vines
a7ee428214
Fix build
2018-11-15 14:06:57 -08:00
anatoly yakovenko
a41254e18c
Add scalable gossip library ( #1546 )
...
* Cluster Replicated Data Store
Separate the data storage and merge strategy from the network IO boundary.
Implement an eager push overlay for transporting recent messages.
Simulation shows fast convergence with 20k nodes.
2018-11-15 13:23:26 -08:00
Sagar Dhawan
c81a3f6ced
Fix RPC address clashes on local multi-node testnet ( #1821 )
...
* Fix RPC address clashes on local multi-node testnet
2018-11-15 10:42:02 -08:00
Tyera Eulberg
a5412fc0cd
Fix find port functions
2018-11-15 10:45:39 -07:00
Michael Vines
5a8938209b
Expose tick_height to native programs
2018-11-14 10:33:27 -08:00
Michael Vines
e33f3a2562
Publish expected native program entrypoint in sdk/
2018-11-14 10:33:27 -08:00
Sathish
9fe210c454
Add host information to db entries ( #1778 )
...
Add new field to each db entry identifying the host
that it originated from.
2018-11-13 21:54:15 -08:00
Jack May
e7b6c8b7e0
Accounts get kicked if no tokens
2018-11-13 17:23:13 -08:00
Jack May
4e553ea095
test_replicate fails locally, ignore
2018-11-13 17:13:25 -08:00
Jack May
0c46f15f94
test_rpc_new fails locally, ignore for now
2018-11-13 17:12:25 -08:00
Sathish
7b92497d21
Update counters irrespective of logging level ( #1799 )
2018-11-13 16:55:14 -08:00
Sagar Dhawan
729d28d910
Add poh verification before processing entries
...
- Replicate stage now verifies entries delivered
by the window
- Minor refactor of entries_from_blobs
2018-11-13 14:17:00 -08:00
carllin
6335be803c
Broadcast last tick before leader rotation ( #1766 )
...
* Broadcast last tick before leader rotation to everybody on network
* Add test
* Refactor broadcast
2018-11-13 02:21:37 -08:00
Sagar Dhawan
a77b1ff767
Revert "Migrate from ring to ed25519-dalek" ( #1798 )
...
* Revert "Migrate from ring to ed25519-dalek"
This reverts commit 7c610b216b
.
* Fix test failures with revert
2018-11-12 22:34:43 -08:00
Tyera Eulberg
c7a67b5a02
Add deploy command to test
2018-11-12 18:21:16 -07:00
Tyera Eulberg
0e749dad4c
Use cluster_info to get rpc address
2018-11-12 18:21:16 -07:00
Rob Walker
fa72160c95
add last_id to Entry, PohEntry ( #1783 )
...
add prev_id to Entry, PohEntry
2018-11-12 17:03:23 -08:00
Greg Fitzgerald
126f065cc9
Extract complex loop from execute_instruction
2018-11-12 14:47:23 -08:00
carllin
4d98da44e3
Fix possibility of a vote error breaking ledger ( #1768 )
...
* Fix possibility of a vote error breaking ledger
* Add test
2018-11-12 11:40:32 -08:00
Michael Vines
522876c808
Rename Account.program_id to Account.owner
2018-11-12 10:59:01 -08:00
Michael Vines
7d05cc8c5d
Add missing account fields
2018-11-12 10:59:01 -08:00
Michael Vines
49f4be6a2b
codemod --extensions rs loader_program_id loader
2018-11-12 10:59:01 -08:00
Greg Fitzgerald
5fce8d2ce1
Don't ignore VoteProgram errors
2018-11-11 22:18:06 -07:00
Greg Fitzgerald
2696b22348
Cleanup TVU diagram
2018-11-11 20:55:21 -08:00
Greg Fitzgerald
5df4754579
Don't call instructions transactions
2018-11-11 20:07:15 -08:00
Tyera Eulberg
a00284c727
Remove userdata diff and make helper fn
2018-11-11 18:57:28 -07:00
Tyera Eulberg
3832602ec4
Move notifications after store_accounts
2018-11-11 18:57:28 -07:00
Greg Fitzgerald
fea86b2955
No longer serialize as JSON-encoded pkcs8
...
That's supposed to be an ASCII format, but we're not making use
of it. We can switch back to that some day, but if we do, it shouldn't
be JSON-encoded.
2018-11-11 09:22:52 -07:00
Greg Fitzgerald
7c610b216b
Migrate from ring to ed25519-dalek
...
Why?
* Pure Rust, no BoringSSL (or OpenSSL) dependency
* Those avx2 benchmarks
* ring includes far more than what we need
* ring author won't add release tags: https://github.com/briansmith/ring#versioning--stability
2018-11-11 09:22:52 -07:00
Greg Fitzgerald
cdf1a96e23
Revert "V1 Window/Ledger based on RocksDb ( #1712 )"
...
This reverts commit bfcdec95cb
.
2018-11-09 20:25:53 -07:00
carllin
bfcdec95cb
V1 Window/Ledger based on RocksDb ( #1712 )
...
* Add rocksdb
* Implement new ledger module based on RocksDb
2018-11-09 18:30:26 -08:00
Greg Fitzgerald
fc55835932
Revert "Boot rpc_port"
...
This reverts commit 1984b6db06dae4f6b655b9076e657e389d786105.
2018-11-09 17:52:10 -07:00
Greg Fitzgerald
3772910bf2
Boot rpc_port
2018-11-09 17:52:10 -07:00
Greg Fitzgerald
24379c14dc
Fix clippy warnings
2018-11-09 17:52:10 -07:00
Greg Fitzgerald
23846bcf1c
Don't require a cluster to query for one's own pubkey
2018-11-09 17:52:10 -07:00
Greg Fitzgerald
9dd0a6e6a7
Boot drone_addr and rpc_addr from config
...
WalletConfig is intended for the validated command-line input.
2018-11-09 17:52:10 -07:00
Greg Fitzgerald
5ca473ac2d
Don't get the network from parse_args
2018-11-09 17:52:10 -07:00
Greg Fitzgerald
f5827d4a83
Fix typo
2018-11-08 17:15:48 -07:00
Greg Fitzgerald
b0f8a983c4
Add the solana-wallet documentation ( #1744 )
...
* Add the solana-wallet documentation
There doesn't seem to be a way to publish bin docs to crates.io.
Until there is, we can include CLI documentation is the appendix
of the markdown book.
* A command to generate all the usage docs
Usage:
$ scripts/wallet-help.sh >> src/wallet.md
2018-11-08 15:42:20 -07:00
Rob Walker
d831c5dcc9
remove dead poh code ( #1747 )
2018-11-08 12:55:23 -08:00
Greg Fitzgerald
ce474eaf54
Better titles for tpu and tvu
2018-11-08 11:33:52 -07:00
Greg Fitzgerald
0da1c06b15
Add disk to the hardware used by both Tpu and Tvu
2018-11-08 11:33:52 -07:00
Greg Fitzgerald
01edc94a4b
Move description of the Rust flavor of stages to service.rs
2018-11-08 11:33:52 -07:00
Greg Fitzgerald
f96563c3f2
Add documentation for pipelining
2018-11-08 11:33:52 -07:00
Rob Walker
30697f63f1
add support for slots in erasure ( #1736 )
2018-11-08 10:20:03 -08:00
Greg Fitzgerald
2a6046de8e
Cleanup TVU code to look like its block diagram ( #1737 )
...
* Reorg TVU code to look like TVU diagram
And move channel creation into LedgerWriteStage so that it can
be used in the same was as all the other stages.
* Delete commented out code
2018-11-07 19:25:36 -07:00
Greg Fitzgerald
43bd28cdfa
Add loader_ prefix to LoaderTransaction methods
2018-11-07 15:06:38 -07:00
Rob Walker
6c10458b5b
leader slots in Blobs ( #1732 )
...
* add leader slot to Blobs
* remove get_X() methods in favor of X() methods for Blob
* add slot to get_scheduled_leader()
2018-11-07 13:18:14 -08:00
Stephen Akridge
7780d9bab8
Add ledger write and storage stage to TVU documentation
2018-11-07 12:07:12 -08:00
Greg Fitzgerald
038a46b5ef
Integrate the markdown book into the codebase
...
This implies that the book should describe exactly what is implemented,
and will not lead the way and eventually bitrot as the RFCs do.
2018-11-07 10:58:47 -07:00
Greg Fitzgerald
8be7c13d2d
Stub out architecture book ( #1674 )
...
* Stub out architecture documentation
* Add book HTML generation and book tests to CI
* Add heading
* Better table of contents
* Reference existing documentation
Move ASCII art from code comments into rendered SVG
* Attempt to fix CI
* Add lamport docs
And truncate lines to 80 characters
* Fix links
And reference shorter, newer description of PoH.
* Replace ASCII art with SVG
* Streamline for Pillbox
* Update path before optional install
* Use $CARGO_HOME instead of $HOME
* Delete code
Attempt to describe all data structures without code.
* Boot RPU from docs, add JsonRpcService
Also, use Rust naming conventions in the block diagrams to
minimize the jump from docs to code.
* Latest code uses tick_height
* Rename bob/ folder to art/
A home for any ASCII art
* Import JSON RPC API
* More mdbook docs
* Add Ncp
* Cleanup links
* Move pipelining description into fullnode description
* Move high-level transaction docs into top-level doc
* Delete unused files
2018-11-06 18:00:58 -07:00
Tyera Eulberg
d7ea66b6a1
RPC and Pubsub, bind to 0.0.0.0
2018-11-06 15:45:36 -07:00
Sathish
371c69d425
Add ledger write stage counters ( #1713 )
2018-11-06 14:44:54 -08:00
Rob Walker
9b43b00d5c
remove tick_count, leader_scheduler, from broadcast code ( #1725 )
2018-11-06 13:17:41 -08:00
Rob Walker
76694bfcf4
remove entry_writer.rs ( #1720 )
2018-11-06 12:42:31 -08:00
Greg Fitzgerald
bfad138bb3
Pass any serializable to Transaction constructor
2018-11-06 11:23:59 -07:00
Greg Fitzgerald
54968b59bb
Update last_id between client retries
...
Fixes #1694
2018-11-06 09:06:15 -07:00
Tyera Eulberg
f683817b48
Remove RPU; replace with RPC
2018-11-05 20:30:47 -07:00
Rob Walker
22abc27be4
add tests for bank.purge() ( #1711 )
2018-11-05 16:43:27 -08:00
Greg Fitzgerald
c9138f964b
Change token type from i64 to u64
...
Fixes #1526
2018-11-05 15:25:26 -07:00
Rob Walker
1fbf1d2cf2
Add checkpoint, rollback to to bank ( #1662 )
...
add linked-list capability to accounts
change accounts from a linked list to a VecDeque
add checkpoint and rollback for lastids
add subscriber notifications for rollbacks
checkpoint transaction count, too
2018-11-05 09:47:41 -08:00
Rob Walker
1d7722043f
genesis has 3 entries now
2018-11-02 22:02:13 -07:00
Rob Walker
95f9488a70
use default buffer size for index, use BLOB_DATA_SIZE for data buffer ( #1693 )
2018-11-02 21:52:57 -07:00
Greg Fitzgerald
e7cbbd8d45
cargo fmt
2018-11-02 19:54:49 -07:00
Greg Fitzgerald
c8c255ad73
Rename Budget to BudgetExpr
2018-11-02 19:54:49 -07:00
Michael Vines
a264f8fa9b
Fix |cargo test|
2018-11-02 19:04:59 -07:00
Michael Vines
40e945b0c8
Move token_program from src/ to programs/native/
2018-11-02 18:13:02 -07:00
carllin
0636399b7a
Compute finality computation in new ComputeLeaderFinalityService ( #1652 )
...
* Move finality computation into a service run from the banking stage, ComputeLeaderFinalityService
* Change last ids nth to tick height, remove separate tick height from bank
2018-11-02 15:49:14 -07:00
carllin
298bd6479a
Add first leader to genesis ( #1681 )
...
* Add first leader to genesis entries, consume in genesis.sh
* Set bootstrap leader in the bank on startup, remove instantiation of bootstrap leader from bin/fullnode
* Remove need to initialize bootstrap leader in leader_scheduler, now can be read from genesis entries
* Add separate interface new_with_leader() in mint for creating genesis leader entries
2018-11-02 14:32:05 -07:00
Tyera Eulberg
879431ebcd
Add timeout to TcpStream connect, and rename test
2018-11-01 14:13:19 -06:00
Tyera Eulberg
af1283e92c
Improve airdrop confirmation logic
2018-11-01 11:28:33 -06:00
Sathish
dffa2eb04f
Do not parallelize deserialize operation ( #1663 )
...
Deserialize operations are faster when done serially with the
MT banking stage and helps with performance improvement with
reduced thread context switches.
2018-10-31 22:12:15 -07:00
carllin
00889c5139
Fix bad function arguments ( #1682 )
2018-10-31 19:55:58 -07:00
Stephen Akridge
af8dc3fd83
Fix snap build
...
cuda and chacha features required for chacha_cuda
2018-10-31 17:59:31 -07:00
carllin
ba884b4e36
Add thin client test for vote functionality, fix sizing errors in vote contract ( #1643 )
...
* Added tests to thin client to test VoteContract calls, fix VoteContract sizing errors
* Calculate upper bound on VoteProgram size at runtime, add test for serializing/deserializing a max sized VoteProgram state
2018-10-31 17:47:50 -07:00
Tyera Eulberg
6ddd494826
Improve rpc logging
2018-10-31 15:21:55 -06:00
Stephen Akridge
aa2fd3f3bb
Storage RFC grammar
2018-10-31 13:44:21 -07:00
Stephen Akridge
cf00354f42
Add storage stage which does storage mining verification for validators
2018-10-31 13:44:21 -07:00
carllin
47f1fa3f2e
Remove purging of leader id from cluster info ( #1642 )
2018-10-31 12:30:48 -07:00
Michael Vines
74b4ecb7f3
Upgrade to influx_db_client@0.3.6
2018-10-30 19:44:09 -07:00
Michael Vines
8d16f69bb9
Improve account subscribe/unsubscribe logging
2018-10-30 12:03:35 -07:00
Michael Vines
3a73a09391
Avoid panicking when a native library doesn't exist
2018-10-30 12:03:35 -07:00
Michael Vines
009c71f7e2
Demote info logs
2018-10-30 12:03:35 -07:00
Michael Vines
073d39df44
Add solana_ prefix to loaders so their logs appear in the default RUST_LOG config
2018-10-30 12:03:35 -07:00
Michael Vines
ae7222f0df
Work around influxdb panic
2018-10-30 12:03:35 -07:00
Rob Walker
13bfdde228
remove ledger tail code, WINDOW_SIZE begone ( #1617 )
...
* remove WINDOW_SIZE, use window.window_size()
* move ledger tail, redundant with ledger-based repair
2018-10-30 10:05:18 -07:00
jackcmay
be003970b7
Program_ids were overlapping ( #1626 )
...
Program_ids were overlapping
2018-10-26 19:44:53 -07:00
Stephen Akridge
b28fbfa13e
Use a smaller test value for window_size
...
Otherwise this test takes forever to run.
2018-10-26 11:38:55 -07:00
Michael Vines
07c656093c
Remove tictactoe programs
2018-10-25 21:22:07 -07:00
Michael Vines
c9e8346e6a
cargo fmt
2018-10-25 17:24:24 -07:00
Michael Vines
236113e417
cargo fmt
2018-10-25 17:13:41 -07:00
carllin
f6c8e1a4bf
Vote contract ( #1552 )
...
* Add Vote Contract
* Move ownership of LeaderScheduler from Fullnode to the bank
* Modified ReplicateStage to consume leader information from bank
* Restart RPC Services in Leader To Validator Transition
* Make VoteContract Context Free
* Remove voting from ClusterInfo and Tpu
* Remove dependency on ActiveValidators in LeaderScheduler
* Switch VoteContract to have two steps 1) Register 2) Vote. Change thin client to create + register a voting account on fullnode startup
* Remove check in leader_to_validator transition for unique references to bank, b/c jsonrpc service and rpcpubsub hold references through jsonhttpserver
2018-10-25 16:58:40 -07:00
carllin
55833e20b1
Create Poh Service ( #1604 )
...
* Create new Poh Service, replace tick generation in BankingStage
2018-10-25 14:56:21 -07:00
Tyera Eulberg
02cfa76916
Plumb GetTransactionCount through solana-wallet
2018-10-25 14:58:51 -06:00
Tyera Eulberg
9314eea7e9
Add leader-readiness test to wallet-sanity
2018-10-25 14:58:51 -06:00
Michael Vines
e47fcb196b
s/solana_program_interface/solana[_-]sdk/g
2018-10-25 12:31:45 -07:00
Michael Vines
af8a36b7fb
Exclude chacha_cuda when chacha is disabled
2018-10-24 17:02:46 -07:00
Michael Vines
208e7d7943
Explicitly reject transactions larger than PACKET_SIZE
2018-10-24 15:34:27 -07:00
Stephen Akridge
61927e1941
Fix compile error for write_entries
...
Takes a reference now.
2018-10-24 11:31:30 -07:00
Tyera Eulberg
2f2531d921
Add retries to Wallet deploy
2018-10-24 11:13:32 -06:00
Tyera Eulberg
d5f20980eb
Incorporate preloaded bpf loader
2018-10-24 11:13:32 -06:00
Tyera Eulberg
21eae981f9
Add deploy method to solana-wallet
2018-10-24 11:13:32 -06:00
Stephen Akridge
ead7f4287a
Storage mining fixups...
...
* Use IV to make unique identies
* Use hex! macro for hex literal and not string converted to u8 slice
* fix sha sampling to control init/end of sha state
2018-10-24 09:58:41 -07:00
Michael Vines
3b33150cfb
Bump drone read timeout to 10s
...
The previous timeout of 3s was not generous enough occasionally
2018-10-24 08:52:41 -07:00
Pankaj Garg
5c483c9928
remove unused variable
2018-10-23 16:52:56 -06:00
Pankaj Garg
a68c99d782
Fix transaction count on testnet dashboard
2018-10-23 16:52:56 -06:00
jackcmay
5ca52d785c
Preload BPF loader ( #1573 )
...
Preload BPF loader
2018-10-23 14:44:41 -07:00
Pankaj Garg
8d9912b4e2
Move ledger write to its own stage ( #1577 )
...
* Move ledger write to its own stage
- Also, rename write_stage to leader_vote_stage, as write functionality
is moved to a different stage
* Address review comments
* Fix leader rotation test failure
* address review comments
2018-10-23 14:42:48 -07:00
Michael Vines
7977b97227
Surface AccountInUse to JSON RPC users so they know to retry the transaction
2018-10-23 13:55:30 -07:00
Michael Vines
4f34822900
Improve logging on various error conditions
2018-10-23 13:40:59 -07:00
Pankaj Garg
bbb38ac106
Increase window size ( #1578 )
...
Addresses the following problem
- Validators are not able to keep up with the leader
- The future blobs (outside of window) get dropped
- The validators won't process repair requests for these future blobs
2018-10-23 10:25:01 -07:00
Michael Vines
45cfa5b574
Add instruction to transfer account ownership
2018-10-20 21:54:25 -05:00
Pankaj Garg
df9ccce5b2
Remove hostname() from calls to metrics as it's expensive operation ( #1557 )
2018-10-20 06:38:20 -07:00
jackcmay
f8516b677a
Load program data in chunks ( #1556 )
...
Load program data in chunks
2018-10-19 18:28:38 -07:00
Greg Fitzgerald
26b99d3f85
Ensure witness and timestamp keys are signed
...
Before this patch, an attacker could point Budget instructions to
unsigned keys, and authorize a transaction from an unauthorized
party.
2018-10-19 10:06:59 -06:00
Greg Fitzgerald
2f9c0d1d9e
Add method to lookup signed keys
2018-10-19 10:06:59 -06:00
carllin
0bd1412562
Switch leader scheduler to use PoH ticks instead of Entry height ( #1519 )
...
* Add PoH height to process_ledger()
* Moved broadcast_stage Leader Scheduling logic to use Poh height instead of entry_height
* Moved LeaderScheduler logic to PoH in ReplicateStage
* Fix Leader scheduling tests to use PoH instead of entry height
* Change is_leader detection in repair() to use PoH instead of entry height
* Add tests to LeaderScheduler for new functionality
* fix Entry::new and genesis block PoH counts
* Moved LeaderScheduler to PoH ticks
* Cleanup to resolve PR comments
2018-10-18 22:57:48 -07:00
Stephen Akridge
37a0b7b132
Initial validator code for rust side hooks for chacha cuda parallel encrypt
2018-10-18 13:50:19 -07:00
Stephen Akridge
c30b605047
Actually submit the storage mining proof
...
Get an aidrop so replicator can submit mining transaction
Some other minor type cleanup.
2018-10-18 13:50:19 -07:00
Rob Walker
76076d6fad
move last_id age checking into the HashMap
...
* allows for simpler chaining of banks
* looks 1.5-2% faster than looping through a VecDequeue
TODO: remove timestamp()?
2018-10-18 11:07:00 -07:00
jackcmay
0a819ec4e2
Programs were not spawned by SystemProgram ( #1533 )
...
* SystemProgram spawns programs
2018-10-18 10:33:30 -07:00
Michael Vines
57a717056e
Delegate accounts now record the original approved amount
2018-10-18 08:53:25 -07:00
Greg Fitzgerald
856c48541f
Restore elaborate attack
...
The test is showing how you can sneak by verify_plan() but not
verify_signature().
2018-10-18 08:46:02 -06:00
Greg Fitzgerald
2045091c4f
Add SystemProgram::Move ix to Budget tx
2018-10-18 08:46:02 -06:00
Greg Fitzgerald
03ac5a6eef
Move all source tokens into Budget account
...
Budget now assumes the source account holds all tokens the program
should spend.
Note: the static guarantees implied by verify_plan() are meaningless
under the new contract engine. The bank no longer calls it. This
serves as a nice example of where comparing code coverage between
integration tests and unit tests would have shown us where a
change rendered unit tests meaningless.
2018-10-18 08:46:02 -06:00
Greg Fitzgerald
32fadc9c30
Merge debits and credits
...
Debits no longer need to be applied before credits. Instead, we
lock any accounts we'd debit and so error out on the second attempt
to lock the same account.
2018-10-18 08:46:02 -06:00
Greg Fitzgerald
15a89d4f17
Boot Contract type from Budget
...
In the old bank (before the contract engine), Contract wasn't specific
to Budget. It provided the same service as what is now called
SystemProgram::Move, but without requiring a separate account.
2018-10-18 08:46:02 -06:00
Rob Walker
d0f43e9934
consolidate tmp ledgers
2018-10-18 08:45:31 -06:00
Pankaj Garg
31e779d3f2
Added counters to track more metrics on dashboard ( #1535 )
...
- Total number of IP packets TX/RX from all nodes in the testnet
- Last consumed index on validator
- Last transmitted index on leader
2018-10-17 17:32:50 -07:00
Pankaj Garg
639c93460a
Write stage optimizations ( #1534 )
...
- Testnet dashboard shows that channel pressure for write stage
is incrementing on every iteration of write.
- This change optimizes ledger writing by removing cloning of map
and reducing calls to flush
2018-10-17 13:02:32 -07:00
Jack May
63caca33be
SystemProgram test was failing due to expected panic
2018-10-16 18:02:44 -07:00
Rob Walker
912eb5e8e9
remove bank.is_leader, dead code ( #1516 )
2018-10-16 15:26:44 -07:00
Jack May
d0c19c2c97
cargo fmt
2018-10-16 14:11:04 -07:00
Jack May
926fdb7519
Rename dynamic_program.rs to native_loader.rs
2018-10-16 14:11:04 -07:00
jackcmay
c886625c83
Move from solana/rbpf fork to qmonnet/rbpf ( #1511 )
2018-10-16 13:13:54 -07:00
Pankaj Garg
f6c10d8a2e
Add channel pressure for validator TVU stages ( #1509 )
2018-10-16 12:54:23 -07:00
anatoly yakovenko
2bd877528f
Par process entries ( #1499 )
...
* Parallel entry processor.
2018-10-16 12:09:48 -07:00
jackcmay
d09889b1dd
Program bank integration ( #1462 )
...
Native, BPF and Lua loaders integrated into the bank
2018-10-16 09:43:49 -07:00
Tyera Eulberg
1b2e9122d5
Pubsub listen on random open port when rpc does (quiet some test errors)
2018-10-16 00:11:26 -06:00
Tyera Eulberg
7424388924
Fix session drop
2018-10-16 00:11:26 -06:00
Michael Vines
537436bd5e
RPC PubSub now uses a well-known socket
2018-10-16 00:11:26 -06:00
Tyera Eulberg
fb99494858
Improve rpc code coverage ( #1487 )
2018-10-15 11:01:40 -06:00
Greg Fitzgerald
515c200d86
Refactor and add test for new Entry::serialized_size()
2018-10-14 10:53:47 -06:00
Greg Fitzgerald
32aab82e32
Don't allocate to see if transactions will fit in a blob
2018-10-14 10:53:47 -06:00
anatoly yakovenko
6aaa350145
effeciently pack gossip responsens and only respond up to max size. ( #1493 )
2018-10-14 06:45:02 -07:00
Michael Vines
d3b4dfe104
Add bool return to entrypoint signature to permit programs to fail transactions
2018-10-13 20:01:43 -07:00
Michael Vines
2d0f07091d
Handle dynamic program dlopen failures gracefully
2018-10-13 11:31:10 -07:00
Michael Vines
3828eda507
Demote log messages
2018-10-13 11:31:10 -07:00
Michael Vines
1e736ec16d
Demote log messages
2018-10-12 20:16:57 -07:00
Anatoly Yakovenko
bba6437ea9
Use a single structure for last_ids and last_ids_sigs
2018-10-12 16:39:35 -07:00
Pankaj Garg
e5ab9a856c
Upload bench output as build artifacts ( #1478 )
...
* Upload bench output as build artifacts
* Fix tags types
* Pull previous stats from metrics
* Change the default branch for comparison
* Fix formatting
* Fix build errors
* Address review comments
* Dedup some common code
* Add eval for channel info to find branch name
2018-10-12 15:13:10 -07:00