37f8dd57e2
Extract ProgramError from BankError
2018-11-24 11:56:51 -07:00
f827bfd83f
Remove instruction index parameter
2018-11-24 11:56:51 -07:00
b3af930153
Rename process_transaction to process_instruction
2018-11-24 11:56:51 -07:00
cd488b7d07
Hoist program static methods to top-level functions
2018-11-24 11:56:51 -07:00
e2373ff51a
add nosigverify command line option to ease debug
2018-11-23 16:55:04 -08:00
b3d2c900cd
Rename BudgetState to BudgetProgram
2018-11-23 13:25:17 -07:00
d5adec20a3
get_ip_addr: Fall back to loopback if no better option exists
2018-11-23 13:24:41 -05:00
942256a647
Add db_ledger benchmarks ( #1875 )
...
* Add db_ledger benchmarks
* ignore benches in CI, due to timeouts
2018-11-23 06:12:43 -08:00
a3321a5d80
Fix endianess in db_ledger to account for the default byte-comparator used by Rocksdb ( #1885 )
2018-11-22 01:35:19 -08:00
521de13571
Add maximum repair length to db_window ( #1886 )
...
* Add maximum repair length to db_window
2018-11-21 23:44:49 -08:00
3abf6a8a30
Reorg the markdown book to cater to app devs
...
First, talk about how a client interacts with Solana to do useful
things. Then describe how the fullnode you're talking to works and
why it's so very fast. Last, why that fullnode you don't trust
does what you asked it to anyway.
2018-11-21 15:49:57 -08:00
59163e2dd9
Optimize some CI stuff ( #1880 )
...
* CI Optimizations
2018-11-21 12:16:16 -08:00
d9dabdfc74
Rocks db window utils ( #1851 )
...
* Implement new ledger module based on RocksDb
* Add db_window module for windowing functions from RocksDb
2018-11-19 23:20:18 -08:00
6b910d1bd4
add tpu_forwarding, simplify ClusterInfo::new() from Result<Self> to Self
2018-11-19 20:45:49 -08:00
bbd9ea8c00
Delete settings.rs.foo
2018-11-19 13:39:08 -08:00
fc67a968e8
Use known keys in the unit test to avoid random false positives.
2018-11-19 13:41:24 -07:00
3d113611cc
remove Result<> return from ClusterInfo::new() ( #1869 )
...
strip Result<> for ClusterInfo::new()
2018-11-19 11:25:14 -08:00
07667771ef
Fix Gossip Pushes going to invalid addresses ( #1858 )
2018-11-17 19:57:28 -08:00
3822c29415
Route program_id to program entrypoint
2018-11-17 19:42:03 -08:00
ff386d6585
Add disclaimer to markdown book
...
copy-paste from readme
2018-11-17 19:56:08 -07:00
88ddb31477
teminology cleanup: leader slots and voting rounds
2018-11-17 18:56:13 -07:00
077d1a41f1
Add too book
2018-11-17 18:56:13 -07:00
857ab8662e
backticks and missing variable descriptions
2018-11-17 18:56:13 -07:00
a17f9bd0f4
Work towards adding leader rotation to the book
2018-11-17 18:56:13 -07:00
f4b9e93b11
Migrate storage RFC to book
2018-11-17 18:55:08 -07:00
2c11bf2e66
Various book cleanup
...
* Merge Leader and Validator diagrams
* New sdk-tools diagram
* Move terminology to just after introduction
* Purge use of LAMPORT as an acronym
* Add notes about persistent storage
2018-11-17 17:50:29 -08:00
719e14b30a
Add an explicit state of a reserved signature
...
An RPC client that fetches the signature status before the bank finishes
executing the corresponding Transaction should receive SignatureNotFound
instead of Confirmed
2018-11-17 16:40:23 -08:00
d1f01b5209
Fix clippy lint
2018-11-17 15:54:21 -08:00
d96a6b42a5
Move drone into its own crate
2018-11-16 20:42:21 -08:00
cf95708c18
Set drone address to always be the initial network entry point ( #1847 )
...
* Set drone address to always be the initial network entry point, so that even when leaders rotate the client can still find the drone
* Extract drone address as a separate argument to bench-tps
* Add drone port to client.sh instead of setting it in bench-tps
* Add drone entrypoint to scripts
* Fix build error
2018-11-16 19:56:26 -08:00
e1c7b99450
Accounts get kicked if no tokens
2018-11-16 18:53:37 -08:00
12ae7b9a6b
Add test for tvu POH verification ( #1844 )
2018-11-16 15:48:10 -08:00
6ac5700f2e
Move metrics into its own crate
2018-11-16 15:10:07 -08:00
a0dd8617be
Remove airdrop from fullnode
2018-11-16 13:25:55 -08:00
1576072edb
remove spurious eprintln!()
2018-11-16 10:21:58 -08:00
03d206a7ca
Check for valid tvu, not tpu in broadcast ( #1836 )
2018-11-15 23:30:22 -08:00
c973de1d76
Decouple log and metrics rate ( #1839 )
...
Use separate env for log and metrics rate.
Set default log level to WARN if unset.
2018-11-15 22:27:16 -08:00
71336965a6
Limit targets to 4 in bench-tps
...
Transaction got bigger so can only fit 4 targets in a
Transaction now.
2018-11-15 20:25:07 -08:00
e791d0f74d
Drone now returns signed airdrop transactions
2018-11-15 17:13:13 -08:00
3543a9a49f
Add check for missing signature with fee'ed transaction
...
And update fetch-perf-libs version
2018-11-15 16:23:13 -08:00
7dd198a99e
Change signed_key to index into account_keys
...
If index is within the signed keys range.
2018-11-15 16:23:13 -08:00
e048116ab2
Remove signed_keys
...
Use first signatures.len() of account_keys for signing
2018-11-15 16:23:13 -08:00
cda9ad8565
Multiple signatures for transactions
...
With multiple instructions in a TX may need
multiple signatures.
Fixes #1531
2018-11-15 16:23:13 -08:00
928f375683
Rocks db ( #1792 )
...
* Add rocksdb crate
* Implement new ledger module based on RocksDb
2018-11-15 15:53:31 -08:00
d3e521f70e
accept other socket errors, ignore unless out of tries ( #1835 )
2018-11-15 15:49:37 -08:00
a7ee428214
Fix build
2018-11-15 14:06:57 -08:00
a41254e18c
Add scalable gossip library ( #1546 )
...
* Cluster Replicated Data Store
Separate the data storage and merge strategy from the network IO boundary.
Implement an eager push overlay for transporting recent messages.
Simulation shows fast convergence with 20k nodes.
2018-11-15 13:23:26 -08:00
c81a3f6ced
Fix RPC address clashes on local multi-node testnet ( #1821 )
...
* Fix RPC address clashes on local multi-node testnet
2018-11-15 10:42:02 -08:00
a5412fc0cd
Fix find port functions
2018-11-15 10:45:39 -07:00
5a8938209b
Expose tick_height to native programs
2018-11-14 10:33:27 -08:00
e33f3a2562
Publish expected native program entrypoint in sdk/
2018-11-14 10:33:27 -08:00
9fe210c454
Add host information to db entries ( #1778 )
...
Add new field to each db entry identifying the host
that it originated from.
2018-11-13 21:54:15 -08:00
e7b6c8b7e0
Accounts get kicked if no tokens
2018-11-13 17:23:13 -08:00
4e553ea095
test_replicate fails locally, ignore
2018-11-13 17:13:25 -08:00
0c46f15f94
test_rpc_new fails locally, ignore for now
2018-11-13 17:12:25 -08:00
7b92497d21
Update counters irrespective of logging level ( #1799 )
2018-11-13 16:55:14 -08:00
729d28d910
Add poh verification before processing entries
...
- Replicate stage now verifies entries delivered
by the window
- Minor refactor of entries_from_blobs
2018-11-13 14:17:00 -08:00
6335be803c
Broadcast last tick before leader rotation ( #1766 )
...
* Broadcast last tick before leader rotation to everybody on network
* Add test
* Refactor broadcast
2018-11-13 02:21:37 -08:00
a77b1ff767
Revert "Migrate from ring to ed25519-dalek" ( #1798 )
...
* Revert "Migrate from ring to ed25519-dalek"
This reverts commit 7c610b216b
2018-11-12 22:34:43 -08:00
c7a67b5a02
Add deploy command to test
2018-11-12 18:21:16 -07:00
0e749dad4c
Use cluster_info to get rpc address
2018-11-12 18:21:16 -07:00
fa72160c95
add last_id to Entry, PohEntry ( #1783 )
...
add prev_id to Entry, PohEntry
2018-11-12 17:03:23 -08:00
126f065cc9
Extract complex loop from execute_instruction
2018-11-12 14:47:23 -08:00
4d98da44e3
Fix possibility of a vote error breaking ledger ( #1768 )
...
* Fix possibility of a vote error breaking ledger
* Add test
2018-11-12 11:40:32 -08:00
522876c808
Rename Account.program_id to Account.owner
2018-11-12 10:59:01 -08:00
7d05cc8c5d
Add missing account fields
2018-11-12 10:59:01 -08:00
49f4be6a2b
codemod --extensions rs loader_program_id loader
2018-11-12 10:59:01 -08:00
5fce8d2ce1
Don't ignore VoteProgram errors
2018-11-11 22:18:06 -07:00
2696b22348
Cleanup TVU diagram
2018-11-11 20:55:21 -08:00
5df4754579
Don't call instructions transactions
2018-11-11 20:07:15 -08:00
a00284c727
Remove userdata diff and make helper fn
2018-11-11 18:57:28 -07:00
3832602ec4
Move notifications after store_accounts
2018-11-11 18:57:28 -07:00
fea86b2955
No longer serialize as JSON-encoded pkcs8
...
That's supposed to be an ASCII format, but we're not making use
of it. We can switch back to that some day, but if we do, it shouldn't
be JSON-encoded.
2018-11-11 09:22:52 -07:00
7c610b216b
Migrate from ring to ed25519-dalek
...
Why?
* Pure Rust, no BoringSSL (or OpenSSL) dependency
* Those avx2 benchmarks
* ring includes far more than what we need
* ring author won't add release tags: https://github.com/briansmith/ring#versioning--stability
2018-11-11 09:22:52 -07:00
cdf1a96e23
Revert "V1 Window/Ledger based on RocksDb ( #1712 )"
...
This reverts commit bfcdec95cb
2018-11-09 20:25:53 -07:00
bfcdec95cb
V1 Window/Ledger based on RocksDb ( #1712 )
...
* Add rocksdb
* Implement new ledger module based on RocksDb
2018-11-09 18:30:26 -08:00
fc55835932
Revert "Boot rpc_port"
...
This reverts commit 1984b6db06dae4f6b655b9076e657e389d786105.
2018-11-09 17:52:10 -07:00
3772910bf2
Boot rpc_port
2018-11-09 17:52:10 -07:00
24379c14dc
Fix clippy warnings
2018-11-09 17:52:10 -07:00
23846bcf1c
Don't require a cluster to query for one's own pubkey
2018-11-09 17:52:10 -07:00
9dd0a6e6a7
Boot drone_addr and rpc_addr from config
...
WalletConfig is intended for the validated command-line input.
2018-11-09 17:52:10 -07:00
5ca473ac2d
Don't get the network from parse_args
2018-11-09 17:52:10 -07:00
f5827d4a83
Fix typo
2018-11-08 17:15:48 -07:00
b0f8a983c4
Add the solana-wallet documentation ( #1744 )
...
* Add the solana-wallet documentation
There doesn't seem to be a way to publish bin docs to crates.io.
Until there is, we can include CLI documentation is the appendix
of the markdown book.
* A command to generate all the usage docs
Usage:
$ scripts/wallet-help.sh >> src/wallet.md
2018-11-08 15:42:20 -07:00
d831c5dcc9
remove dead poh code ( #1747 )
2018-11-08 12:55:23 -08:00
ce474eaf54
Better titles for tpu and tvu
2018-11-08 11:33:52 -07:00
0da1c06b15
Add disk to the hardware used by both Tpu and Tvu
2018-11-08 11:33:52 -07:00
01edc94a4b
Move description of the Rust flavor of stages to service.rs
2018-11-08 11:33:52 -07:00
f96563c3f2
Add documentation for pipelining
2018-11-08 11:33:52 -07:00
30697f63f1
add support for slots in erasure ( #1736 )
2018-11-08 10:20:03 -08:00
2a6046de8e
Cleanup TVU code to look like its block diagram ( #1737 )
...
* Reorg TVU code to look like TVU diagram
And move channel creation into LedgerWriteStage so that it can
be used in the same was as all the other stages.
* Delete commented out code
2018-11-07 19:25:36 -07:00
43bd28cdfa
Add loader_ prefix to LoaderTransaction methods
2018-11-07 15:06:38 -07:00
6c10458b5b
leader slots in Blobs ( #1732 )
...
* add leader slot to Blobs
* remove get_X() methods in favor of X() methods for Blob
* add slot to get_scheduled_leader()
2018-11-07 13:18:14 -08:00
7780d9bab8
Add ledger write and storage stage to TVU documentation
2018-11-07 12:07:12 -08:00
038a46b5ef
Integrate the markdown book into the codebase
...
This implies that the book should describe exactly what is implemented,
and will not lead the way and eventually bitrot as the RFCs do.
2018-11-07 10:58:47 -07:00
8be7c13d2d
Stub out architecture book ( #1674 )
...
* Stub out architecture documentation
* Add book HTML generation and book tests to CI
* Add heading
* Better table of contents
* Reference existing documentation
Move ASCII art from code comments into rendered SVG
* Attempt to fix CI
* Add lamport docs
And truncate lines to 80 characters
* Fix links
And reference shorter, newer description of PoH.
* Replace ASCII art with SVG
* Streamline for Pillbox
* Update path before optional install
* Use $CARGO_HOME instead of $HOME
* Delete code
Attempt to describe all data structures without code.
* Boot RPU from docs, add JsonRpcService
Also, use Rust naming conventions in the block diagrams to
minimize the jump from docs to code.
* Latest code uses tick_height
* Rename bob/ folder to art/
A home for any ASCII art
* Import JSON RPC API
* More mdbook docs
* Add Ncp
* Cleanup links
* Move pipelining description into fullnode description
* Move high-level transaction docs into top-level doc
* Delete unused files
2018-11-06 18:00:58 -07:00
d7ea66b6a1
RPC and Pubsub, bind to 0.0.0.0
2018-11-06 15:45:36 -07:00
371c69d425
Add ledger write stage counters ( #1713 )
2018-11-06 14:44:54 -08:00
9b43b00d5c
remove tick_count, leader_scheduler, from broadcast code ( #1725 )
2018-11-06 13:17:41 -08:00
76694bfcf4
remove entry_writer.rs ( #1720 )
2018-11-06 12:42:31 -08:00
bfad138bb3
Pass any serializable to Transaction constructor
2018-11-06 11:23:59 -07:00
54968b59bb
Update last_id between client retries
...
Fixes #1694
2018-11-06 09:06:15 -07:00
f683817b48
Remove RPU; replace with RPC
2018-11-05 20:30:47 -07:00
22abc27be4
add tests for bank.purge() ( #1711 )
2018-11-05 16:43:27 -08:00
c9138f964b
Change token type from i64 to u64
...
Fixes #1526
2018-11-05 15:25:26 -07:00
1fbf1d2cf2
Add checkpoint, rollback to to bank ( #1662 )
...
add linked-list capability to accounts
change accounts from a linked list to a VecDeque
add checkpoint and rollback for lastids
add subscriber notifications for rollbacks
checkpoint transaction count, too
2018-11-05 09:47:41 -08:00
1d7722043f
genesis has 3 entries now
2018-11-02 22:02:13 -07:00
95f9488a70
use default buffer size for index, use BLOB_DATA_SIZE for data buffer ( #1693 )
2018-11-02 21:52:57 -07:00
e7cbbd8d45
cargo fmt
2018-11-02 19:54:49 -07:00
c8c255ad73
Rename Budget to BudgetExpr
2018-11-02 19:54:49 -07:00
a264f8fa9b
Fix |cargo test|
2018-11-02 19:04:59 -07:00
40e945b0c8
Move token_program from src/ to programs/native/
2018-11-02 18:13:02 -07:00
0636399b7a
Compute finality computation in new ComputeLeaderFinalityService ( #1652 )
...
* Move finality computation into a service run from the banking stage, ComputeLeaderFinalityService
* Change last ids nth to tick height, remove separate tick height from bank
2018-11-02 15:49:14 -07:00
298bd6479a
Add first leader to genesis ( #1681 )
...
* Add first leader to genesis entries, consume in genesis.sh
* Set bootstrap leader in the bank on startup, remove instantiation of bootstrap leader from bin/fullnode
* Remove need to initialize bootstrap leader in leader_scheduler, now can be read from genesis entries
* Add separate interface new_with_leader() in mint for creating genesis leader entries
2018-11-02 14:32:05 -07:00
879431ebcd
Add timeout to TcpStream connect, and rename test
2018-11-01 14:13:19 -06:00
af1283e92c
Improve airdrop confirmation logic
2018-11-01 11:28:33 -06:00
dffa2eb04f
Do not parallelize deserialize operation ( #1663 )
...
Deserialize operations are faster when done serially with the
MT banking stage and helps with performance improvement with
reduced thread context switches.
2018-10-31 22:12:15 -07:00
00889c5139
Fix bad function arguments ( #1682 )
2018-10-31 19:55:58 -07:00
af8dc3fd83
Fix snap build
...
cuda and chacha features required for chacha_cuda
2018-10-31 17:59:31 -07:00
ba884b4e36
Add thin client test for vote functionality, fix sizing errors in vote contract ( #1643 )
...
* Added tests to thin client to test VoteContract calls, fix VoteContract sizing errors
* Calculate upper bound on VoteProgram size at runtime, add test for serializing/deserializing a max sized VoteProgram state
2018-10-31 17:47:50 -07:00
6ddd494826
Improve rpc logging
2018-10-31 15:21:55 -06:00
aa2fd3f3bb
Storage RFC grammar
2018-10-31 13:44:21 -07:00
cf00354f42
Add storage stage which does storage mining verification for validators
2018-10-31 13:44:21 -07:00
47f1fa3f2e
Remove purging of leader id from cluster info ( #1642 )
2018-10-31 12:30:48 -07:00
74b4ecb7f3
Upgrade to influx_db_client@0.3.6
2018-10-30 19:44:09 -07:00
8d16f69bb9
Improve account subscribe/unsubscribe logging
2018-10-30 12:03:35 -07:00
3a73a09391
Avoid panicking when a native library doesn't exist
2018-10-30 12:03:35 -07:00
009c71f7e2
Demote info logs
2018-10-30 12:03:35 -07:00
073d39df44
Add solana_ prefix to loaders so their logs appear in the default RUST_LOG config
2018-10-30 12:03:35 -07:00
ae7222f0df
Work around influxdb panic
2018-10-30 12:03:35 -07:00
13bfdde228
remove ledger tail code, WINDOW_SIZE begone ( #1617 )
...
* remove WINDOW_SIZE, use window.window_size()
* move ledger tail, redundant with ledger-based repair
2018-10-30 10:05:18 -07:00
be003970b7
Program_ids were overlapping ( #1626 )
...
Program_ids were overlapping
2018-10-26 19:44:53 -07:00
b28fbfa13e
Use a smaller test value for window_size
...
Otherwise this test takes forever to run.
2018-10-26 11:38:55 -07:00
07c656093c
Remove tictactoe programs
2018-10-25 21:22:07 -07:00
c9e8346e6a
cargo fmt
2018-10-25 17:24:24 -07:00
236113e417
cargo fmt
2018-10-25 17:13:41 -07:00
f6c8e1a4bf
Vote contract ( #1552 )
...
* Add Vote Contract
* Move ownership of LeaderScheduler from Fullnode to the bank
* Modified ReplicateStage to consume leader information from bank
* Restart RPC Services in Leader To Validator Transition
* Make VoteContract Context Free
* Remove voting from ClusterInfo and Tpu
* Remove dependency on ActiveValidators in LeaderScheduler
* Switch VoteContract to have two steps 1) Register 2) Vote. Change thin client to create + register a voting account on fullnode startup
* Remove check in leader_to_validator transition for unique references to bank, b/c jsonrpc service and rpcpubsub hold references through jsonhttpserver
2018-10-25 16:58:40 -07:00
55833e20b1
Create Poh Service ( #1604 )
...
* Create new Poh Service, replace tick generation in BankingStage
2018-10-25 14:56:21 -07:00
02cfa76916
Plumb GetTransactionCount through solana-wallet
2018-10-25 14:58:51 -06:00
9314eea7e9
Add leader-readiness test to wallet-sanity
2018-10-25 14:58:51 -06:00
e47fcb196b
s/solana_program_interface/solana[_-]sdk/g
2018-10-25 12:31:45 -07:00
af8a36b7fb
Exclude chacha_cuda when chacha is disabled
2018-10-24 17:02:46 -07:00
208e7d7943
Explicitly reject transactions larger than PACKET_SIZE
2018-10-24 15:34:27 -07:00
61927e1941
Fix compile error for write_entries
...
Takes a reference now.
2018-10-24 11:31:30 -07:00
2f2531d921
Add retries to Wallet deploy
2018-10-24 11:13:32 -06:00
d5f20980eb
Incorporate preloaded bpf loader
2018-10-24 11:13:32 -06:00
21eae981f9
Add deploy method to solana-wallet
2018-10-24 11:13:32 -06:00
ead7f4287a
Storage mining fixups...
...
* Use IV to make unique identies
* Use hex! macro for hex literal and not string converted to u8 slice
* fix sha sampling to control init/end of sha state
2018-10-24 09:58:41 -07:00
3b33150cfb
Bump drone read timeout to 10s
...
The previous timeout of 3s was not generous enough occasionally
2018-10-24 08:52:41 -07:00
5c483c9928
remove unused variable
2018-10-23 16:52:56 -06:00
Greg Fitzgerald
Rob Walker
Michael Vines
carllin
jackcmay
Anatoly Yakovenko
Sagar Dhawan
Sathish
Stephen Akridge
anatoly yakovenko
Tyera Eulberg
Pankaj Garg