73b9ee9e84
Add solana_ prefix to native_loader program
...
This allows its logging to show up in the default RUST_LOG=solana=info
log setting
2018-12-08 11:04:45 -08:00
0a83b17cdd
Upgrade to Rust 1.31.0 ( #2052 )
...
* Upgrade to Rust 1.31.0
* Upgrade nightly
* Fix all clippy warnings
* Revert relaxed version check and update
2018-12-07 20:01:28 -07:00
571522e738
Update jsonrpc version
2018-12-07 17:47:54 -07:00
3441d3399b
Replicator rework
...
* Move more of the replicator logic into the replicator class
* Add support for the RPC interface to query the storage last_id value
that the replicator would sign and use to pick a block.
* Fix replicator connecting to gossip and change test to exercise that
scenario.
2018-12-07 15:20:36 -08:00
f4b26247c0
Genesis only needs a keypair, not the entire fullnode::Config
2018-12-06 16:31:24 -08:00
c4b8f0cd2f
bench-tps will now generate an ephemeral identity if not provided with one
...
Also simplify scripts as a result
2018-12-06 16:30:48 -08:00
97b1156a7a
Rename Ncp to GossipService
...
And BroadcastStage to BroadcastService since it's not included in the
TPU pipeline.
2018-12-06 15:48:19 -07:00
cc2f448d92
Add fullnode --no-leader-rotation flag
2018-12-06 11:30:19 -08:00
632425c7d7
Move native_loader under programs/native/
2018-12-05 14:32:42 -08:00
ad3e36a7ab
Bump rand from 0.5.5 to 0.6.1 ( #1891 )
...
* Bump rand from 0.5.5 to 0.6.1
Bumps [rand](https://github.com/rust-random/rand ) from 0.5.5 to 0.6.1.
- [Release notes](https://github.com/rust-random/rand/releases )
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-random/rand/commits )
Signed-off-by: dependabot[bot] <support@dependabot.com>
* Fix conflicts and deprecated usages
* Fix benches
2018-12-05 14:12:10 -08:00
1bcafca690
Find test_tx again
2018-12-05 13:29:29 -08:00
e21b6d9db3
ensure we'd actually have N hashes per tick ( #2011 )
2018-12-05 12:49:41 -08:00
9c30bddb88
Rocks db erasure decoding ( #1900 )
...
* Change erasure to consume new RocksDb window
* Change tests for erasure
* Remove erasure from window
* Integrate erasure decoding back into window
* Remove corrupted blobs from ledger
* Replace Erasure result with result module's Result
2018-12-05 12:47:19 -08:00
59e6bd115e
system_program must be a static lib as it allocates Account memory
2018-12-05 10:49:06 -08:00
15aef079e3
Include builtin programs for ledger verification
2018-12-05 10:49:06 -08:00
42689d4842
cargo fmt
2018-12-05 10:49:06 -08:00
214ed3667c
Move system_transaction out of src/
2018-12-05 10:49:06 -08:00
122627dda2
Move loader_transaction out of src/
2018-12-05 10:49:06 -08:00
7af95eadcc
Move vote_transaction out of src/
2018-12-05 10:49:06 -08:00
9ee858a00c
Move budget_program out of src/
2018-12-05 10:49:06 -08:00
27d456bf93
Move storage_program out of src/
2018-12-05 10:49:06 -08:00
ea6e042a6f
Move vote_program out of src/
2018-12-05 10:49:06 -08:00
a594f56c02
Add token_program.rs to sdk/
2018-12-05 10:49:06 -08:00
e6fa74fe69
Remove custom Error enum, just use ProgramError
2018-12-05 10:49:06 -08:00
9a4f8199d6
Move system_program out of src/
2018-12-05 10:49:06 -08:00
ae0be1e857
Remove bpf_loader.rs
2018-12-05 10:49:06 -08:00
d010cac8a5
Remove token_program.rs
2018-12-05 10:49:06 -08:00
63a758508a
Add sdk native_loader.rs
2018-12-05 10:49:06 -08:00
c1c2f1f0a9
Cleanup ad-hoc rpc address formation
...
Lots of places where we are forming rpc addresses.
2018-12-03 18:13:55 -08:00
777a0a858e
Move ProgramError into sdk/
2018-12-03 13:50:00 -08:00
68e99c18c0
Remove duplicate SYSTEM_PROGRAM_ID
2018-12-03 13:50:00 -08:00
c99f93e40a
Remove signature.rs indirection
2018-12-03 13:50:00 -08:00
4ae58cc854
Change range of leader scheduler to match current broadcasts ( #1920 )
2018-12-03 00:10:43 -08:00
b21facab7b
Add metrics for prune messages ( #1981 )
2018-12-01 14:05:40 -08:00
34c3a0cc1f
Add signature verification to gossip ( #1937 )
2018-12-01 12:00:30 -08:00
549bfe7412
Vote signing JSON RPC service ( #1965 )
...
* Vote signing JSON RPC service
- barebone service that listens for RPC requests
* Daemon for vote signer service
* Add request APIs for JSON RPC
* Cleanup of cargo dependencies
* Fix compiler error
2018-11-30 15:07:08 -08:00
3ca826a480
re-enable test_tpu_forwarder ( #1964 )
2018-11-30 13:52:37 -08:00
bad0b55ab6
Expose which keys signed the Transaction in the SDK
2018-11-30 08:16:23 -08:00
0878bd53d9
Delete stub src/transaction.rs
2018-11-29 23:07:57 -08:00
de910e1169
Make test_pubkey_distribution faster
...
multi-thread pubkey histogram generation.
2018-11-29 17:37:37 -08:00
9684737de7
Add wait before checking confirm again
...
Otherwise we can quickly check that we
have no signature 4 times in a row.
2018-11-29 15:32:58 -08:00
ecc87ab1aa
Add a an optional timeout to thin_client
...
Such that a negative test like test_transaction_count doesn't
have to wait num_retries * default_timeout.
2018-11-29 13:53:40 -08:00
fa359c6fc4
Merge vote new and register transactions
2018-11-29 12:31:34 -08:00
8cc751d1cc
Improve RPC service startup error messages with actual error
...
Error always fixed to message about ports but that's not the only
error that can occur.
2018-11-29 11:39:42 -08:00
978fd6858f
Move replicator_startup_test to integration test set
...
Sometimes fails when run multithreaded with other tests.
2018-11-29 11:39:42 -08:00
41689256c6
Ensure key[0] is signed
2018-11-29 10:26:46 -08:00
194e3100a9
Additional checks in test_bank_checkpoint_zero_balance ( #1943 )
2018-11-28 12:40:34 -08:00
8ad4464d4b
add tests for other "from" indexes signing (or not)
2018-11-28 07:56:04 -08:00
e7b0a736f5
verify signature is on the from account
2018-11-28 07:56:04 -08:00
167eb01735
optimize bench-tps and rpc_request to work on crappy WSL boxes
2018-11-27 22:45:08 -08:00
8fb5d72b13
Make insufficient tokens message more helpful
2018-11-27 17:37:25 -08:00
8947c5a4aa
Set account to default if the balance reaches 0 in a checkpoint bank ( #1932 )
...
Fixes : #1931
2018-11-27 14:17:29 -08:00
a7562c9be1
Extract execute_transaction() from the bank
2018-11-27 12:35:52 -07:00
08dc169f94
Hoist load_loaders()
...
This makes execute_transactions() stateless.
2018-11-27 12:35:52 -07:00
f549d8ac74
Hoist loading of loaders
...
This might cause a TPS boost in batched BPF transactions, since
now it'll only clone its account once per transaction instead of
once per instruction.
2018-11-27 12:35:52 -07:00
1ac7536286
Pass executable_accounts into with_subset()
2018-11-27 12:35:52 -07:00
88e270723f
Move markdown book out of src/
2018-11-26 09:44:19 -08:00
a13e25f083
Ignore flaky test_tpu_forwarder
2018-11-26 09:27:21 -08:00
3d3a30e200
Fix mdbook test
2018-11-26 07:51:10 -08:00
76b83ac0f4
Move testnet demos into the book
...
Have git readme focus on fullnode development and the book focus on
users.
2018-11-26 07:51:10 -08:00
903a9bfd05
s/contract/program/
2018-11-26 08:20:42 -07:00
655ee1a64b
Fix typos
2018-11-26 08:20:42 -07:00
e0e6c3fdb2
Extract execute_instruction() to seed new runtime module
...
Fixes #1528
2018-11-26 08:20:42 -07:00
31f00974f2
Hoist the lookup of executable accounts
2018-11-26 08:20:42 -07:00
c3218bb9c2
Hoist tick_height
2018-11-26 08:20:42 -07:00
d2972024de
Uppercase acronyms
...
Looks like there will be very little Rust code in the markdown book
so switching back to English capitalization conventions.
2018-11-25 22:58:07 -07:00
dc0a2ca656
Move disclaimer down a bit
...
Odd to see a disclaimer before knowing anything about what you're reading
2018-11-25 20:27:35 -07:00
c3fb9d5549
Cleanup book ( #1904 )
...
* Cleanup book
* Distinguish upstream from downstream validators
* Add BroadcastStage to Fullnode/Tpu diagrams
* First attempt to re-describe the runtime
* Reorg book
Push back details of the fullnode implementation
2018-11-25 16:58:38 -07:00
f5b5c54d7d
Update condition for nosigverify ( #1903 )
2018-11-25 13:11:07 -08:00
9f0b06bb86
Filter out leader node while retransmitting blobs ( #1894 )
2018-11-24 20:33:49 -08:00
57a384d6a0
Rocks db window service ( #1888 )
...
* Add db_window module for windowing functions from RocksDb
* Replace window with db_window functions in window_service
* Fix tests
* Make note of change in db_window
* Create RocksDb ledger in bin/fullnode
* Make db_ledger functions generic
* Add db_ledger to bin/replicator
2018-11-24 19:32:33 -08:00
69802e141f
Add the story of how this codebase came to be
2018-11-24 14:39:53 -07:00
6fc02b7424
Detect legacy programs upfront
2018-11-24 11:56:51 -07:00
30cdd85028
Implement the same interface in all builtin programs
2018-11-24 11:56:51 -07:00
871dd47019
Extract the part of execute_instruction that should only return a ProgramError
...
TODO: hoist load_executable_accounts() and then change
process_instruction() to return ProgramError.
2018-11-24 11:56:51 -07:00
37f8dd57e2
Extract ProgramError from BankError
2018-11-24 11:56:51 -07:00
f827bfd83f
Remove instruction index parameter
2018-11-24 11:56:51 -07:00
b3af930153
Rename process_transaction to process_instruction
2018-11-24 11:56:51 -07:00
cd488b7d07
Hoist program static methods to top-level functions
2018-11-24 11:56:51 -07:00
e2373ff51a
add nosigverify command line option to ease debug
2018-11-23 16:55:04 -08:00
b3d2c900cd
Rename BudgetState to BudgetProgram
2018-11-23 13:25:17 -07:00
d5adec20a3
get_ip_addr: Fall back to loopback if no better option exists
2018-11-23 13:24:41 -05:00
942256a647
Add db_ledger benchmarks ( #1875 )
...
* Add db_ledger benchmarks
* ignore benches in CI, due to timeouts
2018-11-23 06:12:43 -08:00
a3321a5d80
Fix endianess in db_ledger to account for the default byte-comparator used by Rocksdb ( #1885 )
2018-11-22 01:35:19 -08:00
521de13571
Add maximum repair length to db_window ( #1886 )
...
* Add maximum repair length to db_window
2018-11-21 23:44:49 -08:00
3abf6a8a30
Reorg the markdown book to cater to app devs
...
First, talk about how a client interacts with Solana to do useful
things. Then describe how the fullnode you're talking to works and
why it's so very fast. Last, why that fullnode you don't trust
does what you asked it to anyway.
2018-11-21 15:49:57 -08:00
59163e2dd9
Optimize some CI stuff ( #1880 )
...
* CI Optimizations
2018-11-21 12:16:16 -08:00
d9dabdfc74
Rocks db window utils ( #1851 )
...
* Implement new ledger module based on RocksDb
* Add db_window module for windowing functions from RocksDb
2018-11-19 23:20:18 -08:00
6b910d1bd4
add tpu_forwarding, simplify ClusterInfo::new() from Result<Self> to Self
2018-11-19 20:45:49 -08:00
bbd9ea8c00
Delete settings.rs.foo
2018-11-19 13:39:08 -08:00
fc67a968e8
Use known keys in the unit test to avoid random false positives.
2018-11-19 13:41:24 -07:00
3d113611cc
remove Result<> return from ClusterInfo::new() ( #1869 )
...
strip Result<> for ClusterInfo::new()
2018-11-19 11:25:14 -08:00
07667771ef
Fix Gossip Pushes going to invalid addresses ( #1858 )
2018-11-17 19:57:28 -08:00
3822c29415
Route program_id to program entrypoint
2018-11-17 19:42:03 -08:00
ff386d6585
Add disclaimer to markdown book
...
copy-paste from readme
2018-11-17 19:56:08 -07:00
88ddb31477
teminology cleanup: leader slots and voting rounds
2018-11-17 18:56:13 -07:00
077d1a41f1
Add too book
2018-11-17 18:56:13 -07:00
857ab8662e
backticks and missing variable descriptions
2018-11-17 18:56:13 -07:00
a17f9bd0f4
Work towards adding leader rotation to the book
2018-11-17 18:56:13 -07:00
f4b9e93b11
Migrate storage RFC to book
2018-11-17 18:55:08 -07:00
2c11bf2e66
Various book cleanup
...
* Merge Leader and Validator diagrams
* New sdk-tools diagram
* Move terminology to just after introduction
* Purge use of LAMPORT as an acronym
* Add notes about persistent storage
2018-11-17 17:50:29 -08:00
719e14b30a
Add an explicit state of a reserved signature
...
An RPC client that fetches the signature status before the bank finishes
executing the corresponding Transaction should receive SignatureNotFound
instead of Confirmed
2018-11-17 16:40:23 -08:00
d1f01b5209
Fix clippy lint
2018-11-17 15:54:21 -08:00
d96a6b42a5
Move drone into its own crate
2018-11-16 20:42:21 -08:00
cf95708c18
Set drone address to always be the initial network entry point ( #1847 )
...
* Set drone address to always be the initial network entry point, so that even when leaders rotate the client can still find the drone
* Extract drone address as a separate argument to bench-tps
* Add drone port to client.sh instead of setting it in bench-tps
* Add drone entrypoint to scripts
* Fix build error
2018-11-16 19:56:26 -08:00
e1c7b99450
Accounts get kicked if no tokens
2018-11-16 18:53:37 -08:00
12ae7b9a6b
Add test for tvu POH verification ( #1844 )
2018-11-16 15:48:10 -08:00
6ac5700f2e
Move metrics into its own crate
2018-11-16 15:10:07 -08:00
a0dd8617be
Remove airdrop from fullnode
2018-11-16 13:25:55 -08:00
1576072edb
remove spurious eprintln!()
2018-11-16 10:21:58 -08:00
03d206a7ca
Check for valid tvu, not tpu in broadcast ( #1836 )
2018-11-15 23:30:22 -08:00
c973de1d76
Decouple log and metrics rate ( #1839 )
...
Use separate env for log and metrics rate.
Set default log level to WARN if unset.
2018-11-15 22:27:16 -08:00
71336965a6
Limit targets to 4 in bench-tps
...
Transaction got bigger so can only fit 4 targets in a
Transaction now.
2018-11-15 20:25:07 -08:00
e791d0f74d
Drone now returns signed airdrop transactions
2018-11-15 17:13:13 -08:00
3543a9a49f
Add check for missing signature with fee'ed transaction
...
And update fetch-perf-libs version
2018-11-15 16:23:13 -08:00
7dd198a99e
Change signed_key to index into account_keys
...
If index is within the signed keys range.
2018-11-15 16:23:13 -08:00
e048116ab2
Remove signed_keys
...
Use first signatures.len() of account_keys for signing
2018-11-15 16:23:13 -08:00
cda9ad8565
Multiple signatures for transactions
...
With multiple instructions in a TX may need
multiple signatures.
Fixes #1531
2018-11-15 16:23:13 -08:00
928f375683
Rocks db ( #1792 )
...
* Add rocksdb crate
* Implement new ledger module based on RocksDb
2018-11-15 15:53:31 -08:00
d3e521f70e
accept other socket errors, ignore unless out of tries ( #1835 )
2018-11-15 15:49:37 -08:00
a7ee428214
Fix build
2018-11-15 14:06:57 -08:00
a41254e18c
Add scalable gossip library ( #1546 )
...
* Cluster Replicated Data Store
Separate the data storage and merge strategy from the network IO boundary.
Implement an eager push overlay for transporting recent messages.
Simulation shows fast convergence with 20k nodes.
2018-11-15 13:23:26 -08:00
c81a3f6ced
Fix RPC address clashes on local multi-node testnet ( #1821 )
...
* Fix RPC address clashes on local multi-node testnet
2018-11-15 10:42:02 -08:00
a5412fc0cd
Fix find port functions
2018-11-15 10:45:39 -07:00
5a8938209b
Expose tick_height to native programs
2018-11-14 10:33:27 -08:00
e33f3a2562
Publish expected native program entrypoint in sdk/
2018-11-14 10:33:27 -08:00
9fe210c454
Add host information to db entries ( #1778 )
...
Add new field to each db entry identifying the host
that it originated from.
2018-11-13 21:54:15 -08:00
e7b6c8b7e0
Accounts get kicked if no tokens
2018-11-13 17:23:13 -08:00
4e553ea095
test_replicate fails locally, ignore
2018-11-13 17:13:25 -08:00
0c46f15f94
test_rpc_new fails locally, ignore for now
2018-11-13 17:12:25 -08:00
7b92497d21
Update counters irrespective of logging level ( #1799 )
2018-11-13 16:55:14 -08:00
729d28d910
Add poh verification before processing entries
...
- Replicate stage now verifies entries delivered
by the window
- Minor refactor of entries_from_blobs
2018-11-13 14:17:00 -08:00
6335be803c
Broadcast last tick before leader rotation ( #1766 )
...
* Broadcast last tick before leader rotation to everybody on network
* Add test
* Refactor broadcast
2018-11-13 02:21:37 -08:00
a77b1ff767
Revert "Migrate from ring to ed25519-dalek" ( #1798 )
...
* Revert "Migrate from ring to ed25519-dalek"
This reverts commit 7c610b216b
2018-11-12 22:34:43 -08:00
c7a67b5a02
Add deploy command to test
2018-11-12 18:21:16 -07:00
0e749dad4c
Use cluster_info to get rpc address
2018-11-12 18:21:16 -07:00
fa72160c95
add last_id to Entry, PohEntry ( #1783 )
...
add prev_id to Entry, PohEntry
2018-11-12 17:03:23 -08:00
126f065cc9
Extract complex loop from execute_instruction
2018-11-12 14:47:23 -08:00
4d98da44e3
Fix possibility of a vote error breaking ledger ( #1768 )
...
* Fix possibility of a vote error breaking ledger
* Add test
2018-11-12 11:40:32 -08:00
522876c808
Rename Account.program_id to Account.owner
2018-11-12 10:59:01 -08:00
7d05cc8c5d
Add missing account fields
2018-11-12 10:59:01 -08:00
49f4be6a2b
codemod --extensions rs loader_program_id loader
2018-11-12 10:59:01 -08:00
5fce8d2ce1
Don't ignore VoteProgram errors
2018-11-11 22:18:06 -07:00
2696b22348
Cleanup TVU diagram
2018-11-11 20:55:21 -08:00
5df4754579
Don't call instructions transactions
2018-11-11 20:07:15 -08:00
a00284c727
Remove userdata diff and make helper fn
2018-11-11 18:57:28 -07:00
3832602ec4
Move notifications after store_accounts
2018-11-11 18:57:28 -07:00
fea86b2955
No longer serialize as JSON-encoded pkcs8
...
That's supposed to be an ASCII format, but we're not making use
of it. We can switch back to that some day, but if we do, it shouldn't
be JSON-encoded.
2018-11-11 09:22:52 -07:00
7c610b216b
Migrate from ring to ed25519-dalek
...
Why?
* Pure Rust, no BoringSSL (or OpenSSL) dependency
* Those avx2 benchmarks
* ring includes far more than what we need
* ring author won't add release tags: https://github.com/briansmith/ring#versioning--stability
2018-11-11 09:22:52 -07:00
cdf1a96e23
Revert "V1 Window/Ledger based on RocksDb ( #1712 )"
...
This reverts commit bfcdec95cb
2018-11-09 20:25:53 -07:00
bfcdec95cb
V1 Window/Ledger based on RocksDb ( #1712 )
...
* Add rocksdb
* Implement new ledger module based on RocksDb
2018-11-09 18:30:26 -08:00
fc55835932
Revert "Boot rpc_port"
...
This reverts commit 1984b6db06dae4f6b655b9076e657e389d786105.
2018-11-09 17:52:10 -07:00
3772910bf2
Boot rpc_port
2018-11-09 17:52:10 -07:00
24379c14dc
Fix clippy warnings
2018-11-09 17:52:10 -07:00
23846bcf1c
Don't require a cluster to query for one's own pubkey
2018-11-09 17:52:10 -07:00
9dd0a6e6a7
Boot drone_addr and rpc_addr from config
...
WalletConfig is intended for the validated command-line input.
2018-11-09 17:52:10 -07:00
5ca473ac2d
Don't get the network from parse_args
2018-11-09 17:52:10 -07:00
f5827d4a83
Fix typo
2018-11-08 17:15:48 -07:00
b0f8a983c4
Add the solana-wallet documentation ( #1744 )
...
* Add the solana-wallet documentation
There doesn't seem to be a way to publish bin docs to crates.io.
Until there is, we can include CLI documentation is the appendix
of the markdown book.
* A command to generate all the usage docs
Usage:
$ scripts/wallet-help.sh >> src/wallet.md
2018-11-08 15:42:20 -07:00
d831c5dcc9
remove dead poh code ( #1747 )
2018-11-08 12:55:23 -08:00
ce474eaf54
Better titles for tpu and tvu
2018-11-08 11:33:52 -07:00
0da1c06b15
Add disk to the hardware used by both Tpu and Tvu
2018-11-08 11:33:52 -07:00
01edc94a4b
Move description of the Rust flavor of stages to service.rs
2018-11-08 11:33:52 -07:00
f96563c3f2
Add documentation for pipelining
2018-11-08 11:33:52 -07:00
30697f63f1
add support for slots in erasure ( #1736 )
2018-11-08 10:20:03 -08:00
2a6046de8e
Cleanup TVU code to look like its block diagram ( #1737 )
...
* Reorg TVU code to look like TVU diagram
And move channel creation into LedgerWriteStage so that it can
be used in the same was as all the other stages.
* Delete commented out code
2018-11-07 19:25:36 -07:00
43bd28cdfa
Add loader_ prefix to LoaderTransaction methods
2018-11-07 15:06:38 -07:00
6c10458b5b
leader slots in Blobs ( #1732 )
...
* add leader slot to Blobs
* remove get_X() methods in favor of X() methods for Blob
* add slot to get_scheduled_leader()
2018-11-07 13:18:14 -08:00
7780d9bab8
Add ledger write and storage stage to TVU documentation
2018-11-07 12:07:12 -08:00
038a46b5ef
Integrate the markdown book into the codebase
...
This implies that the book should describe exactly what is implemented,
and will not lead the way and eventually bitrot as the RFCs do.
2018-11-07 10:58:47 -07:00
8be7c13d2d
Stub out architecture book ( #1674 )
...
* Stub out architecture documentation
* Add book HTML generation and book tests to CI
* Add heading
* Better table of contents
* Reference existing documentation
Move ASCII art from code comments into rendered SVG
* Attempt to fix CI
* Add lamport docs
And truncate lines to 80 characters
* Fix links
And reference shorter, newer description of PoH.
* Replace ASCII art with SVG
* Streamline for Pillbox
* Update path before optional install
* Use $CARGO_HOME instead of $HOME
* Delete code
Attempt to describe all data structures without code.
* Boot RPU from docs, add JsonRpcService
Also, use Rust naming conventions in the block diagrams to
minimize the jump from docs to code.
* Latest code uses tick_height
* Rename bob/ folder to art/
A home for any ASCII art
* Import JSON RPC API
* More mdbook docs
* Add Ncp
* Cleanup links
* Move pipelining description into fullnode description
* Move high-level transaction docs into top-level doc
* Delete unused files
2018-11-06 18:00:58 -07:00
d7ea66b6a1
RPC and Pubsub, bind to 0.0.0.0
2018-11-06 15:45:36 -07:00
371c69d425
Add ledger write stage counters ( #1713 )
2018-11-06 14:44:54 -08:00
9b43b00d5c
remove tick_count, leader_scheduler, from broadcast code ( #1725 )
2018-11-06 13:17:41 -08:00
76694bfcf4
remove entry_writer.rs ( #1720 )
2018-11-06 12:42:31 -08:00
bfad138bb3
Pass any serializable to Transaction constructor
2018-11-06 11:23:59 -07:00
54968b59bb
Update last_id between client retries
...
Fixes #1694
2018-11-06 09:06:15 -07:00
f683817b48
Remove RPU; replace with RPC
2018-11-05 20:30:47 -07:00
22abc27be4
add tests for bank.purge() ( #1711 )
2018-11-05 16:43:27 -08:00
c9138f964b
Change token type from i64 to u64
...
Fixes #1526
2018-11-05 15:25:26 -07:00
1fbf1d2cf2
Add checkpoint, rollback to to bank ( #1662 )
...
add linked-list capability to accounts
change accounts from a linked list to a VecDeque
add checkpoint and rollback for lastids
add subscriber notifications for rollbacks
checkpoint transaction count, too
2018-11-05 09:47:41 -08:00
1d7722043f
genesis has 3 entries now
2018-11-02 22:02:13 -07:00
95f9488a70
use default buffer size for index, use BLOB_DATA_SIZE for data buffer ( #1693 )
2018-11-02 21:52:57 -07:00
e7cbbd8d45
cargo fmt
2018-11-02 19:54:49 -07:00
c8c255ad73
Rename Budget to BudgetExpr
2018-11-02 19:54:49 -07:00
a264f8fa9b
Fix |cargo test|
2018-11-02 19:04:59 -07:00
40e945b0c8
Move token_program from src/ to programs/native/
2018-11-02 18:13:02 -07:00
0636399b7a
Compute finality computation in new ComputeLeaderFinalityService ( #1652 )
...
* Move finality computation into a service run from the banking stage, ComputeLeaderFinalityService
* Change last ids nth to tick height, remove separate tick height from bank
2018-11-02 15:49:14 -07:00
298bd6479a
Add first leader to genesis ( #1681 )
...
* Add first leader to genesis entries, consume in genesis.sh
* Set bootstrap leader in the bank on startup, remove instantiation of bootstrap leader from bin/fullnode
* Remove need to initialize bootstrap leader in leader_scheduler, now can be read from genesis entries
* Add separate interface new_with_leader() in mint for creating genesis leader entries
2018-11-02 14:32:05 -07:00
879431ebcd
Add timeout to TcpStream connect, and rename test
2018-11-01 14:13:19 -06:00
af1283e92c
Improve airdrop confirmation logic
2018-11-01 11:28:33 -06:00
dffa2eb04f
Do not parallelize deserialize operation ( #1663 )
...
Deserialize operations are faster when done serially with the
MT banking stage and helps with performance improvement with
reduced thread context switches.
2018-10-31 22:12:15 -07:00
00889c5139
Fix bad function arguments ( #1682 )
2018-10-31 19:55:58 -07:00
af8dc3fd83
Fix snap build
...
cuda and chacha features required for chacha_cuda
2018-10-31 17:59:31 -07:00
ba884b4e36
Add thin client test for vote functionality, fix sizing errors in vote contract ( #1643 )
...
* Added tests to thin client to test VoteContract calls, fix VoteContract sizing errors
* Calculate upper bound on VoteProgram size at runtime, add test for serializing/deserializing a max sized VoteProgram state
2018-10-31 17:47:50 -07:00
6ddd494826
Improve rpc logging
2018-10-31 15:21:55 -06:00
aa2fd3f3bb
Storage RFC grammar
2018-10-31 13:44:21 -07:00
cf00354f42
Add storage stage which does storage mining verification for validators
2018-10-31 13:44:21 -07:00
47f1fa3f2e
Remove purging of leader id from cluster info ( #1642 )
2018-10-31 12:30:48 -07:00
74b4ecb7f3
Upgrade to influx_db_client@0.3.6
2018-10-30 19:44:09 -07:00
8d16f69bb9
Improve account subscribe/unsubscribe logging
2018-10-30 12:03:35 -07:00
3a73a09391
Avoid panicking when a native library doesn't exist
2018-10-30 12:03:35 -07:00
009c71f7e2
Demote info logs
2018-10-30 12:03:35 -07:00
073d39df44
Add solana_ prefix to loaders so their logs appear in the default RUST_LOG config
2018-10-30 12:03:35 -07:00
ae7222f0df
Work around influxdb panic
2018-10-30 12:03:35 -07:00
13bfdde228
remove ledger tail code, WINDOW_SIZE begone ( #1617 )
...
* remove WINDOW_SIZE, use window.window_size()
* move ledger tail, redundant with ledger-based repair
2018-10-30 10:05:18 -07:00
be003970b7
Program_ids were overlapping ( #1626 )
...
Program_ids were overlapping
2018-10-26 19:44:53 -07:00
b28fbfa13e
Use a smaller test value for window_size
...
Otherwise this test takes forever to run.
2018-10-26 11:38:55 -07:00
07c656093c
Remove tictactoe programs
2018-10-25 21:22:07 -07:00
c9e8346e6a
cargo fmt
2018-10-25 17:24:24 -07:00
236113e417
cargo fmt
2018-10-25 17:13:41 -07:00
f6c8e1a4bf
Vote contract ( #1552 )
...
* Add Vote Contract
* Move ownership of LeaderScheduler from Fullnode to the bank
* Modified ReplicateStage to consume leader information from bank
* Restart RPC Services in Leader To Validator Transition
* Make VoteContract Context Free
* Remove voting from ClusterInfo and Tpu
* Remove dependency on ActiveValidators in LeaderScheduler
* Switch VoteContract to have two steps 1) Register 2) Vote. Change thin client to create + register a voting account on fullnode startup
* Remove check in leader_to_validator transition for unique references to bank, b/c jsonrpc service and rpcpubsub hold references through jsonhttpserver
2018-10-25 16:58:40 -07:00
55833e20b1
Create Poh Service ( #1604 )
...
* Create new Poh Service, replace tick generation in BankingStage
2018-10-25 14:56:21 -07:00
02cfa76916
Plumb GetTransactionCount through solana-wallet
2018-10-25 14:58:51 -06:00
9314eea7e9
Add leader-readiness test to wallet-sanity
2018-10-25 14:58:51 -06:00
e47fcb196b
s/solana_program_interface/solana[_-]sdk/g
2018-10-25 12:31:45 -07:00
af8a36b7fb
Exclude chacha_cuda when chacha is disabled
2018-10-24 17:02:46 -07:00
208e7d7943
Explicitly reject transactions larger than PACKET_SIZE
2018-10-24 15:34:27 -07:00
61927e1941
Fix compile error for write_entries
...
Takes a reference now.
2018-10-24 11:31:30 -07:00
2f2531d921
Add retries to Wallet deploy
2018-10-24 11:13:32 -06:00
d5f20980eb
Incorporate preloaded bpf loader
2018-10-24 11:13:32 -06:00
21eae981f9
Add deploy method to solana-wallet
2018-10-24 11:13:32 -06:00
ead7f4287a
Storage mining fixups...
...
* Use IV to make unique identies
* Use hex! macro for hex literal and not string converted to u8 slice
* fix sha sampling to control init/end of sha state
2018-10-24 09:58:41 -07:00
3b33150cfb
Bump drone read timeout to 10s
...
The previous timeout of 3s was not generous enough occasionally
2018-10-24 08:52:41 -07:00
5c483c9928
remove unused variable
2018-10-23 16:52:56 -06:00
a68c99d782
Fix transaction count on testnet dashboard
2018-10-23 16:52:56 -06:00
5ca52d785c
Preload BPF loader ( #1573 )
...
Preload BPF loader
2018-10-23 14:44:41 -07:00
8d9912b4e2
Move ledger write to its own stage ( #1577 )
...
* Move ledger write to its own stage
- Also, rename write_stage to leader_vote_stage, as write functionality
is moved to a different stage
* Address review comments
* Fix leader rotation test failure
* address review comments
2018-10-23 14:42:48 -07:00
7977b97227
Surface AccountInUse to JSON RPC users so they know to retry the transaction
2018-10-23 13:55:30 -07:00
4f34822900
Improve logging on various error conditions
2018-10-23 13:40:59 -07:00
bbb38ac106
Increase window size ( #1578 )
...
Addresses the following problem
- Validators are not able to keep up with the leader
- The future blobs (outside of window) get dropped
- The validators won't process repair requests for these future blobs
2018-10-23 10:25:01 -07:00
45cfa5b574
Add instruction to transfer account ownership
2018-10-20 21:54:25 -05:00
df9ccce5b2
Remove hostname() from calls to metrics as it's expensive operation ( #1557 )
2018-10-20 06:38:20 -07:00
f8516b677a
Load program data in chunks ( #1556 )
...
Load program data in chunks
2018-10-19 18:28:38 -07:00
26b99d3f85
Ensure witness and timestamp keys are signed
...
Before this patch, an attacker could point Budget instructions to
unsigned keys, and authorize a transaction from an unauthorized
party.
2018-10-19 10:06:59 -06:00
2f9c0d1d9e
Add method to lookup signed keys
2018-10-19 10:06:59 -06:00
0bd1412562
Switch leader scheduler to use PoH ticks instead of Entry height ( #1519 )
...
* Add PoH height to process_ledger()
* Moved broadcast_stage Leader Scheduling logic to use Poh height instead of entry_height
* Moved LeaderScheduler logic to PoH in ReplicateStage
* Fix Leader scheduling tests to use PoH instead of entry height
* Change is_leader detection in repair() to use PoH instead of entry height
* Add tests to LeaderScheduler for new functionality
* fix Entry::new and genesis block PoH counts
* Moved LeaderScheduler to PoH ticks
* Cleanup to resolve PR comments
2018-10-18 22:57:48 -07:00
37a0b7b132
Initial validator code for rust side hooks for chacha cuda parallel encrypt
2018-10-18 13:50:19 -07:00
c30b605047
Actually submit the storage mining proof
...
Get an aidrop so replicator can submit mining transaction
Some other minor type cleanup.
2018-10-18 13:50:19 -07:00
76076d6fad
move last_id age checking into the HashMap
...
* allows for simpler chaining of banks
* looks 1.5-2% faster than looping through a VecDequeue
TODO: remove timestamp()?
2018-10-18 11:07:00 -07:00
0a819ec4e2
Programs were not spawned by SystemProgram ( #1533 )
...
* SystemProgram spawns programs
2018-10-18 10:33:30 -07:00
57a717056e
Delegate accounts now record the original approved amount
2018-10-18 08:53:25 -07:00
856c48541f
Restore elaborate attack
...
The test is showing how you can sneak by verify_plan() but not
verify_signature().
2018-10-18 08:46:02 -06:00
2045091c4f
Add SystemProgram::Move ix to Budget tx
2018-10-18 08:46:02 -06:00
03ac5a6eef
Move all source tokens into Budget account
...
Budget now assumes the source account holds all tokens the program
should spend.
Note: the static guarantees implied by verify_plan() are meaningless
under the new contract engine. The bank no longer calls it. This
serves as a nice example of where comparing code coverage between
integration tests and unit tests would have shown us where a
change rendered unit tests meaningless.
2018-10-18 08:46:02 -06:00
32fadc9c30
Merge debits and credits
...
Debits no longer need to be applied before credits. Instead, we
lock any accounts we'd debit and so error out on the second attempt
to lock the same account.
2018-10-18 08:46:02 -06:00
15a89d4f17
Boot Contract type from Budget
...
In the old bank (before the contract engine), Contract wasn't specific
to Budget. It provided the same service as what is now called
SystemProgram::Move, but without requiring a separate account.
2018-10-18 08:46:02 -06:00
d0f43e9934
consolidate tmp ledgers
2018-10-18 08:45:31 -06:00
31e779d3f2
Added counters to track more metrics on dashboard ( #1535 )
...
- Total number of IP packets TX/RX from all nodes in the testnet
- Last consumed index on validator
- Last transmitted index on leader
2018-10-17 17:32:50 -07:00
639c93460a
Write stage optimizations ( #1534 )
...
- Testnet dashboard shows that channel pressure for write stage
is incrementing on every iteration of write.
- This change optimizes ledger writing by removing cloning of map
and reducing calls to flush
2018-10-17 13:02:32 -07:00
Michael Vines
Greg Fitzgerald
Tyera Eulberg
Stephen Akridge
dependabot[bot]
Rob Walker
carllin
Sagar Dhawan
Pankaj Garg
Sathish
jackcmay
Anatoly Yakovenko
anatoly yakovenko