fa4608a95d
Change leader rotation time to a multiple of ticks per block ( #2414 )
...
* Change leader rotation time to a multiple of ticks per block
* fix component dependencies
* review comments
2019-01-15 12:07:58 -08:00
022a97da99
revert revert of kill window ( #2427 )
...
* remove window code from most places
* window used only for testing
* remove unecessary clippy directives
2019-01-15 10:51:53 -08:00
a33c76a456
Remove JsonRpcRequestProcessor dependency
2019-01-14 17:39:31 -08:00
11b1bd278a
Remove unused exit field
2019-01-14 17:39:12 -08:00
e3a96ed3fc
Minor new cleanup
2019-01-14 16:04:29 -08:00
447243f994
Revert "remove window code from most places" ( #2417 )
...
* Revert "Fix link to book in Local Testnet section (#2416 )"
This reverts commit 710c0c9980#2413 )"
This reverts commit f0300c1711#2389 )"
This reverts commit e3c0bd5a3f
2019-01-14 15:11:18 -08:00
f0300c1711
Add current leader information to dashboard ( #2413 )
2019-01-14 14:20:05 -08:00
e3c0bd5a3f
remove window code from most places ( #2389 )
...
* remove window code from most places
* window used only for testing
* remove unecessary clippy directives
2019-01-14 12:11:55 -08:00
8af61f561b
Improve Wallet coverage ( #2385 )
...
* Add trait for RpcRequestHandler trait for RpcClient and add MockRpcClient for unit tests
* Add request_airdrop integration test
* Add timestamp_tx, witness_tx, and cancel_tx to wallet integration tests; add wallet integration tests to test-stable
* Add test cases
* Ignore plentiful sleeps in unit tests
2019-01-14 00:10:03 -07:00
74e503da92
Hold an accounts_db read lock as briefly as possible to avoid deadlocking
2019-01-13 21:49:09 -08:00
9328ee4f63
Revert "Revert "Delete unused code and its tests""
...
This reverts commit d6b3991d49
2019-01-11 14:54:17 -07:00
d7594b19fc
Implemented a trait for vote signer service ( #2386 )
...
* Implemented a trait for vote signer service
* removes need for RPC in unit tests for vote signing
* fix build errors
* address some review comments
2019-01-11 12:58:31 -08:00
d6b3991d49
Revert "Delete unused code and its tests"
...
This reverts commit e713ba06f1
2019-01-11 07:30:28 -08:00
e713ba06f1
Delete unused code and its tests
2019-01-10 23:19:38 -07:00
7341298a11
Cleanup tpu forwarder ( #2377 )
...
* Use unwrap() on locks
An error there generally indicates a programmer error, not a
runtime error, so a detailed runtime message is not generally useful.
* Only clone Arcs when passing them across thread boundaries
* Cleanup TPU forwarder
By separating the query from the update, all the branches get easier to
test. Also, the update operation gets so simple, that we see it
belongs over in packet.rs.
* Thanks clippy
cute
2019-01-10 13:34:48 -07:00
885fe38c01
Move BloomHashIndex into its own module
...
This trait is for bloom, not crds.
Slightly better would be to put it in the SDK so that the trait
implementations could go into hash and pubkey, but if we don't
want compatibility constraints, this is the next best thing.
2019-01-10 10:22:16 -08:00
2dbe8fc1a9
Refactor vote signer code ( #2368 )
...
* Refactor vote signer code
* fixed test compilation errors
* address clippy errors
* fix missing macro_use
* move macro use
* review comments
2019-01-10 09:21:38 -08:00
7122139e12
Rewrite TPU forwarder test ( #2344 )
2019-01-10 13:50:28 +05:30
4e6c03c9da
Avoid holding a read lock during IO
2019-01-10 00:34:50 -07:00
0c90e1eff6
Make entry_sender optional on window_service
...
window_service in replicator has no need to consume the the produced entries.
2019-01-09 15:15:47 -08:00
491bca5e4b
Remove ledger.rs
...
Split into entry.rs for entry-constructing functions and EntrySlice
trait and db_ledger.rs for ledger helper test functions.
2019-01-09 15:15:47 -08:00
ebd676faaa
Rename Block to EntrySlice
2019-01-09 15:15:47 -08:00
045c5e8556
Remove most of the old ledger code
...
Removes LedgerWriter, read_ledger, LedgerWindow
2019-01-09 15:15:47 -08:00
45b4cf2887
Remove store_ledger_stage which is no longer needed
2019-01-09 15:15:47 -08:00
73eca72f14
Switch test to send a repair request to try and download from replicator
...
Removes need for read_ledger in the test and also tests replicator
download path.
2019-01-09 13:24:12 -08:00
94494b64d7
whack commented out, obsolete, superceded test
2019-01-09 11:30:07 -08:00
b648f37b97
encapsulate erasure_cf ( #2349 )
2019-01-09 10:21:55 -08:00
f53810fcd2
Remove unused exit variable
...
The exit variable was only used by a test.
2019-01-08 20:22:31 -08:00
3c6afe7707
Rename get_blob_bytes to read_blobs_bytes
2019-01-08 16:00:39 -08:00
09296e0d71
Fix two storage tests
...
* test_encrypt_files_many_keys_multiple_keys passing
- buffer chunk size unified between single key and multiple key path,
which shouldn't be necessary but can fix later.
* test_encrypt_file_many_keys_bad_key_length passing
2019-01-08 16:00:39 -08:00
4b3d64ec9f
Convert chacha_encrypt_file to work with db_ledger blobs directly
2019-01-08 16:00:39 -08:00
a904e15ecc
enscapsulate data_cf ( #2336 )
...
* enscapsulate data_cf
2019-01-08 15:53:44 -08:00
a82a5ae184
Delete unused code
...
The ignored test is still broken, but at least no longer creates a
window for no reason.
Also removed all remaining references to "ncp".
2019-01-08 14:09:50 -08:00
bafd90807d
encapsulate meta_cf ( #2335 )
2019-01-08 11:41:55 -08:00
0f8ea6872e
Add missing error counters and load_account test cases ( #2327 )
2019-01-08 09:20:25 -08:00
d2431128c7
Remove WriteStage from TPU/TVU diagrams
...
Fixes #2312
2019-01-08 08:42:06 -08:00
a8b9899dee
Add retry, restore ignored tests
2019-01-07 19:30:08 -08:00
d2cb4e003c
Re-enable the --lib tests
2019-01-07 15:28:20 -08:00
6000df9779
Optimize has_duplicates() for short slices
2019-01-07 13:20:04 -07:00
24963e547c
with_subset() -> get_subset_unchecked_mut()
...
A simpler, safer, and better documented use of unsafe code
2019-01-07 13:20:04 -07:00
46d44ca99c
Add make_rpc_request retry mechanism
2019-01-07 11:02:35 -08:00
0c52df7569
Consolidate locks and error handling when loading accounts( #2309 )
2019-01-06 22:06:55 -08:00
91bd38504e
Use vote signer service in fullnode ( #2009 )
...
* Use vote signer service in fullnode
* Use native types for signature and pubkey, and address other review comments
* Start local vote signer if a remote service address is not provided
* Rebased to master
* Fixes after rebase
2019-01-05 12:57:52 -08:00
b7dc9dbc76
RPC API now assumes a drone running on the bootstrap leader
2019-01-04 18:45:55 -08:00
8b357dcb32
cargo fmt
2019-01-04 16:39:04 -08:00
1f6346d880
De-dup ledgers - db_ledger is now the only ledger written to disk
2019-01-04 16:37:00 -08:00
b7bd38744c
Spelling and formatting
2019-01-04 16:04:31 -08:00
f8a67e282a
Ignore test_tpu_forwarder ( #2307 )
2019-01-04 16:02:50 -08:00
0505d7bd32
Don't double-clone every account
2019-01-03 17:42:37 -07:00
00d310f86d
Remove some metrics datapoint, as it was causing excessive logging ( #2287 )
...
- 100 nodes test was bringing down the influx DB server
2019-01-03 09:25:11 -08:00
0bea870b22
Dynamic N layer 'avalanche' broadcast and retransmit ( #2058 )
...
* Dynamic N layer avalanche broadcast and retransmit
2019-01-02 14:16:15 +05:30
58f2598d5d
Revert "Validators make a transaction to advertise their storage last_id"
...
This reverts commit a1759aed19
2018-12-23 14:02:09 -08:00
58a4905916
Make reconstruct_entries_from_blobs() support Blobs and borrowed SharedBlobs, make distinction between to_blobs and to_shared_blobs ( #2270 )
2018-12-22 19:30:30 -08:00
2c9607d5da
Rename getConfirmation -> getConfirmationTime
2018-12-22 12:47:02 -08:00
a1759aed19
Validators make a transaction to advertise their storage last_id
...
* Also implement more storage contract logic
* Add transactions for proof validation,
* Move storage state members into system storage account userdata
2018-12-21 15:45:30 -08:00
1a3387706d
Spawn threads based on cpu count ( #2232 )
2018-12-21 13:55:45 -08:00
951d6398a0
Rename finality to confirmation ( #2250 )
...
* Rename finality to confirmation
* fix cargo fmt errors
2018-12-20 15:47:48 -08:00
7c98545b33
Use newer votes to calculate confirmation time ( #2247 )
2018-12-20 15:27:47 -08:00
bb1060bdad
Reduce ticks per block to increase voting frequency ( #2242 )
2018-12-20 14:43:03 -08:00
7ad45a91ec
Fix compile error
2018-12-20 13:47:36 -08:00
034c5d0422
db_ledger now fully encapsulates rocksdb
2018-12-20 12:32:25 -08:00
7148c14178
Debug broadcast ( #2233 )
...
* Account for duplicate blobs in process_blobs
* Increase max bytes for level base to match write buffer
2018-12-20 12:12:04 -08:00
93fb61dc8f
Re-export rocksdb::DBRawIterator until it can be encapsulated
2018-12-20 10:38:03 -08:00
b36ceb5be4
Remove rocksdb dependency from result.rs
2018-12-20 10:38:03 -08:00
37d7ad819b
Purge DB::destroy() usage
2018-12-20 10:38:03 -08:00
666af1e62d
Debug broadcast ( #2208 )
...
* Add per cf rocksdb options, increase compaction and flush threads
* Change broadcast stage to bulk write blobs
* add db_ledger function specifically for broadcast
* fix broken tests
* fix benches
2018-12-19 16:11:47 -08:00
b4f4347d6e
add some more tests ( #2217 )
2018-12-18 17:27:03 -08:00
5c866dd000
test drive new coverage stuff ( #2216 )
2018-12-18 16:44:27 -08:00
974249f2a5
Parallelize entry processing in replay stage in validators ( #2212 )
...
* Parallelize entry processing in replay stage in validators
- single threaded entry processing is not utlizing CPU cores to the fullest
* fix tests and address review comments
2018-12-18 16:06:05 -08:00
a65022aed7
DbLedger doesn't need to be mut, doesn't need an RwLock ( #2215 )
...
* DbLedger doesn't need to be mut, doesn't need an RwLock
* fix erasure cases
2018-12-18 15:18:57 -08:00
ffdc1814c6
Add counters for gossip verification failures ( #2094 )
2018-12-17 20:12:50 -08:00
9720ac0019
Fix try_erasure() ( #2185 )
...
* Fix try_erasure bug
* Re-enable asserts in test_replicator_startup
* Add test for out of order process_blobs
2018-12-17 15:34:19 -08:00
9a6e27ac36
Accounts is to big, should be its own module ( #2198 )
...
Account module is to big, should be in its own module.
2018-12-17 12:41:23 -08:00
07202205c4
Revert "ignore unstable tests"
...
This reverts commit bd7ef5d445071329a3b49b1f8be71b602226bbec.
2018-12-17 10:47:32 -08:00
b7144560c9
Include port number when gossip bind_to fails
2018-12-17 09:31:31 -08:00
4be6d01dfb
Move last ids ( #2187 )
...
* Break out last_ids into its own module
* Boot SignatureNotFound from BankError
* No longer return BankError from LastIds methods
* No longer piggypack on BankError for a LastIds signature status
* Drop all dependencies on the bank
* SignatureStatus -> Status and LastIds -> StatusDeque
* Unstable tests, issue 2193
2018-12-17 07:55:56 -08:00
fd562cb9e2
Rust 2018 cleanup
2018-12-14 21:57:15 -08:00
5bf9a20d42
fullnode-config no longer depends on src/
2018-12-14 20:13:34 -08:00
eedc8c7812
Move src/netutil.rs into its own crate
2018-12-14 20:13:34 -08:00
9ef5e51c0f
Cleanup slot remnants in db_ledger ( #2153 )
...
* Cleanup slot remnants in db_ledger
2018-12-14 17:05:41 -08:00
8ee0e9632c
Switch to using hashbrown version of HashMap and ( #2158 )
...
HashSet for improved performance and memory usage
2018-12-14 15:10:10 -08:00
6ac466c0a4
Move src/logger.rs into logger/ crate to unify logging across the workspace
2018-12-14 13:10:43 -08:00
d45fcc4381
Move src/wallet.rs into wallet/ crate
2018-12-14 12:15:18 -08:00
6fcccedb70
align tick entries' tick_height with actual number of ticks in bank ( #2147 )
2018-12-14 02:25:50 -08:00
0fe6d61036
Move binaries from src/bin into their own crate
2018-12-13 22:25:27 -08:00
091b21fae7
Vote every number of ticks ( #2141 )
...
* Vote every number of ticks
* address review comments
* fix for failing leader rotation tests
* remove check for vote failure from replay tests
(as votes will be cached and transmitted when leader is available)
2018-12-13 18:43:10 -08:00
7325b19aef
Do not allocate for each metrics submission ( #2146 )
2018-12-13 16:40:00 -08:00
7cdbbfa88e
Storage stage updates
...
* Remove logging init from storage program: saw a crash in a test
indicating the logger being init'ed twice.
* Add entry_height mining proof to indicate which segment the result is
for
* Add an interface to get storage miner pubkeys for a given entry_height
* Add an interface to get the current storage mining entry_height
* Set the tvu socket to 0.0.0.0:0 in replicator to stop getting entries
after the desired ledger segment is downloaded.
* Use signature of PoH height to determine which block to download for
replicator.
2018-12-13 11:30:12 -08:00
9880a86f80
remove prev_id, unused ( #2150 )
2018-12-13 09:24:38 -08:00
647e5d76b0
Move solana-fullnode into fullnode/
2018-12-13 01:45:29 -08:00
7e4af9382e
Move solana-upload-perf into upload-perf/
2018-12-13 01:06:40 -08:00
282d4a3563
Move solana-keygen into keygen/
2018-12-13 01:06:40 -08:00
cafeef33c3
Relocate all keypair generation into one location: sdk/src/signature.rs
2018-12-13 01:06:40 -08:00
4f48f1a850
add db_ledger genesis, rework to_blob(), to_blobs() ( #2135 )
2018-12-12 20:42:12 -08:00
a05a378db4
cleanup
2018-12-12 19:12:51 -08:00
245362db96
Make a dummy version of serving repairs from db_ledger
2018-12-12 19:12:51 -08:00
b1b190b80d
Fix too many args in Tvu::new ( #2114 )
...
* Reduce args in Tvu::new under to 8
Now pass in sockets through a the crate::tvu::Sockets struct
Move ClusterInfo.keypair to pub(crate) in order to remove redundant
signing keypair parameter
* remove commented code
2018-12-12 18:57:48 -08:00
3408ce89a7
add check_tick_height ( #2144 )
2018-12-12 18:52:11 -08:00
75f407e191
Provide entire elf to bpf_loader
2018-12-12 17:14:50 -08:00
9b81696a09
remove obsoleted TODO
2018-12-12 16:26:59 -08:00
Pankaj Garg
Rob Walker
Michael Vines
Tyera Eulberg
Greg Fitzgerald
Sagar Dhawan
Stephen Akridge
jackcmay
carllin
Sathish
anatoly yakovenko
Carl
Mark
Mekagoza