865c42465a
Cap file size for snapshot data files ( #7182 )
...
* save limit deserialize
* save
* Save
* Clean up
* rustfmt
* rustfmt
* Just comment out to please CI
* Fix ci...
* Move code
* Rustfmt
* Crean up control flow
* Add another comment
* Introduce predetermined constant limit on snapshot data files (deserialize side)
* Introduce predetermined constant limit on snapshot data files (serialize side)
* rustfmt
* Tweak message
* Revert dynamic memory limit
* Limit size of snapshot data file (de)serialization
* Fix test breakage
* Clean up
* Fix uses formatting
* Rename: deserialize_{for,from}_snapshot
* Simplify comment
* Use Slot
* Provide slot for status cache
* Align variable name with snapshot_status_cache_file_path
* Define serialize_snapshot_data_file_with_metrics
* Fix build.......
* De-marco serialize_snapshot_data_file_with_metrics
* Revert u64 => Slot
2020-01-10 09:49:36 +09:00
73c93cc345
Print bank hash and hash inputs. ( #7733 )
2020-01-09 16:33:10 -08:00
cf32fdf672
Bump reqwest from 0.10.0 to 0.10.1 ( #7731 )
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.10.0 to 0.10.1.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.10.0...v0.10.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-01-09 17:10:55 -07:00
57858b8015
Bump reqwest from 0.9.24 to 0.10.0 ( #7642 )
...
* Bump reqwest from 0.9.24 to 0.10.0
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.9.24 to 0.10.0.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
* Make reqwest::blocking specific
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2020-01-08 13:31:43 -07:00
07855e3125
Allow override of RUST_LOG ( #7705 )
2020-01-08 09:19:12 -08:00
43897de12e
Account for stake held by the current node while waiting for the supermajority to join gossip
2020-01-07 22:29:31 -07:00
85c3d64f29
Fix rooted slot iterator ( #7695 )
...
* Enable jumping gaps caused by snapshots in rooted slot iterator
2020-01-07 22:51:28 -05:00
47dd293904
supermajority is one word
2020-01-07 15:50:59 -07:00
c4220a4853
clippy
2020-01-07 15:50:59 -07:00
48ab88a2af
Add --wait-for-super-majority to facilitate asynchronous cluster restarts
2020-01-07 15:50:59 -07:00
84a37a2c0c
Make validator timestamping more coincident, and increase timestamp sample range ( #7673 )
...
automerge
2020-01-03 22:38:00 -08:00
4fe0b116ae
Measure heap usage while processing the ledger
2020-01-03 13:25:37 -07:00
a0fb9de515
Move thread_mem_usage module into measure/
2020-01-03 13:25:37 -07:00
5d42dcc9ec
Reduce constants for ledger cleanup test ( #7629 )
2020-01-03 12:05:14 -08:00
96e88c90e8
Lessen test_slots_to_snapshot constants to make test faster ( #7628 )
...
Reduces test time from 6m to 45s
2020-01-03 09:58:52 -08:00
a707c9410e
More thiserror ( #7183 )
...
* Less solana_core::result. Module now private.
* Drop solana_core::result dependency from a few more modules
* Fix warning
* Cleanup
* Fix typo
2020-01-02 20:50:43 -07:00
6b7d9942a7
Add authorized_voter history ( #7643 )
...
* Add authorized_voter history
* fixups
* coverage
* bigger vote state
2019-12-30 19:57:53 -08:00
87b2525e03
Limit maximum number of shreds in a slot to 32K ( #7584 )
...
* Limit maximum number of shreds in a slot to 32K
* mark dead slot replay as fatal error
2019-12-30 07:42:09 -08:00
727be309b2
fix entryverification state ( #7169 )
...
automerge
2019-12-23 23:26:27 -08:00
ce2d7a2d5a
Bump nix from 0.16.0 to 0.16.1 ( #7623 )
...
Bumps [nix](https://github.com/nix-rust/nix ) from 0.16.0 to 0.16.1.
- [Release notes](https://github.com/nix-rust/nix/releases )
- [Changelog](https://github.com/nix-rust/nix/blob/master/CHANGELOG.md )
- [Commits](https://github.com/nix-rust/nix/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-23 23:06:42 -07:00
488420fdf2
Bump core_affinity from 0.5.9 to 0.5.10 ( #7578 )
...
Bumps [core_affinity](https://github.com/Elzair/core_affinity_rs ) from 0.5.9 to 0.5.10.
- [Release notes](https://github.com/Elzair/core_affinity_rs/releases )
- [Commits](https://github.com/Elzair/core_affinity_rs/compare/0.5.9...0.5.10 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-22 22:41:47 -07:00
ca10cf081f
Update cargo.toml files from 0.22.0 to 0.23.0 ( #7596 )
2019-12-20 21:45:42 -05:00
a7040896f0
Update to rust 1.40.0 ( #7572 )
...
* Update to rust 1.40.0
* fixups
2019-12-19 23:27:54 -08:00
e98132fd76
Move window insertion to separate thread ( #7397 )
...
* Move window insertion to separate thread
2019-12-19 00:15:49 -08:00
fcda972cec
Add support for multiple params
2019-12-18 23:34:01 -07:00
c5b076ec7e
Add getConfirmedBlocks rpc method ( #7550 )
...
automerge
2019-12-18 15:51:47 -08:00
05cf5a38af
Add ledger benchmark test ( #7484 )
2019-12-18 18:31:04 -05:00
bd22b641b3
Speed up getLeaderSchedule RPC call by reducing pubkey duplication
2019-12-18 15:59:55 -07:00
6a9005645a
Update "limit-ledger-size" to use DeleteRange for much faster deletes ( #7515 )
...
* Update "limit-ledger-size" to use DeleteRange for much faster deletes
* Update core/src/ledger_cleanup_service.rs
Co-Authored-By: Michael Vines <mvines@gmail.com>
* Rewrite more idiomatically
* Move max_ledger_slots to a fn for clippy
* Remove unused import
* Detect when all columns have been purged and fix a bug in deletion
* Check that more than 1 column is actually deleted
* Add helper to test that ledger meets minimum slot bounds
* Remove manual batching of deletes
* Refactor to keep some N slots older than the highest root
* Define MAX_LEDGER_SLOTS that ledger_cleanup_service will try to keep around
* Refactor compact range
2019-12-18 11:50:09 -08:00
6aaf742dfe
Extend getConfirmedBlock rpc to return account pre- and post-balances ( #7543 )
...
automerge
2019-12-18 09:56:29 -08:00
323673c3c0
Add `compact_cf` calls to reclaim storage during ledger slot purge ( #7264 )
2019-12-18 10:29:46 -05:00
434cde179f
GetLeaderSchedule can now return a schedule for arbitrary epochs
2019-12-17 23:41:42 -07:00
97589f77f8
Pipeline broadcast socket transmit and blocktree record ( #7481 )
...
automerge
2019-12-16 17:11:18 -08:00
3513f4ee84
Rename drone to faucet ( #7508 )
2019-12-16 14:05:17 -07:00
7ad64c8d45
Bump serde from 1.0.103 to 1.0.104
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.103 to 1.0.104.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.103...v1.0.104 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-16 08:50:09 -07:00
71b93468d5
Bump serial_test from 0.3.1 to 0.3.2
...
Bumps [serial_test](https://github.com/palfrey/serial_test ) from 0.3.1 to 0.3.2.
- [Release notes](https://github.com/palfrey/serial_test/releases )
- [Commits](https://github.com/palfrey/serial_test/compare/v0.3.1...v0.3.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-15 18:19:37 -07:00
6b88da2b82
Hook up getBlockTime rpc to real data ( #7476 )
...
* Add blocktree timestamp helper functions and tests
* Flesh out blocktree::get_block_time
* Move stakes up into rpc to make testing easier; expand tests
* Review comments
2019-12-14 12:23:02 -07:00
d01ea20273
getVoteAccounts now excludes listing inactive unstaked accounts as delinquent
...
This keeps abandoned vote accounts out of the `solana show-validators` output
2019-12-14 09:52:03 -07:00
98b80288ed
Optimize bank_forks critical section ( #7477 )
2019-12-13 17:20:31 -08:00
9d5a07bac4
Move create_dir_all to AccountsDB::new ( #7465 )
...
AppendVec create doesn't need to try and create
paths every time and it can stall while snapshot
create is happening.
2019-12-13 16:46:16 -08:00
d94041e98d
Allow coding shred index to be different than data shred index ( #7438 )
...
* Allow coding shred index to be different than data shred index
* move fec_set_index to shred's common header
* fix bench
2019-12-12 16:50:29 -08:00
1d172b07a8
crc 1.9.0 was yanked, fall back to 1.8 ( #7453 )
2019-12-12 14:30:51 -08:00
83218c479a
code cleanup, storage_size() was Option<u64>, now Result<u64> ( #7424 )
2019-12-12 14:55:30 -05:00
dbb8267b09
Pin dalek version ( #7448 )
...
* Pin Dalek version
* core too
2019-12-12 11:34:43 -08:00
dd54fff978
Use pinned memory for entry verify ( #7440 )
2019-12-12 10:36:27 -08:00
dad5c62df5
Add uptime column to show-validators ( #7441 )
...
automerge
2019-12-11 22:04:54 -08:00
46a4ea8f67
Bump reqwest from 0.9.22 to 0.9.24
...
Bumps [reqwest](https://github.com/seanmonstar/reqwest ) from 0.9.22 to 0.9.24.
- [Release notes](https://github.com/seanmonstar/reqwest/releases )
- [Changelog](https://github.com/seanmonstar/reqwest/blob/v0.9.24/CHANGELOG.md )
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.9.22...v0.9.24 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-11 13:42:38 -07:00
06415de8ee
change blocktree*::storage_size() to return Option<u64> to handle live fs changes ( #7401 )
2019-12-10 19:12:49 -05:00
146bc95c16
Fix sigverify metrics ( #7393 )
...
* Add filter
* Collapse logs
* Fix dashboard
2019-12-10 11:28:07 -08:00
6f457292ff
Bump bincode from 1.2.0 to 1.2.1
...
Bumps [bincode](https://github.com/servo/bincode ) from 1.2.0 to 1.2.1.
- [Release notes](https://github.com/servo/bincode/releases )
- [Commits](https://github.com/servo/bincode/compare/v1.2.0...v1.2.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-10 10:00:56 -07:00
6d2861f358
add unit test for minority fork overcommit attack ( #7292 )
...
* add unit test for minority fork overcommit attack
* add generic function to simulate fork selection
2019-12-10 22:06:16 +05:30
891767c6b7
Bump serde_json from 1.0.42 to 1.0.44
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.42 to 1.0.44.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.42...v1.0.44 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-08 09:43:24 -07:00
1ffd6b4b4d
Add program and runtime support for Durable Transaction Nonces ( #6845 )
...
* Rework transaction processing result forwarding
Durable nonce prereq
* Add Durable Nonce program API
* Add runtime changes for Durable Nonce program
* Register Durable Nonce program
* Concise comments and bad math
* Fix c/p error
* Add rent sysvar to withdraw ix
* Remove rent exempt required balance from Meta struct
* Use the helper
2019-12-07 12:54:10 -07:00
77cd292828
getVoteAccounts RPC API no longer returns "idle" vote accounts, take II
2019-12-07 01:16:36 -07:00
22d6951de5
Revert "getVoteAccounts RPC API no longer returns "idle" vote accounts"
...
This reverts commit 103e40b9689d74ece606385a67d166f55f453823.
2019-12-07 01:16:36 -07:00
c00216e3be
feat: ledger size and cleanup metrics ( #7335 )
2019-12-06 22:32:45 -05:00
42247e0e1a
getVoteAccounts RPC API no longer returns "idle" vote accounts ( #7339 )
2019-12-06 20:23:29 -05:00
9ecb844de7
Split up ReplayStageConfig to make it derive Default ( #7334 )
...
automerge
2019-12-06 14:39:35 -08:00
3ab8185777
Add intermittent Timestamping to Votes ( #7233 )
...
* Add intermittent timestamp to Vote
* Add timestamp to VoteState, add timestamp processing to program
* Print recent timestamp with solana show-vote-account
* Add offset of 1 to timestamp Vote interval to initialize at node boot (slot 1)
* Review comments
* Cache last_timestamp in Tower and use for interval check
* Move work into Tower method
* Clarify timestamping interval
* Replace tuple with struct
2019-12-06 14:38:49 -07:00
b7d4330dd4
Fail fast if account paths cannot be canonicalized ( #7300 )
...
* Canonicalize account paths to avoid symlink issues
* fixes
2019-12-05 21:41:29 -05:00
cfc21e1225
Only serialize rooted append vecs ( #7281 )
2019-12-05 14:27:46 -08:00
d6c3396182
Canonicalize paths before symlink-ing when generating snapshots ( #7294 )
...
* Canonicalize paths before symlinking when generating snapshots
* cargo fmt
2019-12-05 14:58:02 -05:00
a95d37ea25
Fix repair slowness when most peers are unable to serve requests ( #7287 )
...
* Fix repair when most peers are incapable of serving requests
* Add a test for getting the lowest slot in blocktree
* Replace some more u64s with Slot
2019-12-05 11:25:13 -08:00
fae9c08815
Add ReplayStageConfig ( #7195 )
2019-12-04 11:17:17 -07:00
c9245751e9
Bump nix from 0.15.0 to 0.16.0 ( #7216 )
...
Bumps [nix](https://github.com/nix-rust/nix ) from 0.15.0 to 0.16.0.
- [Release notes](https://github.com/nix-rust/nix/releases )
- [Changelog](https://github.com/nix-rust/nix/blob/master/CHANGELOG.md )
- [Commits](https://github.com/nix-rust/nix/commits/v0.16.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-04 09:35:45 -07:00
f0a40862d6
Support local cluster edge case testing ( #7135 )
...
* Refactor local cluster to support killing a partition
* Rework run_network_partition
* Introduce fixed leader schedule
* Plumb fixed schedule into test
2019-12-03 16:31:59 -08:00
a0eafa12e3
Update to hashes_per_tick computation, and tick duration datapoint ( #7127 )
2019-12-02 18:02:11 -08:00
076e384bb5
Tool to tune system parameters like PoH service priority ( #7155 )
...
* New daemon to tune system parameters like PoH service priority
* fixes for Linux
* integrate with poh_service
* fixes
* address review comments
* remove `dead_code` directive
2019-12-02 16:46:46 -08:00
41cff1b49d
Remove spammy log
2019-12-02 16:52:01 -07:00
0f872af502
Bump libc from 0.2.65 to 0.2.66 ( #7180 )
...
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.65 to 0.2.66.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.65...0.2.66 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-02 09:56:03 -07:00
b13696ea1a
Bump jsonrpc-http-server from 14.0.3 to 14.0.5 ( #7181 )
...
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 14.0.3 to 14.0.5.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.3...jsonrpc-http-server-v14.0.5 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-12-02 09:55:40 -07:00
5fbbf7c748
Bump jsonrpc-ws-server from 14.0.3 to 14.0.5 ( #7172 )
...
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc ) from 14.0.3 to 14.0.5.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.3...jsonrpc-ws-server-v14.0.5 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-29 23:06:23 -07:00
e7fe0db051
Bump jsonrpc-derive from 14.0.3 to 14.0.5 ( #7173 )
...
Bumps [jsonrpc-derive](https://github.com/paritytech/jsonrpc ) from 14.0.3 to 14.0.5.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.3...jsonrpc-derive-v14.0.5 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-29 14:15:02 -07:00
dcb7bd8c74
Bump jsonrpc-pubsub from 14.0.3 to 14.0.5 ( #7174 )
...
Bumps [jsonrpc-pubsub](https://github.com/paritytech/jsonrpc ) from 14.0.3 to 14.0.5.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.3...jsonrpc-pubsub-v14.0.5 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-29 14:14:57 -07:00
f97626346b
Bump jsonrpc-core from 14.0.3 to 14.0.5 ( #7170 )
...
Bumps [jsonrpc-core](https://github.com/paritytech/jsonrpc ) from 14.0.3 to 14.0.5.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-28 10:59:31 -07:00
7f4feaee08
Bump serde from 1.0.102 to 1.0.103 ( #7163 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.102 to 1.0.103.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.102...v1.0.103 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-27 09:10:25 -07:00
5a30ef180a
Bump serial_test_derive from 0.2.0 to 0.3.1 ( #7153 )
...
Bumps [serial_test_derive](https://github.com/palfrey/serial_test ) from 0.2.0 to 0.3.1.
- [Release notes](https://github.com/palfrey/serial_test/releases )
- [Commits](https://github.com/palfrey/serial_test/compare/v0.2.0...v0.3.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-26 23:12:13 -07:00
0a0412e47e
Bump serial_test from 0.2.0 to 0.3.1 ( #7154 )
...
Bumps [serial_test](https://github.com/palfrey/serial_test ) from 0.2.0 to 0.3.1.
- [Release notes](https://github.com/palfrey/serial_test/releases )
- [Commits](https://github.com/palfrey/serial_test/compare/v0.2.0...v0.3.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-26 22:07:39 -07:00
c810913861
Bump serde_derive from 1.0.102 to 1.0.103 ( #7141 )
...
automerge
2019-11-26 14:44:20 -08:00
2b13158e29
Bump serde_json from 1.0.41 to 1.0.42 ( #7142 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.41 to 1.0.42.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.41...v1.0.42 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-26 15:09:01 -07:00
0a0f15baca
RPC subscriptions for new slot notifications ( #7114 )
...
* feat: slot notifications via pubsub rpc w/ tests
2019-11-26 03:42:54 -05:00
58c144ee55
Add getBlockTime rpc api ( #7130 )
...
* Add getBlockTime rpc api
* Add getBlockTime to docs
* Fix duration rounding for common tick/slot durations; add slot duration calculation
* Expose slots_per_year
* Use genesis values instead of clock defaults to calculate block offset
* Add get-block-time cli subcommand
* Fix test_rent: decrease magic number usage
2019-11-26 00:40:36 -07:00
294662a1ce
Bump version to 0.22.0
2019-11-25 21:34:50 -07:00
76a68c26c9
Track a Bank's parent slot independently from parent bank ( #7131 )
2019-11-25 15:34:51 -08:00
0f66e5e49b
Add getConfirmedBlock test to rpc ( #7120 )
...
automerge
2019-11-25 11:08:03 -08:00
686aa3a150
Bump chrono from 0.4.9 to 0.4.10 ( #7113 )
...
automerge
2019-11-25 10:01:46 -08:00
094c391cd7
Bump itertools from 0.8.1 to 0.8.2 ( #7111 )
...
Bumps [itertools](https://github.com/bluss/rust-itertools ) from 0.8.1 to 0.8.2.
- [Release notes](https://github.com/bluss/rust-itertools/releases )
- [Commits](https://github.com/bluss/rust-itertools/commits/v0.8.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-25 10:22:47 -07:00
6c89226ccf
Purge zero lamport accounts on snapshot ingestion ( #7010 )
...
Snapshots do not load the original index, so they must
purge zero lamport accounts again.
2019-11-22 18:22:28 -08:00
0bd41f98ed
Avoid jemalloc in windows build ( #7089 )
...
automerge
2019-11-21 18:39:29 -08:00
d9e7a5fcbe
Use fork weight instead of individual bank weight for fork selection. ( #7079 )
...
* Fix weight calculation
* Fix tests
* fork weight
* wait until nodes are in the leader schedule
* enable sanity
* fewer long tests
2019-11-21 15:47:08 -08:00
c965a110f2
Use unbounded channel ( #7081 )
2019-11-21 14:23:40 -07:00
8cbc450192
Create genesis.tar.bz2 in solana-genesis ( #7039 )
...
* Use clap_utils
* Create genesis.tar.bz2 in solana-genesis
* Remove shell-based genesis.tar.bz2 generation
* Make Option=>Result conv more rusty
* stop using solana_logger
* Simplify by just using vec!
* clean up abit
2019-11-21 10:57:27 -07:00
e66b29943b
datapoint for best fork weight and slot in replay ( #7066 )
2019-11-20 17:26:52 -08:00
100b9dd12a
Fix num nodes metrics ( #7068 )
...
* Fix num nodes metric
* Fix node count metrics
2019-11-20 17:00:31 -08:00
3415db9739
Merge api/program into single units ( #7061 )
2019-11-20 16:32:19 -08:00
97ca6858b7
Write transaction status and fee into persistent store ( #7030 )
...
* Pass blocktree into execute_batch, if persist_transaction_status
* Add validator arg to enable persistent transaction status store
* Pass blocktree into banking_stage, if persist_transaction_status
* Add validator params to bash scripts
* Expose actual transaction statuses outside Bank; add tests
* Fix benches
* Offload transaction status writes to a separate thread
* Enable persistent transaction status along with rpc service
* nudge
* Review comments
2019-11-20 16:43:10 -07:00
9f6a2e51b2
add credit-debit rent handling ( #6947 )
...
* add credit-debit rent handling
* add tests
* charge rent for validator account for fee credit
* rent is stored per tx instead of account
2019-11-21 01:57:02 +05:30
b150da837a
Use epoch as the gossip purge timeout for staked nodes. ( #7005 )
...
automerge
2019-11-20 11:25:18 -08:00
d184d3a732
Merge native programs parts into one unit ( #7047 )
2019-11-20 10:12:43 -08:00
d2ed921bc6
Cleanup nightly warnings ( #7055 )
2019-11-19 20:15:37 -08:00
d32a072190
Use ticks_per_slot to calculate maximum grace ticks ( #7024 )
...
* Use ticks_per_slot to calculate maximum grace ticks
* fix test
* fix votable candidate ordering
* fixes to pick_best_fork() and a unit test
* fixes
2019-11-19 17:55:42 -08:00
f2badf2c5d
Fix a bug where gossip loops forever while splitting messages ( #7032 )
...
* Fix a bug where gossip loops forever while splitting messages
* Get rid of while loop
* Minor clean up and rename
2019-11-19 11:51:51 -08:00
ea656b1a3f
Add parent slot to getConfirmedBlock ( #7038 )
...
* Add parent slot to getConfirmedBlock
* Fix bad text-replace
* Use camelCase in getConfirmedBlock
2019-11-19 09:39:55 -07:00
b958bf9086
Fix confirmation metrics ( #7035 )
2019-11-19 09:51:50 -05:00
43144cfe8b
Make banks that fail threshhold check resettable ( #7027 )
2019-11-19 02:36:30 -08:00
11d2d2eccd
Fix progress map losing banks and recomputing stats ( #7026 )
...
* Fix progress map missing banks
* Fix confirmations
* Fix test
* Initialiize progress with frozen banks atartup
2019-11-19 02:36:00 -08:00
6bfe0fca1f
Add a version field to shreds ( #7023 )
...
* Add a version field to shreds
* Clippy
* Fix Chacha Golden
* Fix shredder bench compile
* Fix blocktree bench compile
2019-11-18 18:05:02 -08:00
e0a2bb9d86
Legitimately map transactions to statuses in blocktree ( #7011 )
...
* Refactor rocksdb TransactionStatus to store/return struct; hook up map_transactions_to_statuses
* Cleanup use statements
2019-11-18 09:12:42 -07:00
3bc8d78801
Add ConfirmedBlock struct, and rework Blocktree apis to include block… ( #7004 )
...
* Add RpcConfirmedBlock struct, and rework Blocktree apis to include blockhash info and dummy tx statuses
* Remove unused lifetime
2019-11-17 20:17:15 -07:00
b66c03667c
Log for threshold failure ( #7008 )
2019-11-17 17:10:16 -08:00
c3926e6af0
|solana-gossip spy| no longer requires an entrypoint ( #6999 )
2019-11-16 14:16:28 -07:00
70322d1ff8
Add error logging to dead slots ( #7000 )
2019-11-16 02:54:51 -08:00
0ca943f49b
RecyclerCache for shred_sigverify ( #6986 )
...
automerge
2019-11-15 12:16:56 -08:00
36e3ccfc68
Remvoe pinned memory ( #6976 )
2019-11-15 10:58:25 -08:00
59413b3124
Fix rules for fork selection ( #6906 )
...
automerge
2019-11-15 08:36:33 -08:00
006c39380a
Display 'none' instead of 0.0.0.0 ( #6973 )
2019-11-14 20:24:35 -07:00
852a2146ab
Add Blocktree api to get transactions by slot ( #6966 )
...
* Add blocktree method to get confirmed-block txs
* Clean up use statements
* Add test, and fmt
* Plumb new blocktree method into getConfirmedBlock
2019-11-14 16:34:39 -07:00
99b42f210c
Remove unused sha2 dep ( #6964 )
...
automerge
2019-11-14 14:01:11 -08:00
03f7f0d18c
Rename getBlock to getConfirmedBlock; remove getBlocksSince ( #6961 )
...
automerge
2019-11-14 13:14:42 -08:00
79d7090867
Remove obsolete references to Blob ( #6957 )
...
* Remove the name "blob" from archivers
* Remove the name "blob" from broadcast
* Remove the name "blob" from Cluset Info
* Remove the name "blob" from Repair
* Remove the name "blob" from a bunch more places
* Remove the name "blob" from tests and book
2019-11-14 11:49:31 -08:00
e7f63cd336
Upgrade to rust 1.39.0 ( #6939 )
...
* Upgrade to rust 1.39.0
* 1.39.0 clippy
2019-11-14 12:27:01 -07:00
f108f483b7
Remove Blobs and switch to Packets ( #6937 )
...
* Remove Blobs and switch to Packets
* Fix some gossip messages not respecting MTU size
* Failure to serialize is not fatal
* Add log macros
* Remove unused extern
* Apparently macro use is required
* Explicitly scope macro
* Fix test compile
2019-11-14 10:24:53 -08:00
42af8b199f
feat: add tests for invalid/failure cases ( #6951 )
2019-11-14 11:41:26 -05:00
43e2301e2c
Fix roots overrunning broadcast ( #6884 )
...
* Add trusted pathway for insert_shreds to avoid checks
2019-11-14 00:32:07 -08:00
7b05b3dbb3
rent collector improvments ( #6888 )
...
* avoid account copying + pre-empt rent
* adding support for base rent
2019-11-14 10:56:49 +05:30
4fc767b3f6
Move version! from core:: to clap_utils:: ( #6944 )
...
* Move version! from core to clap-utils
* Completely move version! from core:: to clap_utils::
* rustfmt
* Do remaining transition after rebase
2019-11-14 13:10:38 +09:00
a3a830e1ab
Delete Service trait ( #6921 )
2019-11-13 11:12:09 -07:00
fcc2874591
Remove/address some TODOs ( #6923 )
2019-11-13 09:43:15 -07:00
30a08f4282
Cleanup ledger macros ( #6916 )
...
automerge
2019-11-13 07:14:09 -08:00
86faa3f995
Properly type RpcClient::get_version() ( #6919 )
2019-11-12 22:01:04 -07:00
148a58865e
Make creating new snapshot.tar.bz2 truly-atomic ( #6902 )
2019-11-12 14:21:56 -07:00
3faeb7fa79
Rename solana-netutil to solana-net-utils for consistency ( #6895 )
...
* sed -i -e 's/netutil/net_utils/g' $(git grep --files-with-matches netutil :**.rs)
* sed -i -e 's/netutil/net-utils/g' $(git grep --files-with-matches netutil)
* git mv netutil/ net-utils
* Tweak a bit
* Fix rustfmt & clippy
2019-11-12 13:37:13 -07:00
bb00904fc8
add rent reserve for bootstrap stakes ( #6876 )
...
* genesis investor stakes
* assert rent is sufficient for these bootstrappers
2019-11-12 12:33:40 -08:00
5903339c17
feat: return bank/block info with block-related results ( #6716 )
2019-11-12 14:49:41 -05:00
c6b108ef4f
Don't panic in sdk/ when genesis fails to load ( #6892 )
2019-11-12 10:24:49 -07:00
7e82450d7b
Serialize transaction in proper wire format instead of json ( #6889 )
2019-11-12 10:45:10 -05:00
95d6586dd7
Remove debug datapoint that isn't being plotted ( #6873 )
2019-11-11 14:25:25 -08:00
816b2d7ff8
Tune repair to be less aggressive ( #6868 )
2019-11-11 13:12:22 -08:00
4be646c695
discover() by gossip sockaddr instead of just by gossip ip address ( #6865 )
2019-11-11 12:42:58 -07:00
cc6e1ea200
Stub out `getBlocksSince` and `getBlock` methods ( #6853 )
...
* Add getBlocksSince rpc method, and initial stub of getBlock method
* Return test transactions from getBlock method
* clippy
* Add comment on get_block method
2019-11-11 13:18:34 -05:00
cfab36cb1d
Include channel and commit info in the version of pre-release builds ( #6819 )
2019-11-10 22:39:13 -07:00
5835b3b8eb
Increase timeout when confirming airdrop for max commitment ( #6858 )
...
* Increase timeout when confirming airdrop for max commitment
* Add commitment to airdrop rpc trace
* Flip commitment check
2019-11-10 12:20:52 -05:00
1ddf90ed08
Compress contact_info_trace() output to improve CI log rendering ( #6852 )
2019-11-09 01:12:18 -07:00
9807f47d4e
Rename genesis block to genesis config ( #6816 )
2019-11-08 23:56:57 -05:00
02058ea699
Reject blocks with invalid last ticks in replay stage ( #6833 )
...
* Reject blocks with invalid last ticks in replay stage
* slot_full
2019-11-08 20:21:54 -05:00
d1daeb44e6
Remove custom stack_size() ( #6844 )
2019-11-08 17:11:07 -07:00
efdfc5c327
Remove TODOs ( #6843 )
2019-11-08 16:43:18 -07:00
9c00ad9ff2
Remove some low-hanging TODOs ( #6839 )
2019-11-08 16:41:36 -07:00
da425cc225
Don't insert coding shreds into blocktree on leader ( #6831 )
2019-11-08 13:54:23 -08:00
b800642fa4
Add new fork log message for when the node is leader for consistency ( #6808 )
2019-11-08 12:30:25 -07:00
5bd05fba09
require `to` account signature ( #6658 )
...
* require to signature
* fixing invocation to create_account
* fix create_account references
* address review comment
* whacking bugs in tests
* fixing stake program tests
2019-11-08 15:57:35 +05:30
8e81bc1b49
Fix pinning ( #6604 )
...
Remove Deref implementations and add more pass-throughs to the PinnedVec
wrapper.
Warm recyclers
set_pinnable
2019-11-07 19:48:33 -08:00
b64b54f48f
unfork dalek ed25519 ( #6776 )
2019-11-07 17:08:10 -08:00
67d1e2903c
Upgrade Repair be more intelligent and agressive ( #6789 )
...
* Upgrade Repair be more intelligent and agressive
* Fix u64 casts
* Fix missing bracket
* Add 1 second delay to test to allow repair to kick in
2019-11-07 11:08:09 -08:00
a684984f8b
feat: add confirm_transaction, add rpc client test ( #6778 )
2019-11-06 22:08:03 -05:00
65de227520
Don't panic on packet data ( #6769 )
2019-11-06 14:32:37 -08:00
0ace79939b
Add reference tick to data shreds ( #6772 )
...
* Add reference tick to data shreds
* fix tests
2019-11-06 13:27:58 -08:00
b3a75a60a4
Use rooted bank by default in rpc bank selection ( #6759 )
...
* Name anonymous parameters for clarity
* Add CommitmentConfig to select bank for rpc
* Add commitment information to jsonrpc docs
* Update send_and_confirm retries as per commitment defaults
* Pass CommitmentConfig into client requests; also various 'use' cleanup
* Use _with_commitment methods to speed local_cluster tests
* Pass CommitmentConfig into Archiver in order to enable quick confirmations in local_cluster tests
* Restore solana ping speed
* Increase wallet-sanity timeout to account for longer confirmation time
2019-11-06 14:15:00 -07:00
5e8668799c
Fewer recyclers. ( #6770 )
...
automerge
2019-11-06 12:35:51 -08:00
67f636545a
Refactor sigverify to stage for signing shreds on the GPU ( #6635 )
...
automerge
2019-11-06 10:52:30 -08:00
7ff2a44a63
Make last shred for an interrupted slot signed + typed ( #6760 )
2019-11-06 08:25:17 -07:00
b5074d8577
Enable JSON RPC request/response logging by default ( #6758 )
2019-11-06 08:23:13 -07:00
24102a7435
Allow voting on empty banks ( #6719 )
...
* Allow votes on empty banks
* Remove making first bank is_delta true, no longer necessary for idling
* Remove votable from ledger tool
2019-11-06 01:02:26 -08:00
9614d17024
Limit deserialization of data coming off the wire ( #6751 )
...
* Limit deserialization of data coming off the wire
* Feedback and cleanup
2019-11-06 00:07:57 -08:00
09e648f957
ledger-tool/: Include full validator voting history in fork-graph ( #6756 )
2019-11-05 19:40:00 -07:00
8f91b5aab3
Add threshold to repairman for same slot ( #6728 )
2019-11-05 12:48:45 -08:00
c312d4fba0
Calculate proofs collected and don't encrypt if there are none ( #6698 )
2019-11-05 11:38:50 -08:00
7203036e3e
Adjust nofiles within Blocktree::open() for all ledger/ users ( #6737 )
...
automerge
2019-11-05 11:18:49 -08:00
c6931dcb07
Remove credit-only account handling ( #6726 )
...
* Renaming
- credit-only/credit-debit to read-only/read-write
- debitable to writable
* Remove credit handling, making credit-only accounts read-only
* Update programs to remove deprecated credit-only account designation
* Use readonly and writable instead of underscored types
2019-11-05 09:38:35 -07:00
fba1af6ea9
ledger-tool can now load a ledger snapshot ( #6729 )
2019-11-04 22:14:55 -07:00
b825d04597
Pull perf into a separate module. ( #6718 )
...
automerge
2019-11-04 20:13:43 -08:00
4d52f47f87
Move get_bank_forks() into ledger/ so its available for use by ledger-tool/ ( #6720 )
2019-11-04 19:10:06 -07:00
f54cfcdb8f
Store and persists full stack of tower votes in gossip ( #6695 )
...
* vote array
wip
wip
wip
update
gossip index should match tower index
tests build
clippy
test index after expired vote
test
bank specific last vote sync time
* verify
* we are likely to see many more warnings about old votes now
2019-11-04 16:19:54 -08:00
57983980a7
Lower verify-batch-size to debug ( #6722 )
...
automerge
2019-11-04 16:00:59 -08:00
33f4aaf3fd
Rename confidence to commitment ( #6714 )
2019-11-04 16:44:27 -07:00
c138d692b1
Show all ports for nodes in gossip table ( #6717 )
...
* Show all ports for nodes in gossip table
* review comments
2019-11-04 15:05:08 -08:00
5e3697807c
Fail gracefully if AVX support is missing ( #6705 )
2019-11-04 11:03:39 -07:00
568475e2db
Fix incorrectly signed CrdsValues ( #6696 )
2019-11-03 10:07:51 -08:00
9ea398416e
Sign shreds on the GPU ( #6595 )
...
* sign gpu shreds
* wip
* checks
* tests build
* test
* tests
* test
* nits
* sign cpu test
* write out the sigs in parallel
* clippy
* cpu test
* prepare secret for gpu
* woot!
* update
* bump perf libs
2019-11-02 06:23:14 -07:00
50a17fc00b
Use Slot and Epoch type aliases instead of raw u64 ( #6693 )
...
automerge
2019-11-02 00:38:30 -07:00
a57f6b70da
Fix swapped repair and forwards addrs ( #6691 )
...
automerge
2019-11-01 16:01:42 -07:00
385b4ce959
Get rid of verified packets and use the Meta::discard flag ( #6674 )
...
* get rid of verified packets and use the disabled meta field everywhere
2019-11-01 14:23:03 -07:00
2d67962c2f
Send repairman shreds to the repair socket ( #6671 )
2019-10-31 18:23:50 -07:00
e8e5ddc55d
Verify number of hashes for each block of entries ( #6262 )
...
* Verify number of hashes for each block of entries
* Fix blocktree processor tick check
* Rebase once more
2019-10-31 16:38:50 -04:00
59f3dc3b6b
Fix PohRecorder Metrics ( #6644 )
...
* Update Poh Recorder Dashboard
* Update PohRecorder logging
2019-10-30 18:55:29 -07:00
fa12a5f70b
kill rent calculator ( #6625 )
2019-10-30 16:25:12 -07:00
38491c8c4b
Reduce verify-batch-size log ( #6623 )
2019-10-30 13:41:11 -07:00
801337a422
Refactor Weighted Shuffle ( #6614 )
...
automerge
2019-10-29 21:02:11 -07:00
b4dc1a7263
Remove move feature ( #6605 )
...
automerge
2019-10-29 17:14:07 -07:00
ef3aa2731c
Fix Weighted Best calculation ( #6606 )
...
automerge
2019-10-29 17:04:11 -07:00
029a2837e4
Bump jsonrpc-http-server from 14.0.1 to 14.0.3 ( #6597 )
...
Bumps [jsonrpc-http-server](https://github.com/paritytech/jsonrpc ) from 14.0.1 to 14.0.3.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/compare/v14.0.1...v14.0.3 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-29 10:30:06 -07:00
34a9619806
SigVerify stage for shreds. ( #6563 )
2019-10-28 16:07:51 -07:00
579a02529d
Fix unnecessarily copying shreds in broadcast stage ( #6588 )
...
* Optimize coalesce_shreds to not explictly clone
* Remove Coalesce Shreds altogether
* fn no longer needs clippy exception
2019-10-28 14:58:27 -07:00
243fa6cf63
Shred gpu sigverify ( #6520 )
...
Implement APIs for verifying shred signatures on the GPU.
2019-10-28 10:29:38 -07:00
30c0a7d069
Bump serde from 1.0.101 to 1.0.102 ( #6581 )
...
automerge
2019-10-28 09:19:39 -07:00
71b4e765c8
Bump itertools from 0.8.0 to 0.8.1 ( #6583 )
...
Bumps [itertools](https://github.com/bluss/rust-itertools ) from 0.8.0 to 0.8.1.
- [Release notes](https://github.com/bluss/rust-itertools/releases )
- [Commits](https://github.com/bluss/rust-itertools/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-28 08:26:15 -07:00
73dd5aa2d1
Bump serde_derive from 1.0.101 to 1.0.102 ( #6582 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.101 to 1.0.102.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.101...v1.0.102 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-28 08:24:13 -07:00
6efaaa9d7a
Blocktree metrics ( #6527 )
...
* Add metrics for blocktree performance
* Plumb metrics through window service
2019-10-26 16:15:59 -07:00
73c31d873e
Update Cargo.toml versions from 0.20.0 to 0.21.0 ( #6568 )
2019-10-25 17:40:49 -06:00
8a37b1e742
Bump jsonrpc-ws-server from 14.0.1 to 14.0.3 ( #6553 )
...
Bumps [jsonrpc-ws-server](https://github.com/paritytech/jsonrpc ) from 14.0.1 to 14.0.3.
- [Release notes](https://github.com/paritytech/jsonrpc/releases )
- [Commits](https://github.com/paritytech/jsonrpc/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-25 09:40:42 -07:00
Ryo Onodera
sakridge
dependabot-preview[bot]
Jack May
Michael Vines
carllin
Tyera Eulberg
sakridge
Greg Fitzgerald
Rob Walker
Pankaj Garg
Parth
Dan Albert
Sunny Gleason
Sagar Dhawan
anatoly yakovenko
Justin Starry
Trent Nelson
TristanDebrunner
Ryo Onodera
TristanDebrunner