33052c1dd2
Cleanup shred header structures ( #6378 )
...
automerge
2019-10-15 20:48:45 -07:00
20e800230f
Don't deserialize coding header for data shreds ( #6367 )
...
* Don't deserialize coding hdr for data shreds
* review comments
* fix tests
2019-10-15 15:18:23 -07:00
1afc527919
Lower cluster_info-num_nodes datapoint ( #6368 )
2019-10-15 14:42:19 -07:00
dfca2b510b
Lower shred/receiver stats ( #6365 )
...
too many messages
2019-10-15 11:43:52 -07:00
f8ccd90eeb
Add ForkConfidenceCache methods ( #6359 )
...
automerge
2019-10-14 22:14:20 -07:00
88bb55ffd2
Add get_vote_accounts() to RPC client
2019-10-14 20:38:51 -07:00
5508ac6272
Add root slot to getVoteAccounts
2019-10-14 20:38:51 -07:00
5d99853502
Add getBlockConfidence rpc endpoint ( #6350 )
...
automerge
2019-10-14 15:24:10 -07:00
3313b2ff58
Fetch stage batching of forwarded txs ( #6349 )
...
automerge
2019-10-14 13:32:29 -07:00
322fcea6e5
More fullnode to validator renaming ( #6337 )
2019-10-11 13:30:52 -06:00
5650231df3
Increase buffer size for erasure meta DB column ( #6335 )
2019-10-11 12:18:11 -07:00
bf9c815b9e
Increase Index column buffers ( #6268 )
2019-10-10 23:17:39 -07:00
364781366a
Use sendmmsg for broadcasting shreds ( #6325 )
...
* Replace packet with slice of data in sendmmsg
* fixes
* fix bench
2019-10-10 19:38:48 -07:00
c6e4641781
Remove many uses of legacy term 'fullnode' ( #6324 )
2019-10-10 17:33:00 -06:00
753bd77b41
Use multicast to send retransmit packets ( #6319 )
2019-10-10 15:02:36 -07:00
1960ea8ed7
Add benches for shredding and poh ( #6307 )
...
* Add benches for shredding and poh
* ignore poh bench
* Factor out Poh bench as separate function
2019-10-10 14:00:24 -07:00
1b775044f7
Use multiple retransmit stage threads/sockets ( #6279 )
2019-10-10 13:24:03 -07:00
570b98c7bc
Multicast same packet to multiple destinations via sendmmg ( #6316 )
...
* Implement multicast same packet to multiple destinations using sendmmsg()
2019-10-10 13:09:15 -07:00
1f345ce2d9
Don't grab keypair from cluster info on every iteration of broadccast ( #6303 )
2019-10-09 17:36:45 -07:00
ed85aa43a4
Implement sendmmsg() API ( #6304 )
...
* Implement sendmmsg()
* fixes
2019-10-09 17:06:56 -07:00
4b0250192a
Remove remnants of the cuda feature flag ( #6298 )
...
automerge
2019-10-09 16:09:36 -07:00
dd66d16fdb
Broadcast final shred for slots that are interrupted ( #6269 )
...
* Broadcast final shred for slots that are interrupted
2019-10-09 16:07:18 -07:00
32312f3c16
Do not retransmit Repair responses ( #6284 )
...
* Do not retransmit Repair responses
* Add a test
* Refactor neighboring functionality
2019-10-09 13:11:19 -07:00
2db83e1a21
Remove greedy fetch in shred_fetch stage ( #6278 )
...
* Remove greedy fetch in shred_fetch stage
* cleanup
2019-10-09 10:36:05 -07:00
7cf90766a3
add epoch_schedule sysvar ( #6256 )
...
* add epoch_schedule sysvar
* book sheesh!
2019-10-08 22:34:26 -07:00
f2ee01ace3
Fix blocktree processor entry callback test ( #6285 )
2019-10-08 20:38:05 -04:00
5e31565574
Expand blocktree processor options ( #6248 )
...
* Refactor blocktree processor args and support full leader cache
* Add entry callback option
* Rename num_threads to override_num_threads
* Add test for entry callback
* Refactor cached leader schedule changes
* Add tests for blocktree process options
* Refactor test
* @mvines feedback
2019-10-08 17:58:49 -04:00
723f9a9b81
Remove unnecessary locking in retransmit stage ( #6276 )
...
* Add more detailed metrics to retransmit
* Remove unnecessary locking and add more metrics
2019-10-08 14:41:16 -07:00
c5e5342325
Rearrange broadcast stats ( #6274 )
2019-10-08 12:50:59 -07:00
788296047a
Increase batch size for recvmmsg() ( #6260 )
...
* Increase batch size for recvmmsg()
* fix tests
* new test
2019-10-08 09:54:49 -07:00
9dceb8ac74
Broadcast/Shredding Metrics ( #6270 )
...
automerge
2019-10-08 01:42:42 -07:00
ac2374e9a1
Shred entries in parallel ( #6180 )
...
* Make shredding more parallel
* Fix erasure tests
* Fix replicator test
* Remove UnfinishedSlotInfo
2019-10-08 00:42:51 -07:00
e12c577b16
remove verify_hash_internal_state ( #6261 )
2019-10-07 16:38:54 -07:00
ba7efbb136
Retransmit stage optimization, don't copy packets ( #6250 )
2019-10-07 15:33:22 -07:00
17f169f446
BlobFetchStage cleanup post shred work ( #6254 )
2019-10-07 11:08:01 -07:00
4870a2cbac
Panic when a snapshot fails to verify
2019-10-07 08:12:18 +09:00
da7d94d0f0
Retransmit stage benchmark ( #6249 )
2019-10-06 12:56:17 -07:00
cdef065cca
Broadcast Metrics ( #6166 )
...
* Add timing logigng to broadcast
* Shred metrics
* Fixes
2019-10-05 22:51:47 -07:00
5ef012b2c1
Tweak debug to remove unreadable datapoints ( #6060 )
2019-10-04 16:25:22 -07:00
0c3ff6b75c
Cli refactor: vote and storage program functionalities ( #6242 )
...
automerge
2019-10-04 14:18:19 -07:00
7f53737000
Periodically pull from the entrypoint if it's no longer in Crdt ( #6240 )
2019-10-04 14:18:07 -07:00
23ea8ae56b
Optimize retransmit stage ( #6231 )
...
* Optimize retransmit stage
* Remove comment
* Fix test
* Skip iteration to fixup 0 stakes
2019-10-04 11:52:02 -07:00
f9f5bc2eb5
More clippy
2019-10-02 21:21:07 -07:00
f331f1d1e9
Don't forward transaction to self ( #6218 )
2019-10-02 14:07:34 -07:00
211cae5811
Remove dead constants ( #6207 )
2019-10-01 18:22:57 -07:00
774e9df2e5
Finish unfininished slot before processing new slots ( #6197 )
2019-10-01 11:46:14 -07:00
ae7700296d
broadcast_shreds opt ( #6175 )
...
* Don't clone/copy/sort ContactInfo vec
2019-10-01 09:38:29 -07:00
520f7c3e18
Optimize BPF logs ( #6186 )
2019-09-30 14:21:29 -07:00
2c8c2029d8
cli: enforce rent-exemption balance for stake, vote and program accounts in cli ( #6118 )
...
* require minimum balance for stake, vote and program accounts
2019-10-01 01:14:49 +05:30
4f4618441c
split wallet staking commands ( #6168 )
...
* split wallet staking commands
* elide real home
* unit->UNIT for usage
* unit->UNIT, don't try to run SUBCOMMANDS: ;)
* more fixup
* fixups
* actually check
* shellcheck
* preserve #6158 after rebase
* fixup
* test
* too hard
* remove test
2019-09-29 21:18:15 -07:00
e5a7d08966
Add --expected-genesis-blockhash validator argument ( #6174 )
...
automerge
2019-09-29 19:09:24 -07:00
d50aef8404
Add get-epoch-info command ( #6161 )
...
automerge
2019-09-27 22:00:30 -07:00
5637f88aff
Don't try signging coding shred if fec rate is 0 ( #6171 )
...
automerge
2019-09-27 21:58:53 -07:00
c9e58743e7
Prevent subtract overflow panic when slot < MAX_LOCKOUT_HISTORY ( #6135 )
2019-09-26 19:40:18 -06:00
b4da83a3ab
Remove CUDA feature ( #6094 )
2019-09-26 13:36:51 -07:00
a964570b1a
add authorities to stake init ( #6104 )
...
* add authorities to stake init
* fixups
* code review
2019-09-26 13:29:29 -07:00
67d07254c2
Add rent estimation rpc ( #6109 )
...
* server side new rpc endpoint
* client side rpc
* take data_len as usize
Co-Authored-By: Tyera Eulberg <teulberg@gmail.com>
* add test and documentation
2019-09-26 23:27:13 +05:30
701d90a41d
Remove some AccountStorage Serialization ( #6047 )
...
* Remove serialization of AccountStorageEntry fields
* Add metric for evaluating BankRc serialization time
* Serialize AppendVec current len
* Add dashboard metrics
* Move flush of AppendVecs to packaging thread
2019-09-25 18:07:41 -07:00
43795193c4
add authorized parameters to vote api ( #6072 )
...
* add authorized parameters to vote api
* code review
2019-09-25 13:53:49 -07:00
e987d0094f
Move status cache serialization to the Snapshot Packager service ( #6081 )
...
* Move status cache serialization to the Snapshot Packager service
* Minor comment updates
* use ok_or_else instead of ok_or
* satus cache
* Remove assert when snapshot format is wrong
* Fix compile
* Remove slots_to_snapshot from bank forks
* Address review comment
* Remove unused imports
2019-09-25 13:42:19 -07:00
de3765ab70
Add erasure recovery stats to dashboard ( #6079 )
...
automerge
2019-09-24 19:59:42 -07:00
5f079137e5
Remove kvstore ( #6075 )
...
automerge
2019-09-24 19:59:32 -07:00
374b776a3e
Fix using temp file for archive ( #6058 )
...
* Fix using temp file for archive
* Rename the temp archive instead of hardlinking it
2019-09-24 15:24:54 -07:00
5763d63737
Additional tests for should_retransmit_and_persist ( #6062 )
...
automerge
2019-09-24 14:54:10 -07:00
3ed34b571c
Window service is filtering out coding shreds ( #6052 )
...
* Window service is filtering out coding shreds
* update erasure stats to indicate recovery count
* filter out outdated coding shreds
* address review comments
2019-09-24 12:25:25 -07:00
57e90948a8
Remove dead code from cluster_info ( #6051 )
2019-09-24 10:27:59 -07:00
26a20a7e62
nits ( #6032 )
2019-09-24 10:10:49 -07:00
7fa809c16d
Avoid hardlinking as that confuses tar ( #6042 )
2019-09-23 20:12:16 -07:00
84f74807d4
Skip considering banks older than the latest vote slot ( #6037 )
...
automerge
2019-09-23 19:40:03 -07:00
3a9c03cc89
Don't recover coding shreds ( #6034 )
...
* Don't recover coding shreds
* cleanup
2019-09-23 16:24:21 -07:00
62c22c6cb1
Fix really old banks triggering log spam ( #6025 )
2019-09-23 13:59:16 -07:00
dbd337c616
Upgrade to ReedSolomon 4.0 release ( #6026 )
2019-09-23 13:53:52 -07:00
eeda7338cc
Dump tar stdout/err on failure for better debug ( #6024 )
2019-09-23 13:05:09 -07:00
8240d1fe0a
Confidence implementation ( #5993 )
...
* Change confidence parameters
* Add status_cache_ancestors to get all relevant ancestors of a bank including roots from status cache
* Fix and add tests
* Clippy
2019-09-20 19:38:56 -07:00
fd6e7020eb
Fix bank overlapping another bank's broadcast ( #6012 )
2019-09-20 19:37:40 -07:00
a60a3efc1a
Revert "require stake, vote and executable accounts to be rent exempt ( #5928 )" ( #6005 )
...
This reverts commit 11e6197a83
2019-09-20 14:10:39 -07:00
19ae556857
hash account state on store ( #5573 )
2019-09-20 13:21:12 -07:00
3d44cffcda
✨ Beautify metrics datapoint logging ( #5998 )
2019-09-20 12:00:43 -07:00
c9be9acd14
log snapshot time ( #5996 )
2019-09-20 08:03:00 -07:00
11e6197a83
require stake, vote and executable accounts to be rent exempt ( #5928 )
...
* require vote account to be exempt
* make stake account rent exempt
* add rent exempted system instruction
* use rent exemption instruction in vote and stake api
* use rent exempted account while creating executable account
* updating chacha golden hash as instruction data has changed
* rent will be initialized for genesis bank too
2019-09-20 16:52:17 +05:30
d379786c90
Fix bind errors ( #5986 )
...
* Add ability to bind to a common tcp/udp port
* Extend port range for local-net sanity and fix validator executable
2019-09-19 17:16:22 -07:00
ca9d4e34df
Broadcast stage tuning ( #5989 )
2019-09-19 16:29:52 -07:00
5cbd1190b2
transaction batch ( #5962 )
...
* transaction batch
* fixup
2019-09-19 10:06:08 -07:00
0dbf7995b5
Remove unnecessary serialize of shred data ( #5967 )
...
* Remove unnecessary serialize of shred data
* remove obsolete code
* fix golden hash
2019-09-18 20:08:27 -07:00
e0858cfe06
Add parallel shred signing to shredder ( #5964 )
2019-09-18 18:00:07 -07:00
783e8672e7
Removed Shred enum ( #5963 )
...
* Remove shred enum and it's references
* rename ShredInfo to Shred
* clippy
2019-09-18 16:24:30 -07:00
6c4e656795
Remove obsoleted code from shred ( #5954 )
...
* Remove obsoleted code from shred
* fix broken test
2019-09-18 13:56:44 -07:00
b757294864
Add minor performance bump to shredding ( #5956 )
2019-09-18 12:35:52 -07:00
0d4a2c5eb0
simplify poh recorder => broadcast channel ( #5940 )
...
* simplify poh recorder broadcast channel
* fixup
* fixup
2019-09-18 12:16:22 -07:00
2f50d0e145
Refactor confidence from replay stage ( #5938 )
2019-09-17 19:43:40 -07:00
ff608992ee
Replace Shred usage with ShredInfo ( #5939 )
...
* Replace Shred usage with ShredInfo
* Fix tests
* fix clippy
2019-09-17 18:22:46 -07:00
a2595b44c6
test randomize with error ( #5916 )
...
* test randomize with error
* update magic numbers
* fixup
* fixup
* fixup
* no more blobs
* fixup
2019-09-17 15:11:29 -07:00
14cb6353c0
Change erasure ratio to 0.25 and increase data shreds to 16 ( #5931 )
...
* Change erasure ratio to 0.25 and increase data shreds to 16
* Fix case where no coding shreds are requested
2019-09-17 11:59:14 -07:00
e26f68fe62
Get transactions from LockedAccountsResults when possible ( #5923 )
2019-09-17 08:41:56 -07:00
f10438d530
Respect randomized transaction order when unlocking accounts ( #5918 )
2019-09-16 21:45:16 -07:00
7459eb15c3
A new data-structure in shreds for partial deserialization ( #5915 )
...
* A new datastructure in shreds for partial deserialization
* fix chacha golden hash
* fix clippy and address review comments
2019-09-16 20:28:54 -07:00
c44e7ce184
Leaders should not broadcast to replicators ( #5917 )
2019-09-16 17:56:34 -07:00
82615c703b
Switch erasure to solana-reed-solomon-erasure ( #5913 )
...
* Switch to solana-reed-solomon-erasure
* Disable Rayon for solana-reed-solomon-erasure
2019-09-16 16:14:55 -07:00
d5ba90d375
Don't verify blobs that are less than root in window service ( #5901 )
2019-09-16 13:13:53 -07:00
5f54573613
More shred related cleanup ( #5909 )
...
* More shred related cleanup
* fix uncle
2019-09-16 10:28:28 -07:00
c1880e3f3e
Reduce number of shreds per FEC block ( #5908 )
2019-09-15 10:37:12 -07:00
ee791e2e3e
Optimizations to shred writing and signing ( #5890 )
...
* Optimizations to shred writing and signing
* fix broken tests
* fixes
2019-09-14 21:05:54 -07:00
ceacc42126
Call gpu init earlier to force compilation. ( #5902 )
2019-09-14 12:32:57 -07:00
84c8a5bbec
Add replay-stage-mark_dead_slot datapoint ( #5907 )
2019-09-14 08:50:53 -07:00
8135279335
Reduce serialize/deserialize in shred recovery ( #5887 )
2019-09-12 21:52:13 -07:00
c1d788880d
Limit Rayon threadpool threads ( #5871 )
2019-09-12 11:39:39 -07:00
385086359c
Reduce serializations/deserializations of shreds ( #5879 )
2019-09-12 10:10:25 -07:00
1853771930
Add support for SDK sysvar types ( #5876 )
2019-09-10 18:53:02 -07:00
ee4266bc59
Remove banks in locktower not in bank_forks ( #5837 )
...
* Remove unnecessary calculations from collect_vote_lockouts
* Add test for locktower startup from snapshot
2019-09-10 13:58:27 -07:00
b426dfb2c0
Change tx batching in banking process and record ( #5832 )
...
* Change tx batching in banking process and record
* Change batching to reduce impact on replay stage
2019-09-10 11:04:03 -07:00
fd33b27af1
Fix coding shred generator ( #5865 )
2019-09-10 09:35:07 -07:00
7682db4826
Generate coding shreds on the fly based on erasure limits ( #5852 )
...
* Generate coding shreds on the fly based on erasure limits
* fix uncle
2019-09-09 17:26:51 -07:00
7607800d47
Refactor restart function in local cluster to support separate exit and restart functions ( #5845 )
2019-09-08 17:53:34 -07:00
df205f8752
Use ureq instead of influx_db_client ( #5839 )
2019-09-07 12:48:45 -07:00
e8d88f3237
Split SDK's timing.rs ( #5823 )
2019-09-06 14:30:56 -07:00
1f9fde5f7b
ThinClient internal name grooming ( #5800 )
2019-09-06 09:07:40 -07:00
a452249bf3
Use retain on Packets instead of creating new ones ( #5804 )
...
* Use remove on Packets instead of creating a new one
* Fix compile after rebase
2019-09-05 19:16:18 -07:00
3d3b03a123
Verify signature of recovered shred before adding them to blocktree ( #5811 )
...
* Verify signature of recovered shred before adding them to blocktree
* fix failing tests, and review comments
2019-09-05 18:20:30 -07:00
05d2eec45c
Remove unnecessary erasure config references ( #5809 )
2019-09-05 14:46:41 -07:00
3237e897d7
Adjust packet batching post-decoupling from blobs ( #5783 )
2019-09-05 11:22:39 -07:00
bd74e63702
Offload remaining confidence cache computation to separate thread ( #5792 )
...
* Move remaining confidence cache computation to separate thread
* Move confidence cache out of bank forks
2019-09-04 23:10:25 -07:00
f78b865cba
Cleanup shreds to remove FirstShred data structure ( #5789 )
...
* Cleanup shreds to remove FirstShred data structure
* Also reduce size used by parent slot information in shred header
* clippy
* fixes
* fix chacha test
2019-09-04 21:06:47 -07:00
7062fe4b47
Refactor Blocktree for clarity and correctness ( #5700 )
...
* Refactor shreds to prevent insertion of any metadata on bad shreds
* Refactor fetching Index in blocktree
* Refactor get_slot_meta_entry
* Re-enable local cluster test
* cleanup
* Add tests for success/fail insertion of coding/data shreds
* Remove assert
* Fix and add tests for should_insert coding and data blobs
2019-09-04 17:14:42 -07:00
02ee2a601c
Further cleanup of blocktree after Blob deprecation ( #5780 )
2019-09-04 12:47:09 -07:00
dfa6238342
Remove unnecessary construction of descendants ( #5742 )
2019-09-04 01:49:42 -07:00
3b0d48e3b8
Remove blocktree blob references ( #5691 )
...
* Remove blocktree blob references
* fixes and cleanup
* replace uninitialized() call with MaybeUninit
* fix bench
2019-09-03 21:32:51 -07:00
62f6a78ccd
Make data plane shred filter parallel again ( #5740 )
2019-09-03 21:50:57 +00:00
85e5fbeb35
Add absoluteSlot to getEpochInfo ( #5765 )
2019-09-02 12:21:06 -07:00
475f6fe666
votes only need slots and the last bank hash ( #5499 )
...
churn
cleanup
reverse test slot hashes
test check_slots_are_valid
updates
only send the minimum bank vote difference
fixup! only send the minimum bank vote difference
some banks may not have a voting account setup
fixup! votes only need slots and the last bank hash
fixup! fixup! votes only need slots and the last bank hash
fmt
fixed compare
fixed vote
fixup! fixed vote
poke ci
filter the local votes via the last bank vote
2019-09-02 12:01:09 -07:00
0c2a49391a
Disable pinned gpu memory ( #5753 )
2019-08-31 16:44:07 -07:00
e3a6c9234a
Entrypoint RPC service discovery now blocks until the entrypoint is actually found ( #5756 )
...
automerge
2019-08-30 16:12:58 -07:00
4786143524
Add a more helpful error on genesis block mismatch ( #5744 )
...
automerge
2019-08-30 09:10:22 -07:00
8adac30c05
Integrate shreds to the replicators ( #5711 )
...
* Integrate shreds to the replicators
* fix cuda stuff
* fix cuda tests
2019-08-28 22:34:47 -07:00
7dfb735db9
randomize tx ordering ( #4978 )
...
Summary of Changes:
This change adds functionality to randomize tx execution for every entry. It does this by implementing OrderedIterator that iterates tx slice as per the order specified. The order is generated randomly for every entry.
2019-08-28 21:08:32 +05:30
2510f3d352
Remove extra call to serialize in shred verify ( #5698 )
2019-08-27 19:28:00 -07:00
47535b9ff1
Use serialize_into to fill in shreds instead of writing one byte at a time ( #5695 )
...
automerge
2019-08-27 17:11:24 -07:00
34ab25a88b
feat: getInflation() endpoint ( #5681 )
2019-08-27 18:17:03 -04:00
8b9c3a2561
Blocktree last_root to enforce a slot floor ( #5593 )
...
* Add last_root to blocktree
* Don't repair earlier than last_root
* Add integration test to make sure blocktree floor is enforced
2019-08-27 15:09:41 -07:00
0c62cf8980
Add metrics for snapshot generation ( #5677 )
2019-08-27 13:04:20 -07:00
f1d58f980b
Ignore retransmit channel error ( #5680 )
...
automerge
2019-08-27 12:41:04 -07:00
12ad95eb5e
Erasure statistics for shreds ( #5676 )
2019-08-27 11:22:06 -07:00
a29f0484dc
Add newline before cluster info log ( #5671 )
2019-08-27 08:33:48 -07:00
db768b4c3a
Log contact info every 10 seconds ( #5663 )
2019-08-26 18:31:14 -07:00
4ac1213c9c
Integrate coding shreds and recovery ( #5625 )
...
* Integrate coding shreds and recovery
* More tests for shreds and some fixes
* address review comments
* fixes to code shred generation
* unignore tests
* fixes to recovery
2019-08-26 18:27:45 -07:00
a0f3208828
Ignore flaky test_banking_stage_entryfication ( #5659 )
...
automerge
2019-08-26 16:49:34 -07:00
28f2c75137
Add bigger buffers for shred column families in rocks ( #5653 )
...
automerge
2019-08-26 15:58:26 -07:00
615da845cd
remove replicode in run_purge_batch() ( #5630 )
...
* remove replicode
* bigger timeout
* backout 90 min timeout
2019-08-26 09:47:48 -07:00
52da207f83
test_snapshots_restart_validity now passes ( #5644 )
...
automerge
2019-08-25 21:33:41 -07:00
6e82978931
Fix race with LedgerCleanupService ( #5622 )
2019-08-23 23:40:20 -07:00
4e827af392
Remove unnecessary trailing semicolons ( #5636 )
2019-08-23 22:47:54 -07:00
0ffe7a9c8f
plumb some rent ( #5610 )
...
* plumb some rent
* nits
* fixups
* fixups
* fixups
2019-08-23 14:04:53 -07:00
3fc5009ef2
Snapshot pipefitting through the validator cli ( #5617 )
...
* Handle 404 errors better
* Snapshot pipefitting through the validator cli
* Add download progress bar
* Log the current entrypoint slot
2019-08-23 13:02:07 -07:00
52f6da5cee
upgrade rust to 1.37 ( #5611 )
2019-08-23 08:55:51 -07:00
aeaa0feb61
Add range lookups for erasure set indexes ( #5612 )
2019-08-22 16:32:38 -07:00
087c43b9ef
Add snapshotting integration test ( #5519 )
...
* Add snapshotting integration test
* Update ContactInfo on restart in local cluster nodes
2019-08-21 23:59:11 -07:00
c18ea3ccc9
Fix ignored tests in blocktree ( #5591 )
2019-08-21 20:07:51 -07:00
e2d6f01ad3
solana-validator now verifies its genesis blockhash against the cluster entrypoint ( #5589 )
2019-08-21 18:16:40 -07:00
faafee6b42
to to/the the ( #5590 )
2019-08-21 17:46:59 -07:00
80f618f011
Add info logging around snapshot tarball generation ( #5592 )
...
automerge
2019-08-21 16:36:21 -07:00
0dc0594aaa
Fixes to repair and orphan logic for data shreds ( #5587 )
2019-08-21 15:27:42 -07:00
d651cb7a25
Adjust |ulimit -n| automatically, no bash required ( #5586 )
2019-08-21 14:55:58 -07:00
afaf95cf53
Refine error message when ledger can't be opened ( #5582 )
2019-08-21 09:44:12 -07:00
bb558acdf0
Change JsonRpc exit to use wait->close ( #5566 )
...
* Add wait-close-join pattern to rpc_service
* Create ValidatorExit struct
2019-08-20 23:59:31 -07:00
4798e7fa73
Integrate data shreds ( #5541 )
...
* Insert data shreds in blocktree and database
* Integrate data shreds with rest of the code base
* address review comments, and some clippy fixes
* Fixes to some tests
* more test fixes
* ignore some local cluster tests
* ignore replicator local cluster tests
2019-08-20 17:16:06 -07:00
93ae98812b
change DEFAULT_NUM_TICKS_PER_SECOND to DEFAULT_TICKS_PER_SECOND ( #5559 )
2019-08-19 23:22:56 -07:00
bd193535c9
Cap CrdsFilter sizes such that PullRequest no longer exceeds MTU ( #5561 )
2019-08-19 18:14:10 -07:00
814af378a7
stake cooldown ( #5553 )
...
* stake cooldown
* fixups
* sheesh
2019-08-17 18:12:30 -07:00
01eb7600d9
use stake config to defeat warmup in local_cluster ( #5549 )
...
* use stake config to defeat warmup in local_cluster
* fixups
2019-08-17 12:28:36 -07:00
ccee6241a6
Revert "publish fixes"
...
This reverts commit 4d13d3871d
2019-08-16 17:28:07 -07:00
4d13d3871d
publish fixes
2019-08-16 17:03:57 -07:00
bb0c9d6145
Log more info at the start of PoH ( #5550 )
2019-08-16 16:20:20 -07:00
8d105042ea
Update getEpochVoteAccounts to getVoteAccounts ( #5543 )
...
* Rework getEpochVoteAccounts into getVoteAccounts
* Update client apis
* Update docs
* Review comments
2019-08-16 17:02:19 -06:00
84304cb0fc
Display vote pubkey at startup ( #5548 )
2019-08-16 15:56:06 -07:00
99eeb63f71
move the rest of cluster to local_cluster ( #5535 )
2019-08-16 00:00:38 -07:00
e73cbdda61
Reduce log level for known issue ( #5536 )
...
automerge
2019-08-15 19:42:27 -07:00
94f1132fb6
fix single node testnet, remove bootstrap vote ( #5534 )
2019-08-15 18:58:46 -07:00
4ee212ae4c
Coalesce gossip pull requests and serve them in batches ( #5501 )
...
* Coalesce gossip pull requests and serve them in batches
* batch all filters and immediately respond to messages in gossip
* Fix tests
* make download_from_replicator perform a greedy recv
2019-08-15 17:04:45 -07:00
d5fb493aa4
Change recv to try_recv ( #5533 )
2019-08-15 15:17:46 -07:00
471bc73a23
Fix Rust 1.37.0 compiler warnings ( #5530 )
...
Looks like most usages of trait objects should have introduced
a type variable instead.
2019-08-15 14:00:09 -06:00
4688f9821f
Snapshot optimizations ( #5525 )
...
* Change serializing snapshot tar to use shell command
2019-08-14 23:14:40 -07:00
9f6c9c428b
Move genesis/snapshot archive download into Rust ( #5515 )
2019-08-14 19:25:22 -07:00
d22848f9b1
use live stakes for consensus ( #5426 )
...
* use live stakes for consensus
* lint
* re-enable leader_failure_4
* fixups
* re-ignore leader_failure_4
2019-08-14 13:30:21 -07:00
d791c70d90
Snapshot optimizations ( #5518 )
...
* Limit slots_since_snapshot size, only package latest snapshot, refactor tests
* Add test checking status_cache.roots == bank_forks.slots_since_snapshot after bank_forks.set_root()
2019-08-13 22:39:29 -07:00
1d0608200c
Restore blob size fix ( #5516 )
...
* Revert "Revert "Fix gossip messages growing beyond blob size (#5460 )" (#5512 )"
This reverts commit 97d57d168b
2019-08-13 18:04:14 -07:00
cd14a940d8
Allow process_blocktree() to start processing from any root ( #5484 )
...
* Remove unnecessary entry_height from BankInfo
* Refactor process_blocktree to support process_blocktree_from_root
* Refactor to process blocktree after loading from snapshot
* On restart make sure bank_forks contains all the banks between the root and the tip of each fork, not just the head of each fork
* Account for 1 tick_per_slot in bank 0 so that blockhash of bank0 matches the tick
2019-08-13 17:20:14 -07:00
58d4e32c97
Remove serialization of future AppendVecs and serialize AccountStorage correctly ( #5510 )
2019-08-13 16:05:37 -07:00
08f6a2ea3e
debash: Add `solana-gossip get-rpc-url` command to avoid hard coding ( #5513 )
2019-08-13 10:49:48 -07:00
97d57d168b
Revert "Fix gossip messages growing beyond blob size ( #5460 )" ( #5512 )
...
This reverts commit a8eb0409b7
2019-08-13 10:29:26 -07:00
07d11be6ab
add global stake warmup ( #5483 )
...
* add global stake warmup
* integrate stake history into runtime
* fixup core tests
* fixup
* remove existing cooldown tests for now
2019-08-12 20:59:57 -07:00
a43922ccbf
Boot hashbrown ( #5505 )
...
As of Rust 1.36.0, hashbrown now implements the HashMap in std (which
implements HashSet).
https://blog.rust-lang.org/2019/07/04/Rust-1.36.0.html#a-new-hashmapk,-v%3E-implementation
2019-08-12 16:46:49 -06:00
b7a5136136
Helper functions for shreds ( #5493 )
2019-08-12 15:27:58 -07:00
0fde19239b
Rate limit counter metrics points to one per second ( #5496 )
...
* Rate limit counter metrics points to one per second
* Remove old env var
* Test that metrics counter is incrementing
* Fix typo
2019-08-12 18:15:34 -04:00
a8eb0409b7
Fix gossip messages growing beyond blob size ( #5460 )
...
* fixed bloom filter math
* Add split each pull request into multiple pulls with different filters
* Rework CrdsFilter to generate all possible masks to cover the keyspace
* Limit the bloom sizes such that each pull request is no larger than mtu
2019-08-12 13:51:29 -07:00
1b84092b94
Fix slots_since_snapshot in BankForks.add_root() ( #5489 )
2019-08-12 11:56:03 -07:00
b1d43ace14
Add columns for data and code shreds ( #5461 )
2019-08-12 10:03:57 -07:00
54f4d13350
Validator log filter may now be reconfigured at runtime ( #5473 )
...
* Log filter may now be reconfigured at runtime
* Add RPC API and bash script to reconfigure the log filter
2019-08-10 22:54:46 -07:00
5884469d11
count commitable in banking_stage ( #5477 )
2019-08-09 21:14:20 -07:00
ed093f86f9
harmonize percentage members ( #5459 )
...
* harmonize percentage members
* update tests
* update capitalization when burning fees
* verify capitalization in fee burn
* fixup
2019-08-09 13:58:46 -07:00
5b4ee36cfd
Log more socket addresses at validator startup ( #5471 )
2019-08-08 15:38:23 -07:00
4f86c0b74a
Rate limit transaction counters ( #5447 )
...
* Rate limit transaction counters
* @sakridge feedback
* Set default high metrics rate for multinode demo
* Fix tests
* Swap defaults and fix env var tests
* Only set metrics rate if not already set
2019-08-08 17:05:06 -04:00
Pankaj Garg
sakridge
sakridge
Tyera Eulberg
Michael Vines
Greg Fitzgerald
carllin
Sagar Dhawan
Rob Walker
Justin Starry
Jack May
Parth
anatoly yakovenko
Sunny Gleason