094c391cd7
Bump itertools from 0.8.1 to 0.8.2 ( #7111 )
...
Bumps [itertools](https://github.com/bluss/rust-itertools ) from 0.8.1 to 0.8.2.
- [Release notes](https://github.com/bluss/rust-itertools/releases )
- [Commits](https://github.com/bluss/rust-itertools/commits/v0.8.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-11-25 10:22:47 -07:00
c965a110f2
Use unbounded channel ( #7081 )
2019-11-21 14:23:40 -07:00
8cbc450192
Create genesis.tar.bz2 in solana-genesis ( #7039 )
...
* Use clap_utils
* Create genesis.tar.bz2 in solana-genesis
* Remove shell-based genesis.tar.bz2 generation
* Make Option=>Result conv more rusty
* stop using solana_logger
* Simplify by just using vec!
* clean up abit
2019-11-21 10:57:27 -07:00
3415db9739
Merge api/program into single units ( #7061 )
2019-11-20 16:32:19 -08:00
97ca6858b7
Write transaction status and fee into persistent store ( #7030 )
...
* Pass blocktree into execute_batch, if persist_transaction_status
* Add validator arg to enable persistent transaction status store
* Pass blocktree into banking_stage, if persist_transaction_status
* Add validator params to bash scripts
* Expose actual transaction statuses outside Bank; add tests
* Fix benches
* Offload transaction status writes to a separate thread
* Enable persistent transaction status along with rpc service
* nudge
* Review comments
2019-11-20 16:43:10 -07:00
d184d3a732
Merge native programs parts into one unit ( #7047 )
2019-11-20 10:12:43 -08:00
d2ed921bc6
Cleanup nightly warnings ( #7055 )
2019-11-19 20:15:37 -08:00
ea656b1a3f
Add parent slot to getConfirmedBlock ( #7038 )
...
* Add parent slot to getConfirmedBlock
* Fix bad text-replace
* Use camelCase in getConfirmedBlock
2019-11-19 09:39:55 -07:00
6bfe0fca1f
Add a version field to shreds ( #7023 )
...
* Add a version field to shreds
* Clippy
* Fix Chacha Golden
* Fix shredder bench compile
* Fix blocktree bench compile
2019-11-18 18:05:02 -08:00
e0a2bb9d86
Legitimately map transactions to statuses in blocktree ( #7011 )
...
* Refactor rocksdb TransactionStatus to store/return struct; hook up map_transactions_to_statuses
* Cleanup use statements
2019-11-18 09:12:42 -07:00
3bc8d78801
Add ConfirmedBlock struct, and rework Blocktree apis to include block… ( #7004 )
...
* Add RpcConfirmedBlock struct, and rework Blocktree apis to include blockhash info and dummy tx statuses
* Remove unused lifetime
2019-11-17 20:17:15 -07:00
086e5da8d0
feat: add TransactionStatus column family and test ( #6958 )
2019-11-17 11:26:01 -05:00
c1b06817a2
Add non-dev value for slots_per_epoch and use that as default ( #6984 )
...
When --dev flag is not passed.
2019-11-16 20:53:54 -08:00
7c32640a9b
Set index and set data should write into shred data ( #6995 )
2019-11-16 02:41:59 -08:00
0ca943f49b
RecyclerCache for shred_sigverify ( #6986 )
...
automerge
2019-11-15 12:16:56 -08:00
852a2146ab
Add Blocktree api to get transactions by slot ( #6966 )
...
* Add blocktree method to get confirmed-block txs
* Clean up use statements
* Add test, and fmt
* Plumb new blocktree method into getConfirmedBlock
2019-11-14 16:34:39 -07:00
79d7090867
Remove obsolete references to Blob ( #6957 )
...
* Remove the name "blob" from archivers
* Remove the name "blob" from broadcast
* Remove the name "blob" from Cluset Info
* Remove the name "blob" from Repair
* Remove the name "blob" from a bunch more places
* Remove the name "blob" from tests and book
2019-11-14 11:49:31 -08:00
e7f63cd336
Upgrade to rust 1.39.0 ( #6939 )
...
* Upgrade to rust 1.39.0
* 1.39.0 clippy
2019-11-14 12:27:01 -07:00
d6cbb02c92
Bump rocksdb from 0.12.4 to 0.13.0 ( #6952 )
...
automerge
2019-11-14 09:59:54 -08:00
43e2301e2c
Fix roots overrunning broadcast ( #6884 )
...
* Add trusted pathway for insert_shreds to avoid checks
2019-11-14 00:32:07 -08:00
6009801c5f
More granular timings in shred generation ( #6900 )
2019-11-13 16:30:12 -08:00
ee5cc733a1
Log blocktree and snapshot open times ( #6930 )
...
automerge
2019-11-13 11:20:39 -08:00
9026339d35
Restore is_frozen() asserts ( #6925 )
2019-11-13 10:40:51 -07:00
fcc2874591
Remove/address some TODOs ( #6923 )
2019-11-13 09:43:15 -07:00
30a08f4282
Cleanup ledger macros ( #6916 )
...
automerge
2019-11-13 07:14:09 -08:00
2fd2140f64
🍢 banking-bench/, genesis-programs/ and local-cluster/ ( #6920 )
...
* git mv genesis_programs genesis-programs
* git mv local_cluster local-cluster
* git mv banking_bench banking-bench
2019-11-12 22:20:48 -07:00
6d76c34291
Handle dead slots when loading ledger ( #6887 )
2019-11-12 13:38:26 -07:00
5670cafda4
Fix caching data shreds as coding shreds ( #6877 )
2019-11-12 10:29:58 -08:00
e8e13fdeeb
Insert coding shreds to blocktree only if needed in future ( #6836 )
...
* Insert coding shreds to blocktree only if needed in future
* fixes
2019-11-11 13:12:55 -08:00
9807f47d4e
Rename genesis block to genesis config ( #6816 )
2019-11-08 23:56:57 -05:00
02058ea699
Reject blocks with invalid last ticks in replay stage ( #6833 )
...
* Reject blocks with invalid last ticks in replay stage
* slot_full
2019-11-08 20:21:54 -05:00
efdfc5c327
Remove TODOs ( #6843 )
2019-11-08 16:43:18 -07:00
66a0f54097
Replay should respect order of register_ticks with respect to blockhashes ( #6805 )
2019-11-08 12:29:41 -07:00
5bd05fba09
require `to` account signature ( #6658 )
...
* require to signature
* fixing invocation to create_account
* fix create_account references
* address review comment
* whacking bugs in tests
* fixing stake program tests
2019-11-08 15:57:35 +05:30
8e81bc1b49
Fix pinning ( #6604 )
...
Remove Deref implementations and add more pass-throughs to the PinnedVec
wrapper.
Warm recyclers
set_pinnable
2019-11-07 19:48:33 -08:00
b64b54f48f
unfork dalek ed25519 ( #6776 )
2019-11-07 17:08:10 -08:00
ccac35fc01
Increase FEC ratio to 32:32 ( #6800 )
...
automerge
2019-11-07 16:38:06 -08:00
67d1e2903c
Upgrade Repair be more intelligent and agressive ( #6789 )
...
* Upgrade Repair be more intelligent and agressive
* Fix u64 casts
* Fix missing bracket
* Add 1 second delay to test to allow repair to kick in
2019-11-07 11:08:09 -08:00
0ace79939b
Add reference tick to data shreds ( #6772 )
...
* Add reference tick to data shreds
* fix tests
2019-11-06 13:27:58 -08:00
5e8668799c
Fewer recyclers. ( #6770 )
...
automerge
2019-11-06 12:35:51 -08:00
67f636545a
Refactor sigverify to stage for signing shreds on the GPU ( #6635 )
...
automerge
2019-11-06 10:52:30 -08:00
7ff2a44a63
Make last shred for an interrupted slot signed + typed ( #6760 )
2019-11-06 08:25:17 -07:00
9614d17024
Limit deserialization of data coming off the wire ( #6751 )
...
* Limit deserialization of data coming off the wire
* Feedback and cleanup
2019-11-06 00:07:57 -08:00
09e648f957
ledger-tool/: Include full validator voting history in fork-graph ( #6756 )
2019-11-05 19:40:00 -07:00
85c9a231c1
Include the affected slot in blocktree error metrics ( #6734 )
2019-11-05 13:25:21 -07:00
7203036e3e
Adjust nofiles within Blocktree::open() for all ledger/ users ( #6737 )
...
automerge
2019-11-05 11:18:49 -08:00
d207a34736
remove duplicate signal handling ( #6702 )
2019-11-05 11:36:51 +05:30
fba1af6ea9
ledger-tool can now load a ledger snapshot ( #6729 )
2019-11-04 22:14:55 -07:00
b825d04597
Pull perf into a separate module. ( #6718 )
...
automerge
2019-11-04 20:13:43 -08:00
4d52f47f87
Move get_bank_forks() into ledger/ so its available for use by ledger-tool/ ( #6720 )
2019-11-04 19:10:06 -07:00
efe260f12e
sysvar trait ( #6667 )
...
* sysvar trait
* get the new guy in on it
2019-11-04 12:31:24 -08:00
9ea398416e
Sign shreds on the GPU ( #6595 )
...
* sign gpu shreds
* wip
* checks
* tests build
* test
* tests
* test
* nits
* sign cpu test
* write out the sigs in parallel
* clippy
* cpu test
* prepare secret for gpu
* woot!
* update
* bump perf libs
2019-11-02 06:23:14 -07:00
50a17fc00b
Use Slot and Epoch type aliases instead of raw u64 ( #6693 )
...
automerge
2019-11-02 00:38:30 -07:00
a4d48df30a
Add assertion when filling blocktree slot with ticks ( #6664 )
...
automerge
2019-10-31 14:15:07 -07:00
c52830980a
Rework get_slot_meta ( #6642 )
...
* Assert slotmeta is not orphan
* Clean up get_slot_meta functionality
* Add test
2019-10-31 14:03:41 -07:00
e8e5ddc55d
Verify number of hashes for each block of entries ( #6262 )
...
* Verify number of hashes for each block of entries
* Fix blocktree processor tick check
* Rebase once more
2019-10-31 16:38:50 -04:00
111942a47d
document clock ( #6662 )
2019-10-31 13:26:55 -07:00
9d65e6f183
Fix check in should_insert_data_shred ( #6649 )
2019-10-30 23:37:25 -07:00
6454bfe754
Rework get_index_meta ( #6636 )
2019-10-30 16:48:59 -07:00
a5ef78f709
Expand CF's ( #6528 )
2019-10-29 16:18:03 -07:00
b04c8c1c1a
Demote blocktree metrics log level ( #6590 )
...
automerge
2019-10-28 14:46:43 -07:00
243fa6cf63
Shred gpu sigverify ( #6520 )
...
Implement APIs for verifying shred signatures on the GPU.
2019-10-28 10:29:38 -07:00
30c0a7d069
Bump serde from 1.0.101 to 1.0.102 ( #6581 )
...
automerge
2019-10-28 09:19:39 -07:00
71b4e765c8
Bump itertools from 0.8.0 to 0.8.1 ( #6583 )
...
Bumps [itertools](https://github.com/bluss/rust-itertools ) from 0.8.0 to 0.8.1.
- [Release notes](https://github.com/bluss/rust-itertools/releases )
- [Commits](https://github.com/bluss/rust-itertools/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-28 08:26:15 -07:00
73dd5aa2d1
Bump serde_derive from 1.0.101 to 1.0.102 ( #6582 )
...
Bumps [serde_derive](https://github.com/serde-rs/serde ) from 1.0.101 to 1.0.102.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.101...v1.0.102 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2019-10-28 08:24:13 -07:00
6efaaa9d7a
Blocktree metrics ( #6527 )
...
* Add metrics for blocktree performance
* Plumb metrics through window service
2019-10-26 16:15:59 -07:00
e1b35f9847
Fix race in `blocktree.insert_shreds` ( #6550 )
...
* Add guard for blocktree insert_shreds
* Add test
2019-10-26 04:09:58 -07:00
73c31d873e
Update Cargo.toml versions from 0.20.0 to 0.21.0 ( #6568 )
2019-10-25 17:40:49 -06:00
7f3072d53a
ignore test_fail_entry_verification_leader ( #6537 )
...
* Revert "Revert "Restore CUDA-based unit tests (#6518 )""
This reverts commit 27f38a3770
2019-10-24 21:16:17 -07:00
27f38a3770
Revert "Restore CUDA-based unit tests ( #6518 )"
...
This reverts commit dc52b17c4d
2019-10-24 11:34:53 -07:00
a2543e5a8d
Upgrade RocksDB ( #6496 )
...
* Upgrade rocksdb
* Delete BatchProcessor
Those methods don't need to be `&mut self` and they're causing
compilation failures.
2019-10-24 11:30:53 -06:00
b4119c454a
credit_only credits forwarding ( #6509 )
...
* credit_only_credits_forwarding
* whack transfer_now()
* fixup
* bench should retry the airdrop TX
* fixup
* try to make bench-exchange a bit more robust, informative
2019-10-23 22:01:22 -07:00
dc52b17c4d
Restore CUDA-based unit tests ( #6518 )
2019-10-23 20:09:28 -07:00
955d0ab76f
Cleanup blocktree ( #6508 )
...
* Cut down on liberal use of borrow()
* No need to map_err(Into::into)
* Group From instances
* Remove Direction indirection
* Let rustfmt order imports
* Better copypasta
* Cleanup copypasta
* Add explicit lifetimes so that it doesn't get pegged to 'static when we upgrade rocksdb
* Remove redundant type aliases
2019-10-23 17:13:21 -06:00
f1172617cc
Purge accounts with lamports=0 on rooted forks ( #6315 )
2019-10-23 12:46:48 -07:00
03d29a8311
Async poh verify ( #6353 )
...
* Async poh verify
* Up ticks_per_s to 160
GPU poh verify needs shorter poh sequences or it takes forever to
verify. Keep slot time the same at 400ms.
* Fix stats
* Don't halt on ticks
* Increase retries for local_cluster tests and make repairman test serial
2019-10-23 12:11:04 -07:00
35cc74ef25
Add GenesisBlock::OperatingMode to control how cluster features are activated ( #6430 )
2019-10-23 11:50:10 -07:00
45b2c138e5
Remove circular dependencies in blocktree ( #6494 )
...
* Delete dead code
* Flatten modules
* Break blocktree dependency cycle
* Move BloctreeError into blocktree_db
Fewer dependency cycles
* Inline column family names
Fewer circular dependencies
* Cleanup imports
* Fix build
2019-10-22 09:20:19 -06:00
75d68edfe7
Remove unused re-exports of database types and related dead code ( #6490 )
2019-10-22 06:36:42 -06:00
b38bf90de7
Deshred blocks in parallel ( #6461 )
...
* Deshred in parallel
* Add tests for corrupt slots and parallel deshred
* Rename load_blocktree_entries to load_blocktree_entries_with_shred_count
2019-10-21 16:15:10 -07:00
84e911361a
Use constants instead of lazy_static for shred header sizes ( #6472 )
2019-10-21 12:46:16 -07:00
48eafcc74f
Remove dead code in Rocks wrapper ( #6469 )
...
automerge
2019-10-21 10:18:54 -07:00
09abbd93b1
Cleanup register_tick special handling ( #6462 )
2019-10-21 10:51:02 -04:00
2636418659
Move blocktree_processor to solana_ledger ( #6460 )
...
* Drop core::result dependency in bank_forks
* Move blocktree_processor into solana_ledger
2019-10-20 09:54:38 -06:00
e2c316d2d0
system_instruction_processor updates ( #6448 )
...
* zero lamport account creation
* whack create_user_account, take 2
* target->to
* ..
* ..
* update chacha golden
* update chacha golden
* ..
* ..
2019-10-19 18:23:27 -07:00
badeb4d31a
Rework shred headers to fix position of signature ( #6451 )
...
* Rework shred headers to fix position of signature
* fix clippy
2019-10-18 22:55:59 -07:00
8c29700402
Remove the DbCursor struct ( #6441 )
2019-10-18 13:11:59 -06:00
5468be2ef9
Add solana-ledger crate ( #6415 )
...
automerge
2019-10-18 09:28:51 -07:00
dependabot-preview[bot]
Tyera Eulberg
Ryo Onodera
Jack May
Sagar Dhawan
Sunny Gleason
sakridge
carllin
anatoly yakovenko
Michael Vines
Greg Fitzgerald
Pankaj Garg
Justin Starry
Parth
Rob Walker
Dan Albert
TristanDebrunner
TristanDebrunner