Commit Graph

578 Commits

Author SHA1 Message Date
GroovieGermanikus 83752afe17
RPC: add method getProgramAccountsCompressed 2024-12-05 23:28:23 +01:00
mergify[bot] 8561902444
v2.0: Scheduler: Improve TTL (backport of #3161) (#3179)
* Scheduler: Improve TTL (#3161)

Co-authored-by: Justin Starry <justin.m.starry@gmail.com>
(cherry picked from commit 7b0a57316d)

# Conflicts:
#	accounts-db/src/accounts.rs
#	core/src/banking_stage/consumer.rs
#	core/src/banking_stage/immutable_deserialized_packet.rs
#	core/src/banking_stage/latest_unprocessed_votes.rs
#	core/src/banking_stage/transaction_scheduler/scheduler_controller.rs
#	runtime/src/bank/address_lookup_table.rs

* resolve conflicts

---------

Co-authored-by: Andrew Fitzgerald <apfitzge@gmail.com>
2024-10-17 12:52:12 -05:00
mergify[bot] 377d19de93
v2.0: Improves panic message if send() fails in streaming_unpack_snapshot() (backport of #2459) (#2464)
Improves panic message if send() fails in streaming_unpack_snapshot() (#2459)

(cherry picked from commit 427a18b22e)

Co-authored-by: Brooks <brooks@anza.xyz>
2024-08-16 17:53:14 -04:00
mergify[bot] 1f0c8f4be0
v2.0: Flushes hash cache data file's mmap after done writing (backport of #2567) (#2575)
Flushes hash cache data file's mmap after done writing (#2567)

(cherry picked from commit 65f6466396)

Co-authored-by: Brooks <brooks@anza.xyz>
2024-08-14 17:26:37 -04:00
Jeff Washington (jwash) e1e9a8394c
add stats for ancient bytes_from_newest_storages (#1802)
* add stats for ancient bytes_from_smallest_storages

* fix else if

* remove totally unrelated demo code. ugh.
2024-06-21 19:52:15 +00:00
Jon C 9bb532abcc
deps: Use bytemuck_derive explicitly instead of "derive" feature on bytemuck (#1799)
* deps: Use bytemuck_derive explicitly

* Missed a couple in zk-token-sdk

* Fix last few bits

* Fixup a re-export

* Use re-exports properly
2024-06-21 12:50:36 +02:00
Justin Starry 0d1ad0dc1d
Reuse compute budget processing (#1700)
* refactor: reuse compute budget limits

* fix tests
2024-06-20 19:22:19 +00:00
knotts 5feacd1d13
typo fixes (#1795) 2024-06-20 11:42:31 -05:00
Justin Starry 8da4062644
refactor: consolidate fee deduction for failed transactions (#1636) 2024-06-20 08:03:40 -07:00
Brooks b1815e784d
Round up correctly when truncating max ancient storages (#1781) 2024-06-20 10:54:18 -04:00
Jeff Washington (jwash) 4c921ca276
add ancient pack metrics (#1750)
* add ancient pack metrics

* add missing params

---------

Co-authored-by: brooks <brooks@anza.xyz>
2024-06-18 19:45:43 +00:00
Jeff Washington (jwash) 7eca784e78
remove double-counted metric (#1748) 2024-06-18 17:26:34 +00:00
Jeff Washington (jwash) d2b3476db9
always pack a few newest ancient slots (#1730)
* always pack a few newest ancient slots

* pr feedback

* remove extra ()

* adds high slot tests

---------

Co-authored-by: brooks <brooks@anza.xyz>
2024-06-18 11:20:27 -05:00
Brooks 954f3d175b
Adds `diff` to accounts-hash-cache-tool (#1772) 2024-06-18 10:40:51 -04:00
HaoranYi d2124a995f
accounts-db: get rid of const in tests (#1732)
get rid of const in tests

Co-authored-by: HaoranYi <haoran.yi@solana.com>
2024-06-14 09:37:53 -05:00
galactus a6b2283142
ScanConfig defaults no longer sort results (#1539) 2024-06-14 08:27:33 -04:00
Brooks 7b4c4f6fb4
Adds accounts-hash-cache-tool to inspect accounts hash cache files (#1731) 2024-06-13 16:16:42 -04:00
Jeff Washington (jwash) 91a4ecfff7
refactor file version of get_account_shared_data (#1712)
* refactor file version of get_account_shared_data

* add tests to cover corrupted file when we can't read the complete data
for the account

* pr comments

---------

Co-authored-by: HaoranYi <haoran.yi@solana.com>
2024-06-13 14:08:45 -05:00
HaoranYi e366797875
Use accounts_keep_slots map len for stats (#1716)
use accounts_keep_slots map len for stats

Co-authored-by: HaoranYi <haoran.yi@solana.com>
2024-06-13 09:15:21 -05:00
Joe C 5148dcccf7
SVM: change modified programs result to hash map (#1391)
* SVM: change modified programs result to hash map

* take entries
2024-06-12 22:54:29 +00:00
Jeff Washington (jwash) 54adee58f8
add ancient pack stats for unmovable slots (#1699) 2024-06-12 15:31:07 -05:00
Jeff Washington (jwash) 1bd9bd1a10
file based append vecs (#1394)
* file based storages

* pr feedback

* add comments

* add tests for buffered reader and file reader

* fix windows clippy

* pr: update tests for jeff comments

* pr feedback

* fix a bug - read at least default min bytes

* Revert "fix a bug - read at least default min bytes"

This reverts commit 52ccd8e022dd8a047596b95b4ab2abc91c7c983c.

* add test coverages flush, reset, reopen functions for append_vec.rs

* one more dead code

* renames

* renames

* renames

* wee wah wee wah grammar police

* rename

* add debug assert

* use const

* const

* reorder

* reorders and renames

---------

Co-authored-by: HaoranYi <haoran.yi@solana.com>
2024-06-12 15:26:47 -05:00
Brooks a0e1824196
Flushes append vec mmaps only if dirty (#1676) 2024-06-11 12:09:19 -04:00
Brooks f423d5b685
store-tool: Adds verbose cli option (#1628) 2024-06-06 16:35:13 -04:00
Justin Starry dbf070b959
Refactor nonce rollback to remove overly complex code (#1428) 2024-06-06 08:20:40 -07:00
HaoranYi fbc75a7544
fix a typo (#1619)
Co-authored-by: HaoranYi <haoran.yi@solana.com>
2024-06-06 09:41:30 -05:00
Jeff Washington (jwash) c038908600
get rid of get_account_meta (#1620) 2024-06-06 07:21:26 -05:00
Brooks 6255f3608e
Renames solana-store-tool to agave-store-tool (#1613) 2024-06-05 23:47:57 -04:00
Brooks 3e22a7be3e
store-tool: Reuses Pubkey::to_string() (#1618) 2024-06-05 18:25:42 -04:00
Brooks 28242cda5e
store-tool: Opens file without needing len (#1595) 2024-06-05 15:29:00 -04:00
Jeff Washington (jwash) 478f190cd4
skip packing multi ref ancient slots until sufficient normal slots are packed (#1583)
* don't pack multi ref slots until safe

* sub 1 to get math perfect
2024-06-05 10:37:14 -05:00
Jeff Washington (jwash) 63c16b65cc
add pack tuning max_resulting_storages (#1579) 2024-06-04 12:09:46 -05:00
Jeff Washington (jwash) 8a1b2dc3fa
refactor to use tuning param (#1567) 2024-06-03 12:08:01 -05:00
Jeff Washington (jwash) fdf724ee1d
refactor addref_accounts_failed_to_shrink_ancient (#1562) 2024-06-03 10:52:45 -05:00
Jeff Washington (jwash) 0c70735072
remove useless hashmap (#1569) 2024-06-03 10:52:25 -05:00
Yihau Chen c59fa1ea77
chore: remove unused clippy attributes, needless_collect (#1517)
* remove clippy needless_collect

* update comment
2024-06-03 13:24:20 +00:00
Tao Zhu faa4fa609d
Include loaded accounts data size in TransactionResults (#1525)
Add loaded_accounts_stats to TransactionResults, so call sites can access stats of loaded accounts for sanitized transactions; Such stats include the actual loaded-accounts-data-size, count of loaded accounts.
2024-05-30 14:10:29 -05:00
Brooks 97d36e6076
Updates frozen abi test for bank snapshot serialization (#1544) 2024-05-30 15:03:38 -04:00
Justin Starry 2cc540a7de
refactor: reuse calculated fees (#1462)
* refactor: reuse calculated fees

* fix tests

* feedback

* fix test

* fix unused warn
2024-05-29 19:41:47 +00:00
HaoranYi 64c473c3d7
accounts-db/write-cache: fix memory consistence ordering for max_flush_root (#1490)
* fix memeory consistence ordering for max_flush_root

* Update accounts-db/src/accounts_cache.rs

Co-authored-by: Brooks <brooks@prumo.org>

---------

Co-authored-by: HaoranYi <haoran.yi@solana.com>
Co-authored-by: Brooks <brooks@prumo.org>
2024-05-28 12:51:52 -05:00
Yihau Chen 12b6665a99
test: remove some useless cases in the test (#1485)
remove unused ub test
2024-05-29 01:01:21 +08:00
HaoranYi 73246ff945
accounts-db/write-cache/refactor: move `remove_slots_le` to test context (#1489)
move `remove_slots_le` to test context

Co-authored-by: HaoranYi <haoran.yi@solana.com>
2024-05-28 09:28:10 -05:00
HaoranYi 4aee0f97c6
accounts-db/write-cache/refactor: decorate test_util with dev-context attr (#1488)
decorate test_util with dev-context attr

Co-authored-by: HaoranYi <haoran.yi@solana.com>
2024-05-28 09:27:47 -05:00
Justin Starry a79ba51741
refactor: get hash info for tx (#1480) 2024-05-24 14:08:08 -04:00
HaoranYi 92b093d019
get_snapshot_storages: chain parallel iterator for unzip (#1461)
chain parallel iterator

Co-authored-by: HaoranYi <haoran.yi@solana.com>
2024-05-24 09:20:39 -05:00
Jeff Washington (jwash) b97a5b4565
refactor get_type and get_slice (#1420) 2024-05-19 15:22:57 -05:00
Jeff Washington (jwash) d8d546053c
remove InternalFileOrMmap (#1413) 2024-05-17 16:00:59 -05:00
Justin Starry 5410794308
refactor: move nonce info into `LoadedTransaction` (#1407)
* refactor: move nonce into LoadedTransaction

* clean up tests
2024-05-17 15:59:20 -05:00
Brooks 83be26ac8e
Adds CLI arg for accounts db storage access method (#1299) 2024-05-17 15:08:22 -04:00
Jeff Washington (jwash) c40fcca9f8
internals_for_archive implemented in `AppendVec` (#1411) 2024-05-17 13:56:35 -05:00