bbd7bc2985
AcctIdx: Fix bad test ( #20115 )
2021-09-22 12:39:31 -05:00
1eeddf2e23
orderings on AcctIdx dirty ( #20087 )
2021-09-22 11:24:16 -05:00
681d6d121e
AcctIdx: 2 upserts use disk ( #20072 )
2021-09-22 11:14:08 -05:00
deab944b30
AcctIdx: flush inserts to disk ( #20074 )
2021-09-22 09:55:40 -05:00
804ed825f7
AcctIdx: rework timing of bg loop ( #20077 )
2021-09-22 09:39:49 -05:00
a6aef76f52
AcctIdx: put_range_in_cache loads from disk ( #20073 )
2021-09-22 09:37:34 -05:00
c944bfb1d9
AcctIdx tests use disk buckets ( #20070 )
2021-09-22 08:55:58 -05:00
9e9417b474
AcctIdx: initialze stats with # bins ( #20088 )
2021-09-22 08:55:07 -05:00
b918c2f4cd
AcctIdx: remove_if_slot_list_empty uses disk backing ( #20069 )
2021-09-22 08:48:44 -05:00
6c518102dd
AcctIdx: fix some missing dirty calls ( #20089 )
2021-09-22 08:45:08 -05:00
e6795e6fdd
AcctIdx: get can load from disk ( #20067 )
2021-09-21 12:40:07 -05:00
7f3d445af5
AcctIdx: Orderings and cleanup ( #20046 )
2021-09-21 10:52:39 -05:00
bbe151e594
AcctIdx: only flush if disk index being used ( #20045 )
2021-09-21 08:42:13 -05:00
38ea3aa31a
AcctIdx: keys impl when items are on disk ( #20039 )
2021-09-21 08:41:39 -05:00
fb71e80962
AcctIdx: accessors for age ( #20023 )
2021-09-21 08:41:17 -05:00
c3679ab9bd
AcctIdx: first pass at aging buckets ( #20008 )
2021-09-21 08:40:55 -05:00
b507715d44
CPI without Account Refs ( #20034 )
...
* Removes search for accounts and unsafe lifetime transmute in InvokeContext::push().
* Replaces accounts by account_indices in verify_and_update() and process_cross_program_instruction().
Co-authored-by: Justin Starry <justin.m.starry@gmail.com>
2021-09-21 14:41:02 +02:00
94330de843
AcctIdx: delete from disk index ( #20035 )
2021-09-20 16:19:21 -05:00
6399a87485
AcctIdx: report age in stats ( #20025 )
2021-09-20 14:30:12 -05:00
e9ee90a121
AcctIdx: age adds time component ( #20024 )
2021-09-20 14:29:34 -05:00
d842705622
AcctIdx: when bg processing in multiple threads, avoid bin collisions ( #20019 )
2021-09-20 11:50:22 -05:00
e6934e7247
AcctIdx: consolidate to correct CondVar ( #20017 )
2021-09-20 09:58:20 -05:00
55d9ff9899
WaitableCondVar supports notify_one ( #20013 )
2021-09-20 09:57:57 -05:00
bc7983b13e
AcctIdx: metric for active bg threads ( #20026 )
2021-09-20 09:44:40 -05:00
2a42f8a06e
AcctIdx: disk index now holds a bucket map ( #19995 )
2021-09-20 08:40:10 -05:00
af5b0d42a8
AcctIdx: initial index items have future age to flush ( #20010 )
2021-09-19 20:22:09 -05:00
c1d181add5
add --accounts-index-memory-limit-mb ( #19269 )
2021-09-19 18:00:15 -05:00
f579f73700
AcctIdx: introduce age per in-mem bucket ( #19982 )
2021-09-18 22:09:37 -05:00
742155c214
call set_startup and add metrics on generate_index ( #20006 )
2021-09-18 22:08:58 -05:00
db40d06a39
AcctIdx: introduce startup to bucket map ( #20004 )
2021-09-18 12:55:57 -05:00
bed0049a51
AcctIdx: add age per item in in_mem acct idx ( #19981 )
2021-09-18 09:56:26 -05:00
8df8f4396d
AcctIdx: start calling flush on in mem cache buckets ( #19966 )
...
* AcctIdx: start calling flush on in mem cache buckets
* fix orderings
2021-09-18 09:56:08 -05:00
4089f8b06b
AcctIdx: with multiple bg threads, only log stats once per time interval ( #19984 )
2021-09-18 09:55:20 -05:00
4e038e94fd
add 'drives' to AccountsIndexConfig ( #19989 )
2021-09-18 09:54:57 -05:00
f500c99a6d
pass AcctIdxConfig to BucketMapHolder ( #19997 )
2021-09-18 09:54:00 -05:00
bd86f41e18
acct idx tests use 2 bins instead of 8k ( #19996 )
2021-09-18 09:53:44 -05:00
4dc2f08198
AcctIdx: hold_range_in_memory ( #19955 )
2021-09-17 22:19:29 +00:00
24b136a993
AcctIdx: configurable flush threads ( #19983 )
2021-09-17 22:02:43 +00:00
cddb9da4f0
AcctIdx: central age functions/state ( #19980 )
2021-09-17 15:11:07 -05:00
99f5684dc4
AcctIdx: handle future config defaults ( #19967 )
2021-09-17 13:12:06 -05:00
9998e16df3
AcctIdx: prepare to spin up multiple bg threads ( #19969 )
2021-09-17 11:53:25 -05:00
7b0bf64404
cleanup old features ( #19956 )
2021-09-17 09:46:49 -07:00
37d6f5013f
AcctIdx: initialize acct idx by config ( #19968 )
2021-09-17 16:39:41 +00:00
376b20c3d2
AcctIdx: add some bucket flush helpers ( #19965 )
2021-09-17 10:41:30 -05:00
4d8b3aa578
AcctsIdx: introduce dirty state per pubkey ( #19960 )
2021-09-16 21:36:23 -05:00
58f25a8752
AcctIdx: move background() to AccountsIndexStorage ( #19948 )
2021-09-16 17:52:06 -05:00
66e0fafc21
AccountsIndexStorage holds InMemAccountsIndex[] ( #19947 )
2021-09-16 21:12:22 +00:00
dc69cc1ae4
Only allow votes when root distance gets too high ( #19917 )
2021-09-16 15:12:26 +02:00
bd434d92e1
nit: misspelling ( #19929 )
2021-09-16 01:27:26 +00:00
eddd583cd5
AcctIdx: pass bins to BucketMapHolder ( #19906 )
2021-09-15 18:07:53 +00:00
99f2c746d1
AcctIdx: Put InMemAcctIndex behind arc ( #19904 )
2021-09-15 17:36:08 +00:00
b467e7fb3b
AcctIdx: remove auto Debug trait ( #19905 )
2021-09-15 09:54:16 -05:00
8e3c420414
Add logging after taking a bank snapshot ( #19891 )
2021-09-15 07:39:21 -05:00
d3c80be7d5
AcctIdx: use stats() accessor ( #19890 )
2021-09-15 05:28:44 +00:00
691bea8776
extract map to map() ( #19883 )
2021-09-14 23:08:17 -05:00
229b378ed1
in-mem acct idx hash map uses rwlock ( #19878 )
2021-09-14 18:01:34 -05:00
fc647eed19
introduce trait IndexValue for accounts index ( #19859 )
2021-09-14 17:51:07 -05:00
21bc7e94f5
Add logging of incremental snapshots to purge_old_snapshot_archives() ( #19874 )
2021-09-14 17:49:15 -05:00
60276da1fd
rework acct idx entry to prepare for hashmap ( #19875 )
2021-09-14 15:27:23 -05:00
2a795614d3
accounts index keys returns by value ( #19858 )
2021-09-14 09:38:59 -05:00
00d7981f64
Fix native invoke writable privileges ( #19750 )
...
* Fix native invoke writable privileges
* build downstream spl bpf programs for tests
2021-09-13 22:57:37 -07:00
910f241c3f
add <T> through accounts index ( #19852 )
2021-09-13 22:59:03 -05:00
b57e86abf2
cache account hash info ( #19426 )
...
* cache account hash info
* ledger_path -> accounts_hash_cache_path
2021-09-13 20:39:26 -05:00
dca49a614f
size and per-bin stats ( #19842 )
2021-09-13 19:26:49 -05:00
87a7f00926
Track reset bank in PohRecorder ( #19810 )
2021-09-13 16:55:35 -07:00
3071c4caad
Set is_startup=true for exhaustively_free_unused_resource() ( #19846 )
2021-09-13 18:08:06 -05:00
e1a038e791
add stats inserts, deletes, updates_in_mem ( #19807 )
2021-09-13 15:59:01 -05:00
ef749a2506
Flush accounts cache before calling clean_accounts() ( #19839 )
2021-09-13 14:56:13 -05:00
c05226620f
metrics on accounts index entry ( #19806 )
2021-09-13 08:33:45 -05:00
3f6eb96d6e
Call `Bank::update_accounts_hash()` before taking bank snapshot ( #19765 )
...
This is a bugfix.
When `load_frozen_forks()` called `snapshot_bank()`, the accounts hash
was not computed. So then when a snapshot archive was eventually
created, its hash would be all 1s, which is clearly wrong. The fix is
to update the bank's accounts hash before taking the bank snapshot.
2021-09-13 08:27:50 -05:00
d388c5c257
move update_key_if_exists to InMemAccountsIndex ( #19803 )
2021-09-13 08:27:21 -05:00
3cea535fdb
InMemAccountsIndex::remove is no longer called ( #19805 )
2021-09-12 22:01:41 -05:00
b992c02708
in_mem_accounts_index filters by range ( #19779 )
2021-09-12 21:57:15 -05:00
0263ffb2ed
move upsert and a handful of helpers to InMemAccountsIndex ( #19799 )
2021-09-12 21:54:09 -05:00
3617d43e76
accounts index stats ( #19797 )
2021-09-12 22:14:59 +00:00
d9674f7ff0
consolidate another use of remove_if_slot_list_empty ( #19804 )
2021-09-12 19:05:44 +00:00
62c8bcf565
Add default() to SnapshotConfig ( #19776 )
2021-09-12 13:44:27 -05:00
c9a3b8941f
move insert_new_entry_if_missing_with_lock into InMemAccountsIndex ( #19800 )
2021-09-12 13:39:29 -05:00
a295febf04
move remove_if_slot_list_empty to InMemAccountsIndex ( #19801 )
2021-09-12 10:26:04 -05:00
361101bd31
rename generic V -> T. Matches intent better. V is now a larger type that contains T ( #19798 )
2021-09-12 10:25:09 -05:00
91c3b18e1e
InMemAccountsIndex iter returns vec<owned> ( #19778 )
2021-09-11 20:33:04 +00:00
7de2236284
accounts index get returns value ( #19777 )
2021-09-11 13:28:56 -05:00
ed7a6c6732
push use of AccountMapEntry one level deeper ( #19775 )
2021-09-11 02:09:51 +00:00
cba834808a
refactor generate_index zero lamports ( #19769 )
2021-09-10 23:46:08 +00:00
595bba95b4
accounts index traits ( #19768 )
2021-09-10 18:32:10 -05:00
9899cd359a
accounts index iterator uses copy of pubkey and account map entry ( #19767 )
2021-09-10 17:52:49 -05:00
11b10439b4
factor out InMemAccountsIndex to prepare for disk index ( #19773 )
2021-09-10 17:52:25 -05:00
7aa5f6b833
Add CLI args for incremental snapshots ( #19694 )
...
Add `--incremental-snapshots` flag to enable incremental snapshots.
This will allow setting `--full-snapshot-interval-slots` and
`--incremental-snapshot-interval-slots`.
Also added `--maximum-incremental-snapshots-to-retain`.
Co-authored-by: Michael Vines <mvines@gmail.com>
2021-09-10 15:59:26 -05:00
2de2c6ddd7
log accounts loaded for shrink stats ( #19747 )
2021-09-10 12:51:58 -05:00
098585234d
Add return data implementation
...
This consists of:
- syscalls
- passing return data from invoked to invoker
- printing to stable log
- rust and C SDK changes
2021-09-10 14:25:54 +01:00
88c1b8f047
Index loaders / executable accounts ( #19469 )
...
* Appends loaders / executable_accounts to accounts in transaction loading.
* Adds indices to loaders / executable_accounts.
* Moves MessageProcessor::create_keyed_accounts() into InvokeContext::push().
* Removes "executable_accounts",
now referenced by transaction wide index into "accounts".
* Removes create_pre_accounts() from InstructionProcessor,
as it is already in MessageProcessor.
* Collect program account indices directly in load_executable_accounts().
2021-09-10 08:36:21 +02:00
df5befdaca
metrics on rent partitions ( #19728 )
2021-09-09 10:50:35 -05:00
8489ee7df9
Revert "collect rent in parallel for partitions ( #19478 )" ( #19723 )
...
This reverts commit 1560d5e3c3
2021-09-08 21:27:08 -05:00
97418bede3
introduce BinnedHashData type to improve some code readability ( #19722 )
2021-09-08 19:25:52 -05:00
1cf7ae51f8
add comment ( #19705 )
2021-09-08 19:25:20 -05:00
001ed66b4d
minor constant cleanup ( #19721 )
2021-09-08 18:26:10 -05:00
38bbb77989
Return error if Transaction contains writable executable or ProgramData accounts ( #19629 )
...
* Return error if Transaction locks an executable as writable
* Return error if a ProgramData account is writable but the upgradable loader isn't present
* Remove unreachable clause
* Fixup bpf tests
* Review comments
* Add new TransactionError
* Disallow writes to any upgradeable-loader account when loader not present; remove is_upgradeable_loader_present exception for all other executables
2021-09-08 15:21:52 -06:00
3a8c678f62
Remove some copying ( #19691 )
2021-09-08 18:32:38 +02:00
456bf15012
AccountsIndexConfig -> AccountsDbConfig ( #19687 )
2021-09-08 04:30:38 +00:00
d3f938f0cf
Remove Copy from AccountsIndexConfig. Not all types will support it ( #19686 )
2021-09-07 20:09:40 -05:00
Jeff Washington (jwash)
Alexander Meißner
Jack May
sakridge
Brooks Prumo
carllin
Sean Young
Tyera Eulberg