765c628546
use exit signal for acct idx bg threads ( #27483 )
2022-09-12 11:51:12 -07:00
8c1e193d5d
delay trying to flush cached upserts until far future ( #26908 )
2022-08-31 08:56:26 -05:00
2031e0afaf
simple refactorings to disk idx ( #27238 )
2022-08-19 12:40:42 -05:00
d159682a6d
add comment ( #26875 )
2022-08-01 14:25:19 -05:00
2b6c9852f1
add more slop to test_age_time ( #26537 )
2022-07-10 17:52:07 -05:00
d07b079850
make test_age_time less intermittent ( #26280 )
2022-06-28 09:13:01 -05:00
ae37359b6b
AcctIdx: only advance age on thread 0 ( #25943 )
2022-06-14 21:43:42 -05:00
306faed3a8
update comment ( #25949 )
2022-06-13 17:43:29 -05:00
53695ecd21
Remove SlotT type alias ( #25908 )
2022-06-10 22:04:56 -05:00
40b1655eb5
fix intermittent bucket age test failure ( #25841 )
...
* fix double count of account index del stats
* refactor to seperate delete and insert account index stats
* fix test
* increase test timing tolerance for bucket age
* Revert "increase test timing tolerance for bucket age"
This reverts commit 2b91cf902208e4585d25dff1d4298d412c9da516.
* Revert "Revert "increase test timing tolerance for bucket age""
This reverts commit 8f07367b64ddc45a9a693729ea2725895627d14c.
2022-06-08 16:15:49 +00:00
779ec564e4
add data to assert ( #25749 )
2022-06-03 09:32:43 -05:00
7c95ae341d
disk idx: reduce lock calls ( #25734 )
...
* disk idx: reduce lock calls
* adjust ordering for count_buckets_flushed
2022-06-02 18:26:08 -05:00
e8df90c34b
rename count_buckets_flushed ( #25733 )
2022-06-02 12:16:01 -05:00
6a474f29cd
default to disk index ( #24251 )
2022-04-13 09:24:50 -05:00
1bc49d219d
IndexLimitMb option adds 'Unspecified' state ( #24249 )
2022-04-12 09:38:09 -05:00
7ebf398ed7
AcctIdx: env var "SOLANA_TEST_ACCOUNTS_INDEX_MEMORY_LIMIT_MB" ( #23194 )
...
* AcctIdx: env var "SOLANA_TEST_ACCOUNTS_INDEX_MEMORY_LIMIT_MB"
* ignore env var when starting as validator
* Update runtime/src/bucket_map_holder.rs
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
2022-02-22 09:40:12 -06:00
04b76eb066
Use AtomicUsize for next_bucket_to_flush ( #22095 )
2022-01-03 10:35:35 -06:00
181c0092d6
AcctIdx: resize in-mem after startup for disk index ( #21676 )
2021-12-08 16:52:22 -06:00
b8837c04ec
Reformat imports to a consistent style for imports
...
rustfmt.toml configuration:
imports_granularity = "One"
group_imports = "One"
2021-12-03 09:19:13 -08:00
4d6190a1ba
change bg waiting metrics to percent ( #20955 )
...
* Revert part of "AcctIdx: cleanup bg threads (#20731 )"
This reverts part of commit 47de4f31b6
2021-10-26 15:09:17 -05:00
47de4f31b6
AcctIdx: cleanup bg threads ( #20731 )
2021-10-15 16:15:11 -05:00
b80fd7566a
add worker threads during startup ( #20700 )
2021-10-15 10:40:36 -05:00
4267419349
AcctIdx: sleep thread when enough threads are running to complete the remaining work ( #20446 )
2021-10-05 16:48:23 -05:00
bd9b2f6f39
AcctIdx: throttling bg flushing to spread out work over interval ( #20176 )
...
* AcctIdx: throttling bg flushing to spread out work over interval
* prevent hang
2021-09-29 07:42:54 -05:00
320beb76f6
AcctIdx: implement wait_for_idle ( #20256 )
2021-09-28 11:07:19 -05:00
e50a26e6cf
AcctIdx: add age_interval_ms() to remove constant use ( #20264 )
2021-09-28 01:22:07 +00:00
8266864adc
AcctIdx: maybe advance age when a bg thread wakes up ( #20250 )
...
* fix math error with stats calc
* AcctIdx: maybe report stats when a bg thread wakes up
2021-09-27 18:39:41 +00:00
025261c05e
AcctIdx: when no disk index, always wait for stats ( #20248 )
2021-09-27 11:24:36 -05:00
c6d189dac2
bg threads wait until next expected event ( #20126 )
2021-09-24 16:00:41 -05:00
122206dbb1
AcctIdx: bg loop sleeps when all buckets flushed at current age ( #20168 )
2021-09-24 13:19:06 -05:00
1d13594c1c
AcctIdx: store # threads in BucketHolder. Used later. ( #20151 )
2021-09-23 19:56:44 -05:00
093dd68214
AcctIdx: stats for how much time bg threads wait ( #20127 )
2021-09-23 18:37:14 +00:00
4fb77183ef
AcctIdx: move background() to bucket holder ( #20085 )
2021-09-22 17:40:30 +00:00
804ed825f7
AcctIdx: rework timing of bg loop ( #20077 )
2021-09-22 09:39:49 -05:00
9e9417b474
AcctIdx: initialze stats with # bins ( #20088 )
2021-09-22 08:55:07 -05:00
7f3d445af5
AcctIdx: Orderings and cleanup ( #20046 )
2021-09-21 10:52:39 -05:00
c3679ab9bd
AcctIdx: first pass at aging buckets ( #20008 )
2021-09-21 08:40:55 -05:00
e9ee90a121
AcctIdx: age adds time component ( #20024 )
2021-09-20 14:29:34 -05:00
e6934e7247
AcctIdx: consolidate to correct CondVar ( #20017 )
2021-09-20 09:58:20 -05:00
2a42f8a06e
AcctIdx: disk index now holds a bucket map ( #19995 )
2021-09-20 08:40:10 -05:00
af5b0d42a8
AcctIdx: initial index items have future age to flush ( #20010 )
2021-09-19 20:22:09 -05:00
c1d181add5
add --accounts-index-memory-limit-mb ( #19269 )
2021-09-19 18:00:15 -05:00
742155c214
call set_startup and add metrics on generate_index ( #20006 )
2021-09-18 22:08:58 -05:00
db40d06a39
AcctIdx: introduce startup to bucket map ( #20004 )
2021-09-18 12:55:57 -05:00
f500c99a6d
pass AcctIdxConfig to BucketMapHolder ( #19997 )
2021-09-18 09:54:00 -05:00
cddb9da4f0
AcctIdx: central age functions/state ( #19980 )
2021-09-17 15:11:07 -05:00
376b20c3d2
AcctIdx: add some bucket flush helpers ( #19965 )
2021-09-17 10:41:30 -05:00
58f25a8752
AcctIdx: move background() to AccountsIndexStorage ( #19948 )
2021-09-16 17:52:06 -05:00
66e0fafc21
AccountsIndexStorage holds InMemAccountsIndex[] ( #19947 )
2021-09-16 21:12:22 +00:00
eddd583cd5
AcctIdx: pass bins to BucketMapHolder ( #19906 )
2021-09-15 18:07:53 +00:00
Jeff Washington (jwash)
Jeff Washington (jwash)
Brooks Prumo
HaoranYi
Michael Vines
Jeff Washington (jwash)