Commit Graph

145 Commits

Author SHA1 Message Date
Jeff Washington (jwash) 0121be5a9f
disk index: add more tests (#31135) 2023-04-11 07:30:11 -07:00
Jeff Washington (jwash) 4f0adcde89
disk index: correctly keep track of count during batch add (#31133) 2023-04-10 14:01:25 -07:00
Jeff Washington (jwash) d63359a3ff
disk index: batch insert (#31094) 2023-04-10 11:08:54 -07:00
Jeff Washington (jwash) 03abaf76d0
disk index: bucket_index_ix doesn't % by capacity (#31096) 2023-04-07 06:59:35 -07:00
Jeff Washington (jwash) 3422823932
disk index: keep same random during resize (#31095) 2023-04-07 06:54:50 -07:00
Jeff Washington (jwash) 06461fb348
disk index: index files grow by bytes instead of doubling (#31013) 2023-04-05 06:30:37 -07:00
Jeff Washington (jwash) 9fb22bc0be
disk index: store ref_count in data file (#30974) 2023-04-04 19:17:48 -07:00
Jeff Washington (jwash) fd28fd1d34
disk index: move capacity to contents (#31040) 2023-04-04 13:08:13 -07:00
Jeff Washington (jwash) aa3e0b9c20
disk index: add stat: disk_index_failed_resizes (#31039) 2023-04-04 09:39:06 -07:00
Jeff Washington (jwash) 514816a31f
disk index: move key enum to bitvec (#31026) 2023-04-04 08:21:29 -07:00
Jeff Washington (jwash) b0540ff5ad
disk index: add `Capacity` (#31031)
* disk index: add `Capacity`

* pr feedback
2023-04-04 06:57:09 -07:00
Jeff Washington (jwash) bc343a431c
disk index: set_anticipated_count to optimally grow disk buckets at startup (#31033)
* disk index: set_anticipated_count to optimally grow disk buckets at startup

* remove atomic
2023-04-03 20:28:50 -07:00
Jeff Washington (jwash) 05f2a01a80
disk index: refactor OccupiedEnumTag (#31028) 2023-04-03 13:12:06 -07:00
Jeff Washington (jwash) f289a0726b
disk index: refactoring get/get_mut fns (#31025) 2023-04-03 11:40:49 -07:00
Jeff Washington (jwash) 7edef94088
disk index: remove Option on read_value (#31023) 2023-04-03 11:36:58 -07:00
Jeff Washington (jwash) ef6b6793dd
disk bucket: add trait fn copying_entry (#31024) 2023-04-03 11:35:15 -07:00
Jeff Washington (jwash) 9219a16c42
disk bucket: new_map takes bytes (#31020) 2023-04-03 06:57:06 -07:00
Jeff Washington (jwash) 8051aea88e
disk index: store single slot list in index entry (#31002) 2023-04-03 06:51:59 -07:00
Jeff Washington (jwash) fc2bcdffe2
fix up refcounts on disk bucket test (#31001) 2023-03-31 12:37:21 -07:00
Jeff Washington (jwash) a2797ebfa9
disk index: use bits in ref count to store occupied (#31004) 2023-03-31 10:50:55 -07:00
Jeff Washington (jwash) db5cdbedae
disk index remove dead code (#30999) 2023-03-31 09:08:16 -07:00
Jeff Washington (jwash) 3f6c33d7e2
disk index: break ref_count u64 into reserved bits (#30997) 2023-03-31 06:51:00 -07:00
Jeff Washington (jwash) 32780353c7
disk index: move fn data_loc to MultipleSlots (#30993)
disk index: move fn `data_loc` to `MultipleSlots`
2023-03-30 16:23:57 -07:00
Brooks 399b7ba722
Removes unnecessary Sized bounds in bucket map (#30990) 2023-03-30 16:34:59 -04:00
Jeff Washington (jwash) 89f7d4ab9a
Move `data_bucket_ix()` method to `MultipleSlots` (#30992)
move data_bucket_ix to MultipleSlots
2023-03-30 13:20:10 -07:00
Jeff Washington (jwash) b5afcbb72f
disk index: move num_slots() to MultipleSlots (#30991) 2023-03-30 12:39:15 -07:00
Jeff Washington (jwash) 2672637395
disk index: move fns to MultipleSlots (#30989) 2023-03-30 12:00:43 -07:00
Jeff Washington (jwash) 2cafd641fe
disk index: introduce MultipleSlots (#30988)
* disk index: introduce MultipleSlots

* pr feedback
2023-03-30 11:27:45 -07:00
Brooks eb47e44c6b
disk bucket: refactor storage get/get_mut fns (#30985) 2023-03-30 12:38:35 -04:00
Jeff Washington (jwash) 5ae3288a0b
disk index IndexEntry gets <T> (#30984)
* disk index IndexEntry gets <T>

* remove unused phantom
2023-03-30 09:23:51 -07:00
Jeff Washington (jwash) e6ca734ac4
disk index: include T on a few structs (#30983) 2023-03-30 07:44:50 -07:00
Jeff Washington (jwash) 38e054f4a6
disk bucket: get mut right on get_mut_cell_slice (#30972) 2023-03-30 05:19:29 -07:00
Jeff Washington (jwash) 4b7cfa23c1
disk index: introduce IndexEntryPlaceInBucket (#30944)
* refactor: move data_bucket_from_num_slots

* disk index: introduce IndexEntryPlaceInBucket

* remove <T> from IndexEntryPlaceInBucket

* fix and comment index_bucket_for_testing
2023-03-29 13:41:10 -07:00
Jeff Washington (jwash) 97af6aad4a
remove unused bucket map direct add/unref calls (#30942) 2023-03-29 10:26:53 -07:00
Jeff Washington (jwash) 823d55ea9f
disk index find_entry -> find_index_entry (#30941) 2023-03-29 06:54:03 -07:00
Jeff Washington (jwash) 6285aaee89
store data and index occupy in bitvec (#30899) 2023-03-28 12:17:28 -07:00
Jeff Washington (jwash) 89bc86f11a
use trait for disk bucket header (#30875)
* use trait for disk bucket header

* pr feedback

* remove debug and default

* as_mut_ptr

* add comments

* verify slice is large enough
2023-03-27 11:07:02 -07:00
Jeff Washington (jwash) b54c2cc1e3
refactor disk index bucket::find_entry_mut (#30877) 2023-03-23 18:48:35 -07:00
Jeff Washington (jwash) 9f3381c771
disk bucket allocated bit can be not in header (#30834) 2023-03-22 15:11:35 -07:00
Jeff Washington (jwash) 4285cb2b84
remove uid concept from disk buckets (#30836)
* remove uid concept from disk buckets

* remove uid parameter from try_lock
2023-03-22 06:30:44 -07:00
Jeff Washington (jwash) d4a6e00ffc
rework find_entry_mut for missing case (#30833)
* rework find_entry_mut for missing case

* clippy
2023-03-21 14:09:17 -07:00
Jeff Washington (jwash) df2c95119c
add buckets stats for # files and total file size (#30780)
* add buckets stats for # files and total file size

* change metrics to bytes

* get index file size correct
2023-03-20 08:22:31 -07:00
Jeff Washington (jwash) 6dd5a22926
when writing to disk bucket index, tune towards packing tighter (#30761)
* when writing to disk bucket index, tune towards packing tighter

* switch to min
2023-03-17 12:34:56 -07:00
Jeff Washington (jwash) d66d1f7a46
disk index handles empty slot list more correctly (#30752) 2023-03-16 12:34:45 -07:00
Jeff Washington (jwash) 2441a06e78
drop default from PhantomData::default() (#30476) 2023-02-23 14:59:08 -08:00
Yihau Chen df3ef111f7
chore: workspace inheritance (#29893)
* introduce workspace.package

* introduce workspace.dependencies

* read version from root cargo.toml

* pass check when version = { workspace = true }

* don't bump version when version = { workspace = true }

* including workspace Cargo.toml when bump version

* programs/sbf use workspace inheritance

* fix increasing cargo version ignore program/sbf/Cargo.toml
2023-02-23 22:01:54 +08:00
Michael Vines 5136ed3448
Update homepage value for all crates (#30444) 2023-02-23 02:20:18 +00:00
Jeff Washington (jwash) 1269011477
bucket map try_write takes iter (#30440) 2023-02-22 14:43:10 -08:00
Will Hickey 04a6a631bc
Bump version to v1.16 (#30028) 2023-01-31 17:48:33 -06:00
joeaba a12bf8c003
Update maintainers references (#29997)
* update maintainers references

* chore: update maintainers reference
2023-01-31 08:07:13 -05:00