2c0831aa12
ledger-tool: remove inefficient base58 encoding options
2022-10-19 19:16:52 -07:00
dd7fee8f32
Re-enqueues unhandled ABS requests ( #28362 )
2022-10-13 16:25:39 -04:00
9cbd00fdbc
Converts PendingAccountsPackage to a channel ( #28352 )
2022-10-13 12:47:36 -04:00
7ae7a3ff0e
after replay at validator startup don't verify hash calc ( #28222 )
2022-10-04 14:04:04 -07:00
7fef7d569a
Make RocksFifo storage size API expose an Option<u64> ( #28192 )
...
A fifo rocksdb instance must be opened with max size parameter on the
fifo columns. To support this, we previously plumbed a constant up to
callers that provided a default if unbounded growth desired.
This change attempts to be more rusty by exposing an option for this
value, and converting the option to a constant at the lowest level
possible.
2022-10-04 12:38:40 -05:00
8cc8a0656a
Cleanup solana-ledger-tool slot output ( #28129 )
2022-10-03 23:25:44 -05:00
6b17bee5a8
Remove the const default for RocksFifo ( #27965 )
...
#### Summary of Changes
Removes the constant default for ShredStorageType::RocksFifo
as the shred storage size is either user-specified or derived
from --limit-ledger-size in #27459 .
2022-10-01 15:10:54 -07:00
599677f965
Derive rocksdb_fifo_shred_storage_size based on limit-ledger-size ( #27459 )
...
### Problem
When FIFO compaction is used while --rocksdb_fifo_shred_storage_size
is unspecified, the FIFO shred storage size is set to a const default based
on the default `--limit-ledger-size`.
### Summary of the Change
When --rocksdb_fifo_shred_storage_size is unspecified, it is now
derived from `--limit-ledger-size` by reserving 1500 bytes for each
shred.
2022-09-28 00:32:27 -07:00
97c9af4c6b
plumbs through flag to generate merkle variant of shreds
2022-09-23 16:45:18 +00:00
9a57c64f21
patches clippy errors from new rust nightly release ( #27996 )
2022-09-22 22:23:03 +00:00
c4fa849844
chore: bump itertools from 0.10.3 to 0.10.5 ( #27962 )
...
* chore: bump itertools from 0.10.3 to 0.10.5
Bumps [itertools](https://github.com/rust-itertools/itertools ) from 0.10.3 to 0.10.5.
- [Release notes](https://github.com/rust-itertools/itertools/releases )
- [Changelog](https://github.com/rust-itertools/itertools/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-itertools/itertools/commits )
---
updated-dependencies:
- dependency-name: itertools
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-09-21 15:28:49 -06:00
860cd607fd
add flag to genesis cmd to dump account data in specified format ( #27695 )
...
* feat: add flag to genesis cmd to dump account data in jsonParsed format
* update Cargo.lock
* add json-parsed flag
* fix formatting
* fix formatting again
* use rustfmt
* use --encoding
* fix for failing checks
* Apply suggestions from code review
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
* address review comments
* address review comments
* fix indent
* fix print fmt
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2022-09-18 22:52:53 -06:00
1d5314b5e6
Make solana-ledger-tool retain all snapshots by default ( #27788 )
2022-09-15 16:21:12 -05:00
70c4f6ea96
Enable ledger-tool copy command to infer target_db shred storage type. ( #27438 )
...
#### Problem
The ledger-tool copy command currently assumes target_db uses the same
shred storage type as the source ledger.
#### Summary of Changes
This PR enables ledger-tool copy command to infer the target_db shred storage
type based on whether rocksdb or rocksdb_fifo exists under the target_db directory
(same way as how ledger-tool infers the shred storage type for the main db.)
If the ledger-tool is not able to infer the shred storage type of the target_db, then
the default level compaction will be used.
2022-09-13 10:27:58 -07:00
c0e4379f43
Whickey/version v1.15 ( #27739 )
...
* Bump version to v1.13.0
* Bump version to v1.14.0
* Bump version to v1.15.0
2022-09-13 09:06:15 -05:00
765c628546
use exit signal for acct idx bg threads ( #27483 )
2022-09-12 11:51:12 -07:00
54284955de
Respect rewards parameter in getBlock transaction-level rewards ( #27655 )
...
* Respect options.show_rewards in UiTransactionStatusMeta
* Fixup docs
2022-09-08 10:17:02 -06:00
518e16744d
move --accounts-db-verify-refcounts under verify ( #27651 )
2022-09-08 07:59:24 -07:00
4308c300b4
In ledger-tool delete the account files in the async way ( #27622 )
...
* In ledger-tool delete the account files in the async way
* format changes by ./cargo nightly fmt --all
2022-09-07 14:35:06 -07:00
93a4f80a2c
Handling snapshot requests is now required ( #27537 )
2022-09-07 10:08:42 -04:00
ed00365101
Add ledger tool command print-file-metadata ( #26790 )
...
Add ledger-tool command print-file-metadata
#### Summary of Changes
This PR adds a ledger tool subcommand print-file-metadata.
```
USAGE:
solana-ledger-tool print-file-metadata [FLAGS] [OPTIONS] [SST_FILE_NAME]
Prints the metadata of the specified ledger-store file.
If no file name is unspecified, then it will print the metadata of all ledger files
```
2022-09-06 21:46:35 -07:00
72a2c02ee7
add --accounts-db-verify-refcounts for debugging ( #27504 )
2022-09-06 09:39:39 -07:00
6684c62280
Add SnapshotUsage to SnapshotConfig ( #27508 )
2022-09-02 08:56:23 -04:00
66717ff87d
chore: bump chrono from 0.4.21 to 0.4.22 ( #27509 )
...
* chore: bump chrono from 0.4.21 to 0.4.22
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.21 to 0.4.22.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/v0.4.22/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.21...v0.4.22 )
---
updated-dependencies:
- dependency-name: chrono
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-08-31 22:39:12 +00:00
3c7cd62030
Move pruned_banks_receiver into PrunedBanksRequestHandler ( #27445 )
2022-08-29 13:30:06 -04:00
6da3eb028c
create-snapshot check if snapshot slot exists ( #27153 )
2022-08-19 09:34:35 -05:00
40b9f2f2be
slots_connected: check if the range is connected (>= ending_slot) ( #27152 )
2022-08-19 09:33:50 -05:00
adcc36da8e
Add fallback for ledger-tool commands to create new column families ( #26565 )
...
RocksDB settings include an option to create_if_missing, which will
create missing columns or the entire rocksdb directory if starting from
scratch. However, create_if_missing functionality only works if the
session has Primary (read+write) access. Many ledger-tool commands only
need Secondary (read-only) access to the database, so these commands are
unable to open the Blockstore when a column must be added.
This change detects when Secondary access open fails due to missing
column(s) or files, opens the database temporarily with Primary access,
and then reattempts to open the database Secondary access.
2022-08-14 05:20:13 -05:00
f641d3bad6
chore: bump chrono from 0.4.19 to 0.4.21 ( #27076 )
...
* chore: bump chrono from 0.4.19 to 0.4.21
Bumps [chrono](https://github.com/chronotope/chrono ) from 0.4.19 to 0.4.21.
- [Release notes](https://github.com/chronotope/chrono/releases )
- [Changelog](https://github.com/chronotope/chrono/blob/main/CHANGELOG.md )
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.19...v0.4.21 )
---
updated-dependencies:
- dependency-name: chrono
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <you@example.com>
2022-08-11 09:28:50 -06:00
e3a8d2ecdd
chore: bump serde_json from 1.0.81 to 1.0.83 ( #27036 )
...
* chore: bump serde_json from 1.0.81 to 1.0.83
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.81 to 1.0.83.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.81...v1.0.83 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-08-10 09:45:42 -06:00
f7c6901191
ledger-tool: support Geyser accounts updates ( #26909 )
2022-08-09 15:44:57 +00:00
07a0076fc2
chore: bump bytecount from 0.6.2 to 0.6.3 ( #27014 )
...
Bumps [bytecount](https://github.com/llogiq/bytecount ) from 0.6.2 to 0.6.3.
- [Release notes](https://github.com/llogiq/bytecount/releases )
- [Commits](https://github.com/llogiq/bytecount/commits )
---
updated-dependencies:
- dependency-name: bytecount
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-09 00:33:43 -06:00
ed8c224374
Bump version to v1.12 ( #26967 )
2022-08-06 13:20:30 -05:00
66919e5adb
Unpin tokio for non-rpc crates ( #26957 )
2022-08-05 20:50:45 -06:00
300666dce7
Make `solana-ledger-tool` run AccountsBackgroundService ( #26914 )
...
Prior to this change, long running commands like `solana-ledger-tool
verify` would OOM due to AccountsDb cleanup not happening.
Co-authored-by: Michael Vines <mvines@gmail.com>
2022-08-04 15:44:31 -05:00
fbf1bf6d86
Bump Version to 1.11.6 ( #26906 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-08-03 12:48:43 -05:00
f3b760dd91
Add IO metrics ( #26804 )
...
* Add Disk IO metrics
2022-08-02 14:29:53 -07:00
c7462b7a52
ledger tool verify can store debug info on hash calc ( #26837 )
2022-07-29 15:54:56 -05:00
5d038b9d2a
Bump Version to 1.11.5 ( #26758 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-07-25 13:05:14 -06:00
0fff5b8bf8
ledger-tool: optionally `graph` vote states
2022-07-22 17:43:01 -06:00
633950e029
ledger-tool: factor out `graph` options to config struct
2022-07-22 17:43:01 -06:00
a541827fb9
ledger-tool: fix off-by-one in `graph` skipped slot label
2022-07-22 17:43:01 -06:00
dcbda2c6c5
Allow ledger tool to automatically detect the shred compaction style ( #26182 )
...
#### Problem
Ledger-tool doesn't support shred-compaction-type other than the default rocksdb level compaction.
#### Summary of Changes
This PR enables ledger-tool to automatically detect the shred-compaction-type of the specified ledger.
#### Test Plan
New ledger-tool tests are added for both level and fifo compactions.
2022-07-19 01:19:17 +08:00
fd5df1cf25
Bump Version to 1.11.4 ( #26578 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-07-11 23:30:38 -05:00
1c2f6a4c41
Bugfix: slots_connected snapshot_slot not full ( #26506 )
...
* slots_connected check used by ledger-tool should not require a full slot for snapshot slot
* Cleaner Result<Option<>> unwrap/default
* return false if no meta for starting slot
* Add clarifying comments
2022-07-11 13:45:12 -05:00
9d937fb8a0
Bump Version to 1.11.3 ( #26481 )
...
Co-authored-by: willhickey <willhickey@users.noreply.github.com>
2022-07-07 14:39:46 -05:00
26176af4aa
cleanup cli arg help ( #26366 )
2022-07-05 14:49:05 -05:00
95ae82e074
add info to ledger tool for total execution time ( #26368 )
2022-07-05 09:23:06 -05:00
2b21c1da29
Sort Cargo.toml files
2022-06-24 12:41:38 -07:00
5c2f819f99
Bump Version to 1.11.2 ( #26159 )
2022-06-22 21:16:18 -05:00
Trent Nelson
Brooks Prumo
Jeff Washington (jwash)
steviez
Yueh-Hsuan Chiang
behzad nouri
dependabot[bot]
Amit Panghal
Will Hickey
Tyera Eulberg
Xiang Zhu
Jeff Washington (jwash)
apfitzge
Richard Patel
github-actions[bot]
Brennan Watt
Nicholas Rempel