9e703f85de
Upgrades Rust to 1.72.0 & nightly-2023-08-25 ( #32961 )
...
* allow pedantic invalid cast lint
* allow lint with false-positive triggered by `test-case` crate
* nightly `fmt` correction
* adapt to rust layout changes
* remove dubious test
* Use transmute instead of pointer cast and de/ref when check_aligned is false.
* Renames clippy::integer_arithmetic to clippy::arithmetic_side_effects.
* bump rust nightly to 2023-08-25
* Upgrades Rust to 1.72.0
---------
Co-authored-by: Trent Nelson <trent@solana.com>
2023-09-01 07:26:13 +00:00
a8be70fa7a
General cleanup ( #32980 )
...
* Fixes `cargo::` in build.rs
* Fixes overshadowing reexports.
* Removes unnecessary `as *const u8`.
* Removes unnecessary `.into_iter()`.
* cargo clippy
2023-08-24 21:44:19 +02:00
b6d8174aba
bigtable: Adjust logging and condense counters ( #31661 )
...
* bigtable: Demote log lines for entering functions to trace
* bigtable: Condense counters into single datapoint
Counters (inc_new_counter_*) incur extra overhead in that each update
can result in an item being sent over crossbeam channel to MetricsAgent.
So, accumulate the counter locally and submit as datapoint later.
2023-05-15 21:48:00 -05:00
94cb88ffad
add solana-ledger-tool bigtable copy ( #28122 )
...
* init copy cmd
* extract creating emulator connection logic
* extract copy args as struct
* add new_for_emulator
* add tryFrom confirmed block to versioned block
* implement bigtable copy command
* use 'force' flag to force upload
* use unwrap_or
* remove redundant importing
* fix nightly lint
* explicit transactions missing error
* process ending_slot
* prevent start slot > end slot
* print skip slots in debug level
* fix destination bigtable should not be readonly
* combine is-emulator and endpoint to emulated source. conflict with crenditial path
* wording
* log some error messages with error level
* nightly lint
* add dry-run
* extract create bigtable instances logic
* use a lighter way to check block
* use the latest futures version which is used in the repo
* use futures = "0.3"
Co-authored-by: Tyera <teulberg@gmail.com>
* wording
Co-authored-by: Tyera <teulberg@gmail.com>
* wording
Co-authored-by: Tyera <teulberg@gmail.com>
Co-authored-by: Tyera <teulberg@gmail.com>
2023-01-09 11:23:35 +08:00
9524c9dbff
patches errors from clippy::uninlined_format_args
...
https://rust-lang.github.io/rust-clippy/master/index.html#uninlined_format_args
2022-12-06 19:32:15 +00:00
55985701ba
bigtable: add timeout to token refresh ( #28728 )
...
Co-authored-by: Kirill Fomichev <fanatid@ya.ru>
2022-11-14 16:39:26 -07:00
d1ba42180d
clippy for rust 1.65.0 ( #28765 )
2022-11-09 19:39:38 +00:00
d949f4f42f
add a lighter way to check whether a block exists in the Bigtable ( #28308 )
...
* add does_row_key_exist
* add does_confirmed_block_exist
* lint
* Update storage-bigtable/src/bigtable.rs
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
* rename does_row_key_exist -> row_key_exists
* rename does_confirmed_block_exist -> confirmed_block_exists
* Update storage-bigtable/src/lib.rs
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2022-10-18 06:34:26 +00:00
9ee53e594d
patches clippy errors from new rust nightly release ( #28028 )
2022-09-23 20:57:27 +00:00
e22842f5db
chore: bump enum-iterator from 0.8.1 to 1.2.0 ( #27496 )
...
* chore: bump enum-iterator from 0.8.1 to 1.2.0
Bumps [enum-iterator](https://github.com/stephaneyfx/enum-iterator ) from 0.8.1 to 1.2.0.
- [Release notes](https://github.com/stephaneyfx/enum-iterator/releases )
- [Commits](https://github.com/stephaneyfx/enum-iterator/compare/0.8.1...1.2.0 )
---
updated-dependencies:
- dependency-name: enum-iterator
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
* Make versions consistent, and a-z toml
* Accommodate new apis
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2022-08-31 15:07:29 -06:00
7a11571e7f
Update BigTable apis to respect a limit of zero ( #27380 )
...
Update apis to respect a limit of zero
2022-08-24 12:44:19 -06:00
caca525695
ignore clippy derive_partial_eq_without_eq in prost generated code ( #27337 )
...
ignore clippy derive_partial_eq_without_eq in prost generated code
2022-08-23 14:21:24 -05:00
270315a7f6
transaction-status, storage-proto: add compute_units_consumed ( #26528 )
...
* transaction-status, storage-proto: add compute_units_consumed
* fix bpf test
Co-authored-by: Justin Starry <justin@solana.com>
2022-08-06 17:14:31 +00:00
0c98b06249
bigtable: set_nodelay for http connector ( #26398 )
2022-07-25 15:16:55 -06:00
90d9118048
Add `get_confirmed_transactions` to `storage-bigtable` ( #25404 )
...
* Add get_confirmed_transactions to storage-bigtable
* remove zip
* HashMap::new instead of default
* extract txs in order
2022-07-05 22:52:11 +00:00
d12e566a4c
bigtable: allow forward proxy in gRPC connection ( #25918 )
...
* bigtable: allow forward proxy in tonic connection
* bigtable: try fixing ci
* bigtable: cargo fmt
* bigtable: add docs for BIGTABLE_PROXY env var
* bigtable: fix readme header level
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2022-06-23 10:51:31 -06:00
49648c16c4
Add metric for tracking Bigtable block uploads ( #26027 )
2022-06-21 18:27:02 -06:00
32a58dd9e0
Add ability to use a non-default app profile id in bigtable requests ( #25968 )
...
* Add ability to use a non-default app profile id in bigtable requests
* Only run subcommand once when getting global configs
* Remove unneded scoping on option type
2022-06-16 00:58:16 +00:00
b05c7d91ed
Fix derive_partial_eq_without_eq clippy lint
2022-05-22 22:22:21 -07:00
6bcadc755e
Speedup bigtable block upload by factor of 8-10x ( #24534 )
...
Added multiple blockstore read threads.
Run the bigtable upload in tokio::spawn context.
Run bigtable tx and tx-by-addr uploads in tokio::spawn context.
2022-05-17 00:21:05 -06:00
4520c25330
chore: bump tonic-build from 0.7.1 to 0.7.2 ( #25037 )
...
* chore: bump tonic-build from 0.7.1 to 0.7.2
Bumps [tonic-build](https://github.com/hyperium/tonic ) from 0.7.1 to 0.7.2.
- [Release notes](https://github.com/hyperium/tonic/releases )
- [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/tonic/compare/v0.7.1...v0.7.2 )
---
updated-dependencies:
- dependency-name: tonic-build
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
* Regenerate proto
* Bump tonic and remove deprecated method
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2022-05-09 12:26:58 -06:00
aea17c35ae
Add a stringified credential option for LedgerStorage ( #24314 )
...
* add a stringified credential option for LedgerStorage
* fix clippy::useless-format warning
* change CredentialOption to enum CredentialType
* rename credential_option to credential_type
* restore LedgerStorage new fn signature
* fmt
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2022-04-13 14:35:06 -06:00
d8be0d9430
make get_protobuf_or_bincode_cells accept IntoIter on row_keys, make get_confirmed_blocks_with_data return an Iterator
2022-03-22 22:47:25 -06:00
f717fda9a3
modify get_protobuf_or_bincode_cells to accept and return an iterator
2022-03-22 22:47:25 -06:00
fbcf6a0802
use &[T] instead of Vec<T> where appropriate
...
clippy
2022-03-22 22:47:25 -06:00
5533e9393c
appease clippy
2022-03-22 22:47:25 -06:00
f3219fb695
add get_confirmed_blocks_with_data and get_protobuf_or_bincode_cells
2022-03-22 22:47:25 -06:00
7af48465fa
transaction-status: Add return data to meta ( #23688 )
...
* transaction-status: Add return data to meta
* Add return data to simulation results
* Use pretty-hex for printing return data
* Update arg name, make TransactionRecord struct
* Rename TransactionRecord -> ExecutionRecord
2022-03-22 23:17:05 +01:00
9b32b72990
bigtable: allow custom instance names
2022-03-21 11:26:49 -06:00
f513195468
bigtable: add a config ctor for `LedgerStorage`
2022-03-21 11:26:49 -06:00
d5dec989b9
Enforce tx metadata upload with static types ( #23028 )
2022-02-10 13:28:18 +08:00
ba215e94f6
Refactor: Add AccountKeys struct for static and dynamic message keys ( #22960 )
2022-02-05 20:00:31 +08:00
f804ccdece
Store address table lookups in blockstore and bigtable ( #22402 )
2022-01-14 15:24:41 +08:00
d9220652ad
[ledger-tool]compare_blocks ( #22229 )
...
* 1.made load_credentials accept credential path as a parameter. 2.partial implement bigtable comparasion function
* finding missing blocks in bigtables in a specified range
* refactor compare-blocks,add unit test for missing_blocks and fmt
* compare-block fix last block bug
* refactor compare-block and improve wording
* Update ledger-tool/src/bigtable.rs
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
* update compare-block command-line description
* style:improve wording/naming/code style
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2022-01-06 14:36:03 +08:00
2a00382d71
Refactor: cleanup solana_transaction_status crate ( #22230 )
2022-01-03 15:45:18 +00:00
b8837c04ec
Reformat imports to a consistent style for imports
...
rustfmt.toml configuration:
imports_granularity = "One"
group_imports = "One"
2021-12-03 09:19:13 -08:00
f3f8d2e4f3
Add BigTable query logs and counter ( #21394 )
...
* Add LedgerStorage logs
* Add storage-bigtable metric
2021-11-22 16:22:46 -07:00
f0de3e9bf0
chore: bump tonic from 0.5.2 to 0.6.1 ( #21035 )
...
* Bump tonic and prost crates
* connect_lazy no longer infallible
2021-10-28 06:59:36 +00:00
795dde109c
Fix memo handling and "blocks" key formatting ( #20044 )
...
* Fix memo handling and "blocks" key formatting
* Skip memo equality check
* Define slot_to_tx_by_addr_key
Co-authored-by: Justin Starry <justin@solana.com>
2021-09-22 00:46:46 +09:00
c71fab6cb3
Add `delete` subcommand to `ledger-tool bigtable` ( #19931 )
...
* Add `delete` subcommand to `ledger-tool bigtable` command
* feedback
2021-09-16 23:37:45 +00:00
f4ae450f34
Populate memo in bigtable transaction structs ( #19512 )
...
* Populate memo in bigtable transaction structs
* Preface memos with len
2021-08-30 21:14:18 -06:00
4098af3b5b
Record vote account commission with voting/staking rewards and surface in RPC
2021-07-12 15:09:44 -07:00
c2e7d39154
Add storage-proto build.rs and readme ( #18353 )
...
* Use build.rs for storage-proto generation
* Add readme
* Single use statements
2021-07-09 20:06:06 +00:00
761de8b1a3
Bump prost, prost-types, and tonic ( #18537 )
...
* Bump prost+tonic and accommodate generated service changes
* Unignore advisory
* Fixup .proto error list
2021-07-09 17:31:26 +00:00
0426c2d28e
chore: bump bzip2 from 0.3.3 to 0.4.3 ( #18361 )
...
* chore: bump bzip2 from 0.3.3 to 0.4.3
Bumps [bzip2](https://github.com/alexcrichton/bzip2-rs ) from 0.3.3 to 0.4.3.
- [Release notes](https://github.com/alexcrichton/bzip2-rs/releases )
- [Commits](https://github.com/alexcrichton/bzip2-rs/commits )
---
updated-dependencies:
- dependency-name: bzip2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
* Update to new api
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2021-07-01 13:10:52 -06:00
4a12c715a3
Drop Error suffix from enum values to avoid the enum_variant_names clippy lint
2021-06-18 23:02:13 +00:00
6514096a67
chore: cargo +nightly clippy --fix -Z unstable-options
2021-06-18 10:42:46 -07:00
c57d1b44ef
Properly handle block_height in Bigtable bincode deserialization ( #17990 )
...
* Default block_height on eof
* Add comment to prevent future errors
2021-06-15 17:34:07 -06:00
ab581dafc2
Add block height to ConfirmedBlock structs ( #17523 )
...
* Add BlockHeight CF to blockstore
* Rename CacheBlockTimeService to be more general
* Cache block-height using service
* Fixup previous proto mishandling
* Add block_height to block structs
* Add block-height to solana block
* Fallback to BankForks if block time or block height are not yet written to Blockstore
* Add docs
* Review comments
2021-05-26 22:16:16 -06:00
9541411c15
Plumb transaction-level rewards (aka "rent debits") into the `getTransaction` RPC method
2021-05-27 03:05:05 +00:00
Alexander Meißner
steviez
Yihau Chen
behzad nouri
Brandon Roberts
Brooks Prumo
dependabot[bot]
Tyera Eulberg
apfitzge
Richard Patel
Kirill Fomichev
lwus
Arthur Burkart
Dan Coombs
Michael Vines
buffalu
Rachael Pai
Edgar Xi
Jon Cinque
Trent Nelson
Justin Starry
Tyera Eulberg
Ryo Onodera