a63d99fd11
Use write! to fix clippy and save heap allocation ( #25220 )
2022-05-16 22:39:33 +02:00
21e066ef26
Merge pull request from GHSA-wxrh-ff9f-fc6w
2022-05-16 12:30:37 -07:00
5625959f7e
(LedgerStore) Change perf_samples_counter from Arc<AtomicUsize> to AtomicUsize ( #25043 )
...
#### Problem
After #25042 , each LedgerColumn has its own BlockstoreRocksDbWritePerfMetrics
and BlockstoreRocksDbReadPerfMetrics instances. As it has total ownership,
its member field does not need to use Arc.
#### Summary of Changes
Change perf_samples_counter from Arc<AtomicUsize> to AtomicUsize
under BlockstoreRocksDbWritePerfMetrics and BlockstoreRocksDbReadPerfMetrics.
2022-05-16 11:31:07 -07:00
196de1c043
Refactor make_connection ( #25225 )
...
1. Move logics related to creating endpoint, creating new connection and retry 0rtt connections into a wrapper construct QuicNewConnection to put the logic together.
2. get_or_add_connection: logic is much simplified to allow manage the connection cache -- the QUIC connection is lazy constructed. get_or_add_connection should no longer be a global hotspot.
3. Per connection stats update is moved out of get_or_add_connection to avoid bad connection impacting good connections.
2022-05-16 11:13:18 -07:00
3e44046a73
Support lz4 for snapshot archives ( #25089 )
...
* add lz4
* add cargo package file
* fix tests
* use fast lz4 compression
* report snapshot archive format
* add test
* code review feedback
* add cargo.lock
* fix var name
* refactor archive format parsing and add default compress cli arg
* clippy
* add from_cli_arg test
* update cargo.lock
* add lz4 support for mmap
* cargo.lock
* clippy
2022-05-16 12:44:15 -05:00
f81c5df1f0
Include account index in rent paying account tx error ( #25189 )
2022-05-16 23:35:34 +08:00
389d78e424
Don't use mmarinus package ( #25177 )
...
* Revert "Revert "Use memory map to speed up snapshot untar (#24889 )" (#25174 )"
This reverts commit fc793de2dd
2022-05-16 08:49:17 -05:00
daac9399ed
docs: Remove redundant and incorrect tx priority details ( #25239 )
2022-05-16 04:41:51 +00:00
b1b3702e6d
Prioritize transactions in banking stage by their compute unit price ( #25178 )
...
* - get prioritization fee from compute_budget instruction;
- update compute_budget::process_instruction function to take instruction iter to support sanitized versioned message;
- updated runtime.md
* update transaction fee calculation for prioritization fee rate as lamports per 10K CUs
* review changes
* fix test
* fix a bpf test
* fix bpf test
* patch feedback
* fix clippy
* fix bpf test
* feedback
* rename prioritization fee rate to compute unit price
* feedback
Co-authored-by: Justin Starry <justin@solana.com>
2022-05-16 12:06:33 +08:00
52db2e19bc
Lower default batch size to 64 and add 2 banking threads ( #25226 )
2022-05-15 16:52:47 +02:00
6c10515ccf
Revert "Serialize lamports per signature in snapshots ( #25181 )" ( #25228 )
...
This reverts commit 35d2a0fd69
2022-05-15 12:04:17 +00:00
82dd0eaf8b
Refactoring and extending functionality of DoS tool ( #24412 )
...
* move cli to separate file
* move rpc_client creation to function
* move rpc mode handling to separate function
* Separated unique transaction workflow, added keypairs generation
* use faucet to fund kp, add new transaction types
* update Cargo.lock
* update documentation
* fix clippy errors
* introduce num_instructions
* add cli tests
* clippy updates
* update Cargo.lock
* add cli tests for mode rpc
* address PR comments
* refactor mode rpc case
* formatting changes
* run_dos_rpc_mode with generics
* replaced &Option with Option&
* simplified nodes discovery
* formatting changes
* reduced number of iterations for random test
* address PR comments
2022-05-15 11:41:13 +02:00
4ea39c1cd3
feat: thread new blockheight expiry strategy through `sendAndConfirmTransaction` ( #25227 )
...
* chore: extract expirable blockhash record into its own type
* fix: the local latest blockhash cache now fetches and stores lastValidBlockHeight
* fix: allow people to supply a confirmation strategy to sendAndConfirmRawTransaction
* test: upgrade RPC helpers to use blockheight confirmation method
* test: patch up tests to use blockheight based confirmation strategy
* fix: eliminate deprecated construction of Transaction inside simulateTransaction
* test: eliminate deprecated constructions of Transaction in tests
2022-05-14 21:54:12 -07:00
abd4ef889e
Fixed a race condition where in multiple thread environment that wasteful ( #25176 )
...
Duplicate and useless connections are being created which overloads the server and cause unreliable
connections on the client side.
2022-05-14 15:02:13 -07:00
35d2a0fd69
Serialize lamports per signature in snapshots ( #25181 )
...
* Serialize lamports per signature
* pr comments
2022-05-14 10:57:51 -07:00
592aa4c21b
Improve hard fork message with more detail ( #25214 )
2022-05-15 01:14:23 +09:00
3d96a1ab76
Block packets in vote-only mode ( #24906 )
2022-05-14 17:53:37 +02:00
d513407485
test: getEstimatedFee change runs only in live environment now ( #25210 )
...
Co-authored-by: Marc Jaramillo <mnj.webdeveloper@gmail.com>
2022-05-13 21:16:39 -07:00
375968da3b
fix: transaction confirmation strategy: wait until the last valid blockheight passes ( closes #24211 )
...
Co-authored-by: Marc Jaramillo <mnj.webdeveloper@gmail.com>
Co-authored-by: Stella Wang <stella01wang@gmail.com>
2022-05-13 20:21:24 -07:00
7826fef120
clippy ( #25206 )
2022-05-13 21:03:54 -05:00
aaf417998d
Add ledger-store label description to CONTRIBUTING.md. ( #25130 )
...
#### Summary of Changes
Add ledger-store label and its description to CONTRIBUTING.md.
The label should help us track issues / PR easier.
2022-05-13 16:23:00 -07:00
9ccdc8a050
populate ancient append vec metrics ( #25204 )
...
* populate ancient append vec metrics
* count ancient storages while enumerating storages anyway.
2022-05-13 18:20:15 -05:00
d7dcb62fe1
ancient_append_vec refactoring ( #25203 )
2022-05-13 16:40:26 -05:00
cb037e49ea
is_candidate_for_shrink respects ancient append vecs ( #25205 )
2022-05-13 16:26:46 -05:00
3c70220142
Remove obsolete string C header input file
...
string.h doesn't contain any syscall declarations that need to be
processed by the gen-headers C header file generating utility.
2022-05-13 10:37:25 -07:00
5eeb07fead
coalesce purge stats and reclaim result ( #25183 )
2022-05-13 12:34:11 -05:00
e493e0033a
chore: build windows artifacts on Github Actions ( #25188 )
...
* chore: always checkout repo from master
* chore: rename variable tag => commit
* chore: gh-release when tag is present
* chore: add release-artifacts-auto
* chore: skip build when channel is empty
* chore: use GITHUB_REF_NAME as CI_BRANCH
2022-05-13 17:10:03 +08:00
e024806aa5
fix: mark the socket as closed when receiving a close/error message ( #25180 )
2022-05-13 02:07:13 -07:00
5948b6c741
explorer: Display error details on tx page ( #25186 )
2022-05-13 07:55:38 +00:00
bc005e3408
Add configurable limit to number of blocks to check before Bigtable upload ( #24716 )
...
* Add ConfirmedBlockUploadConfig, no behavior changes
* Add comment
* A little DRY cleanup
* Add configurable limit to number of blocks to check in Blockstore and Bigtable before uploading
* Limit blockstore and bigtable look-ahead
* Exit iterator early when reach ending_slot
* Use rooted_slot_iterator instead of slot_meta_iterator
* Only check blocks in the ledger
2022-05-13 07:34:02 +00:00
71dd95e842
Tune banking_stage receive loop timing ( #25172 )
2022-05-13 03:42:08 +00:00
e4ac75af90
chore: bump ts-mocha from 9.0.2 to 10.0.0 in /web3.js ( #25102 )
...
Bumps [ts-mocha](https://github.com/piotrwitek/ts-mocha ) from 9.0.2 to 10.0.0.
- [Release notes](https://github.com/piotrwitek/ts-mocha/releases )
- [Changelog](https://github.com/piotrwitek/ts-mocha/blob/master/CHANGELOG.md )
- [Commits](https://github.com/piotrwitek/ts-mocha/commits )
---
updated-dependencies:
- dependency-name: ts-mocha
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-05-13 10:53:07 +08:00
d8a8393994
Don't extract invoked keys from a message when using a lookup table ( #25065 )
...
* Refactor message compiled keys
* Prohibit invoked keys from being extracted by lookup table
2022-05-13 10:32:10 +08:00
295df294de
chore: bump zstd from 0.11.1+zstd.1.5.2 to 0.11.2+zstd.1.5.2 ( #25156 )
...
* chore: bump zstd from 0.11.1+zstd.1.5.2 to 0.11.2+zstd.1.5.2
Bumps [zstd](https://github.com/gyscos/zstd-rs ) from 0.11.1+zstd.1.5.2 to 0.11.2+zstd.1.5.2.
- [Release notes](https://github.com/gyscos/zstd-rs/releases )
- [Commits](https://github.com/gyscos/zstd-rs/commits/v0.11.2 )
---
updated-dependencies:
- dependency-name: zstd
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-12 20:28:50 -06:00
8468f80a18
fix: restore package-lock file; it's needed for the build cache :/
2022-05-12 16:59:48 -07:00
6f1cc5a2a7
assert we haven't squashed to ancient after hash calc ( #25168 )
2022-05-12 18:26:01 -05:00
8902a66b20
Revert "Disallow deployment of deprecated _sol_alloc_free syscall ( #24986 )" ( #25170 )
...
This reverts commit 8f1d4c1665
2022-05-12 17:58:17 -05:00
82404d3f1c
fix: repair native bigint-buffer binding by preventing module from being bundled ( fixes #25159 )
2022-05-12 14:31:21 -07:00
14bc55eddb
Use net-stats-validator metric on the dashboard ( #25171 )
2022-05-12 20:20:20 +00:00
fc793de2dd
Revert "Use memory map to speed up snapshot untar ( #24889 )" ( #25174 )
...
This reverts commit 3367e44671
2022-05-12 14:48:29 -05:00
08da486c05
additional costs in block capacity calc ( #25059 )
...
* Added additional costs to block capacity computation, and pushed alloc of CostModel all the way to the top of the call chain, instead of reallocing
* Fix two compiler errors
* Update block processing to propagate computed costs, rather than re-computing deeper in the call stack
* Clippy fix
* Reformatting fix after merge
* Add CostModel::sum_without_bpf
2022-05-12 13:52:20 -05:00
3367e44671
Use memory map to speed up snapshot untar ( #24889 )
...
* mmap
* add no_os_memory_reporting_args to ledger-tool
* use safe memory map package for unix. use regular file for windows
* fallback to untaring with filebuf when mmap fails
* update comments
2022-05-12 13:35:19 -05:00
cde15ff687
support 64-bit prioritization fee ( #25027 )
2022-05-12 11:07:36 -07:00
896729f25e
keep track of oldest slot used by last hash calculation ( #25152 )
2022-05-12 11:18:08 -05:00
3a4f0d3397
println -> info ( #25163 )
2022-05-12 11:07:13 -05:00
bcf4d54235
Update test_banking_stage_entryfication to be more deterministic ( #25146 )
...
* Update test_banking_stage_entryfication to be more deterministic
* revert to original test with updated checks
2022-05-12 15:36:19 +00:00
abb4993a3b
SortedStorages::max_slot_inclusive() ( #25153 )
2022-05-12 10:24:03 -05:00
849cbe93aa
add AccountsToStore::has_overflow ( #25143 )
2022-05-12 10:14:27 -05:00
7e4397204a
chore: fix typo in security-txt.ts ( #25160 )
...
seperated -> separated
2022-05-12 21:28:52 +08:00
069b052553
docs(developing): remove duplicate entry ( #25129 )
2022-05-12 01:57:09 -07:00
sakridge
Jack May
Yueh-Hsuan Chiang
Lijun Wang
HaoranYi
Justin Starry
Tao Zhu
Justin Starry
kirill lykov
Steven Luscher
Ashwin Sekar
Ryo Onodera
Marc Jaramillo
Jeff Washington (jwash)
Dmitri Makarov
apfitzge
Yihau Chen
Tyera Eulberg
Pankaj Garg
dependabot[bot]
steveluscher
Jeff Washington (jwash)
Jason
Ikko Ashimine
Sohrab