934da5ef99
Fix pre-check of blockstore slots during load_bank_forks ( #25632 )
...
Fix pre-check of blockstore slts during load_bank_forks. Now iterates from starting_slot to halt_slot via slot_meta.next_slots to confirm they are connected.
2022-06-01 20:19:42 -05:00
29cfa04c05
records number of residual data shreds which don't make a full batch ( #25693 )
...
Data shreds are batched into MAX_DATA_SHREDS_PER_FEC_BLOCK shreds for
each erasure batch. If there are residual shreds not making a full
batch, then we cannot generate coding shreds and need to buffer shreds
until there is a full batch; This may add latency to coding shreds
generation and broadcast.
In order to evaluate upcoming changes removing this buffering logic,
this commit adds metrics tracking residual number of data shreds which
don't make a full batch.
2022-06-02 00:32:32 +00:00
10afdfee90
client: Refactor quic_client to nonblocking module ( #25501 )
2022-06-02 01:20:11 +02:00
51ac599915
Add user requested CU (eg. compute_budget.compute_unit_limit) to immutable_deserialized_packet, to be used in cost model and prioritized forwarding ( #25695 )
2022-06-01 22:43:48 +00:00
149a54b786
remove par_iter on update index below threshold ( #25699 )
2022-06-01 17:41:56 -05:00
891dcb2084
move rent collection time into datapoint ( #25714 )
2022-06-01 17:28:47 -05:00
6349a6dc97
tpu-client: Add "fake" async version with sync sending ( #25499 )
...
* tpu-client: Add "fake" async for sending
* Add Drop implementation
* Rebase
2022-06-01 23:41:35 +02:00
dd0bf4ff4b
add filler accounts gradually with cache flush ( #25678 )
2022-06-01 15:47:21 -05:00
b80a82a9e5
runtime: gate nonce disable at restart slot
2022-06-01 12:00:10 -06:00
635bd40f09
runtime: disable durable nonces
2022-06-01 11:15:16 -06:00
905fef29cb
add filter to AppendVecScan ( #25664 )
2022-06-01 11:55:18 -05:00
17995c7e67
Cleanup BlockstoreInsertionMetrics ( #25618 )
...
* Move BlockstoreInsertionMetrics to blockstore_metrics.rs
* Specify unit (us) in metric fields
2022-06-01 10:54:11 -05:00
94b0ce5d43
remove_old_historical_roots uses accounts_hash_complete_one_epoch_old ( #25673 )
2022-06-01 10:45:26 -05:00
c91fbd289f
set active state to shrink_ancient when doing intersting work ( #25677 )
2022-06-01 10:36:58 -05:00
8bb76fcd87
add ancient metrics ( #25656 )
...
* add ancient metrics
* review feedback
2022-06-01 10:36:23 -05:00
07958fd8ed
use self.init_accum ( #25663 )
2022-06-01 08:38:37 -05:00
3ed2e0ce26
chore: bump @commitlint/config-conventional in /web3.js ( #25691 )
...
Bumps [@commitlint/config-conventional](https://github.com/conventional-changelog/commitlint/tree/HEAD/@commitlint/config-conventional ) from 15.0.0 to 17.0.2.
- [Release notes](https://github.com/conventional-changelog/commitlint/releases )
- [Changelog](https://github.com/conventional-changelog/commitlint/blob/master/@commitlint/config-conventional/CHANGELOG.md )
- [Commits](https://github.com/conventional-changelog/commitlint/commits/v17.0.2/@commitlint/config-conventional )
---
updated-dependencies:
- dependency-name: "@commitlint/config-conventional"
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-01 10:21:33 +00:00
27978c4d0c
chore: bump flate2 from 1.0.23 to 1.0.24 ( #25636 )
...
* chore: bump flate2 from 1.0.23 to 1.0.24
Bumps [flate2](https://github.com/rust-lang/flate2-rs ) from 1.0.23 to 1.0.24.
- [Release notes](https://github.com/rust-lang/flate2-rs/releases )
- [Commits](https://github.com/rust-lang/flate2-rs/commits )
---
updated-dependencies:
- dependency-name: flate2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-31 23:15:46 -06:00
b6994dcf0a
chore:(deps): bump eventsource from 1.0.7 to 1.1.1 in /explorer ( #25684 )
...
Bumps [eventsource](https://github.com/EventSource/eventsource ) from 1.0.7 to 1.1.1.
- [Release notes](https://github.com/EventSource/eventsource/releases )
- [Changelog](https://github.com/EventSource/eventsource/blob/master/HISTORY.md )
- [Commits](https://github.com/EventSource/eventsource/compare/v1.0.7...v1.1.1 )
---
updated-dependencies:
- dependency-name: eventsource
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-01 04:46:37 +00:00
aedcb05dc8
Record solana-validator ver to metrics at startup ( #25635 )
...
* Record solana-validator ver to metrics at startup
* Update Cargo.lock
2022-06-01 13:37:50 +09:00
8584a3a331
Add feature to increase timestamp bounding on the slow side to 150% of poh estimate (1s/slot) ( #25666 )
2022-05-31 16:53:06 -06:00
897e97a305
Add docs to solana_program::program ( #25352 )
2022-05-31 10:10:40 -07:00
5994b4f53f
use object for hash scanning ( #25418 )
2022-05-31 11:51:56 -05:00
bcff88bf42
Use the new datapoint macro for RocksDB column family metrics ( #25505 )
...
#### Summary of Changes
Use the new datapoint macro that supports group-by for RocksDB column family metrics.
By using the new macro, we can further remove large chunks of boilerplate code that try to work around the previous datapoint macro that does not support group-by.
2022-05-31 09:26:57 -07:00
56d38e4954
Add lz4 to snapshot filename regex for matching files on load ( #25633 )
...
* Add lz4 to snapshot filename regex for matching files on load
* Add tests for lz4 archive format filenames
2022-05-31 11:06:41 -05:00
02b26ddd82
SigVerify: Fix num_valid_packets metric ( #25643 )
...
It used to report the number of packets with successful signature
validations but was accidentally changed to count packets passed into
the verifier by e4409a87fe
2022-05-31 18:51:20 +10:00
6b2f58152b
Ignore rocksdb directories when unpacking genesis archive ( #25575 )
...
Unpacking the rocksdb directory from genesis archive can have unintended
consequences, such as clobbering files in pre-existing rocksdb
directory.
2022-05-31 00:38:45 -05:00
e5ebcb0855
chore: test stable-bpf on gcp agents
2022-05-31 11:36:30 +08:00
90a3315b69
Detect tracer key in sigverify ( #25579 )
...
* Mark the tracer transaction
* simplify tracer check
2022-05-30 18:41:54 -05:00
58092f746c
fix: serializing transactions; sort that takes less time and memory
2022-05-30 16:37:50 -07:00
1727ca4371
test: massage tests from PR 25641
2022-05-30 11:40:30 -07:00
20f169c0b0
fix: sort accountMetas after deduping
2022-05-30 11:40:01 -07:00
4b1dd0f921
Fix a possible test hang in runtime::test_shared_buffer_sweep ( #25545 )
...
* Fix a possible test hang in runtime::test_shared_buffer_sweep
The test may hang if the total number of threads it wants to start
is greater than the number of threads configured in the rayon
threadpool. Check to avoid this situation from happening.
* Incorporate comment from Xiang Zhu, using std::cmp::min() to simplify the code
2022-05-30 23:39:32 +08:00
d4e7ebf4f8
increasing timeout limit to 35 for few tests
2022-05-28 18:18:18 +05:30
387d9d9c77
Store missing unupdated executors earlier
2022-05-28 13:42:35 +10:00
740ee0c502
Fix datapoint name ( #25614 )
2022-05-28 01:01:29 +00:00
a74adb07fa
Upd doc comment for cloud CreateInstances ( #25609 )
2022-05-27 18:34:41 +02:00
4e6b276f6c
bump executor cache max entries ( #25600 )
...
* executor-cache: unify `remove` calls
* executor-cache: metrics - add one-hit-wonder counter
* executor-cache: bump max entries to 256
2022-05-28 01:54:10 +10:00
e4409a87fe
Add pre shrink pass before sigverify batch ( #25136 )
2022-05-28 01:51:55 +10:00
ce14c63bf0
fix: stop double counting execution timings ( #25605 )
2022-05-28 00:06:29 +10:00
8fdfe56a6f
chore: bump tarpc from 0.28.0 to 0.29.0 ( #25601 )
...
* chore: bump tarpc from 0.28.0 to 0.29.0
Bumps [tarpc](https://github.com/google/tarpc ) from 0.28.0 to 0.29.0.
- [Release notes](https://github.com/google/tarpc/releases )
- [Changelog](https://github.com/google/tarpc/blob/master/RELEASES.md )
- [Commits](https://github.com/google/tarpc/commits )
---
updated-dependencies:
- dependency-name: tarpc
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-27 07:03:40 -06:00
24634b6e25
Use the new datapoint macro that supports group-by for RocksDB read/write metrics. ( #25392 )
...
#### Summary of Changes
Use the new datapoint macro that supports group-by for RocksDB read/write perf metrics.
2022-05-26 22:17:29 -07:00
e58de2c233
Check fee payer before loading all accounts ( #25371 )
...
* fix vote account loading
* fix clippy and rename some stuff
* fix bug
Co-authored-by: Justin Starry <justin@solana.com>
2022-05-27 13:44:29 +10:00
6de2884969
Extend the datapoint macro to support group-by operations. ( #25385 )
...
#### Problem
Our existing datapoint macro syntax does directly not support group-by tags.
The existing workaround is to embed the group-by tags into the metric name which does not scale well.
#### Summary of Changes
This PR extends the existing syntax to support group-by tags as follows. The new syntax is also compatible with the existing syntax:
```
datapoint_debug!(
"metric_name",
"tag" => "tag-value",
"tag2" => "tag-value2",
....
("field1", 100, i64), // field syntax is the same as the current syntax.
("field2", "hello", String),
...
);
```
2022-05-26 17:00:58 -07:00
5b67960c76
(Refactor) Move blocktore options related stuff to blockstore_options.rs ( #25509 )
...
#### Problem
blockstore_db.rs has a mutual dependency between blockstore_metrics.rs.
#### Summary of Changes
This PR removes the mutual dependency by moving the option-related stuff
out from blockstore_db.rs to its new home --- blockstore_options.rs.
By doing this, we address the mutual dependency and also make the code cleaner.
2022-05-26 16:59:26 -07:00
da28badcaa
fix: web3.js fork fetch for browsers
2022-05-26 14:40:18 -07:00
9f1b876c74
fix: correct the types of the fetch infra in web3.js
2022-05-26 14:40:18 -07:00
994ae755a9
chore: augment build script to build forked modules into correct bundles
2022-05-26 14:40:18 -07:00
7d202a0be2
Make run-sanity.sh ledger-tool verify operate on more slots ( #25591 )
...
Prior to this change, genesis.tar.bz2 and the snapshot would be copied
over to a new directory but not rocksdb. As such, the verify step would
only unpack the snapshot and verify that hash.
2022-05-26 15:44:09 -05:00
7f4128947b
chore: bump lru from 0.7.5 to 0.7.6 ( #25572 )
...
* chore: bump lru from 0.7.5 to 0.7.6
Bumps [lru](https://github.com/jeromefroe/lru-rs ) from 0.7.5 to 0.7.6.
- [Release notes](https://github.com/jeromefroe/lru-rs/releases )
- [Changelog](https://github.com/jeromefroe/lru-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/jeromefroe/lru-rs/compare/0.7.5...0.7.6 )
---
updated-dependencies:
- dependency-name: lru
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
2022-05-26 19:05:02 +00:00
apfitzge
behzad nouri
Jon Cinque
Tao Zhu
Jeff Washington (jwash)
Trent Nelson
steviez
dependabot[bot]
Ryo Onodera
Tyera Eulberg
Brian Anderson
Yueh-Hsuan Chiang
Christian Kamm
yihau
carllin
steveluscher
sudhir-b
Wei Hu
axleiro
kirill lykov
Justin Starry
buffalu