Commit Graph

20326 Commits

Author SHA1 Message Date
Ivan Mironov 9159415e1b Add watchtower option to specify RPC timeout
This is useful when solana-watchtower is running on slow network.
2022-09-16 15:36:15 -07:00
Ivan Mironov 2f40c5680e Add watchtower option to add custom string into notifications
This helps to distinguish between Mainnet and Testnet notifications sent
into the same notification channel. Usage example:

	solana-watchtower --name-suffix " mainnet" ...
	solana-watchtower --name-suffix " testnet" ...
2022-09-16 15:36:15 -07:00
Kevin Heavey 8c41cf9330
remove solana-vote-program dep from solana-transaction-status (#27845)
Co-authored-by: Kevin Heavey <ID+username@users.noreply.github.com>
2022-09-16 21:46:47 +00:00
Kevin Heavey 742ee71138 remove vote-program dep from account-decoder 2022-09-16 14:38:54 -07:00
Yueh-Hsuan Chiang 9831e4ddad
Remove daily rewrite/compaction of each ledger file (#27571)
#### Problem
Previously before #26651, our LedgerCleanupService needs RocksDB background
compactions to reclaim ledger disk space via our custom CompactionFilter.
However, since RocksDB's compaction isn't smart enough to know which file to pick,
we rely on the 1-day compaction period so that each file will be forced to be compacted
once a day so that we can reclaim ledger disk space in time.  The downside of this is
each ledger file will be rewritten once per day.

#### Summary of Changes
As #26651 makes LedgerCleanupService actively delete those files whose entire slot-range
is older than both --limit-ledger-size and the current root, we can remove the 1-day compaction
period and get rid of the daily ledger file rewrite.

The results on mainnet-beta shows that this PR reduces ~20% write-bytes-per-second
and reduces ~50% read-bytes-per-second on ledger disk.
2022-09-16 13:12:55 -07:00
Jeff Washington (jwash) 1d701aa4f9
ancient append vec stats: ancient_append_vecs_shrunk (#27824) 2022-09-16 12:58:48 -07:00
Alexander Meißner 79f45da7d4
Tests for the patch in #27752 (#27784)
Adds tests for the two account aliasing restrictions of UpgradeableLoaderInstruction::Upgrade which can be triggered.
2022-09-16 10:54:20 +02:00
behzad nouri b183e00dcf
patches range check in shred::layout::get_signed_message_range (#27822) 2022-09-16 00:08:10 +00:00
Jon Cinque 51ab9627d7
ci: Add spl-token-upgrade to downstream program build (#27826) 2022-09-16 01:50:12 +02:00
Brian Anderson 0c1ff7c63d
Document the pubsub client APIs. (#27188)
* Document the pubsub client APIs.

* Apply suggestions from code review

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>

* Update client/src/nonblocking/pubsub_client.rs

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>

* Update pubsub_client docs

* Link pubsub docs to solana-rpc docs

* fmt

* Update solana_client references

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2022-09-15 16:39:16 -06:00
steviez 1d5314b5e6
Make solana-ledger-tool retain all snapshots by default (#27788) 2022-09-15 16:21:12 -05:00
kirill lykov 1a4b8b5b79
recycle_store_count is moved to try_recycle_store (#27797) 2022-09-15 21:27:09 +02:00
Yihau Chen aae07807cb
docs: fix wrong args in 'solana program set-buffer-authority' (#27817)
fix wrong args in 'solana program set-buffer-authority'
2022-09-15 19:03:27 +00:00
Justin Starry 40d881d3d0
Explorer: Bump @solana/web3.js to v1.62.0 (#27769)
* Explorer: Bump @solana/web3.js to v1.62.0

* Don't fetch unsupported transaction versions
2022-09-15 18:54:18 +00:00
Justin Starry 07a83e0fbb
feat: add isAccountWritable and isAccountSigner to MessageV0 (#27808) 2022-09-15 18:31:43 +00:00
Justin Starry b9700244b5
Increase transaction account lock limit from 64 to 128 (#27242)
* Increase transaction account lock limit from 64 to 256

* fix bpf test

* Reduce lock limit from 256 to 128
2022-09-15 13:50:14 -04:00
Tyera Eulberg 973a5fb0e9
Add new TransactionDetails level (#27601)
* Add new transaction details level

* Dedupe common code

* Update docs

* Respect showRewards parameter in tx meta
2022-09-15 10:00:30 -06:00
Jeff Washington (jwash) 138d5ed5b0
don't return zero lamport accounts from 'load' with feature (#27793)
* don't return zero lamport accounts from 'load'

* add feature

* rename
2022-09-15 08:46:32 -07:00
samkim-crypto bac6ebcd88
zk-token-sdk: update errors in comments (#27602)
update errors in comments
2022-09-15 17:11:14 +09:00
Yihau Chen 6eeff08b15
chore: fix docs pipeline (#27794)
* trigger docs build when .github/workflows/docs.yml changed

* echo tag info

* echo channel info

* echo any changes info

* bump tj-actions/changed-files@v29.0.7

* fix variable name

* fix broken link
2022-09-15 14:50:59 +08:00
Tyera Eulberg 360ca07a40
Add serialization-control enum for RPC Options (#27676)
* Add test to verify output when deserializing/reserializing empty fields

* Add test to verify serialization from UiTransactionStatusMeta constructors

* Add OptionSerializer

* Use OptionSerializer for inner_instructions

* Use OptionSerializer for loaded_addresses

* Remove Default variant, use into instead

* Add as_ref implementation

* Use OptionSerializer for log_messages and rewards

* Use OptionSerializer for token_balances

* Use OptionSerializer for return_data

* Use OptionSerializer for compute_units_consumed
2022-09-14 16:58:50 -06:00
kirill lykov 6a7fbf7aba
move create_store counting to create_store (#27781) 2022-09-14 22:02:29 +02:00
Brooks Prumo 2a875a894b
Fix and expand EAH calculation info (#27779) 2022-09-14 15:23:43 -04:00
Jeff Washington (jwash) 3a47dfb8e6
add bank.bank_enable_rehashing_on_accounts_hash (#27768) 2022-09-14 11:29:23 -07:00
Ashwin Sekar 9119dc13ec
Add structure to house unprocessed transactions in banking_stage (#27777)
Separate storage for voting and transaction threads:
- Voting threads utilize a shared reference in order to dedup extraneous
  votes
- Transactions have thread local storage like before
2022-09-14 10:40:44 -07:00
Jeff Washington (jwash) 4f232250e5
add `dirty_ancient_stores` to clean metrics (#27774) 2022-09-14 06:52:51 -07:00
Jeff Washington (jwash) 416b45ac0f
calculate_capitalization gets 'enable_rehashing' (#27767) 2022-09-14 06:52:18 -07:00
Jeff Washington (jwash) cd44a0ab7b
acctidx: unref returns whether refcount went negative (#27773) 2022-09-14 06:51:50 -07:00
Jeff Washington (jwash) 17007fdda8
remove ancient append vec stores from shrink_candidate_slots (#27763) 2022-09-14 06:50:34 -07:00
Ashwin Sekar c74df830b1
Add structure to collect and coalesce vote packets (#27558)
* Add structure to collect and coalesce vote packets

Will be used in banking stage to throw out extraneous vote packets
before processing

* pr comments

* Update inner lock to arc to improve performance
2022-09-14 00:44:26 -07:00
Justin Starry e6687b89e6
chore: fix flakey partialSign test (#27770) 2022-09-13 20:16:30 +00:00
Justin Starry c345981321
Explorer: Remove support for bonfida bot instructions (#27766) 2022-09-13 19:42:04 +00:00
Justin Starry afe1cfe94a
fix: replace computed max u64 constant with literal (#27765) 2022-09-13 19:37:40 +00:00
Will Hickey e48456dbbc
Create continuous delivery directory and add readme with canary details. (#27683)
* Create continuous delivery directory and add readme with canary details.
2022-09-13 14:33:49 -05:00
Alexander Meißner c9eac2e6a1
Restore aliasing rules in BPF loader. (#27752) 2022-09-13 19:58:19 +02:00
Yueh-Hsuan Chiang 70c4f6ea96
Enable ledger-tool copy command to infer target_db shred storage type. (#27438)
#### Problem
The ledger-tool copy command currently assumes target_db uses the same
shred storage type as the source ledger.

#### Summary of Changes
This PR enables ledger-tool copy command to infer the target_db shred storage
type based on whether rocksdb or rocksdb_fifo exists under the target_db directory
(same way as how ledger-tool infers the shred storage type for the main db.)
If the ledger-tool is not able to infer the shred storage type of the target_db, then
the default level compaction will be used.
2022-09-13 10:27:58 -07:00
Will Hickey c0e4379f43
Whickey/version v1.15 (#27739)
* Bump version to v1.13.0
* Bump version to v1.14.0
* Bump version to v1.15.0
2022-09-13 09:06:15 -05:00
Will Hickey 6e2ab45b68
Update mergify backport actions to new version numbers v1.13 and v1.14 (#27749) 2022-09-13 07:53:19 -05:00
Yihau Chen ac1444ddb2
chore: bump axum-core to v0.2.8 (#27745) 2022-09-13 14:52:25 +08:00
Justin Starry d9b1ebece7
feat: add version getter to VersionedTransaction class (#27734) 2022-09-13 00:22:12 +00:00
apfitzge 079bf561b0
Clean_up/upb_push_comment (#27707) 2022-09-12 18:59:41 -05:00
Justin Starry 8bb0acc4c6
chore: remove failing request units test (#27735) 2022-09-12 23:18:29 +00:00
Yueh-Hsuan Chiang ba3d9cd325
Add LedgerColumn::multi_get() (#26354)
#### Problem
Blockstore operations such as get_slots_since() issues multiple rocksdb::get()
at once which is not optimal for performance.

#### Summary of Changes
This PR adds LedgerColumn::multi_get() based on rocksdb::batched_multi_get(),
the optimized version of multi_get() where get requests are processed in batch
to minimize read I/O.
2022-09-12 15:01:22 -07:00
apfitzge 0c185d1983
Fix a constant that was missed (#27731)
Missed constant
2022-09-12 16:23:55 -05:00
Michael Vines 0bcd9134bc Rework 'remove_dead_slots_metadata: slots' info log message 2022-09-12 13:36:05 -07:00
Jeff Washington (jwash) d242c0fc97
pass 'enable_rehashing' through all accounts hash functions (#27701) 2022-09-12 12:18:09 -07:00
Jeff Washington (jwash) ac74fc16b6
cleanup test constants (#27704) 2022-09-12 12:00:52 -07:00
Jeff Washington (jwash) 765c628546
use exit signal for acct idx bg threads (#27483) 2022-09-12 11:51:12 -07:00
Jeff Washington (jwash) f0770c199e
fix ledger tool final hash calc (#27725)
fix ledger tool final hash calc
2022-09-12 11:09:34 -07:00
royalrust 0cff1eff08
move if let destructuring out of for loop (#27712)
* move if let destructuring out of for loop

* remove trailing whitespace

* Update programs/vote/src/vote_state/mod.rs

Co-authored-by: Justin Starry <justin.m.starry@gmail.com>
2022-09-12 18:08:02 +00:00