Geyser - Yellowstone gRPC - Validator Patches Overview

[grooviegermanikus]

(Abstract: Use this issue to track patches floating around - the list is very subjecting from what @grooviegermanikus know and need ATM)

GitHub Sources

• https://github.com/solana-labs/solana
• https://github.com/rpcpool/solana-public
• https://github.com/rpcpool/yellowstone-grpc
• https://github.com/blockworks-foundation/yellowstone-grpc

BlockInfoV3 backport to Validator 1.16.x

thread '' panicked at 'internal error: entered unreachable code: ReplicaBlockInfoVersions::V0_0_2 is not supported', yellowstone-grpc-geyser/src/plugin.rs:201:21

• backport of BlockInfoV3

Cluster Info

• new geyser interface for RPCv2
• send cluster info over geyser
• required also for leader schedule calculation

InvalidEntriesCount in Yellowstone-gRPC when reconstruction block

failed reconstruct ... InvalidEntriesCount

• issue happens info the geyser plugin runs on a validator node which is not the leader (e.g. solana-test-validator)
• open (as of 2024-01-11), geyser: zero value for entry_count solana-labs/solana#33823
• blockworks-foundation/yellowstone-grpc@6590208d
• geyser: reconstruct blocks with zero entries rpcpool/yellowstone-grpc#245

Account Deletions notifications over Geyser

• missing feature
• tracked on Solana PR
• not merged (as of 2024-01-11); 1.16.27, 1.17.15

Yellowstone-gRPC Block filter requires special filter option on accounts

• add full block notification with no account defined. rpcpool/yellowstone-grpc#167 and geyser: fix config example rpcpool/yellowstone-grpc#168
• merged into yellowstone-grpc version v1.10.0+solana.1.16.16, v1.11.0+solana.1.16.17 and more

banking stage tx error patch

• patch for validator + yellowstone-grpc
• inspects banking stage errors which are used on the banking stage tx error dashboard application operated by mango

[grooviegermanikus]

Rolled this setup ATM for local testing of banking stage plugin on solana 1.16:

Patched Solana 1.16

• https://github.com/blockworks-foundation/solana/tree/mango_all_patches_v1.16.23

Patched yellowstone_grpc_geyser:

1. checkout tag-v1.16-mango (https://github.com/blockworks-foundation/yellowstone-grpc.git)
2. cherry-pick 8b8618dd, resolve conflicts by choosing "Yours"
3. config: blocks -> account_include_any=true!!!!

Command

RUST_LOG="warn,solana_geyser_plugin_manager=debug,yellowstone_grpc_geyser::plugin=debug" \ solana-test-validator --log --geyser-plugin-config $YELLOWSTONE_CONFIG_FILE

config.json:

{
    "libpath": "libyellowstone_grpc_geyser-tag-v1.16-mango.dylib",
    "log": {
        "level": "info"
    },
    "grpc": {
        "address": "0.0.0.0:10000",
        "snapshot_plugin_channel_capacity": null,
        "snapshot_client_channel_capacity": "50_000_000",
        "channel_capacity": "100_000",
        "unary_concurrency_limit": 100,
        "unary_disabled": false,
        "filters": {
            "accounts": {
                "max": 1,
                "any": false,
                "account_max": 10,
                "account_reject": ["TokenkegQfeZyiNwAJbNbGKPFXCWuBvf9Ss623VQ5DA"],
                "owner_max": 10,
                "owner_reject": ["11111111111111111111111111111111"]
            },
            "slots": {
                "max": 1
            },
            "transactions": {
                "max": 1,
                "any": false,
                "account_include_max": 10,
                "account_include_reject": ["TokenkegQfeZyiNwAJbNbGKPFXCWuBvf9Ss623VQ5DA"],
                "account_exclude_max": 10,
                "account_required_max": 10
            },
            "blocks": {
                "max": 1,
                "account_include_max": 10,
                "account_include_any": true,
                "account_include_reject": ["TokenkegQfeZyiNwAJbNbGKPFXCWuBvf9Ss623VQ5DA"],
                "include_transactions": true,
                "include_accounts" : false,
                "include_entries" : false
            },
            "blocks_meta": {
                "max": 1
            },
            "entry": {
                "max": 1
            }
        }
    },
    "prometheus": {
        "address": "0.0.0.0:8999"
    },
    "block_fail_action": "log"
}