Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a large number of hive Delegation tokens regularly #24067

Open
lugela988 opened this issue Nov 18, 2024 · 0 comments
Open

Create a large number of hive Delegation tokens regularly #24067

lugela988 opened this issue Nov 18, 2024 · 0 comments
Labels

Comments

@lugela988
Copy link

lugela988 commented Nov 18, 2024

Describe the problem you faced

  • A clear and concise description of the problem.
    Recently, it was discovered that when using hive, presto regularly creates a large number of hive Delegation tokens, and hive's Delegation tokens are stored in zk. This causes zk to generate a large number of znodes, which puts a lot of pressure on zk. Why is this happening? Can the generation of so many Delegation tokens be controlled?
    HMS log:
bca0a027bbc2e1396c3ac9dc1fe599d zk monitor:

1731899338403

  • Was this working before or is this a first try?
  • If this worked before, then what has changed that recently?
  • Provide table DDLs and EXPLAIN ANALYZE for your Presto queries.

Environment Description

  • Presto version used:
    0.282
  • Storage (HDFS/S3/GCS..):
    HDFS
  • Data source and connectors or catalogs used:
    hive
  • Deployment (Cloud or On-prem):
    On-prem
  • Pastebin link to the complete debug logs:

Steps To Reproduce

Steps to reproduce the behavior:
1.
2.
3.
4.

Expected behavior

Additional context

Stacktrace

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: 🆕 Unprioritized
Development

No branches or pull requests

1 participant