Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: find no available rootcoord, check rootcoord state + Your previous request to create the named bucket succeeded and you already own it. + there is no value on key = by-dev/meta/root-coord/credential/grantee-privileges/public/Global/*.* find no available querycoord, check querycoord state #37960

Closed
1 task done
taowang1993 opened this issue Nov 23, 2024 · 1 comment
Assignees
Labels
kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one.

Comments

@taowang1993
Copy link

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version: v2.3.1
- Deployment mode(standalone or cluster): standalone
- MQ type(rocksmq, pulsar or kafka): not sure what this means
- SDK version(e.g. pymilvus v2.0.0rc2): not sure what this means
- OS(Ubuntu or CentOS): Ubuntu
- CPU/Memory: 4GB
- GPU: 0
- Others:

Current Behavior

When I run docker compose up -d, I ran into the following errors:

  • error="find no available rootcoord, check rootcoord state
  • error="Your previous request to create the named bucket succeeded and you already own it.
  • error="there is no value on key = by-dev/meta/root-coord/credential/grantee-privileges/public/Global/.
  • error="find no available querycoord, check querycoord state

Expected Behavior

No response

Steps To Reproduce

git clone https://github.com/langgenius/dify.git
cd dify/docker
cp .env.example .env
set VECTOR_STORE=milvus
docker compose up -d

The milvus section of dify's docker-compose.yaml file:


  minio:
    container_name: milvus-minio
    image: minio/minio:RELEASE.2023-03-20T20-16-18Z
    profiles:
      - milvus
    environment:
      MINIO_ACCESS_KEY: ${MINIO_ACCESS_KEY:-minioadmin}
      MINIO_SECRET_KEY: ${MINIO_SECRET_KEY:-minioadmin}
    volumes:
      - ./volumes/milvus/minio:/minio_data
    command: minio server /minio_data --console-address ":9001"
    healthcheck:
      test: ['CMD', 'curl', '-f', 'http://localhost:9000/minio/health/live']
      interval: 30s
      timeout: 20s
      retries: 3
    networks:
      - milvus

  milvus-standalone:
    container_name: milvus-standalone
    image: milvusdb/milvus:v2.3.1
    profiles:
      - milvus
    command: ['milvus', 'run', 'standalone']
    environment:
      ETCD_ENDPOINTS: ${ETCD_ENDPOINTS:-etcd:2379}
      MINIO_ADDRESS: ${MINIO_ADDRESS:-minio:9000}
      common.security.authorizationEnabled: ${MILVUS_AUTHORIZATION_ENABLED:-true}
    volumes:
      - ./volumes/milvus/milvus:/var/lib/milvus
    healthcheck:
      test: ['CMD', 'curl', '-f', 'http://localhost:9091/healthz']
      interval: 30s
      start_period: 90s
      timeout: 20s
      retries: 3
    depends_on:
      - etcd
      - minio
    ports:
      - 19530:19530
      - 9091:9091
    networks:
      - milvus


### Milvus Log

[2024/11/23 09:36:34.427 +00:00] [WARN] [client/client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord]
[2024/11/23 09:36:34.427 +00:00] [WARN] [grpcclient/client.go:176] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.428 +00:00] [WARN] [grpcclient/client.go:483] ["fail to get grpc client"] [client_role=rootcoord] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.428 +00:00] [WARN] [retry/retry.go:40] ["grpc client is nil, maybe fail to get client in the retry state"] [client_role=rootcoord] [error="empty grpc client: find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.430 +00:00] [WARN] [client/client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord]
[2024/11/23 09:36:34.430 +00:00] [WARN] [grpcclient/client.go:176] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.430 +00:00] [WARN] [grpcclient/client.go:409] ["fail to get grpc client in the retry state"] [client_role=rootcoord] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.430 +00:00] [ERROR] [grpcclient/client.go:405] ["retry func failed"] ["retry time"=0] [error="empty grpc client: find no available rootcoord, check rootcoord state"] [stack="github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).call\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:405\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).Call\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:483\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).ReCall\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:499\ngithub.com/milvus-io/milvus/internal/distributed/rootcoord/client.wrapGrpcCall[...]\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:120\ngithub.com/milvus-io/milvus/internal/distributed/rootcoord/client.(*Client).GetComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:134\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentStates.func1\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:34\ngithub.com/milvus-io/milvus/pkg/util/retry.Do\n\t/go/src/github.com/milvus-io/milvus/pkg/util/retry/retry.go:40\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:58\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentHealthy\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:73\ngithub.com/milvus-io/milvus/internal/distributed/proxy.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/proxy/service.go:531\ngithub.com/milvus-io/milvus/internal/distributed/proxy.(*Server).Run\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/proxy/service.go:355\ngithub.com/milvus-io/milvus/cmd/components.(*Proxy).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/proxy.go:51\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:112"]
[2024/11/23 09:36:34.495 +00:00] [DEBUG] [rootcoord/service.go:181] ["grpc init done ..."]
[2024/11/23 09:36:34.495 +00:00] [DEBUG] [rootcoord/service.go:184] ["RootCoord start to create DataCoord client"]
[2024/11/23 09:36:34.495 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.496 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.496 +00:00] [DEBUG] [rootcoord/service.go:201] ["RootCoord start to create QueryCoord client"]
[2024/11/23 09:36:34.496 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.497 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.500 +00:00] [INFO] [dependency/factory.go:83] ["try to init mq"] [standalone=true] [mqType=rocksmq]
[2024/11/23 09:36:34.500 +00:00] [DEBUG] [server/global_rmq.go:39] ["initializing global rmq"] [path=/var/lib/milvus/rdb_data]
[2024/11/23 09:36:34.501 +00:00] [DEBUG] [server/rocksmq_impl.go:179] ["Start rocksmq "] ["max proc"=3] [parallism=1] ["lru cache"=536870912]
[2024/11/23 09:36:34.511 +00:00] [INFO] [dependency/factory.go:83] ["try to init mq"] [standalone=true] [mqType=rocksmq]
[2024/11/23 09:36:34.512 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.513 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.514 +00:00] [DEBUG] [querycoord/service.go:155] ["QueryCoord try to wait for RootCoord ready"]
[2024/11/23 09:36:34.514 +00:00] [WARN] [client/client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord]
[2024/11/23 09:36:34.514 +00:00] [WARN] [grpcclient/client.go:176] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.514 +00:00] [WARN] [grpcclient/client.go:483] ["fail to get grpc client"] [client_role=rootcoord] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.514 +00:00] [WARN] [retry/retry.go:40] ["grpc client is nil, maybe fail to get client in the retry state"] [client_role=rootcoord] [error="empty grpc client: find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.515 +00:00] [WARN] [client/client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord]
[2024/11/23 09:36:34.515 +00:00] [WARN] [grpcclient/client.go:176] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.515 +00:00] [WARN] [grpcclient/client.go:409] ["fail to get grpc client in the retry state"] [client_role=rootcoord] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.515 +00:00] [ERROR] [grpcclient/client.go:405] ["retry func failed"] ["retry time"=0] [error="empty grpc client: find no available rootcoord, check rootcoord state"] [stack="github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).call\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:405\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).Call\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:483\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).ReCall\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:499\ngithub.com/milvus-io/milvus/internal/distributed/rootcoord/client.wrapGrpcCall[...]\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:120\ngithub.com/milvus-io/milvus/internal/distributed/rootcoord/client.(*Client).GetComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:134\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentStates.func1\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:34\ngithub.com/milvus-io/milvus/pkg/util/retry.Do\n\t/go/src/github.com/milvus-io/milvus/pkg/util/retry/retry.go:40\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:58\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentHealthy\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:73\ngithub.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:156\ngithub.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).Run\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:95\ngithub.com/milvus-io/milvus/cmd/components.(*QueryCoord).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/query_coord.go:53\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:112"]
[2024/11/23 09:36:34.518 +00:00] [INFO] [datanode/service.go:271] ["initializing RootCoord client for DataNode"]
[2024/11/23 09:36:34.519 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.519 +00:00] [INFO] [etcd/etcd_util.go:49] ["create etcd client"] [useEmbedEtcd=false] [useSSL=false] [endpoints="[etcd:2379]"] [minVersion=1.3]
[2024/11/23 09:36:34.520 +00:00] [INFO] [indexnode/indexnode.go:197] ["IndexNode init"] [state=Initializing]
[2024/11/23 09:36:34.520 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.521 +00:00] [DEBUG] [querynode/service.go:125] [QueryNode] [State=Initializing]
[2024/11/23 09:36:34.522 +00:00] [INFO] [querynodev2/server.go:239] ["QueryNode session info"] [metaPath=by-dev/meta]
[2024/11/23 09:36:34.522 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.523 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.524 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.528 +00:00] [WARN] [client/client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord]
[2024/11/23 09:36:34.528 +00:00] [WARN] [grpcclient/client.go:176] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.528 +00:00] [WARN] [grpcclient/client.go:483] ["fail to get grpc client"] [client_role=rootcoord] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.528 +00:00] [WARN] [retry/retry.go:40] ["grpc client is nil, maybe fail to get client in the retry state"] [client_role=rootcoord] [error="empty grpc client: find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.529 +00:00] [DEBUG] [sessionutil/session_util.go:285] [getServerID] [reuse=true]
[2024/11/23 09:36:34.529 +00:00] [WARN] [client/client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord]
[2024/11/23 09:36:34.530 +00:00] [WARN] [grpcclient/client.go:176] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.530 +00:00] [WARN] [grpcclient/client.go:409] ["fail to get grpc client in the retry state"] [client_role=rootcoord] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.530 +00:00] [ERROR] [grpcclient/client.go:405] ["retry func failed"] ["retry time"=0] [error="empty grpc client: find no available rootcoord, check rootcoord state"] [stack="github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).call\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:405\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).Call\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:483\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).ReCall\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:499\ngithub.com/milvus-io/milvus/internal/distributed/rootcoord/client.wrapGrpcCall[...]\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:120\ngithub.com/milvus-io/milvus/internal/distributed/rootcoord/client.(*Client).GetComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:134\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentStates.func1\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:34\ngithub.com/milvus-io/milvus/pkg/util/retry.Do\n\t/go/src/github.com/milvus-io/milvus/pkg/util/retry/retry.go:40\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:58\ngithub.com/milvus-io/milvus/internal/util/componentutil.WaitForComponentHealthy\n\t/go/src/github.com/milvus-io/milvus/internal/util/componentutil/componentutil.go:73\ngithub.com/milvus-io/milvus/internal/distributed/datanode.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/datanode/service.go:285\ngithub.com/milvus-io/milvus/internal/distributed/datanode.(*Server).Run\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/datanode/service.go:189\ngithub.com/milvus-io/milvus/cmd/components.(*DataNode).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/data_node.go:52\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:112"]
[2024/11/23 09:36:34.532 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.535 +00:00] [DEBUG] [sessionutil/session_util.go:343] ["Session get serverID success"] [key=id] [ServerId=1]
[2024/11/23 09:36:34.535 +00:00] [INFO] [sessionutil/session_util.go:259] ["start server"] [name=querynode] [address=172.20.0.6:21123] [id=1]
[2024/11/23 09:36:34.535 +00:00] [DEBUG] [sessionutil/session_util.go:285] [getServerID] [reuse=true]
[2024/11/23 09:36:34.536 +00:00] [INFO] [querynodev2/server.go:154] ["QueryNode init session"] [nodeID=1] ["node address"=172.20.0.6:21123]
[2024/11/23 09:36:34.536 +00:00] [INFO] [dependency/factory.go:83] ["try to init mq"] [standalone=true] [mqType=rocksmq]
[2024/11/23 09:36:34.535 +00:00] [INFO] [sessionutil/session_util.go:259] ["start server"] [name=indexnode] [address=172.20.0.6:21121] [id=1]
[2024/11/23 09:36:34.536 +00:00] [INFO] [indexnode/indexnode.go:204] ["IndexNode init session successful"] [serverID=1]
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20241123 09:36:34.536718    22 knowhere_config.cc:93] [KNOWHERE][SetBlasThreshold][milvus] Set faiss::distance_compute_blas_threshold to 16384
I20241123 09:36:34.536818    22 knowhere_config.cc:104] [KNOWHERE][SetEarlyStopThreshold][milvus] Set faiss::early_stop_threshold to 0
I20241123 09:36:34.536841    22 knowhere_config.cc:52] [KNOWHERE][ShowVersion][milvus] Knowhere Version: v2.2.1
[2024/11/23 09:36:34.541 +00:00] [INFO] [indexnode/indexnode.go:209] ["Init IndexNode finished"] []
[2024/11/23 09:36:34.542 +00:00] [DEBUG] [indexnode/service.go:72] ["IndexNode init done ..."]
[2024/11/23 09:36:34.542 +00:00] [INFO] [indexnode/indexnode.go:221] [IndexNode] [State=Healthy]
[2024/11/23 09:36:34.542 +00:00] [INFO] [indexnode/indexnode.go:224] ["IndexNode start finished"] []
[2024/11/23 09:36:34.542 +00:00] [DEBUG] [sessionutil/session_util.go:406] ["service begin to register to etcd"] [serverName=indexnode] [ServerID=1]
[2024/11/23 09:36:34.542 +00:00] [DEBUG] [indexnode/task_scheduler.go:242] ["IndexNode TaskScheduler start build loop ..."]
[2024/11/23 09:36:34.549 +00:00] [INFO] [sessionutil/session_util.go:435] ["put session key into etcd"] [key=by-dev/meta/session/indexnode-1] [value="{\"ServerID\":1,\"ServerName\":\"indexnode\",\"Address\":\"172.20.0.6:21121\",\"TriggerKill\":true,\"Version\":\"2.3.1\",\"LeaseID\":7587882954988120086}"]
[2024/11/23 09:36:34.550 +00:00] [INFO] [sessionutil/session_util.go:445] ["Service registered successfully"] [ServerName=indexnode] [serverID=1]
[2024/11/23 09:36:34.558 +00:00] [DEBUG] [indexnode/service.go:204] ["IndexNode Register etcd success"]
[2024/11/23 09:36:34.558 +00:00] [DEBUG] [indexnode/service.go:76] ["IndexNode start done ..."]
[2024/11/23 09:36:34.558 +00:00] [DEBUG] [components/index_node.go:55] ["IndexNode successfully started"]
[2024/11/23 09:36:34.607 +00:00] [INFO] [tso/tso.go:122] ["sync and save timestamp"] [last=0001/01/01 00:00:00.000 +00:00] [save=2024/11/23 09:36:37.605 +00:00] [next=2024/11/23 09:36:34.605 +00:00]
[2024/11/23 09:36:34.609 +00:00] [INFO] [msgstream/mq_factory.go:17] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb_data]
[2024/11/23 09:36:34.609 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.609 +00:00] [INFO] [msgstream/mq_factory.go:17] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb_data]
[2024/11/23 09:36:34.610 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.609 +00:00] [INFO] [msgstream/mq_factory.go:17] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb_data]
[2024/11/23 09:36:34.609 +00:00] [DEBUG] [server/rocksmq_retention.go:80] ["Rocksmq retention goroutine start!"]
[2024/11/23 09:36:34.610 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.612 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.613 +00:00] [DEBUG] [sessionutil/session_util.go:285] [getServerID] [reuse=true]
[2024/11/23 09:36:34.613 +00:00] [INFO] [sessionutil/session_util.go:259] ["start server"] [name=rootcoord] [address=172.20.0.6:53100] [id=1]
[2024/11/23 09:36:34.613 +00:00] [INFO] [rootcoord/root_coord.go:159] ["update rootcoord state"] [state=Initializing]
[2024/11/23 09:36:34.614 +00:00] [INFO] [sessionutil/session_util.go:852] ["register session success"] [role=indexnode] [key=by-dev/meta/session/indexnode-1]
[2024/11/23 09:36:34.614 +00:00] [DEBUG] [sessionutil/session_util.go:285] [getServerID] [reuse=true]
[2024/11/23 09:36:34.615 +00:00] [INFO] [sessionutil/session_util.go:259] ["start server"] [name=indexcoord] [address=172.20.0.6:13333] [id=1]
[2024/11/23 09:36:34.615 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.616 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.618 +00:00] [INFO] [tso/tso.go:122] ["sync and save timestamp"] [last=0001/01/01 00:00:00.000 +00:00] [save=2024/11/23 09:36:37.616 +00:00] [next=2024/11/23 09:36:34.616 +00:00]
[2024/11/23 09:36:34.621 +00:00] [INFO] [rootcoord/root_coord.go:366] ["id allocator initialized"] [root_path=by-dev/kv] [sub_path=gid] [key=idTimestamp]
[2024/11/23 09:36:34.621 +00:00] [DEBUG] [sessionutil/session_util.go:285] [getServerID] [reuse=true]
[2024/11/23 09:36:34.621 +00:00] [INFO] [sessionutil/session_util.go:259] ["start server"] [name=datacoord] [address=172.20.0.6:13333] [id=1]
[2024/11/23 09:36:34.621 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:34.622 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:34.624 +00:00] [INFO] [tso/tso.go:122] ["sync and save timestamp"] [last=0001/01/01 00:00:00.000 +00:00] [save=2024/11/23 09:36:37.622 +00:00] [next=2024/11/23 09:36:34.622 +00:00]
[2024/11/23 09:36:34.625 +00:00] [INFO] [rootcoord/root_coord.go:382] ["tso allocator initialized"] [root_path=by-dev/kv] [sub_path=gid] [key=idTimestamp]
[2024/11/23 09:36:34.626 +00:00] [INFO] [storage/minio_chunk_manager.go:132] ["blob bucket not exist, create bucket."] ["bucket name"=a-bucket]
[2024/11/23 09:36:34.626 +00:00] [INFO] [storage/minio_chunk_manager.go:132] ["blob bucket not exist, create bucket."] ["bucket name"=a-bucket]
[2024/11/23 09:36:34.632 +00:00] [DEBUG] [rootcoord/suffix_snapshot.go:557] ["suffix snapshot GC goroutine start!"]
[2024/11/23 09:36:34.632 +00:00] [WARN] [retry/retry.go:40] ["grpc client is nil, maybe fail to get client in the retry state"] [client_role=rootcoord] [error="empty grpc client: find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.635 +00:00] [INFO] [storage/minio_chunk_manager.go:154] ["minio chunk manager init success."] [bucketname=a-bucket] [root=files]
[2024/11/23 09:36:34.640 +00:00] [WARN] [client/client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord]
[2024/11/23 09:36:34.641 +00:00] [WARN] [grpcclient/client.go:176] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.641 +00:00] [WARN] [grpcclient/client.go:409] ["fail to get grpc client in the retry state"] [client_role=rootcoord] [error="find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.641 +00:00] [WARN] [storage/minio_chunk_manager.go:135] ["failed to create blob bucket"] [bucket=a-bucket] [error="Your previous request to create the named bucket succeeded and you already own it."]
[2024/11/23 09:36:34.641 +00:00] [ERROR] [storage/minio_chunk_manager.go:144] ["retry func failed"] ["retry time"=0] [error="Your previous request to create the named bucket succeeded and you already own it."] [stack="github.com/milvus-io/milvus/internal/storage.newMinioChunkManagerWithConfig\n\t/go/src/github.com/milvus-io/milvus/internal/storage/minio_chunk_manager.go:144\ngithub.com/milvus-io/milvus/internal/storage.(*ChunkManagerFactory).newChunkManager\n\t/go/src/github.com/milvus-io/milvus/internal/storage/factory.go:51\ngithub.com/milvus-io/milvus/internal/storage.(*ChunkManagerFactory).NewPersistentStorageChunkManager\n\t/go/src/github.com/milvus-io/milvus/internal/storage/factory.go:58\ngithub.com/milvus-io/milvus/internal/util/dependency.(*DefaultFactory).NewPersistentStorageChunkManager\n\t/go/src/github.com/milvus-io/milvus/internal/util/dependency/factory.go:149\ngithub.com/milvus-io/milvus/internal/querynodev2.(*QueryNode).Init.func1\n\t/go/src/github.com/milvus-io/milvus/internal/querynodev2/server.go:268\nsync.(*Once).doSlow\n\t/usr/local/go/src/sync/once.go:74\nsync.(*Once).Do\n\t/usr/local/go/src/sync/once.go:65\ngithub.com/milvus-io/milvus/internal/querynodev2.(*QueryNode).Init\n\t/go/src/github.com/milvus-io/milvus/internal/querynodev2/server.go:237\ngithub.com/milvus-io/milvus/internal/distributed/querynode.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querynode/service.go:126\ngithub.com/milvus-io/milvus/internal/distributed/querynode.(*Server).Run\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querynode/service.go:223\ngithub.com/milvus-io/milvus/cmd/components.(*QueryNode).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/query_node.go:54\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:112"]
[2024/11/23 09:36:34.643 +00:00] [INFO] [rootcoord/meta_table.go:150] ["recover databases"] ["num of dbs"=0]
[2024/11/23 09:36:34.648 +00:00] [INFO] [rootcoord/meta_table.go:249] ["create database"] [db=default] [ts=454126362852589569]
[2024/11/23 09:36:34.650 +00:00] [INFO] [rootcoord/meta_table.go:188] ["recover collections from db"] [collection_num=0] [partition_num=0]
[2024/11/23 09:36:34.651 +00:00] [INFO] [datacoord/meta.go:170] ["DataCoord meta reloadFromKV done"] [duration=15.994846ms]
[2024/11/23 09:36:34.653 +00:00] [INFO] [rootcoord/meta_table.go:204] ["RootCoord meta table reload done"] [duration=26.718846ms]
[2024/11/23 09:36:34.654 +00:00] [INFO] [datacoord/channel_store.go:171] ["channel store reload done"] [duration=518.169µs]
[2024/11/23 09:36:34.656 +00:00] [INFO] [datacoord/server.go:479] ["DataCoord success to get DataNode sessions"] [sessions={}]
[2024/11/23 09:36:34.657 +00:00] [INFO] [datacoord/channel_manager.go:171] ["starting etcd states checker"]
[2024/11/23 09:36:34.657 +00:00] [INFO] [datacoord/channel_manager.go:176] ["starting background balance checker"]
[2024/11/23 09:36:34.657 +00:00] [INFO] [datacoord/channel_manager.go:179] ["cluster start up"] [nodes="[]"] [oNodes="[]"] ["old onlines"="[]"] ["new onlines"="[]"] [offLines="[]"]
[2024/11/23 09:36:34.659 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_0] [elapsed=3]
[2024/11/23 09:36:34.659 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_1] [elapsed=0]
[2024/11/23 09:36:34.659 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_2] [elapsed=0]
[2024/11/23 09:36:34.659 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_3] [elapsed=0]
[2024/11/23 09:36:34.659 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_4] [elapsed=0]
[2024/11/23 09:36:34.659 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_5] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_6] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_7] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_8] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_9] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_10] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_11] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_12] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_13] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_14] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [server/rocksmq_impl.go:426] ["Rocksmq create topic successfully "] [topic=by-dev-rootcoord-dml_15] [elapsed=0]
[2024/11/23 09:36:34.660 +00:00] [INFO] [rootcoord/dml_channels.go:216] ["init dml channels"] [prefix=by-dev-rootcoord-dml] [num=16]
[2024/11/23 09:36:34.660 +00:00] [DEBUG] [rootcoord/root_coord.go:451] ["RootCoord init QuotaCenter done"]
[2024/11/23 09:36:34.662 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=indexnode] [key=indexnode-1] [address=172.20.0.6:21121]
[2024/11/23 09:36:34.662 +00:00] [DEBUG] [datacoord/indexnode_manager.go:83] ["add IndexNode"] [nodeID=1] ["node address"=172.20.0.6:21121]
[2024/11/23 09:36:34.662 +00:00] [DEBUG] [datacoord/indexnode_manager.go:56] ["set IndexNode client"] [nodeID=1]
[2024/11/23 09:36:34.662 +00:00] [DEBUG] [datacoord/indexnode_manager.go:61] ["IndexNode IndexNodeManager setClient success"] [nodeID=1] ["IndexNode num"=1]
[2024/11/23 09:36:34.662 +00:00] [INFO] [datacoord/garbage_collector.go:71] ["GC with option"] [enabled=true] [interval=1h0m0s] [missingTolerance=1h0m0s] [dropTolerance=3h0m0s]
[2024/11/23 09:36:34.662 +00:00] [DEBUG] [datacoord/service.go:232] ["DataCoord init done ..."]
[2024/11/23 09:36:34.662 +00:00] [DEBUG] [sessionutil/session_util.go:406] ["service begin to register to etcd"] [serverName=indexcoord] [ServerID=1]
[2024/11/23 09:36:34.663 +00:00] [DEBUG] [rootcoord/kv_catalog.go:386] ["not found the user"] [key=root-coord/credential/users/root]
[2024/11/23 09:36:34.664 +00:00] [DEBUG] [rootcoord/root_coord.go:511] ["RootCoord init user root"]
[2024/11/23 09:36:34.670 +00:00] [INFO] [sessionutil/session_util.go:435] ["put session key into etcd"] [key=by-dev/meta/session/indexcoord] [value="{\"ServerID\":1,\"ServerName\":\"indexcoord\",\"Address\":\"172.20.0.6:13333\",\"Exclusive\":true,\"TriggerKill\":true,\"Version\":\"2.3.1\",\"LeaseID\":7587882954988120123}"]
[2024/11/23 09:36:34.670 +00:00] [INFO] [sessionutil/session_util.go:445] ["Service registered successfully"] [ServerName=indexcoord] [serverID=1]
[2024/11/23 09:36:34.670 +00:00] [DEBUG] [sessionutil/session_util.go:406] ["service begin to register to etcd"] [serverName=datacoord] [ServerID=1]
[2024/11/23 09:36:34.673 +00:00] [INFO] [sessionutil/session_util.go:435] ["put session key into etcd"] [key=by-dev/meta/session/datacoord] [value="{\"ServerID\":1,\"ServerName\":\"datacoord\",\"Address\":\"172.20.0.6:13333\",\"Exclusive\":true,\"TriggerKill\":true,\"Version\":\"2.3.1\",\"LeaseID\":7587882954988120128}"]
[2024/11/23 09:36:34.673 +00:00] [INFO] [sessionutil/session_util.go:445] ["Service registered successfully"] [ServerName=datacoord] [serverID=1]
[2024/11/23 09:36:34.673 +00:00] [INFO] [datacoord/server.go:258] ["DataCoord Register Finished"]
[2024/11/23 09:36:34.673 +00:00] [DEBUG] [rootcoord/kv_catalog.go:386] ["not found the user"] [key=root-coord/credential/users/root]
[2024/11/23 09:36:34.675 +00:00] [INFO] [runtime/asm_amd64.s:1598] ["index builder schedule loop start"]
[2024/11/23 09:36:34.676 +00:00] [INFO] [datacoord/index_service.go:91] ["start create index for segment loop..."]
[2024/11/23 09:36:34.675 +00:00] [INFO] [datacoord/server.go:394] ["DataCoord (re)starts successfully and re-collecting segment stats from DataNodes"]
[2024/11/23 09:36:34.678 +00:00] [INFO] [datacoord/server.go:1053] ["re-collecting segment stats from DataNodes"] ["DataNode IDs"="[]"]
[2024/11/23 09:36:34.678 +00:00] [INFO] [datacoord/server.go:378] ["DataCoord startup successfully"]
[2024/11/23 09:36:34.678 +00:00] [DEBUG] [datacoord/service.go:237] ["DataCoord start done ..."]
[2024/11/23 09:36:34.678 +00:00] [DEBUG] [components/data_coord.go:53] ["DataCoord successfully started"]
[2024/11/23 09:36:34.683 +00:00] [WARN] [rootcoord/kv_catalog.go:962] ["fail to load grant privilege entity"] [key=root-coord/credential/grantee-privileges/public/Global/*.*] [type=Grant] [error="there is no value on key = by-dev/meta/root-coord/credential/grantee-privileges/public/Global/*.*"]
[2024/11/23 09:36:34.685 +00:00] [WARN] [rootcoord/kv_catalog.go:984] ["fail to load the grantee id"] [key=root-coord/credential/grantee-id/250dd41b686083b0/PrivilegeDescribeCollection] [error="there is no value on key = by-dev/meta/root-coord/credential/grantee-id/250dd41b686083b0/PrivilegeDescribeCollection"]
[2024/11/23 09:36:34.685 +00:00] [DEBUG] [rootcoord/kv_catalog.go:989] ["not found the grantee id"] [key=root-coord/credential/grantee-id/250dd41b686083b0/PrivilegeDescribeCollection]
[2024/11/23 09:36:34.692 +00:00] [WARN] [rootcoord/kv_catalog.go:984] ["fail to load the grantee id"] [key=root-coord/credential/grantee-id/250dd41b686083b0/PrivilegeShowCollections] [error="there is no value on key = by-dev/meta/root-coord/credential/grantee-id/250dd41b686083b0/PrivilegeShowCollections"]
[2024/11/23 09:36:34.692 +00:00] [DEBUG] [rootcoord/kv_catalog.go:989] ["not found the grantee id"] [key=root-coord/credential/grantee-id/250dd41b686083b0/PrivilegeShowCollections]
[2024/11/23 09:36:34.694 +00:00] [WARN] [rootcoord/kv_catalog.go:962] ["fail to load grant privilege entity"] [key=root-coord/credential/grantee-privileges/public/Collection/*.*] [type=Grant] [error="there is no value on key = by-dev/meta/root-coord/credential/grantee-privileges/public/Collection/*.*"]
[2024/11/23 09:36:34.699 +00:00] [WARN] [rootcoord/kv_catalog.go:984] ["fail to load the grantee id"] [key=root-coord/credential/grantee-id/e03326696e8a3b16/PrivilegeIndexDetail] [error="there is no value on key = by-dev/meta/root-coord/credential/grantee-id/e03326696e8a3b16/PrivilegeIndexDetail"]
[2024/11/23 09:36:34.699 +00:00] [DEBUG] [rootcoord/kv_catalog.go:989] ["not found the grantee id"] [key=root-coord/credential/grantee-id/e03326696e8a3b16/PrivilegeIndexDetail]
[2024/11/23 09:36:34.701 +00:00] [DEBUG] [rootcoord/service.go:146] ["RootCoord init done ..."]
[2024/11/23 09:36:34.701 +00:00] [INFO] [rootcoord/service.go:288] ["RootCoord Core start ..."]
[2024/11/23 09:36:34.701 +00:00] [DEBUG] [sessionutil/session_util.go:406] ["service begin to register to etcd"] [serverName=rootcoord] [ServerID=1]
[2024/11/23 09:36:34.704 +00:00] [INFO] [sessionutil/session_util.go:435] ["put session key into etcd"] [key=by-dev/meta/session/rootcoord] [value="{\"ServerID\":1,\"ServerName\":\"rootcoord\",\"Address\":\"172.20.0.6:53100\",\"Exclusive\":true,\"TriggerKill\":true,\"Version\":\"2.3.1\",\"LeaseID\":7587882954988120151}"]
[2024/11/23 09:36:34.704 +00:00] [INFO] [sessionutil/session_util.go:445] ["Service registered successfully"] [ServerName=rootcoord] [serverID=1]
[2024/11/23 09:36:34.704 +00:00] [INFO] [rootcoord/root_coord.go:281] ["RootCoord Register Finished"]
[2024/11/23 09:36:34.708 +00:00] [INFO] [rootcoord/proxy_manager.go:88] ["succeed to init sessions on etcd"] [sessions=null] [revision=18]
[2024/11/23 09:36:34.710 +00:00] [INFO] [rootcoord/root_coord.go:159] ["update rootcoord state"] [state=Healthy]
[2024/11/23 09:36:34.710 +00:00] [INFO] [rootcoord/root_coord.go:665] ["rootcoord startup successfully"]
[2024/11/23 09:36:34.710 +00:00] [DEBUG] [rootcoord/service.go:151] ["RootCoord start done ..."]
[2024/11/23 09:36:34.710 +00:00] [INFO] [components/root_coord.go:55] ["RootCoord successfully started"]
[2024/11/23 09:36:34.710 +00:00] [WARN] [rootcoord/proxy_client_manager.go:235] ["proxy client is empty, RefreshPrivilegeInfoCache will not send to any client"]
[2024/11/23 09:36:34.710 +00:00] [INFO] [rootcoord/quota_center.go:135] ["Start QuotaCenter"] [collectInterval/s=3]
[2024/11/23 09:36:34.710 +00:00] [INFO] [rootcoord/proxy_manager.go:111] ["start to watch etcd"]
[2024/11/23 09:36:34.716 +00:00] [INFO] [sessionutil/session_util.go:852] ["register session success"] [role=rootcoord] [key=by-dev/meta/session/rootcoord]
[2024/11/23 09:36:34.718 +00:00] [WARN] [retry/retry.go:40] ["grpc client is nil, maybe fail to get client in the retry state"] [client_role=rootcoord] [error="empty grpc client: find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.718 +00:00] [INFO] [sessionutil/session_util.go:852] ["register session success"] [role=datacoord] [key=by-dev/meta/session/datacoord]
[2024/11/23 09:36:34.719 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=rootcoord] [key=rootcoord] [address=172.20.0.6:53100]
[2024/11/23 09:36:34.719 +00:00] [DEBUG] [client/client.go:96] ["RootCoordClient GetSessions success"] [address=172.20.0.6:53100] [serverID=1]
[2024/11/23 09:36:34.731 +00:00] [WARN] [retry/retry.go:40] ["grpc client is nil, maybe fail to get client in the retry state"] [client_role=rootcoord] [error="empty grpc client: find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:34.732 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=rootcoord] [key=rootcoord] [address=172.20.0.6:53100]
[2024/11/23 09:36:34.732 +00:00] [DEBUG] [client/client.go:96] ["RootCoordClient GetSessions success"] [address=172.20.0.6:53100] [serverID=1]
[2024/11/23 09:36:34.846 +00:00] [INFO] [storage/minio_chunk_manager.go:154] ["minio chunk manager init success."] [bucketname=a-bucket] [root=files]
[2024/11/23 09:36:34.850 +00:00] [INFO] [storage/minio_chunk_manager.go:154] ["minio chunk manager init success."] [bucketname=a-bucket] [root=files]
[2024/11/23 09:36:34.850 +00:00] [INFO] [querynodev2/server.go:293] ["queryNode try to connect etcd success"] [MetaRootPath=by-dev/meta]
[2024/11/23 09:36:34.850 +00:00] [INFO] [tasks/concurrent_safe_scheduler.go:25] ["query node use concurrent safe scheduler"] [max_concurrency=3]
[2024/11/23 09:36:34.851 +00:00] [INFO] [querynodev2/server.go:299] ["queryNode init scheduler"] [policy=fifo]
[2024/11/23 09:36:34.851 +00:00] [INFO] [segments/segment_loader.go:112] ["SegmentLoader created"] [ioPoolSize=32]
[2024/11/23 09:36:34.913 +00:00] [WARN] [rootcoord/root_coord.go:199] ["zero ts was met, this should be only occurred in starting state"] [minBgDdlTs=454126362928873473] [minNormalDdlTs=0]
[2024/11/23 09:36:34.915 +00:00] [INFO] [gc/gc_tuner.go:137] ["GC Helper initialized."] ["Initial GoGC"=100] [minimumGOGC=30] [maximumGOGC=200] [memoryThreshold=3604720435]
[2024/11/23 09:36:34.915 +00:00] [INFO] [querynodev2/server.go:353] ["query node init successfully"] [queryNodeID=1] [Address=172.20.0.6:21123]
[2024/11/23 09:36:34.915 +00:00] [DEBUG] [querynode/service.go:226] ["QueryNode init done ..."]
[2024/11/23 09:36:34.915 +00:00] [INFO] [querynodev2/server.go:372] ["query node start successfully"] [queryNodeID=1] [Address=172.20.0.6:21123] [mmapEnabled=false]
[2024/11/23 09:36:34.915 +00:00] [DEBUG] [sessionutil/session_util.go:406] ["service begin to register to etcd"] [serverName=querynode] [ServerID=1]
[2024/11/23 09:36:34.915 +00:00] [INFO] [tasks/concurrent_safe_scheduler.go:169] ["start execute loop"]
[2024/11/23 09:36:34.918 +00:00] [INFO] [sessionutil/session_util.go:435] ["put session key into etcd"] [key=by-dev/meta/session/querynode-1] [value="{\"ServerID\":1,\"ServerName\":\"querynode\",\"Address\":\"172.20.0.6:21123\",\"TriggerKill\":true,\"Version\":\"2.3.1\",\"LeaseID\":7587882954988120158}"]
[2024/11/23 09:36:34.919 +00:00] [INFO] [sessionutil/session_util.go:445] ["Service registered successfully"] [ServerName=querynode] [serverID=1]
[2024/11/23 09:36:34.922 +00:00] [DEBUG] [querynode/service.go:231] ["QueryNode start done ..."]
[2024/11/23 09:36:34.922 +00:00] [DEBUG] [components/query_node.go:58] ["QueryNode successfully started"]
[2024/11/23 09:36:35.017 +00:00] [INFO] [sessionutil/session_util.go:852] ["register session success"] [role=querynode] [key=by-dev/meta/session/querynode-1]
[2024/11/23 09:36:35.042 +00:00] [WARN] [retry/retry.go:40] ["grpc client is nil, maybe fail to get client in the retry state"] [client_role=rootcoord] [error="empty grpc client: find no available rootcoord, check rootcoord state"]
[2024/11/23 09:36:35.043 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=rootcoord] [key=rootcoord] [address=172.20.0.6:53100]
[2024/11/23 09:36:35.043 +00:00] [DEBUG] [client/client.go:96] ["RootCoordClient GetSessions success"] [address=172.20.0.6:53100] [serverID=1]
[2024/11/23 09:36:35.055 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=100] ["heapuse "=19] ["total memory"=624] ["next GC"=32] ["new GOGC"=200] [gc-pause=56.766µs] [gc-pause-end=1732354595054979456]
[2024/11/23 09:36:35.123 +00:00] [DEBUG] [querycoord/service.go:165] ["QueryCoord report RootCoord ready"]
[2024/11/23 09:36:35.123 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:35.123 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:35.124 +00:00] [DEBUG] [querycoord/service.go:184] ["QueryCoord try to wait for DataCoord ready"]
[2024/11/23 09:36:35.125 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=datacoord] [key=datacoord] [address=172.20.0.6:13333]
[2024/11/23 09:36:35.126 +00:00] [DEBUG] [querycoord/service.go:193] ["QueryCoord report DataCoord ready"]
[2024/11/23 09:36:35.126 +00:00] [INFO] [querycoordv2/server.go:174] ["QueryCoord start init"] [meta-root-path=by-dev/meta] [address=172.20.0.6:19531]
[2024/11/23 09:36:35.126 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:35.127 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:35.128 +00:00] [DEBUG] [sessionutil/session_util.go:285] [getServerID] [reuse=true]
[2024/11/23 09:36:35.128 +00:00] [INFO] [sessionutil/session_util.go:259] ["start server"] [name=querycoord] [address=172.20.0.6:19531] [id=1]
[2024/11/23 09:36:35.128 +00:00] [INFO] [querycoordv2/server.go:206] [QueryCoord] [State=Initializing]
[2024/11/23 09:36:35.128 +00:00] [INFO] [querycoordv2/server.go:210] ["query coordinator try to connect etcd success"]
[2024/11/23 09:36:35.129 +00:00] [INFO] [tso/tso.go:122] ["sync and save timestamp"] [last=0001/01/01 00:00:00.000 +00:00] [save=2024/11/23 09:36:38.128 +00:00] [next=2024/11/23 09:36:35.128 +00:00]
[2024/11/23 09:36:35.129 +00:00] [INFO] [querycoordv2/server.go:301] ["init meta"]
[2024/11/23 09:36:35.129 +00:00] [INFO] [querycoordv2/server.go:310] ["recover meta..."]
[2024/11/23 09:36:35.130 +00:00] [INFO] [querycoordv2/server.go:311] ["recover collections and partitions from kv store"] [traceID=1732354595130213622]
[2024/11/23 09:36:35.130 +00:00] [INFO] [querycoordv2/server.go:317] ["recovering collections..."] [collections="[]"]
[2024/11/23 09:36:35.131 +00:00] [INFO] [querycoordv2/server.go:342] ["QueryCoord server initMeta done"] [duration=2.407256ms]
[2024/11/23 09:36:35.131 +00:00] [INFO] [querycoordv2/server.go:234] ["init session"]
[2024/11/23 09:36:35.132 +00:00] [INFO] [querycoordv2/server.go:238] ["init schedulers"]
[2024/11/23 09:36:35.132 +00:00] [INFO] [querycoordv2/server.go:251] ["init dist controller"]
[2024/11/23 09:36:35.132 +00:00] [INFO] [querycoordv2/server.go:261] ["init all available balancer"]
[2024/11/23 09:36:35.132 +00:00] [INFO] [querycoordv2/server.go:270] ["use config balancer"] [balancer=ScoreBasedBalancer]
[2024/11/23 09:36:35.132 +00:00] [INFO] [querycoordv2/server.go:277] ["init checker controller"]
[2024/11/23 09:36:35.132 +00:00] [INFO] [querycoordv2/server.go:347] ["init observers"]
[2024/11/23 09:36:35.132 +00:00] [INFO] [querycoordv2/server.go:294] ["QueryCoord init success"]
[2024/11/23 09:36:35.132 +00:00] [DEBUG] [querycoord/service.go:98] ["QueryCoord init done ..."]
[2024/11/23 09:36:35.132 +00:00] [DEBUG] [sessionutil/session_util.go:406] ["service begin to register to etcd"] [serverName=querycoord] [ServerID=1]
[2024/11/23 09:36:35.137 +00:00] [INFO] [sessionutil/session_util.go:435] ["put session key into etcd"] [key=by-dev/meta/session/querycoord] [value="{\"ServerID\":1,\"ServerName\":\"querycoord\",\"Address\":\"172.20.0.6:19531\",\"Exclusive\":true,\"TriggerKill\":true,\"Version\":\"2.3.1\",\"LeaseID\":7587882954988120174}"]
[2024/11/23 09:36:35.137 +00:00] [INFO] [sessionutil/session_util.go:445] ["Service registered successfully"] [ServerName=querycoord] [serverID=1]
[2024/11/23 09:36:35.137 +00:00] [INFO] [datanode/service.go:289] ["RootCoord client is ready for DataNode"]
[2024/11/23 09:36:35.137 +00:00] [DEBUG] [datanode/service.go:297] ["starting DataCoord client for DataNode"]
[2024/11/23 09:36:35.137 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:35.138 +00:00] [INFO] [querycoordv2/server.go:392] ["start watcher..."]
[2024/11/23 09:36:35.140 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:35.141 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=querynode] [key=querynode-1] [address=172.20.0.6:21123]
[2024/11/23 09:36:35.141 +00:00] [INFO] [task/scheduler.go:222] ["add executor for new QueryNode"] [nodeID=1]
[2024/11/23 09:36:35.142 +00:00] [INFO] [runtime/asm_amd64.s:1598] ["start dist handler"] [nodeID=1]
[2024/11/23 09:36:35.142 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=datacoord] [key=datacoord] [address=172.20.0.6:13333]
[2024/11/23 09:36:35.143 +00:00] [INFO] [datanode/service.go:315] ["DataCoord client is ready for DataNode"]
[2024/11/23 09:36:35.143 +00:00] [INFO] [sync/once.go:74] ["DataNode server initializing"] [TimeTickChannelName=by-dev-datacoord-timetick-channel]
[2024/11/23 09:36:35.143 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:35.145 +00:00] [INFO] [meta/resource_manager.go:470] ["HandleNodeUp: add node to default resource group"] [rgName=__default_resource_group] [node=1]
[2024/11/23 09:36:35.145 +00:00] [INFO] [querycoordv2/server.go:682] ["HandleNodeUp: assign node to resource group"] [nodeID=1] [resourceGroup=__default_resource_group]
[2024/11/23 09:36:35.146 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:35.150 +00:00] [WARN] [dist/dist_handler.go:100] ["node last heart beat time lag too behind"] [now=2024/11/23 09:36:35.150 +00:00] [lastHeartBeatTime=1970/01/01 00:00:00.000 +00:00] [nodeID=1]
[2024/11/23 09:36:35.150 +00:00] [INFO] [querycoordv2/server.go:420] ["start cluster..."]
[2024/11/23 09:36:35.150 +00:00] [INFO] [querycoordv2/server.go:423] ["start job scheduler..."]
[2024/11/23 09:36:35.150 +00:00] [INFO] [querycoordv2/server.go:426] ["start task scheduler..."]
[2024/11/23 09:36:35.150 +00:00] [INFO] [querycoordv2/server.go:429] ["start checker controller..."]
[2024/11/23 09:36:35.150 +00:00] [INFO] [querycoordv2/server.go:432] ["start observers..."]
[2024/11/23 09:36:35.150 +00:00] [INFO] [querycoordv2/server.go:386] ["QueryCoord started"]
[2024/11/23 09:36:35.150 +00:00] [DEBUG] [querycoord/service.go:103] ["QueryCoord start done ..."]
[2024/11/23 09:36:35.150 +00:00] [DEBUG] [components/query_coord.go:57] ["QueryCoord successfully started"]
[2024/11/23 09:36:35.150 +00:00] [INFO] [observers/resource_observer.go:62] ["Start check resource group loop"]
[2024/11/23 09:36:35.150 +00:00] [INFO] [observers/target_observer.go:89] ["Start update next target loop"]
[2024/11/23 09:36:35.150 +00:00] [INFO] [observers/replica_observer.go:64] ["Start check replica loop"]
[2024/11/23 09:36:35.151 +00:00] [DEBUG] [sessionutil/session_util.go:285] [getServerID] [reuse=true]
[2024/11/23 09:36:35.151 +00:00] [INFO] [sessionutil/session_util.go:259] ["start server"] [name=datanode] [address=172.20.0.6:21124] [id=1]
[2024/11/23 09:36:35.152 +00:00] [INFO] [datanode/data_node.go:247] ["DataNode server init rateCollector done"] ["node ID"=1]
[2024/11/23 09:36:35.152 +00:00] [INFO] [datanode/data_node.go:250] ["DataNode server init dispatcher client done"] ["node ID"=1]
[2024/11/23 09:36:35.152 +00:00] [INFO] [dependency/factory.go:83] ["try to init mq"] [standalone=true] [mqType=rocksmq]
[2024/11/23 09:36:35.152 +00:00] [INFO] [msgstream/mq_factory.go:17] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb_data]
[2024/11/23 09:36:35.152 +00:00] [INFO] [datanode/data_node.go:263] ["DataNode server init succeeded"] [MsgChannelSubName=by-dev-dataNode]
[2024/11/23 09:36:35.152 +00:00] [INFO] [datanode/service.go:327] ["current DataNode state"] [state=Initializing]
[2024/11/23 09:36:35.152 +00:00] [INFO] [datanode/service.go:193] ["DataNode gRPC services successfully initialized"]
[2024/11/23 09:36:35.152 +00:00] [INFO] [datanode/data_node.go:498] ["start id allocator done"] [role=datanode]
[2024/11/23 09:36:35.159 +00:00] [INFO] [storage/minio_chunk_manager.go:154] ["minio chunk manager init success."] [bucketname=a-bucket] [root=files]
[2024/11/23 09:36:35.159 +00:00] [DEBUG] [sessionutil/session_util.go:406] ["service begin to register to etcd"] [serverName=datanode] [ServerID=1]
[2024/11/23 09:36:35.159 +00:00] [INFO] [datanode/data_node.go:477] ["DataNode Background GC Start"]
[2024/11/23 09:36:35.159 +00:00] [INFO] [datanode/data_node.go:277] ["Start watch channel"] [prefix=channelwatch/1]
[2024/11/23 09:36:35.162 +00:00] [DEBUG] [sessionutil/session_util.go:718] ["watch services"] ["add kv"="key:\"by-dev/meta/session/datanode-1\" create_revision:23 mod_revision:23 version:1 value:\"{\\\"ServerID\\\":1,\\\"ServerName\\\":\\\"datanode\\\",\\\"Address\\\":\\\"172.20.0.6:21124\\\",\\\"TriggerKill\\\":true,\\\"Version\\\":\\\"2.3.1\\\",\\\"LeaseID\\\":7587882954988120184}\" lease:7587882954988120184 "]
[2024/11/23 09:36:35.163 +00:00] [DEBUG] [sessionutil/session_util.go:746] [WatchService] ["event type"=SessionAddEvent]
[2024/11/23 09:36:35.161 +00:00] [INFO] [sessionutil/session_util.go:435] ["put session key into etcd"] [key=by-dev/meta/session/datanode-1] [value="{\"ServerID\":1,\"ServerName\":\"datanode\",\"Address\":\"172.20.0.6:21124\",\"TriggerKill\":true,\"Version\":\"2.3.1\",\"LeaseID\":7587882954988120184}"]
[2024/11/23 09:36:35.163 +00:00] [INFO] [sessionutil/session_util.go:445] ["Service registered successfully"] [ServerName=datanode] [serverID=1]
[2024/11/23 09:36:35.163 +00:00] [INFO] [datanode/data_node.go:190] ["DataNode Register Finished"]
[2024/11/23 09:36:35.163 +00:00] [INFO] [datacoord/server.go:825] ["received datanode register"] [address=172.20.0.6:21124] [serverID=1]
[2024/11/23 09:36:35.163 +00:00] [INFO] [datacoord/channel_manager.go:348] ["register node with no reassignment"] ["registered node"=1]
[2024/11/23 09:36:35.165 +00:00] [INFO] [datanode/service.go:198] ["DataNode gRPC services successfully started"]
[2024/11/23 09:36:35.165 +00:00] [DEBUG] [components/data_node.go:56] ["Datanode successfully started"]
[2024/11/23 09:36:35.218 +00:00] [INFO] [sessionutil/session_util.go:852] ["register session success"] [role=querycoord] [key=by-dev/meta/session/querycoord]
[2024/11/23 09:36:35.219 +00:00] [INFO] [sessionutil/session_util.go:852] ["register session success"] [role=datanode] [key=by-dev/meta/session/datanode-1]
[2024/11/23 09:36:35.660 +00:00] [DEBUG] [datanode/timetick_sender.go:160] ["timeTickSender send datanode timetick message"] [toSendMsgs=null] [sendLastTss={}]
[2024/11/23 09:36:35.661 +00:00] [DEBUG] [datanode/timetick_sender.go:155] ["timeTickSender channelStatesCaches"] [sendedLastTss={}] [sizeBeforeClean=0] [sizeAfterClean=0]
[2024/11/23 09:36:35.849 +00:00] [DEBUG] [proxy/service.go:535] ["Proxy wait for RootCoord to be healthy done"]
[2024/11/23 09:36:35.852 +00:00] [DEBUG] [proxy/service.go:537] ["set RootCoord client for Proxy"]
[2024/11/23 09:36:35.852 +00:00] [DEBUG] [proxy/service.go:539] ["set RootCoord client for Proxy done"]
[2024/11/23 09:36:35.852 +00:00] [DEBUG] [proxy/service.go:543] ["create DataCoord client for Proxy"]
[2024/11/23 09:36:35.852 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:35.852 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:35.853 +00:00] [DEBUG] [proxy/service.go:549] ["create DataCoord client for Proxy done"]
[2024/11/23 09:36:35.853 +00:00] [DEBUG] [proxy/service.go:552] ["init DataCoord client for Proxy"]
[2024/11/23 09:36:35.853 +00:00] [DEBUG] [proxy/service.go:557] ["init DataCoord client for Proxy done"]
[2024/11/23 09:36:35.853 +00:00] [DEBUG] [proxy/service.go:559] ["Proxy wait for DataCoord to be healthy"]
[2024/11/23 09:36:35.853 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=datacoord] [key=datacoord] [address=172.20.0.6:13333]
[2024/11/23 09:36:35.854 +00:00] [DEBUG] [proxy/service.go:564] ["Proxy wait for DataCoord to be healthy done"]
[2024/11/23 09:36:35.854 +00:00] [DEBUG] [proxy/service.go:566] ["set DataCoord client for Proxy"]
[2024/11/23 09:36:35.854 +00:00] [DEBUG] [proxy/service.go:568] ["set DataCoord client for Proxy done"]
[2024/11/23 09:36:35.854 +00:00] [DEBUG] [proxy/service.go:572] ["create QueryCoord client for Proxy"]
[2024/11/23 09:36:35.854 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:35.854 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:35.855 +00:00] [DEBUG] [proxy/service.go:578] ["create QueryCoord client for Proxy done"]
[2024/11/23 09:36:35.855 +00:00] [DEBUG] [proxy/service.go:581] ["init QueryCoord client for Proxy"]
[2024/11/23 09:36:35.855 +00:00] [DEBUG] [proxy/service.go:586] ["init QueryCoord client for Proxy done"]
[2024/11/23 09:36:35.855 +00:00] [DEBUG] [proxy/service.go:588] ["Proxy wait for QueryCoord to be healthy"]
[2024/11/23 09:36:35.857 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions"] [prefix=querycoord] [key=querycoord] [address=172.20.0.6:19531]
[2024/11/23 09:36:35.858 +00:00] [DEBUG] [proxy/service.go:593] ["Proxy wait for QueryCoord to be healthy done"]
[2024/11/23 09:36:35.858 +00:00] [DEBUG] [proxy/service.go:595] ["set QueryCoord client for Proxy"]
[2024/11/23 09:36:35.858 +00:00] [DEBUG] [proxy/service.go:597] ["set QueryCoord client for Proxy done"]
[2024/11/23 09:36:35.858 +00:00] [DEBUG] [proxy/service.go:599] ["update Proxy's state to Initializing"]
[2024/11/23 09:36:35.858 +00:00] [DEBUG] [proxy/service.go:602] ["init Proxy"]
[2024/11/23 09:36:35.858 +00:00] [INFO] [proxy/proxy.go:190] ["init session for Proxy"]
[2024/11/23 09:36:35.858 +00:00] [DEBUG] [sessionutil/session_util.go:227] ["Session try to connect to etcd"]
[2024/11/23 09:36:35.859 +00:00] [DEBUG] [sessionutil/session_util.go:242] ["Session connect to etcd success"]
[2024/11/23 09:36:35.861 +00:00] [DEBUG] [sessionutil/session_util.go:285] [getServerID] [reuse=true]
[2024/11/23 09:36:35.861 +00:00] [INFO] [sessionutil/session_util.go:259] ["start server"] [name=proxy] [address=172.20.0.6:19529] [id=1]
[2024/11/23 09:36:35.861 +00:00] [INFO] [proxy/proxy.go:195] ["init session for Proxy done"]
[2024/11/23 09:36:35.861 +00:00] [INFO] [dependency/factory.go:83] ["try to init mq"] [standalone=true] [mqType=rocksmq]
[2024/11/23 09:36:35.861 +00:00] [INFO] [msgstream/mq_factory.go:17] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb_data]
[2024/11/23 09:36:35.861 +00:00] [INFO] [accesslog/log_writer.go:74] ["Access log save to /tmp/milvus_accesslog"]
[2024/11/23 09:36:35.861 +00:00] [INFO] [accesslog/log_writer.go:260] ["start time rotating of access log"]
[2024/11/23 09:36:35.863 +00:00] [DEBUG] [proxy/proxy.go:200] ["init access log for Proxy done"]
[2024/11/23 09:36:35.863 +00:00] [INFO] [proxy/proxy.go:206] ["Proxy init rateCollector done"] [nodeID=1]
[2024/11/23 09:36:35.864 +00:00] [DEBUG] [proxy/proxy.go:216] ["create id allocator done"] [role=proxy] [ProxyID=1]
[2024/11/23 09:36:35.864 +00:00] [DEBUG] [proxy/proxy.go:226] ["create timestamp allocator done"] [role=proxy] [ProxyID=1]
[2024/11/23 09:36:35.864 +00:00] [DEBUG] [proxy/proxy.go:237] ["create segment id assigner done"] [role=proxy] [ProxyID=1]
[2024/11/23 09:36:35.864 +00:00] [DEBUG] [proxy/proxy.go:242] ["create channels manager done"] [role=proxy]
[2024/11/23 09:36:35.864 +00:00] [DEBUG] [proxy/proxy.go:249] ["create task scheduler done"] [role=proxy]
[2024/11/23 09:36:35.864 +00:00] [DEBUG] [proxy/proxy.go:253] ["create channels time ticker done"] [role=proxy] [syncTimeTickInterval=100ms]
[2024/11/23 09:36:35.864 +00:00] [DEBUG] [proxy/proxy.go:256] ["create metrics cache manager done"] [role=proxy]
[2024/11/23 09:36:35.868 +00:00] [DEBUG] [rootcoord/service.go:507] [PolicyList] [role=rootcoord] [in=]
[2024/11/23 09:36:35.871 +00:00] [DEBUG] [rootcoord/service.go:507] ["PolicyList success"] [role=rootcoord] [in=]
[2024/11/23 09:36:35.875 +00:00] [INFO] [proxy/meta_cache.go:226] ["success to init meta cache"] [policy_infos="[\"{\\\"PType\\\":\\\"p\\\",\\\"V0\\\":\\\"public\\\",\\\"V1\\\":\\\"Collection-*.*\\\",\\\"V2\\\":\\\"PrivilegeIndexDetail\\\"}\",\"{\\\"PType\\\":\\\"p\\\",\\\"V0\\\":\\\"public\\\",\\\"V1\\\":\\\"Global-*.*\\\",\\\"V2\\\":\\\"PrivilegeDescribeCollection\\\"}\",\"{\\\"PType\\\":\\\"p\\\",\\\"V0\\\":\\\"public\\\",\\\"V1\\\":\\\"Global-*.*\\\",\\\"V2\\\":\\\"PrivilegeShowCollections\\\"}\"]"]
[2024/11/23 09:36:35.875 +00:00] [DEBUG] [proxy/proxy.go:262] ["init meta cache done"] [role=proxy]
[2024/11/23 09:36:35.875 +00:00] [DEBUG] [proxy/service.go:607] ["init Proxy done"]
---Milvus Proxy successfully initialized and ready to serve!---
[2024/11/23 09:36:35.875 +00:00] [DEBUG] [proxy/service.go:359] ["init Proxy server done"]
[2024/11/23 09:36:35.875 +00:00] [DEBUG] [proxy/service.go:361] ["start Proxy server"]
[2024/11/23 09:36:35.876 +00:00] [DEBUG] [proxy/proxy.go:354] ["start task scheduler done"] [role=proxy]
[2024/11/23 09:36:35.876 +00:00] [DEBUG] [proxy/proxy.go:360] ["start id allocator done"] [role=proxy]
[2024/11/23 09:36:35.876 +00:00] [DEBUG] [proxy/proxy.go:366] ["start segment id assigner done"] [role=proxy]
[2024/11/23 09:36:35.877 +00:00] [DEBUG] [proxy/proxy.go:372] ["start channels time ticker done"] [role=proxy]
[2024/11/23 09:36:35.877 +00:00] [DEBUG] [proxy/proxy.go:381] ["update state code"] [role=proxy] [State=Healthy]
[2024/11/23 09:36:35.877 +00:00] [DEBUG] [sessionutil/session_util.go:406] ["service begin to register to etcd"] [serverName=proxy] [ServerID=1]
[2024/11/23 09:36:35.883 +00:00] [INFO] [sessionutil/session_util.go:435] ["put session key into etcd"] [key=by-dev/meta/session/proxy-1] [value="{\"ServerID\":1,\"ServerName\":\"proxy\",\"Address\":\"172.20.0.6:19529\",\"TriggerKill\":true,\"Version\":\"2.3.1\",\"LeaseID\":7587882954988120199}"]
[2024/11/23 09:36:35.883 +00:00] [INFO] [sessionutil/session_util.go:445] ["Service registered successfully"] [ServerName=proxy] [serverID=1]
[2024/11/23 09:36:35.883 +00:00] [INFO] [proxy/proxy.go:143] ["Proxy Register Finished"]
[2024/11/23 09:36:35.883 +00:00] [DEBUG] [rootcoord/proxy_manager.go:157] ["received proxy put event with session"] [session="Session:<ServerID: 1, ServerName: proxy, Version: 2.3.1>"]
[2024/11/23 09:36:35.883 +00:00] [INFO] [rootcoord/timeticksync.go:233] ["Add session for timeticksync"] [serverID=1]
[2024/11/23 09:36:35.883 +00:00] [INFO] [rootcoord/proxy_client_manager.go:125] ["succeed to create proxy client"] [address=172.20.0.6:19529] [serverID=1]
[2024/11/23 09:36:35.884 +00:00] [INFO] [proxy/service.go:627] ["start Proxy http server"]
[2024/11/23 09:36:35.886 +00:00] [DEBUG] [proxy/service.go:366] ["start Proxy server done"]
[2024/11/23 09:36:35.886 +00:00] [INFO] [components/proxy.go:55] ["Proxy successfully started"]
[2024/11/23 09:36:35.886 +00:00] [INFO] [logutil/logutil.go:163] ["Log directory"] [configDir=]
[2024/11/23 09:36:35.886 +00:00] [INFO] [logutil/logutil.go:164] ["Set log file to "] [path=]
[2024/11/23 09:36:35.887 +00:00] [INFO] [tracer/tracer.go:71] ["Init tracer finished"] [Exporter=stdout]
[2024/11/23 09:36:35.923 +00:00] [INFO] [sessionutil/session_util.go:852] ["register session success"] [role=proxy] [key=by-dev/meta/session/proxy-1]
[2024/11/23 09:37:11.491 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=26] ["total memory"=2071] ["next GC"=62] ["new GOGC"=200] [gc-pause=62.076µs] [gc-pause-end=1732354631489545657]
[2024/11/23 09:38:10.384 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=27] ["total memory"=2103] ["next GC"=62] ["new GOGC"=200] [gc-pause=144.911µs] [gc-pause-end=1732354690382159286]

### Anything else?

_No response_
@taowang1993 taowang1993 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Nov 23, 2024
@taowang1993
Copy link
Author

Fixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one.
Projects
None yet
Development

No branches or pull requests

2 participants