Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"minikube start" on Podman 5.x (on Win11 WSL) fails to create network #18969

Closed
mulan04 opened this issue May 27, 2024 · 2 comments
Closed

"minikube start" on Podman 5.x (on Win11 WSL) fails to create network #18969

mulan04 opened this issue May 27, 2024 · 2 comments

Comments

@mulan04
Copy link

mulan04 commented May 27, 2024

What Happened?

"minikube start" on Podman 5.x (on Win11 WSL) fails to create network, hence fails to start

The same on Podman 4.x works fine

On the Windows host in Powershell:

> podman machine init --cpus 8 --memory 8000  --rootful --now
Downloading VM image: v20240520154143-5.1-rootfs-amd64.tar.zst: done
...
Configuring system...
Machine init complete
Starting machine "podman-machine-default"
API forwarding listening on: npipe:////./pipe/docker_engine

Docker API clients default to this address. You do not need to set DOCKER_HOST.
Machine "podman-machine-default" started successfully

On the WSL VM in bash:

$ minikube start --driver=podman --container-runtime=containerd --cpus 8 --memory 6g

😄  minikube v1.33.1 on Fedora 40 (amd64)
✨  Using the podman driver based on user configuration
📌  Using Podman driver with root privileges
👍  Starting "minikube" primary control-plane node in "minikube" cluster
🚜  Pulling base image v0.0.44 ...
💾  Downloading Kubernetes v1.30.0 preload ...
    > preloaded-images-k8s-v18-v1...:  375.69 MiB / 375.69 MiB  100.00% 3.21 Mi
    > gcr.io/k8s-minikube/kicbase...:  481.58 MiB / 481.58 MiB  100.00% 3.40 Mi
E0527 09:07:07.698222     544 cache.go:189] Error downloading kic artifacts:  not yet implemented, see issue #8426
🔥  Creating podman container (CPUs=8, Memory=6144MB) ...
📦  Preparing Kubernetes v1.30.0 on containerd 1.6.31 ...
💢  initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:

stderr:
unable to select an IP from lo network interface
To see the stack trace of this error execute with --v=5 or higher


💣  Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

unable to select an IP from lo network interface

❌  Exiting due to GUEST_START: failed to start node: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1

unable to select an IP from lo network interface

(The same error is output when creating the cluster with any other value available for container-runtime)

The failing command in verbose mode indicates:

$ minikube ssh
docker@minikube:~$ /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables --v=5"
I0527 10:06:48.370211    3687 initconfiguration.go:260] loading configuration from "/var/tmp/minikube/kubeadm.yaml"
I0527 10:06:48.372014    3687 interface.go:209] Interface lo is up
I0527 10:06:48.372040    3687 interface.go:257] Interface "lo" has 2 addresses :[127.0.0.1/8 ::1/128].
I0527 10:06:48.372065    3687 interface.go:224] Checking addr  127.0.0.1/8.
I0527 10:06:48.372083    3687 interface.go:234] Non-global unicast address found 127.0.0.1
I0527 10:06:48.372105    3687 interface.go:224] Checking addr  ::1/128.
I0527 10:06:48.372110    3687 interface.go:237] ::1 is not an IPv4 address
I0527 10:06:48.372159    3687 interface.go:209] Interface lo is up
I0527 10:06:48.372186    3687 interface.go:257] Interface "lo" has 2 addresses :[127.0.0.1/8 ::1/128].
I0527 10:06:48.372203    3687 interface.go:224] Checking addr  127.0.0.1/8.
I0527 10:06:48.372207    3687 interface.go:237] 127.0.0.1 is not an IPv6 address
I0527 10:06:48.372222    3687 interface.go:224] Checking addr  ::1/128.
I0527 10:06:48.372226    3687 interface.go:234] Non-global unicast address found ::1
unable to select an IP from lo network interface

Root cause for the issue seems that obviously no network has been created for minikube

$ sudo podman network ls
NETWORK ID    NAME        DRIVER
2f259bab93aa  podman      bridge

(I also tried to manually create the network prior to minikube start with "sudo podman network create minikube" but this did not help)

Attach the log file

==> Audit <==
|------------|--------------------------------|----------|------|---------|----------------------|----------------------|
|  Command   |              Args              | Profile  | User | Version |      Start Time      |       End Time       |
|------------|--------------------------------|----------|------|---------|----------------------|----------------------|
| completion | bash                           | minikube | user | v1.33.1 | 27 May 24 12:40 CEST | 27 May 24 12:40 CEST |
| delete     |                                | minikube | user | v1.33.1 | 27 May 24 12:40 CEST | 27 May 24 12:40 CEST |
| start      | --driver=podman                | minikube | user | v1.33.1 | 27 May 24 12:43 CEST |                      |
|            | --container-runtime=containerd |          |      |         |                      |                      |
|            | --cpus 8 --memory 6g           |          |      |         |                      |                      |
|------------|--------------------------------|----------|------|---------|----------------------|----------------------|


==> Last Start <==
Log file created at: 2024/05/27 12:43:27
Running on machine: LAPTOP-HMPMQHJ3
Binary: Built with gc go1.22.1 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0527 12:43:27.823819   34203 out.go:291] Setting OutFile to fd 1 ...
I0527 12:43:27.823912   34203 out.go:304] Setting ErrFile to fd 2...
I0527 12:43:27.824017   34203 root.go:338] Updating PATH: /home/user/.minikube/bin
I0527 12:43:27.824401   34203 out.go:298] Setting JSON to false
I0527 12:43:27.824855   34203 start.go:129] hostinfo: {"hostname":"LAPTOP-HMPMQHJ3","uptime":13394,"bootTime":1716793214,"procs":48,"os":"linux","platform":"fedora","platformFamily":"fedora","platformVersion":"40","kernelVersion":"5.15.146.1-microsoft-standard-WSL2","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"guest","hostId":"cf735d44-bace-47d6-93e1-ed0f61451a11"}
I0527 12:43:27.824886   34203 start.go:139] virtualization:  guest
I0527 12:43:27.831783   34203 out.go:177] 😄  minikube v1.33.1 on Fedora 40 (amd64)
I0527 12:43:27.833469   34203 notify.go:220] Checking for updates...
I0527 12:43:27.833645   34203 driver.go:392] Setting default libvirt URI to qemu:///system
I0527 12:43:27.864505   34203 podman.go:123] podman version: 5.0.3
I0527 12:43:27.866332   34203 out.go:177] ✨  Using the podman driver based on user configuration
I0527 12:43:27.867909   34203 start.go:297] selected driver: podman
I0527 12:43:27.867914   34203 start.go:901] validating driver "podman" against <nil>
I0527 12:43:27.867922   34203 start.go:912] status for podman: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0527 12:43:27.867985   34203 cli_runner.go:164] Run: sudo -n podman system info --format json
I0527 12:43:27.926825   34203 info.go:288] podman info: {Host:{BuildahVersion:1.35.4 CgroupVersion:v1 Conmon:{Package:conmon-2.1.10-1.fc40.x86_64 Path:/usr/bin/conmon Version:conmon version 2.1.10, commit: } Distribution:{Distribution:fedora Version:40} MemFree:3878412288 MemTotal:8185262080 OCIRuntime:{Name:crun Package:crun-1.15-1.fc40.x86_64 Path:/usr/bin/crun Version:crun version 1.15
commit: e6eacaf4034e84185fd8780ac9262bbf57082278
rundir: /run/crun
spec: 1.0.0
+SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +LIBKRUN +WASM:wasmedge +YAJL} SwapFree:2147483648 SwapTotal:2147483648 Arch:amd64 Cpus:8 Eventlogger:file Hostname:LAPTOP-HMPMQHJ3 Kernel:5.15.146.1-microsoft-standard-WSL2 Os:linux Security:{Rootless:false} Uptime:3h 43m 13.00s (Approximately 0.12 days)} Registries:{Search:[docker.io]} Store:{ConfigFile:/usr/share/containers/storage.conf ContainerStore:{Number:0} GraphDriverName:overlay GraphOptions:{} GraphRoot:/var/lib/containers/storage GraphStatus:{BackingFilesystem:extfs NativeOverlayDiff:false SupportsDType:true UsingMetacopy:true} ImageStore:{Number:1} RunRoot:/run/containers/storage VolumePath:/var/lib/containers/storage/volumes}}
I0527 12:43:27.927337   34203 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
I0527 12:43:27.927462   34203 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
I0527 12:43:27.931017   34203 out.go:177] 📌  Using Podman driver with root privileges
I0527 12:43:27.933276   34203 cni.go:84] Creating CNI manager for ""
I0527 12:43:27.933282   34203 cni.go:143] "podman" driver + "containerd" runtime found, recommending kindnet
I0527 12:43:27.933287   34203 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0527 12:43:27.933340   34203 start.go:340] cluster config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e Memory:6144 CPUs:8 DiskSize:20000 Driver:podman HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/user:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0527 12:43:27.935606   34203 out.go:177] 👍  Starting "minikube" primary control-plane node in "minikube" cluster
I0527 12:43:27.937258   34203 cache.go:121] Beginning downloading kic base image for podman with containerd
I0527 12:43:27.938907   34203 out.go:177] 🚜  Pulling base image v0.0.44 ...
I0527 12:43:27.940469   34203 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime containerd
I0527 12:43:27.940503   34203 preload.go:147] Found local preload: /home/user/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-containerd-overlay2-amd64.tar.lz4
I0527 12:43:27.940508   34203 cache.go:56] Caching tarball of preloaded images
I0527 12:43:27.940559   34203 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e to local cache
I0527 12:43:27.940630   34203 preload.go:173] Found /home/user/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I0527 12:43:27.940636   34203 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on containerd
I0527 12:43:27.940660   34203 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e in local cache directory
I0527 12:43:27.940668   34203 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e in local cache directory, skipping pull
I0527 12:43:27.940672   34203 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e exists in cache, skipping pull
I0527 12:43:27.940677   34203 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e as a tarball
I0527 12:43:27.940823   34203 profile.go:143] Saving config to /home/user/.minikube/profiles/minikube/config.json ...
I0527 12:43:27.940831   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/profiles/minikube/config.json: {Name:mk6327333169e91a1071710da22e1494715b6bb7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
E0527 12:43:27.940922   34203 cache.go:189] Error downloading kic artifacts:  not yet implemented, see issue #8426
I0527 12:43:27.940966   34203 cache.go:194] Successfully downloaded all kic artifacts
I0527 12:43:27.940983   34203 start.go:360] acquireMachinesLock for minikube: {Name:mk648109fbde03481b35c47ade82f19f0f69ee02 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0527 12:43:27.941003   34203 start.go:364] duration metric: took 14.999µs to acquireMachinesLock for "minikube"
I0527 12:43:27.941010   34203 start.go:93] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e Memory:6144 CPUs:8 DiskSize:20000 Driver:podman HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/user:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0527 12:43:27.941037   34203 start.go:125] createHost starting for "" (driver="podman")
I0527 12:43:27.942672   34203 out.go:204] 🔥  Creating podman container (CPUs=8, Memory=6144MB) ...
I0527 12:43:27.942818   34203 start.go:159] libmachine.API.Create for "minikube" (driver="podman")
I0527 12:43:27.942834   34203 client.go:168] LocalClient.Create starting
I0527 12:43:27.942878   34203 main.go:141] libmachine: Creating CA: /home/user/.minikube/certs/ca.pem
I0527 12:43:28.005757   34203 main.go:141] libmachine: Creating client certificate: /home/user/.minikube/certs/cert.pem
I0527 12:43:28.074977   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:28.103478   34203 cli_runner.go:164] Run: sudo -n podman network inspect minikube --format "{{range .}}{{if eq .Driver "bridge"}}{{(index .Subnets 0).Subnet}},{{(index .Subnets 0).Gateway}}{{end}}{{end}}"
W0527 12:43:28.129544   34203 cli_runner.go:211] sudo -n podman network inspect minikube --format "{{range .}}{{if eq .Driver "bridge"}}{{(index .Subnets 0).Subnet}},{{(index .Subnets 0).Gateway}}{{end}}{{end}}" returned with exit code 125
I0527 12:43:28.129589   34203 network_create.go:281] running [podman network inspect minikube] to gather additional debugging logs...
I0527 12:43:28.129608   34203 cli_runner.go:164] Run: sudo -n podman network inspect minikube
W0527 12:43:28.157379   34203 cli_runner.go:211] sudo -n podman network inspect minikube returned with exit code 125
I0527 12:43:28.157398   34203 network_create.go:284] error running [sudo -n podman network inspect minikube]: sudo -n podman network inspect minikube: exit status 125
stdout:
[]

stderr:
time="2024-05-27T12:43:28+02:00" level=warning msg="Using cgroups-v1 which is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `PODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Error: network minikube: unable to find network with name or ID minikube: network not found
I0527 12:43:28.157408   34203 network_create.go:286] output of [sudo -n podman network inspect minikube]: -- stdout --
[]

-- /stdout --
** stderr ** 
time="2024-05-27T12:43:28+02:00" level=warning msg="Using cgroups-v1 which is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `PODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Error: network minikube: unable to find network with name or ID minikube: network not found

** /stderr **
I0527 12:43:28.157448   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:28.184953   34203 cli_runner.go:164] Run: sudo -n podman network inspect podman --format "{{range .}}{{if eq .Driver "bridge"}}{{(index .Subnets 0).Subnet}},{{(index .Subnets 0).Gateway}}{{end}}{{end}}"
I0527 12:43:28.213357   34203 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000712880}
I0527 12:43:28.213388   34203 network_create.go:124] attempt to create podman network minikube 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 0 ...
I0527 12:43:28.213428   34203 cli_runner.go:164] Run: sudo -n podman network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=minikube minikube
I0527 12:43:28.240470   34203 network_create.go:108] podman network minikube 192.168.49.0/24 created
I0527 12:43:28.240485   34203 kic.go:121] calculated static IP "192.168.49.2" for the "minikube" container
I0527 12:43:28.240532   34203 cli_runner.go:164] Run: sudo -n podman ps -a --format {{.Names}}
I0527 12:43:28.266121   34203 cli_runner.go:164] Run: sudo -n podman volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true
I0527 12:43:28.308478   34203 oci.go:103] Successfully created a podman volume minikube
I0527 12:43:28.308533   34203 cli_runner.go:164] Run: sudo -n podman run --rm --name minikube-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --entrypoint /usr/bin/test -v minikube:/var gcr.io/k8s-minikube/kicbase:v0.0.44 -d /var/lib
I0527 12:43:28.842003   34203 oci.go:107] Successfully prepared a podman volume minikube
I0527 12:43:28.842035   34203 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime containerd
I0527 12:43:28.842050   34203 kic.go:194] Starting extracting preloaded images to volume ...
I0527 12:43:28.842096   34203 cli_runner.go:164] Run: sudo -n podman run --rm --entrypoint /usr/bin/tar --security-opt label=disable -v /home/user/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.44 -I lz4 -xf /preloaded.tar -C /extractDir
I0527 12:43:30.957906   34203 cli_runner.go:217] Completed: sudo -n podman run --rm --entrypoint /usr/bin/tar --security-opt label=disable -v /home/user/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.44 -I lz4 -xf /preloaded.tar -C /extractDir: (2.115751932s)
I0527 12:43:30.957921   34203 kic.go:203] duration metric: took 2.115869706s to extract preloaded images to volume ...
W0527 12:43:30.958034   34203 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0527 12:43:30.958090   34203 cli_runner.go:164] Run: sudo -n podman info --format "'{{json .SecurityOptions}}'"
W0527 12:43:31.015377   34203 cli_runner.go:211] sudo -n podman info --format "'{{json .SecurityOptions}}'" returned with exit code 125
I0527 12:43:31.015480   34203 cli_runner.go:164] Run: sudo -n podman run --cgroup-manager cgroupfs -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --network minikube --ip 192.168.49.2 --volume minikube:/var:exec --memory=6144mb --cpus=8 -e container=podman --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.44
I0527 12:43:31.144511   34203 cli_runner.go:164] Run: sudo -n podman container inspect minikube --format={{.State.Running}}
I0527 12:43:31.176378   34203 cli_runner.go:164] Run: sudo -n podman container inspect minikube --format={{.State.Status}}
I0527 12:43:31.207975   34203 cli_runner.go:164] Run: sudo -n podman exec minikube stat /var/lib/dpkg/alternatives/iptables
I0527 12:43:31.342425   34203 oci.go:144] the created container "minikube" has a running status.
I0527 12:43:31.342453   34203 kic.go:225] Creating ssh key for kic: /home/user/.minikube/machines/minikube/id_rsa...
I0527 12:43:31.741836   34203 kic_runner.go:191] podman (temp): /home/user/.minikube/machines/minikube/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0527 12:43:31.742613   34203 kic_runner.go:262] Run: /usr/bin/sudo -n podman cp /tmp/tmpf-memory-asset4011495659 minikube:/home/docker/.ssh/authorized_keys
I0527 12:43:31.847558   34203 cli_runner.go:164] Run: sudo -n podman container inspect minikube --format={{.State.Status}}
I0527 12:43:31.881062   34203 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0527 12:43:31.881090   34203 kic_runner.go:114] Args: [sudo -n podman exec --privileged minikube chown docker:docker /home/docker/.ssh/authorized_keys]
I0527 12:43:32.042255   34203 cli_runner.go:164] Run: sudo -n podman container inspect minikube --format={{.State.Status}}
I0527 12:43:32.071406   34203 machine.go:94] provisionDockerMachine start ...
I0527 12:43:32.071470   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:32.098368   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0527 12:43:32.128105   34203 main.go:141] libmachine: Using SSH client type: native
I0527 12:43:32.128223   34203 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d6e0] 0x830440 <nil>  [] 0s} 127.0.0.1 39115 <nil> <nil>}
I0527 12:43:32.128228   34203 main.go:141] libmachine: About to run SSH command:
hostname
I0527 12:43:32.270708   34203 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

I0527 12:43:32.270735   34203 ubuntu.go:169] provisioning hostname "minikube"
I0527 12:43:32.270866   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:32.318244   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0527 12:43:32.348378   34203 main.go:141] libmachine: Using SSH client type: native
I0527 12:43:32.348485   34203 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d6e0] 0x830440 <nil>  [] 0s} 127.0.0.1 39115 <nil> <nil>}
I0527 12:43:32.348489   34203 main.go:141] libmachine: About to run SSH command:
sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname
I0527 12:43:32.509737   34203 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

I0527 12:43:32.509817   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:32.548539   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0527 12:43:32.579769   34203 main.go:141] libmachine: Using SSH client type: native
I0527 12:43:32.579879   34203 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d6e0] 0x830440 <nil>  [] 0s} 127.0.0.1 39115 <nil> <nil>}
I0527 12:43:32.579886   34203 main.go:141] libmachine: About to run SSH command:

		if ! grep -xq '.*\sminikube' /etc/hosts; then
			if grep -xq '127.0.1.1\s.*' /etc/hosts; then
				sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts;
			else 
				echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; 
			fi
		fi
I0527 12:43:32.721588   34203 main.go:141] libmachine: SSH cmd err, output: <nil>: 
I0527 12:43:32.721611   34203 ubuntu.go:175] set auth options {CertDir:/home/user/.minikube CaCertPath:/home/user/.minikube/certs/ca.pem CaPrivateKeyPath:/home/user/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/user/.minikube/machines/server.pem ServerKeyPath:/home/user/.minikube/machines/server-key.pem ClientKeyPath:/home/user/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/user/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/user/.minikube}
I0527 12:43:32.721661   34203 ubuntu.go:177] setting up certificates
I0527 12:43:32.721675   34203 provision.go:84] configureAuth start
I0527 12:43:32.721807   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f {{.NetworkSettings.IPAddress}} minikube
I0527 12:43:32.776786   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube
I0527 12:43:32.807469   34203 provision.go:143] copyHostCerts
I0527 12:43:32.807498   34203 exec_runner.go:151] cp: /home/user/.minikube/certs/ca.pem --> /home/user/.minikube/ca.pem (1070 bytes)
I0527 12:43:32.807574   34203 exec_runner.go:151] cp: /home/user/.minikube/certs/cert.pem --> /home/user/.minikube/cert.pem (1115 bytes)
I0527 12:43:32.807599   34203 exec_runner.go:151] cp: /home/user/.minikube/certs/key.pem --> /home/user/.minikube/key.pem (1675 bytes)
I0527 12:43:32.807623   34203 provision.go:117] generating server cert: /home/user/.minikube/machines/server.pem ca-key=/home/user/.minikube/certs/ca.pem private-key=/home/user/.minikube/certs/ca-key.pem org=user.minikube san=[127.0.0.1 localhost minikube]
I0527 12:43:32.859234   34203 provision.go:177] copyRemoteCerts
I0527 12:43:32.859263   34203 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0527 12:43:32.859289   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:32.886788   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0527 12:43:32.916407   34203 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39115 SSHKeyPath:/home/user/.minikube/machines/minikube/id_rsa Username:docker}
I0527 12:43:33.018749   34203 ssh_runner.go:362] scp /home/user/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0527 12:43:33.051727   34203 ssh_runner.go:362] scp /home/user/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1070 bytes)
I0527 12:43:33.084034   34203 ssh_runner.go:362] scp /home/user/.minikube/machines/server.pem --> /etc/docker/server.pem (1164 bytes)
I0527 12:43:33.115534   34203 provision.go:87] duration metric: took 393.842805ms to configureAuth
I0527 12:43:33.115558   34203 ubuntu.go:193] setting minikube options for container-runtime
I0527 12:43:33.115792   34203 config.go:182] Loaded profile config "minikube": Driver=podman, ContainerRuntime=containerd, KubernetesVersion=v1.30.0
I0527 12:43:33.115802   34203 machine.go:97] duration metric: took 1.0443863s to provisionDockerMachine
I0527 12:43:33.115811   34203 client.go:171] duration metric: took 5.172971962s to LocalClient.Create
I0527 12:43:33.115871   34203 start.go:167] duration metric: took 5.173049844s to libmachine.API.Create "minikube"
I0527 12:43:33.115881   34203 start.go:293] postStartSetup for "minikube" (driver="podman")
I0527 12:43:33.115894   34203 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0527 12:43:33.116027   34203 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0527 12:43:33.116092   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:33.159948   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0527 12:43:33.190660   34203 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39115 SSHKeyPath:/home/user/.minikube/machines/minikube/id_rsa Username:docker}
I0527 12:43:33.290712   34203 ssh_runner.go:195] Run: cat /etc/os-release
I0527 12:43:33.295757   34203 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0527 12:43:33.295793   34203 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0527 12:43:33.295808   34203 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0527 12:43:33.295817   34203 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0527 12:43:33.295831   34203 filesync.go:126] Scanning /home/user/.minikube/addons for local assets ...
I0527 12:43:33.295907   34203 filesync.go:126] Scanning /home/user/.minikube/files for local assets ...
I0527 12:43:33.295930   34203 start.go:296] duration metric: took 180.041447ms for postStartSetup
I0527 12:43:33.296432   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f {{.NetworkSettings.IPAddress}} minikube
I0527 12:43:33.352711   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube
I0527 12:43:33.384657   34203 profile.go:143] Saving config to /home/user/.minikube/profiles/minikube/config.json ...
I0527 12:43:33.384859   34203 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0527 12:43:33.384891   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:33.411144   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0527 12:43:33.441092   34203 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39115 SSHKeyPath:/home/user/.minikube/machines/minikube/id_rsa Username:docker}
I0527 12:43:33.532890   34203 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0527 12:43:33.540427   34203 start.go:128] duration metric: took 5.599368318s to createHost
I0527 12:43:33.540448   34203 start.go:83] releasing machines lock for "minikube", held for 5.599437131s
I0527 12:43:33.540555   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f {{.NetworkSettings.IPAddress}} minikube
I0527 12:43:33.598250   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube
I0527 12:43:33.631539   34203 ssh_runner.go:195] Run: cat /version.json
I0527 12:43:33.631574   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:33.631624   34203 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0527 12:43:33.631663   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:33.658787   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0527 12:43:33.659163   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0527 12:43:33.692967   34203 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39115 SSHKeyPath:/home/user/.minikube/machines/minikube/id_rsa Username:docker}
I0527 12:43:33.696018   34203 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:39115 SSHKeyPath:/home/user/.minikube/machines/minikube/id_rsa Username:docker}
I0527 12:43:38.796321   34203 ssh_runner.go:235] Completed: curl -sS -m 2 https://registry.k8s.io/: (5.164665527s)
W0527 12:43:38.796381   34203 start.go:860] [curl -sS -m 2 https://registry.k8s.io/] failed: curl -sS -m 2 https://registry.k8s.io/: Process exited with status 28
stdout:

stderr:
curl: (28) Resolving timed out after 2000 milliseconds
W0527 12:43:38.796463   34203 out.go:239] ❗  This container is having trouble accessing https://registry.k8s.io
W0527 12:43:38.796555   34203 out.go:239] 💡  To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/
I0527 12:43:38.796555   34203 ssh_runner.go:235] Completed: cat /version.json: (5.16498232s)
I0527 12:43:38.796889   34203 ssh_runner.go:195] Run: systemctl --version
I0527 12:43:38.803422   34203 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0527 12:43:38.806161   34203 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0527 12:43:38.820203   34203 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0527 12:43:38.820250   34203 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0527 12:43:38.832517   34203 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0527 12:43:38.832528   34203 start.go:494] detecting cgroup driver to use...
I0527 12:43:38.832548   34203 detect.go:196] detected "cgroupfs" cgroup driver on host os
I0527 12:43:38.832576   34203 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0527 12:43:38.840289   34203 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0527 12:43:38.847510   34203 docker.go:217] disabling cri-docker service (if available) ...
I0527 12:43:38.847542   34203 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0527 12:43:38.855643   34203 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0527 12:43:38.863330   34203 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0527 12:43:38.945113   34203 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0527 12:43:39.032914   34203 docker.go:233] disabling docker service ...
I0527 12:43:39.032949   34203 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0527 12:43:39.044615   34203 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0527 12:43:39.051600   34203 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0527 12:43:39.135286   34203 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0527 12:43:39.215718   34203 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0527 12:43:39.222237   34203 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0527 12:43:39.230402   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0527 12:43:39.236034   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0527 12:43:39.243261   34203 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0527 12:43:39.243302   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0527 12:43:39.251794   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0527 12:43:39.259603   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0527 12:43:39.265819   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0527 12:43:39.272035   34203 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0527 12:43:39.277202   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0527 12:43:39.282156   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0527 12:43:39.287391   34203 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0527 12:43:39.292313   34203 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0527 12:43:39.296546   34203 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0527 12:43:39.301195   34203 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0527 12:43:39.383569   34203 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0527 12:43:39.529566   34203 start.go:541] Will wait 60s for socket path /run/containerd/containerd.sock
I0527 12:43:39.529613   34203 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0527 12:43:39.531627   34203 start.go:562] Will wait 60s for crictl version
I0527 12:43:39.531647   34203 ssh_runner.go:195] Run: which crictl
I0527 12:43:39.533468   34203 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0527 12:43:39.554455   34203 start.go:578] Version:  0.1.0
RuntimeName:  containerd
RuntimeVersion:  1.6.31
RuntimeApiVersion:  v1
I0527 12:43:39.571843   34203 ssh_runner.go:195] Run: containerd --version
I0527 12:43:39.603302   34203 ssh_runner.go:195] Run: containerd --version
I0527 12:43:39.620550   34203 out.go:177] 📦  Preparing Kubernetes v1.30.0 on containerd 1.6.31 ...
I0527 12:43:39.622040   34203 cli_runner.go:164] Run: sudo -n podman container inspect --format {{.NetworkSettings.Gateway}} minikube
I0527 12:43:39.652607   34203 cli_runner.go:164] Run: sudo -n podman container inspect --format "
{{ if index .NetworkSettings.Networks "minikube"}} 
	{{(index .NetworkSettings.Networks "minikube").Gateway}}
{{ end }}
" minikube
I0527 12:43:39.683041   34203 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
I0527 12:43:39.685168   34203 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0527 12:43:39.690785   34203 cli_runner.go:164] Run: sudo -n podman version --format {{.Version}}
I0527 12:43:39.717575   34203 cli_runner.go:164] Run: sudo -n podman container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" minikube
I0527 12:43:39.748917   34203 kubeadm.go:877] updating cluster {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e Memory:6144 CPUs:8 DiskSize:20000 Driver:podman HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:127.0.0.1 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/user:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0527 12:43:39.748982   34203 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime containerd
I0527 12:43:39.749012   34203 ssh_runner.go:195] Run: sudo crictl images --output json
I0527 12:43:39.770928   34203 containerd.go:627] all images are preloaded for containerd runtime.
I0527 12:43:39.770936   34203 containerd.go:534] Images already preloaded, skipping extraction
I0527 12:43:39.770969   34203 ssh_runner.go:195] Run: sudo crictl images --output json
I0527 12:43:39.792981   34203 containerd.go:627] all images are preloaded for containerd runtime.
I0527 12:43:39.792990   34203 cache_images.go:84] Images are preloaded, skipping loading
I0527 12:43:39.792994   34203 kubeadm.go:928] updating node { 127.0.0.1 8443 v1.30.0 containerd true true} ...
I0527 12:43:39.793052   34203 kubeadm.go:940] kubelet [Unit]
Wants=containerd.service

[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=minikube --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=127.0.0.1

[Install]
 config:
{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0527 12:43:39.793082   34203 ssh_runner.go:195] Run: sudo crictl info
I0527 12:43:39.815611   34203 cni.go:84] Creating CNI manager for ""
I0527 12:43:39.815617   34203 cni.go:143] "podman" driver + "containerd" runtime found, recommending kindnet
I0527 12:43:39.815621   34203 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0527 12:43:39.815635   34203 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:127.0.0.1 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "127.0.0.1"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:127.0.0.1 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0527 12:43:39.815702   34203 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
  advertiseAddress: 127.0.0.1
  bindPort: 8443
bootstrapTokens:
  - groups:
      - system:bootstrappers:kubeadm:default-node-token
    ttl: 24h0m0s
    usages:
      - signing
      - authentication
nodeRegistration:
  criSocket: unix:///run/containerd/containerd.sock
  name: "minikube"
  kubeletExtraArgs:
    node-ip: 127.0.0.1
  taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
  certSANs: ["127.0.0.1", "localhost", "127.0.0.1"]
  extraArgs:
    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
  extraArgs:
    allocate-node-cidrs: "true"
    leader-elect: "false"
scheduler:
  extraArgs:
    leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
  local:
    dataDir: /var/lib/minikube/etcd
    extraArgs:
      proxy-refresh-interval: "70000"
kubernetesVersion: v1.30.0
networking:
  dnsDomain: cluster.local
  podSubnet: "10.244.0.0/16"
  serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
  x509:
    clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
  nodefs.available: "0%!"(MISSING)
  nodefs.inodesFree: "0%!"(MISSING)
  imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
  maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
  tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
  tcpCloseWaitTimeout: 0s

I0527 12:43:39.815737   34203 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0
I0527 12:43:39.820428   34203 binaries.go:44] Found k8s binaries, skipping transfer
I0527 12:43:39.820472   34203 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0527 12:43:39.824887   34203 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)
I0527 12:43:39.833901   34203 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0527 12:43:39.844008   34203 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)
I0527 12:43:39.855732   34203 ssh_runner.go:195] Run: grep 127.0.0.1	control-plane.minikube.internal$ /etc/hosts
I0527 12:43:39.858196   34203 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "127.0.0.1	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0527 12:43:39.865532   34203 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0527 12:43:39.965702   34203 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0527 12:43:39.973748   34203 certs.go:68] Setting up /home/user/.minikube/profiles/minikube for IP: 127.0.0.1
I0527 12:43:39.973755   34203 certs.go:194] generating shared ca certs ...
I0527 12:43:39.973764   34203 certs.go:226] acquiring lock for ca certs: {Name:mke32e43b48026f434383aa025803b9c56ebd98b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:39.973853   34203 certs.go:240] generating "minikubeCA" ca cert: /home/user/.minikube/ca.key
I0527 12:43:40.032516   34203 crypto.go:156] Writing cert to /home/user/.minikube/ca.crt ...
I0527 12:43:40.032527   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/ca.crt: {Name:mk66f3784c9655bd4fd68a35bd57e79e62701e6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.032639   34203 crypto.go:164] Writing key to /home/user/.minikube/ca.key ...
I0527 12:43:40.032643   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/ca.key: {Name:mkf4771b7f85676de50877ad9b8035c4810de560 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.032739   34203 certs.go:240] generating "proxyClientCA" ca cert: /home/user/.minikube/proxy-client-ca.key
I0527 12:43:40.067967   34203 crypto.go:156] Writing cert to /home/user/.minikube/proxy-client-ca.crt ...
I0527 12:43:40.067973   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/proxy-client-ca.crt: {Name:mk058de199223d099a30d9d2206f5bdca0211c74 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.068034   34203 crypto.go:164] Writing key to /home/user/.minikube/proxy-client-ca.key ...
I0527 12:43:40.068037   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/proxy-client-ca.key: {Name:mkd69704e4b9a72b043f3831d43124e126c41482 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.068065   34203 certs.go:256] generating profile certs ...
I0527 12:43:40.068092   34203 certs.go:363] generating signed profile cert for "minikube-user": /home/user/.minikube/profiles/minikube/client.key
I0527 12:43:40.068096   34203 crypto.go:68] Generating cert /home/user/.minikube/profiles/minikube/client.crt with IP's: []
I0527 12:43:40.222255   34203 crypto.go:156] Writing cert to /home/user/.minikube/profiles/minikube/client.crt ...
I0527 12:43:40.222264   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/profiles/minikube/client.crt: {Name:mka9c1a5e835a20e74006b58a7759660b6a78a2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.222367   34203 crypto.go:164] Writing key to /home/user/.minikube/profiles/minikube/client.key ...
I0527 12:43:40.222371   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/profiles/minikube/client.key: {Name:mke5de9237360705a6b08eefae35bd1f5421d2e1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.222403   34203 certs.go:363] generating signed profile cert for "minikube": /home/user/.minikube/profiles/minikube/apiserver.key.9d195f84
I0527 12:43:40.222410   34203 crypto.go:68] Generating cert /home/user/.minikube/profiles/minikube/apiserver.crt.9d195f84 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 127.0.0.1]
I0527 12:43:40.351906   34203 crypto.go:156] Writing cert to /home/user/.minikube/profiles/minikube/apiserver.crt.9d195f84 ...
I0527 12:43:40.351914   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/profiles/minikube/apiserver.crt.9d195f84: {Name:mk63a8fba621cf4b56eb58d1d9799bd6cb8cb536 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.352014   34203 crypto.go:164] Writing key to /home/user/.minikube/profiles/minikube/apiserver.key.9d195f84 ...
I0527 12:43:40.352017   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/profiles/minikube/apiserver.key.9d195f84: {Name:mk0d642e72d2fb146a0c6f9283b332ae2f8a3a1e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.352052   34203 certs.go:381] copying /home/user/.minikube/profiles/minikube/apiserver.crt.9d195f84 -> /home/user/.minikube/profiles/minikube/apiserver.crt
I0527 12:43:40.352100   34203 certs.go:385] copying /home/user/.minikube/profiles/minikube/apiserver.key.9d195f84 -> /home/user/.minikube/profiles/minikube/apiserver.key
I0527 12:43:40.352121   34203 certs.go:363] generating signed profile cert for "aggregator": /home/user/.minikube/profiles/minikube/proxy-client.key
I0527 12:43:40.352129   34203 crypto.go:68] Generating cert /home/user/.minikube/profiles/minikube/proxy-client.crt with IP's: []
I0527 12:43:40.404962   34203 crypto.go:156] Writing cert to /home/user/.minikube/profiles/minikube/proxy-client.crt ...
I0527 12:43:40.404967   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/profiles/minikube/proxy-client.crt: {Name:mke1f0483b419ee897a73431cf7d3912dc6b1e41 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.405112   34203 crypto.go:164] Writing key to /home/user/.minikube/profiles/minikube/proxy-client.key ...
I0527 12:43:40.405118   34203 lock.go:35] WriteFile acquiring /home/user/.minikube/profiles/minikube/proxy-client.key: {Name:mkb31655180fc53f8c7371a942a88835985e38f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0527 12:43:40.405230   34203 certs.go:484] found cert: /home/user/.minikube/certs/ca-key.pem (1675 bytes)
I0527 12:43:40.405244   34203 certs.go:484] found cert: /home/user/.minikube/certs/ca.pem (1070 bytes)
I0527 12:43:40.405253   34203 certs.go:484] found cert: /home/user/.minikube/certs/cert.pem (1115 bytes)
I0527 12:43:40.405262   34203 certs.go:484] found cert: /home/user/.minikube/certs/key.pem (1675 bytes)
I0527 12:43:40.405585   34203 ssh_runner.go:362] scp /home/user/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0527 12:43:40.418428   34203 ssh_runner.go:362] scp /home/user/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0527 12:43:40.430448   34203 ssh_runner.go:362] scp /home/user/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0527 12:43:40.449115   34203 ssh_runner.go:362] scp /home/user/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0527 12:43:40.469124   34203 ssh_runner.go:362] scp /home/user/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1411 bytes)
I0527 12:43:40.485257   34203 ssh_runner.go:362] scp /home/user/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0527 12:43:40.505805   34203 ssh_runner.go:362] scp /home/user/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0527 12:43:40.530961   34203 ssh_runner.go:362] scp /home/user/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0527 12:43:40.561606   34203 ssh_runner.go:362] scp /home/user/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0527 12:43:40.587885   34203 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (740 bytes)
I0527 12:43:40.608656   34203 ssh_runner.go:195] Run: openssl version
I0527 12:43:40.614083   34203 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0527 12:43:40.624454   34203 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0527 12:43:40.627491   34203 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 May 27 10:43 /usr/share/ca-certificates/minikubeCA.pem
I0527 12:43:40.627527   34203 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0527 12:43:40.632663   34203 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0527 12:43:40.638324   34203 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0527 12:43:40.640578   34203 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:

stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0527 12:43:40.640614   34203 kubeadm.go:391] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e Memory:6144 CPUs:8 DiskSize:20000 Driver:podman HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:127.0.0.1 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/user:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0527 12:43:40.640657   34203 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0527 12:43:40.640679   34203 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0527 12:43:40.661562   34203 cri.go:89] found id: ""
I0527 12:43:40.661600   34203 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0527 12:43:40.666402   34203 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0527 12:43:40.670760   34203 kubeadm.go:213] ignoring SystemVerification for kubeadm because of podman driver
I0527 12:43:40.670792   34203 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0527 12:43:40.674951   34203 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:

stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0527 12:43:40.674957   34203 kubeadm.go:156] found existing configuration files:

I0527 12:43:40.674977   34203 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0527 12:43:40.679026   34203 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:

stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0527 12:43:40.679047   34203 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0527 12:43:40.683145   34203 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0527 12:43:40.687511   34203 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:

stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0527 12:43:40.687533   34203 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0527 12:43:40.691468   34203 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0527 12:43:40.695915   34203 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:

stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0527 12:43:40.695936   34203 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0527 12:43:40.700714   34203 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0527 12:43:40.705592   34203 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:

stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0527 12:43:40.705617   34203 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0527 12:43:40.709770   34203 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0527 12:43:40.733932   34203 kubeadm.go:309] unable to select an IP from lo network interface
I0527 12:43:40.733978   34203 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
W0527 12:43:40.734052   34203 out.go:239] 💢  initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:

stderr:
unable to select an IP from lo network interface
To see the stack trace of this error execute with --v=5 or higher

I0527 12:43:40.734113   34203 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force"
I0527 12:43:42.163829   34203 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm reset --cri-socket /run/containerd/containerd.sock --force": (1.429699424s)
I0527 12:43:42.163868   34203 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0527 12:43:42.170104   34203 kubeadm.go:213] ignoring SystemVerification for kubeadm because of podman driver
I0527 12:43:42.170135   34203 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0527 12:43:42.174609   34203 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:

stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0527 12:43:42.174614   34203 kubeadm.go:156] found existing configuration files:

I0527 12:43:42.174645   34203 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0527 12:43:42.179097   34203 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:

stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0527 12:43:42.179123   34203 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0527 12:43:42.183410   34203 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0527 12:43:42.187751   34203 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:

stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0527 12:43:42.187773   34203 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0527 12:43:42.192542   34203 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0527 12:43:42.197486   34203 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:

stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0527 12:43:42.197509   34203 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0527 12:43:42.201738   34203 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0527 12:43:42.206097   34203 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:

stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0527 12:43:42.206121   34203 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0527 12:43:42.210409   34203 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0527 12:43:42.232195   34203 kubeadm.go:309] unable to select an IP from lo network interface
I0527 12:43:42.232241   34203 kubeadm.go:309] To see the stack trace of this error execute with --v=5 or higher
I0527 12:43:42.232268   34203 kubeadm.go:393] duration metric: took 1.591657454s to StartCluster
I0527 12:43:42.232327   34203 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
I0527 12:43:42.232357   34203 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I0527 12:43:42.255122   34203 cri.go:89] found id: ""
I0527 12:43:42.255132   34203 logs.go:276] 0 containers: []
W0527 12:43:42.255137   34203 logs.go:278] No container was found matching "kube-apiserver"
I0527 12:43:42.255140   34203 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
I0527 12:43:42.255173   34203 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I0527 12:43:42.277342   34203 cri.go:89] found id: ""
I0527 12:43:42.277353   34203 logs.go:276] 0 containers: []
W0527 12:43:42.277358   34203 logs.go:278] No container was found matching "etcd"
I0527 12:43:42.277362   34203 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
I0527 12:43:42.277397   34203 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I0527 12:43:42.298394   34203 cri.go:89] found id: ""
I0527 12:43:42.298404   34203 logs.go:276] 0 containers: []
W0527 12:43:42.298408   34203 logs.go:278] No container was found matching "coredns"
I0527 12:43:42.298412   34203 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
I0527 12:43:42.298444   34203 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I0527 12:43:42.318380   34203 cri.go:89] found id: ""
I0527 12:43:42.318389   34203 logs.go:276] 0 containers: []
W0527 12:43:42.318394   34203 logs.go:278] No container was found matching "kube-scheduler"
I0527 12:43:42.318398   34203 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
I0527 12:43:42.318429   34203 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I0527 12:43:42.340706   34203 cri.go:89] found id: ""
I0527 12:43:42.340715   34203 logs.go:276] 0 containers: []
W0527 12:43:42.340720   34203 logs.go:278] No container was found matching "kube-proxy"
I0527 12:43:42.340724   34203 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
I0527 12:43:42.340756   34203 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I0527 12:43:42.360386   34203 cri.go:89] found id: ""
I0527 12:43:42.360396   34203 logs.go:276] 0 containers: []
W0527 12:43:42.360402   34203 logs.go:278] No container was found matching "kube-controller-manager"
I0527 12:43:42.360405   34203 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
I0527 12:43:42.360438   34203 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I0527 12:43:42.383174   34203 cri.go:89] found id: ""
I0527 12:43:42.383184   34203 logs.go:276] 0 containers: []
W0527 12:43:42.383189   34203 logs.go:278] No container was found matching "kindnet"
I0527 12:43:42.383195   34203 logs.go:123] Gathering logs for kubelet ...
I0527 12:43:42.383203   34203 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0527 12:43:42.390071   34203 logs.go:123] Gathering logs for dmesg ...
I0527 12:43:42.390080   34203 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0527 12:43:42.396631   34203 logs.go:123] Gathering logs for describe nodes ...
I0527 12:43:42.396639   34203 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W0527 12:43:42.434195   34203 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:

stderr:
E0527 10:43:42.429470    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:43:42.429848    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:43:42.431223    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:43:42.431347    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:43:42.432779    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
The connection to the server localhost:8443 was refused - did you specify the right host or port?
 output: 
** stderr ** 
E0527 10:43:42.429470    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:43:42.429848    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:43:42.431223    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:43:42.431347    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:43:42.432779    2098 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
The connection to the server localhost:8443 was refused - did you specify the right host or port?

** /stderr **
I0527 12:43:42.434202   34203 logs.go:123] Gathering logs for containerd ...
I0527 12:43:42.434209   34203 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
I0527 12:43:42.457076   34203 logs.go:123] Gathering logs for container status ...
I0527 12:43:42.457090   34203 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
W0527 12:43:42.480101   34203 out.go:364] Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:

stderr:
unable to select an IP from lo network interface
To see the stack trace of this error execute with --v=5 or higher
W0527 12:43:42.480126   34203 out.go:239] 
W0527 12:43:42.480198   34203 out.go:239] 💣  Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:

stderr:
unable to select an IP from lo network interface
To see the stack trace of this error execute with --v=5 or higher

W0527 12:43:42.480216   34203 out.go:239] 
W0527 12:43:42.480755   34203 out.go:239] �[31m╭───────────────────────────────────────────────────────────────────────────────────────────╮�[0m
�[31m│�[0m                                                                                           �[31m│�[0m
�[31m│�[0m    😿  If the above advice does not help, please let us know:                             �[31m│�[0m
�[31m│�[0m    👉  https://github.com/kubernetes/minikube/issues/new/choose                           �[31m│�[0m
�[31m│�[0m                                                                                           �[31m│�[0m
�[31m│�[0m    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    �[31m│�[0m
�[31m│�[0m                                                                                           �[31m│�[0m
�[31m╰───────────────────────────────────────────────────────────────────────────────────────────╯�[0m
I0527 12:43:42.491200   34203 out.go:177] 
W0527 12:43:42.494383   34203 out.go:239] ❌  Exiting due to GUEST_START: failed to start node: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1
stdout:

stderr:
unable to select an IP from lo network interface
To see the stack trace of this error execute with --v=5 or higher

W0527 12:43:42.494420   34203 out.go:239] 
W0527 12:43:42.494968   34203 out.go:239] �[31m╭───────────────────────────────────────────────────────────────────────────────────────────╮�[0m
�[31m│�[0m                                                                                           �[31m│�[0m
�[31m│�[0m    😿  If the above advice does not help, please let us know:                             �[31m│�[0m
�[31m│�[0m    👉  https://github.com/kubernetes/minikube/issues/new/choose                           �[31m│�[0m
�[31m│�[0m                                                                                           �[31m│�[0m
�[31m│�[0m    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    �[31m│�[0m
�[31m│�[0m                                                                                           �[31m│�[0m
�[31m╰───────────────────────────────────────────────────────────────────────────────────────────╯�[0m
I0527 12:43:42.497335   34203 out.go:177] 


==> container status <==
CONTAINER           IMAGE               CREATED             STATE               NAME                ATTEMPT             POD ID              POD


==> containerd <==
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.689578993Z" level=info msg="StopPodSandbox for \"using\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.689640409Z" level=error msg="StopPodSandbox for \"using\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"using\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.706234275Z" level=info msg="StopPodSandbox for \"using\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.706278037Z" level=error msg="StopPodSandbox for \"using\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"using\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.721362492Z" level=info msg="StopPodSandbox for \"using\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.721403541Z" level=error msg="StopPodSandbox for \"using\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"using\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.738073885Z" level=info msg="StopPodSandbox for \"using\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.738134411Z" level=error msg="StopPodSandbox for \"using\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"using\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.755699472Z" level=info msg="StopPodSandbox for \"using\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.755743148Z" level=error msg="StopPodSandbox for \"using\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"using\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.771588502Z" level=info msg="StopPodSandbox for \"full\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.771617438Z" level=error msg="StopPodSandbox for \"full\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"full\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.788220709Z" level=info msg="StopPodSandbox for \"full\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.788266684Z" level=error msg="StopPodSandbox for \"full\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"full\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.804118766Z" level=info msg="StopPodSandbox for \"full\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.804161356Z" level=error msg="StopPodSandbox for \"full\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"full\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.821648113Z" level=info msg="StopPodSandbox for \"full\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.821704113Z" level=error msg="StopPodSandbox for \"full\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"full\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.837959838Z" level=info msg="StopPodSandbox for \"full\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.838002751Z" level=error msg="StopPodSandbox for \"full\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"full\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.854493138Z" level=info msg="StopPodSandbox for \"URL\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.854538349Z" level=error msg="StopPodSandbox for \"URL\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.869786415Z" level=info msg="StopPodSandbox for \"URL\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.869831182Z" level=error msg="StopPodSandbox for \"URL\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.886092995Z" level=info msg="StopPodSandbox for \"URL\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.886138514Z" level=error msg="StopPodSandbox for \"URL\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.903157061Z" level=info msg="StopPodSandbox for \"URL\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.903199687Z" level=error msg="StopPodSandbox for \"URL\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.919910972Z" level=info msg="StopPodSandbox for \"URL\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.919956362Z" level=error msg="StopPodSandbox for \"URL\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.935656391Z" level=info msg="StopPodSandbox for \"format\\\"\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.935702711Z" level=error msg="StopPodSandbox for \"format\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"format\\\"\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.952171425Z" level=info msg="StopPodSandbox for \"format\\\"\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.952237702Z" level=error msg="StopPodSandbox for \"format\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"format\\\"\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.967589729Z" level=info msg="StopPodSandbox for \"format\\\"\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.967630159Z" level=error msg="StopPodSandbox for \"format\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"format\\\"\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.984537357Z" level=info msg="StopPodSandbox for \"format\\\"\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.984578333Z" level=error msg="StopPodSandbox for \"format\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"format\\\"\": not found"
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.998674211Z" level=info msg="StopPodSandbox for \"format\\\"\""
May 27 10:43:41 minikube containerd[801]: time="2024-05-27T10:43:41.998719435Z" level=error msg="StopPodSandbox for \"format\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"format\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.014644831Z" level=info msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.014709543Z" level=error msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"endpoint=\\\"/run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.029520840Z" level=info msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.029582871Z" level=error msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"endpoint=\\\"/run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.047290996Z" level=info msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.047333773Z" level=error msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"endpoint=\\\"/run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.063669745Z" level=info msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.063714414Z" level=error msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"endpoint=\\\"/run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.078895215Z" level=info msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.078938832Z" level=error msg="StopPodSandbox for \"endpoint=\\\"/run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"endpoint=\\\"/run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.093886431Z" level=info msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.093927688Z" level=error msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.110371550Z" level=info msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.110419280Z" level=error msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.127265285Z" level=info msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.127307888Z" level=error msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.144544612Z" level=info msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.144598143Z" level=error msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\": not found"
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.160406256Z" level=info msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\""
May 27 10:43:42 minikube containerd[801]: time="2024-05-27T10:43:42.160459287Z" level=error msg="StopPodSandbox for \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\" failed" error="rpc error: code = NotFound desc = an error occurred when try to find sandbox \"URL=\\\"unix:///run/containerd/containerd.sock\\\"\": not found"


==> describe nodes <==
command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:

stderr:
E0527 10:44:58.126691    2347 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:44:58.126962    2347 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:44:58.128702    2347 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:44:58.129081    2347 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
E0527 10:44:58.130625    2347 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused
The connection to the server localhost:8443 was refused - did you specify the right host or port?


==> dmesg <==
[May27 07:00] PCI: Fatal: No config space access function found
[  +0.012275] PCI: System does not support PCI
[  +0.069514] kvm: already loaded the other module
[  +0.632459] FS-Cache: Duplicate cookie detected
[  +0.000664] FS-Cache: O-cookie c=00000004 [p=00000002 fl=222 nc=0 na=1]
[  +0.000629] FS-Cache: O-cookie d=00000000f48718bc{9P.session} n=000000006807cd40
[  +0.000417] FS-Cache: O-key=[10] '34323934393337333637'
[  +0.000230] FS-Cache: N-cookie c=00000005 [p=00000002 fl=2 nc=0 na=1]
[  +0.000217] FS-Cache: N-cookie d=00000000f48718bc{9P.session} n=00000000395aca6a
[  +0.000337] FS-Cache: N-key=[10] '34323934393337333637'
[  +0.002180] FS-Cache: Duplicate cookie detected
[  +0.000333] FS-Cache: O-cookie c=00000006 [p=00000002 fl=222 nc=0 na=1]
[  +0.000805] FS-Cache: O-cookie d=00000000f48718bc{9P.session} n=00000000baa51707
[  +0.000579] FS-Cache: O-key=[10] '34323934393337333638'
[  +0.000289] FS-Cache: N-cookie c=00000007 [p=00000002 fl=2 nc=0 na=1]
[  +0.000713] FS-Cache: N-cookie d=00000000f48718bc{9P.session} n=00000000fb9ce272
[  +0.000368] FS-Cache: N-key=[10] '34323934393337333638'
[  +1.921930] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000532] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000499] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000569] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -2
[  +4.776740] Exception: 
[  +0.000003] Operation canceled @p9io.cpp:258 (AcceptAsync)

[  +0.001468] WSL (1) ERROR: InitEntryUtilityVm:2273: Init has exited. Terminating distribution
[  +0.484884] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000574] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000445] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000516] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -2
[  +0.409779] Exception: 
[  +0.000003] Operation canceled @p9io.cpp:258 (AcceptAsync)

[  +0.000963] WSL (1) ERROR: InitEntryUtilityVm:2273: Init has exited. Terminating distribution
[  +0.529965] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000633] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000443] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22
[  +0.000539] misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -2
[May27 07:04] overlayfs: idmapped layers are currently not supported
[May27 07:08] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to [email protected] if you depend on this functionality.


==> kernel <==
 10:44:58 up  3:44,  0 users,  load average: 0.16, 0.12, 0.04
Linux minikube 5.15.146.1-microsoft-standard-WSL2 #1 SMP Thu Jan 11 04:09:03 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"


==> kubelet <==
May 27 10:43:39 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
May 27 10:43:40 minikube kubelet[929]: E0527 10:43:40.003524     929 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory"
May 27 10:43:40 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE
May 27 10:43:40 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
May 27 10:43:40 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1.
May 27 10:43:40 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
May 27 10:43:40 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
May 27 10:43:40 minikube systemd[1]: Stopping kubelet: The Kubernetes Node Agent...
May 27 10:43:40 minikube systemd[1]: kubelet.service: Deactivated successfully.
May 27 10:43:40 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.

Operating System

Redhat/Fedora

Driver

Podman

@hilmeeen
Copy link

I got the same error with WSL2 Fedora

@mulan04
Copy link
Author

mulan04 commented Sep 11, 2024

just for the record - the initially described issue does NOT happen any longer in the constellation WSL2 / podman 5.2.2 / minikube 1.34.0 on Fedora 40 after following Answer 42 from https://stackoverflow.com/questions/73021599/how-to-enable-cgroup-v2-in-wsl2

@mulan04 mulan04 closed this as completed Sep 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants