Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Podman commands info, pull and others do not work with Podman 5.0.1 on windows using podman machine #22439

Closed
odockal opened this issue Apr 19, 2024 · 17 comments
Closed

Podman commands info, pull and others do not work with Podman 5.0.1 on windows using podman machine #22439

odockal opened this issue Apr 19, 2024 · 17 comments
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. machine windows issue/bug on Windows

Comments

@odockal
Copy link

odockal commented Apr 19, 2024

Issue Description

On windows using rootful podman machine, if I try to pull an image:

podman pull alpine
Cannot connect to Podman. Please verify your connection to the Linux system using `podman system connection list`, or try `podman machine init` and `podman machine start` to manage a new Linux VM
Error: unable to connect to Podman socket: Get "http://d/v5.0.1/libpod/_ping": ssh: rejected: connect failed (open failed)

or podman info

podman info
OS: windows/amd64
provider: wsl
version: 5.0.1

Cannot connect to Podman. Please verify your connection to the Linux system using `podman system connection list`, or try `podman machine init` and `podman machine start` to manage a new Linux VM
Error: unable to connect to Podman socket: Get "http://d/v5.0.1/libpod/_ping": ssh: rejected: connect failed (open failed)

Steps to reproduce the issue

Steps to reproduce the issue

  1. Installs Podman 5.0.1
  2. podman machine init --rootful --now
  3. podman pull alpine
  4. one can also run podman info to get the same result

Describe the results you received

Cannot connect to Podman. Please verify your connection to the Linux system using podman system connection list, or try podman machine init and podman machine start to manage a new Linux VM
Error: unable to connect to Podman socket: Get "http://d/v5.0.1/libpod/_ping": ssh: rejected: connect failed (open failed)

Describe the results you expected

Pulled image.

podman info output

podman info
OS: windows/amd64
provider: wsl
version: 5.0.1

Cannot connect to Podman. Please verify your connection to the Linux system using `podman system connection list`, or try `podman machine init` and `podman machine start` to manage a new Linux VM
Error: unable to connect to Podman socket: Get "http://d/v5.0.1/libpod/_ping": ssh: rejected: connect failed (open failed)

podman -v
podman.exe version 5.0.1

podman version
Cannot connect to Podman. Please verify your connection to the Linux system using `podman system connection list`, or try `podman machine init` and `podman machine start` to manage a new Linux VM
Error: unable to connect to Podman socket: Get "http://d/v5.0.1/libpod/_ping": ssh: rejected: connect failed (open failed)

Podman in a container

No

Privileged Or Rootless

Privileged

Upstream Latest Release

Yes

Additional environment details

Windows 10, using wsl as hypervisor.

Additional information

podman pull alpine
Cannot connect to Podman. Please verify your connection to the Linux system using `podman system connection list`, or try `podman machine init` and `podman machine start` to manage a new Linux VM
Error: unable to connect to Podman socket: Get "http://d/v5.0.1/libpod/_ping": ssh: rejected: connect failed (open failed)
PS C:\Users\podmanqe> podman machine ssh
Connecting to vm podman-machine-default. To close connection, use `~.` or `exit`
[root@DESKTOP-U7FRUQA ~]# podman pull alpine
WARN[0000] Using cgroups-v1 which is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `PODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning.
Error:
[root@DESKTOP-U7FRUQA ~]# podman -v
podman version 5.1.0-dev-04bd1b1a2
@odockal odockal added the kind/bug Categorizes issue or PR as related to a bug. label Apr 19, 2024
@Luap99
Copy link
Member

Luap99 commented Apr 19, 2024

Is this a dup of #22423? Can you check your system connections?

@odockal
Copy link
Author

odockal commented Apr 19, 2024

@Luap99 Likely not, this is windows. This one is more close to what I am seeing: #22373.

Although I decide to open new issue to provide different steps to reproduce.
Problem is the podman-machine-wsl-os image. Latest image used as of today that being used in 5.0.2, 5.0.1 and 5.0.0 podman to create a machine prevent usage of rootful connection. In general podman > 5.0.0 always uses latest image, so no specific micro to be blamed.

I tried image from 2021-04-09 and it works.
This one image works nice: https://github.com/containers/podman-machine-wsl-os/releases/tag/v20240409161947

@Luap99
Copy link
Member

Luap99 commented Apr 19, 2024

Can you check systemctl status podman.service and systemctl status podman.socket in WSL to see if the service reports any errors? Also check journalctl -u podman.service if you don't see anything wrong there.

@n1hility @baude PTAL! Looks like windows images are broken.

@Luap99 Luap99 added machine windows issue/bug on Windows labels Apr 19, 2024
@odockal
Copy link
Author

odockal commented Apr 19, 2024

So this one v20240418122826 is broken.

This one works: v20240417162145.

@odockal
Copy link
Author

odockal commented Apr 19, 2024 •
edited
Loading

Can you check systemctl status podman.service and systemctl status podman.socket in WSL to see if the service reports any errors? Also check journalctl -u podman.service if you don't see anything wrong there.

@n1hility @baude PTAL! Looks like windows images are broken.

the latest image had the service down. Let me find image that broke it, I am close.

@odockal
Copy link
Author

odockal commented Apr 19, 2024 •
edited
Loading

We got a winner: https://github.com/containers/podman-machine-wsl-os/releases/tag/v20240417182849

@odockal
Copy link
Author

odockal commented Apr 19, 2024

Some of these changes broke it:

aardvark-dns                   1.10.0-1.20240417165604887829.main.37.g01d8574.fc39
containers-common              0.58.0-10.fc39
containers-common-extra        0.58.0-10.fc39
podman                         5.1.0~dev-1.20240417173120067584.main.267.60e0ef3e0.fc39
podman-docker                  5.1.0~dev-1.20240417173120067584.main.267.60e0ef3e0.fc39

@Luap99
Copy link
Member

Luap99 commented Apr 19, 2024

Please show the logs of the service, what is the error?

@odockal
Copy link
Author

odockal commented Apr 19, 2024 

systemctl status podman.service
× podman.service - Podman API Service
     Loaded: loaded (/usr/lib/systemd/system/podman.serv
ice; disabled; preset: disabled)
    Drop-In: /usr/lib/systemd/system/service.d
             └─10-timeout-abort.conf
     Active: failed (Result: exit-code) since Fri 2024-04-19 04:34:41 PDT; 1min 56s ago
   Duration: 35ms
TriggeredBy: × podman.socket
       Docs: man:podman-system-service(1)
    Process: 439 ExecStart=/usr/bin/podman $LOGGING system service (code=exited, status=125)
   Main PID: 439 (code=exited, status=125)

Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.

systemctl status podman.socket
× podman.socket - Podman API Socket
     Loaded: loaded (/usr/lib/systemd/system/podman.socke
t; enabled; preset: disabled)
    Drop-In: /etc/systemd/system/podman.socket.d
             └─10-group.conf
     Active: failed (Result: trigger-limit-hit) since Fri 2024-04-19 04:34:41 PDT; 2min 29s ago
   Duration: 4.000s
   Triggers: ● podman.service
       Docs: man:podman-system-service(1)
     Listen: /run/podman/podman.sock (Stream)

Apr 19 04:34:37 DESKTOP-U7FRUQA systemd[1]: Starting podman.socket - Podman API Socket...
Apr 19 04:34:37 DESKTOP-U7FRUQA systemd[1]: Listening on podman.socket - Podman API Socket.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.socket: Trigger limit hit, refusi
ng further activation.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.socket: Failed with result 'trigg
er-limit-hit'.

@odockal
Copy link
Author

odockal commented Apr 19, 2024 

journalctl -u podman.service
Apr 19 04:34:39 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:39 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:39 DESKTOP-U7FRUQA podman[154]: time="2024-04-19T04:34:39-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:39 DESKTOP-U7FRUQA podman[154]: time="2024-04-19T04:34:39-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:39 DESKTOP-U7FRUQA podman[154]: time="2024-04-19T04:34:39-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[154]: Error: invalid argument
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[185]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[185]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[185]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[185]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[195]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[195]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[195]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[195]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[220]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[220]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[220]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[220]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[254]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[254]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[254]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[254]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[263]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[263]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[263]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[263]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[274]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[274]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[274]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[274]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[283]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[283]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[283]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[283]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[291]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[291]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[291]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[291]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[300]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[300]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[300]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[300]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[310]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[310]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[310]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[310]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[319]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[319]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[319]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[319]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[329]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[329]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[329]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[329]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[339]: time="2024-04-19T04:34:40-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[339]: time="2024-04-19T04:34:40-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[339]: time="2024-04-19T04:34:40-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:40 DESKTOP-U7FRUQA podman[339]: Error:
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:40 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[349]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[349]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[349]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[349]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[360]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[360]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[360]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[360]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[370]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[370]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[370]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[370]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[379]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[379]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[379]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[379]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[389]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[389]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[389]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[389]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[399]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[399]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[399]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[399]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[409]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[409]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[409]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[409]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[419]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[419]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[419]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[419]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[429]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[429]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[429]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[429]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Starting podman.service - Podman API Service...
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: Started podman.service - Podman API Service.
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: time="2024-04-19T04:34:41-07:00" level=info msg="/usr/bin/podman filtering
at log level info"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: time="2024-04-19T04:34:41-07:00" level=info msg="Using sqlite as database b
ackend"
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: time="2024-04-19T04:34:41-07:00" level=warning msg="Using cgroups-v1 which
is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `P
ODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: Error:
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Main process exited, code=exited, st
atus=125/n/a
Apr 19 04:34:41 DESKTOP-U7FRUQA systemd[1]: podman.service: Failed with result 'exit
-code'.

@Luap99
Copy link
Member

Luap99 commented Apr 19, 2024

Thanks, this looks bad!

Apr 19 04:34:41 DESKTOP-U7FRUQA podman[439]: Error:

The error message is just missing (empty) for whatever reason, so it impossible to tell what what the real service error cause is.

@odockal odockal mentioned this issue Apr 19, 2024
Open
@tnk4on
Copy link
Contributor

tnk4on commented Apr 19, 2024

The debug level logs are as follows.

[root@WINGPU user]# grep log /usr/lib/systemd/system/podman.service
Environment=LOGGING="--log-level=debug"
[root@WINGPU user]# systemctl daemon-reload
[root@WINGPU user]# systemctl restart podman.service
[root@WINGPU user]# journalctl -n 26
Apr 19 21:07:43 WINGPU systemd[1]: Reloading requested from client PID 558 ('systemctl') (unit session-c3.scope)...
Apr 19 21:07:43 WINGPU systemd[1]: Reloading...
Apr 19 21:07:43 WINGPU systemd[1]: Reloading finished in 105 ms.
Apr 19 21:08:10 WINGPU systemd[1]: Starting podman.service - Podman API Service...
Apr 19 21:08:10 WINGPU systemd[1]: Started podman.service - Podman API Service.
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=info msg="/usr/bin/podman filtering at log level debug"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Called service.PersistentPreRunE(/usr/bin/podman --log-level=debug system service)"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Using conmon: \"/usr/bin/conmon\""
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=info msg="Using sqlite as database backend"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=warning msg="Using cgroups-v1 which is deprecated in favor of cgroups-v2 with Podman v5 and will be removed in a future version. Set environment variable `PODMAN_IGNORE_CGROUPSV1_WARNING` to hide this warning."
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Using graph driver overlay"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Using graph root /var/lib/containers/storage"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Using run root /run/containers/storage"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Using static dir /var/lib/containers/storage/libpod"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Using tmp dir /run/libpod"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Using volume path /var/lib/containers/storage/volumes"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Using transient store: false"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="[graphdriver] trying provided driver \"overlay\""
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="overlay: imagestore=/usr/lib/containers/storage"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="overlay: use_composefs=true"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Cached value indicated that overlay is supported"
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Cached value indicated that data-only layers for overlay are not supported"
Apr 19 21:08:10 WINGPU podman[590]: Error:
Apr 19 21:08:10 WINGPU podman[590]: time="2024-04-19T21:08:10+09:00" level=debug msg="Shutting down engines"
Apr 19 21:08:10 WINGPU systemd[1]: podman.service: Main process exited, code=exited, status=125/n/a
Apr 19 21:08:10 WINGPU systemd[1]: podman.service: Failed with result 'exit-code'.

@Luap99
Copy link
Member

Luap99 commented Apr 19, 2024

containers-common 0.58.0-10.fc39

This is the broken update, it enabled composefs which never should have happen, #22417

There a series of bigger problems here, first podman-next brings in broken rawhide changes. I think @lsm5 works on improving the flow for contianers-common to follow upstream changes with packit like done for our other packages (containers/common#1960) which should hopefully prevent us shipping bad changes like that.

Second, why are shipping daily updates from podman-next in our podman-machine WSL images? Shouldn't this be stable and not use development snapshots?

And lastly why the hell is no error message being reported, that is some real bug within podman. I still need to debug this.

@Luap99 Luap99 mentioned this issue Apr 19, 2024
Open
@Luap99
Copy link
Member

Luap99 commented Apr 19, 2024

And lastly why the hell is no error message being reported, that is some real bug within podman. I still need to debug this.

c/storage returns empty errors, filled a issue for this: containers/storage#1891

@n1hility
Copy link
Member

n1hility commented Apr 19, 2024 •
edited
Loading

I have rolled the stream back to v20240417162145. As soon as there is a fix will pull in the new one and restart updates

@n1hility
Copy link
Member

Thanks for the catching this!

@odockal odockal mentioned this issue Jun 17, 2024
Closed
@cmoulliard
Copy link

cmoulliard commented Jun 27, 2024 •
edited
Loading

This error also occurs on macos

podman info
OS: darwin/arm64
provider: applehv
version: 5.0.3

Cannot connect to Podman. Please verify your connection to the Linux system using `podman system connection list`, or try `podman machine init` and `podman machine start` to manage a new Linux VM
Error: unable to connect to Podman socket: Get "http://d/v5.0.3/libpod/_ping": ssh: rejected: connect failed (open failed)

and

podman machine ssh
Connecting to vm podman-machine-default. To close connection, use `~.` or `exit`
Fedora CoreOS 40.20240504.2.0
Tracker: https://github.com/coreos/fedora-coreos-tracker
Discuss: https://discussion.fedoraproject.org/tag/coreos

Last login: Thu Jun 27 16:29:37 2024
[systemd]
Failed Units: 5
  console-login-helper-messages-gensnippet-ssh-keys.service
  coreos-ignition-write-issues.service
  fwupd-refresh.service
  podman.service
  podman.socket
Error: updating container state: unable to open database file: no such file or directory

and 

root@localhost:~# df -h
Filesystem                            Size  Used Avail Use% Mounted on
/dev/vda4                             100G  100G   44K 100% /sysroot
...

So why is /sysroot full and how can we fix that ?

Remark: Increasing the disk size of the VM using dpoman desktop don't fix the problem

@stale-locking-app stale-locking-app bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Sep 26, 2024
@stale-locking-app stale-locking-app bot locked as resolved and limited conversation to collaborators Sep 26, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. machine windows issue/bug on Windows
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@n1hility @cmoulliard @odockal @ashley-cui @Luap99 @tnk4on