Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Error running on github workflow #347

Open
bdlukaa opened this issue Feb 28, 2024 · 5 comments · May be fixed by #348 or #350
Open

Error running on github workflow #347

bdlukaa opened this issue Feb 28, 2024 · 5 comments · May be fixed by #348 or #350

Comments

@bdlukaa
Copy link

bdlukaa commented Feb 28, 2024

In the following job, my workflow is failing. You can see the workflow result here.

      - name: Build AppImage
        run: |
          sudo pip3 install git+https://github.com/AppImageCrafters/appimage-builder.git
          appimage-builder --skip-tests
Workflow result 
Run sudo pip3 install git+https://github.com/AppImageCrafters/appimage-builder.git
Collecting git+https://github.com/AppImageCrafters/appimage-builder.git
  Cloning https://github.com/AppImageCrafters/appimage-builder.git to /tmp/pip-req-build-6e4c[9](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:10)rct
  Running command git clone --filter=blob:none --quiet https://github.com/AppImageCrafters/appimage-builder.git /tmp/pip-req-build-6e4c9rct
  Resolved https://github.com/AppImageCrafters/appimage-builder.git to commit 61c8ddde9ef44b85d7444bbe79d80b44a6a5576d
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting docker
  Downloading docker-7.0.0-py3-none-any.whl (147 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.6/147.6 KB 8.3 MB/s eta 0:00:00
Collecting emrichen
  Downloading emrichen-0.4.0-py3-none-any.whl (34 kB)
Collecting libconf
  Downloading libconf-2.0.1-py2.py3-none-any.whl (11 kB)
Collecting lief
  Downloading lief-0.14.1-cp3[10](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:11)-cp310-manylinux_2_28_x86_64.manylinux_2_27_x86_64.whl (2.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.7/2.7 MB 94.2 MB/s eta 0:00:00
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from appimage-builder==1.1.1.dev61+g61c8ddd) (23.2)
Collecting pydpkg
  Downloading pydpkg-1.9.2-py3-none-any.whl (15 kB)
Collecting python-gnupg
  Downloading python_gnupg-0.5.2-py2.py3-none-any.whl (20 kB)
Requirement already satisfied: pyyaml>=5 in /usr/lib/python3/dist-packages (from appimage-builder==1.1.1.dev61+g61c8ddd) (5.4.1)
Collecting questionary
  Downloading questionary-2.0.1-py3-none-any.whl (34 kB)
Requirement already satisfied: requests in /usr/lib/python3/dist-packages (from appimage-builder==1.1.1.dev61+g61c8ddd) (2.25.1)
Collecting roam
  Downloading roam-0.3.1-py3-none-any.whl (33 kB)
Collecting ruamel.yaml
  Downloading ruamel.yaml-0.18.6-py3-none-any.whl ([11](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:12)7 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.8/117.8 KB 49.3 MB/s eta 0:00:00
Collecting schema
  Downloading schema-0.7.5-py2.py3-none-any.whl (17 kB)
Requirement already satisfied: urllib3 in /usr/lib/python3/dist-packages (from appimage-builder==1.1.1.dev61+g61c8ddd) (1.26.5)
Collecting requests
  Downloading requests-2.31.0-py3-none-any.whl (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 KB 33.0 MB/s eta 0:00:00
Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests->appimage-builder==1.1.1.dev61+g61c8ddd) (3.3)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests->appimage-builder==1.1.1.dev61+g61c8ddd) (2020.6.20)
Collecting charset-normalizer<4,>=2
  Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 142.1/142.1 KB 54.4 MB/s eta 0:00:00
Collecting jsonpath-rw~=1.4.0
  Downloading jsonpath-rw-1.4.0.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting pyaml~=21.10
  Downloading pyaml-21.10.1-py2.py3-none-any.whl (24 kB)
Collecting zstandard<0.20.0,>=0.19.0
  Downloading zstandard-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.5/2.5 MB 110.2 MB/s eta 0:00:00
Collecting arpy<3.0.0,>=2.3.0
  Downloading arpy-2.3.0.tar.gz (9.6 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting PGPy==0.6.0
  Downloading PGPy-0.6.0.tar.gz (603 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 603.0/603.0 KB 104.5 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting cryptography>=39.0.1
  Downloading cryptography-42.0.3-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 115.5 MB/s eta 0:00:00
Requirement already satisfied: six<2.0.0,>=1.16.0 in /usr/lib/python3/dist-packages (from pydpkg->appimage-builder==1.1.1.dev61+g61c8ddd) (1.16.0)
Requirement already satisfied: pyasn1 in /usr/lib/python3/dist-packages (from PGPy==0.6.0->pydpkg->appimage-builder==1.1.1.dev61+g61c8ddd) (0.4.8)
Collecting prompt_toolkit<=3.0.36,>=2.0
  Downloading prompt_toolkit-3.0.36-py3-none-any.whl (386 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 386.4/386.4 KB 86.7 MB/s eta 0:00:00
Collecting ruamel.yaml.clib>=0.2.7
  Downloading ruamel.yaml.clib-0.2.8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (526 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 526.7/526.7 KB 96.3 MB/s eta 0:00:00
Collecting contextlib2>=0.5.5
  Downloading contextlib2-21.6.0-py2.py3-none-any.whl (13 kB)
Collecting cffi>=1.[12](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:13)
  Downloading cffi-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (443 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 443.9/443.9 KB 89.1 MB/s eta 0:00:00
Collecting decorator
  Downloading decorator-5.1.1-py3-none-any.whl (9.1 kB)
Collecting ply
  Downloading ply-3.11-py2.py3-none-any.whl (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.6/49.6 KB 25.1 MB/s eta 0:00:00
Collecting wcwidth
  Downloading wcwidth-0.2.[13](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:14)-py2.py3-none-any.whl (34 kB)
Collecting pycparser
  Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 KB 52.6 MB/s eta 0:00:00
Building wheels for collected packages: appimage-builder, PGPy, arpy, jsonpath-rw
  Building wheel for appimage-builder (setup.py): started
  Building wheel for appimage-builder (setup.py): finished with status 'done'
  Created wheel for appimage-builder: filename=appimage_builder-1.1.1.dev61+g61c8ddd-py3-none-any.whl size=171158 sha256=4de395bb267d67544c8107e32a6d6d08a7427c2122deedce6457390af319d21c
  Stored in directory: /tmp/pip-ephem-wheel-cache-6btqdmg7/wheels/30/bc/d7/b321f2f47e3c5b50b507a258934e09880d90ff368c6892ec24
  Building wheel for PGPy (pyproject.toml): started
  Building wheel for PGPy (pyproject.toml): finished with status 'done'
  Created wheel for PGPy: filename=PGPy-0.6.0-py3-none-any.whl size=84172 sha256=9193f02e65340d94954f7407db5993d3b1577cdad5856577b4e4d2e44f05cbcd
  Stored in directory: /root/.cache/pip/wheels/98/43/cf/8b931d43f64c6f48ae00c993740daeca9edf95074ff13faf8a
  Building wheel for arpy (setup.py): started
  Building wheel for arpy (setup.py): finished with status 'done'
  Created wheel for arpy: filename=arpy-2.3.0-py3-none-any.whl size=6197 sha256=72a16d2da0dd8580d1692af0e2efcc9f61f2869c5ec45c1720adc9455bc25d34
  Stored in directory: /root/.cache/pip/wheels/48/a6/15/ea1b47129ab3ca92d6717df9698113ed7d8c2a9ab31c137fd8
  Building wheel for jsonpath-rw (setup.py): started
  Building wheel for jsonpath-rw (setup.py): finished with status 'done'
  Created wheel for jsonpath-rw: filename=jsonpath_rw-1.4.0-py3-none-any.whl size=15[14](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:15)9 sha256=d184045bb5266869d1caa321f84e89552a3ced1c207edf49db0bbdf2bfda8d12
  Stored in directory: /root/.cache/pip/wheels/e3/76/6f/c25be6a9e6cc9985b96e8c95997d46790242c6426ef68e754c
Successfully built appimage-builder PGPy arpy jsonpath-rw
Installing collected packages: wcwidth, python-gnupg, ply, libconf, arpy, zstandard, ruamel.yaml.clib, roam, pycparser, pyaml, prompt_toolkit, lief, decorator, contextlib2, charset-normalizer, schema, ruamel.yaml, requests, questionary, jsonpath-rw, cffi, emrichen, docker, cryptography, PGPy, pydpkg, appimage-builder
  Attempting uninstall: requests
    Found existing installation: requests 2.25.1
    Not uninstalling requests at /usr/lib/python3/dist-packages, outside environment /usr
    Can't uninstall 'requests'. No files were found to uninstall.
  Attempting uninstall: cryptography
    Found existing installation: cryptography 3.4.8
    Not uninstalling cryptography at /usr/lib/python3/dist-packages, outside environment /usr
    Can't uninstall 'cryptography'. No files were found to uninstall.
Successfully installed PGPy-0.6.0 appimage-builder-1.1.1.dev61+g61c8ddd arpy-2.3.0 cffi-1.[16](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:17).0 charset-normalizer-3.3.2 contextlib2-21.6.0 cryptography-42.0.3 decorator-5.1.1 docker-7.0.0 emrichen-0.4.0 jsonpath-rw-1.4.0 libconf-2.0.1 lief-0.14.1 ply-3.11 prompt_toolkit-3.0.36 pyaml-21.10.1 pycparser-2.21 pydpkg-1.9.2 python-gnupg-0.5.2 questionary-2.0.1 requests-2.31.0 roam-0.3.1 ruamel.yaml-0.[18](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:19).6 ruamel.yaml.clib-0.2.8 schema-0.7.5 wcwidth-0.2.13 zstandard-0.[19](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:20).0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/schema.py", line 443, in validate
    return s.validate(data, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/schema.py", line 4[20](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:21), in validate
    raise SchemaMissingKeyError(message, e.format(data) if e else None)
schema.SchemaMissingKeyError: Missing key: 'comp'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/schema.py", line [40](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:41)5, in validate
    nvalue = Schema(svalue, error=e, ignore_extra_keys=i).validate(value, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/schema.py", line [44](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:45)5, in validate
    raise SchemaError([None] + x.autos, [e.format(data) if e else None] + x.errors)
schema.SchemaError: Missing key: 'comp'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/appimage-builder", line 8, in <module>
    sys.exit(__main__())
  File "/usr/local/lib/python3.10/dist-packages/appimagebuilder/__main__.py", line 44, in __main__
    schema.validate(recipe_roamer)
  File "/usr/local/lib/python3.10/dist-packages/appimagebuilder/recipe/schema.py", line [114](https://github.com/bluecherrydvr/unity/actions/runs/7949704191/job/21701168853#step:13:115), in validate
    return self.v1.validate(recipe(resolve_variables=False))
  File "/usr/local/lib/python3.10/dist-packages/schema.py", line 409, in validate
    raise SchemaError([message] + x.autos, [e.format(data) if e else None] + x.errors)
schema.SchemaError: Key 'AppImage' error:
Missing key: 'comp'
Error: Process completed with exit code 1.

I am not sure on what's wrong. It started to fail 3 weeks ago (at this commit) without any changes to the workflow.
@goldstar611
Copy link
Contributor

goldstar611 commented Feb 29, 2024 •
edited
Loading

Looks like commit af45b1b added a new recipe option comp that is not marked as optional and there is no default value.

@bdlukaa
Copy link
Author

bdlukaa commented Mar 5, 2024

Did you happen to get a fix?

@goldstar611
Copy link
Contributor

Did you happen to get a fix?

yes, it's an easy fix. Just add a comp line to your recipe. You can choose xz, gzip or none for the compression method apparently.

AppImage:
  sign-key: None
  arch: ${TARGET_ARCH_APPIMAGE}
  comp: xz

@bdlukaa
Copy link
Author

bdlukaa commented Mar 5, 2024

I tried to use comp: None but it doesn't seem to work. It fails saying that None is not a valid compression type.

What is the output when compressed? I want the .AppImage file without needing to decompress it.

goldstar611 added a commit to goldstar611/appimage-builder that referenced this issue Mar 5, 2024
@goldstar611
Fix AppImageCrafters#347: No data compression
eac1c50 
mksquashfs has an option `-no-compression` [1] but it seems to have been released about 10 months ago [2] and not widely available, especially on older OS installations.

Switch to a more widely available `-noDatacompression` option instead. [3] [4]

1. https://www.mankier.com/1/mksquashfs
2. https://github.com/plougher/squashfs-tools/blame/1c791c5bdd2307458088e1f0821d9cefd14e0c96/README-4.6.1#L83
3. https://manpages.debian.org/jessie/squashfs-tools/mksquashfs.1.en.html
4. https://manpages.ubuntu.com/manpages/focal/man1/mksquashfs.1.html
@goldstar611 goldstar611 linked a pull request Mar 5, 2024 that will close this issue
Open
@goldstar611
Copy link
Contributor

I tried to use comp: None but it doesn't seem to work. It fails saying that None is not a valid compression type.

What is the output when compressed? I want the .AppImage file without needing to decompress it.

Use gzip or xz compression for now and when #348 is merged then you should be able to use None

@MeltyObserver MeltyObserver linked a pull request Mar 30, 2024 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
2 participants
@goldstar611 @bdlukaa