Tiktoken Docker on Raspbeey PI

[AlejandroIglesiasCalvo]

Hello, I'm working on this Bot on a Raspberry Pi. I use Github Actions to compile different versions, but the compilation for arm v7 is of greater interest to me. The problem is that the tiktoken library doesn't have wheels for armv7. I would like to know if someone has managed to patch this or avoid the problem. Specifically, I managed to avoid it at the cost of losing all usage calculations. That is, without using tiktoken. The error that generates is:

#10 415.8 Building wheels for collected packages: tiktoken, regex, aiohttp, frozenlist, multidict, yarl
#10 415.8 Building wheel for tiktoken (pyproject.toml): started
#10 424.5 Building wheel for tiktoken (pyproject.toml): finished with status 'error'
#10 424.6 error: subprocess-exited-with-error
#10 424.6
#10 424.6 × Building wheel for tiktoken (pyproject.toml) did not run successfully.
#10 424.6 │ exit code: 1
#10 424.6 ╰─> [39 lines of output]
#10 424.6 running bdist_wheel
#10 424.6 running build
#10 424.6 running build_py
#10 424.6 creating build
#10 424.6 creating build/lib.linux-armv7l-cpython-39
#10 424.6 creating build/lib.linux-armv7l-cpython-39/tiktoken
#10 424.6 copying tiktoken/load.py -> build/lib.linux-armv7l-cpython-39/tiktoken
#10 424.6 copying tiktoken/init.py -> build/lib.linux-armv7l-cpython-39/tiktoken
#10 424.6 copying tiktoken/core.py -> build/lib.linux-armv7l-cpython-39/tiktoken
#10 424.6 copying tiktoken/registry.py -> build/lib.linux-armv7l-cpython-39/tiktoken
#10 424.6 copying tiktoken/model.py -> build/lib.linux-armv7l-cpython-39/tiktoken
#10 424.6 creating build/lib.linux-armv7l-cpython-39/tiktoken_ext
#10 424.6 copying tiktoken_ext/openai_public.py -> build/lib.linux-armv7l-cpython-39/tiktoken_ext
#10 424.6 running egg_info
#10 424.6 writing tiktoken.egg-info/PKG-INFO
#10 424.6 writing dependency_links to tiktoken.egg-info/dependency_links.txt
#10 424.6 writing requirements to tiktoken.egg-info/requires.txt
#10 424.6 writing top-level names to tiktoken.egg-info/top_level.txt
#10 424.6 reading manifest file 'tiktoken.egg-info/SOURCES.txt'
#10 424.6 reading manifest template 'MANIFEST.in'
#10 424.6 warning: no files found matching 'Makefile'
#10 424.6 adding license file 'LICENSE'
#10 424.6 writing manifest file 'tiktoken.egg-info/SOURCES.txt'
#10 424.6 copying tiktoken/py.typed -> build/lib.linux-armv7l-cpython-39/tiktoken
#10 424.6 warning: build_py: byte-compiling is disabled, skipping.
#10 424.6
#10 424.6 running build_ext
#10 424.6 running build_rust
#10 424.6 error: can't find Rust compiler
#10 424.6
#10 424.6 If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.
#10 424.6
#10 424.6 To update pip, run:
#10 424.6
#10 424.6 pip install --upgrade pip
#10 424.6
#10 424.6 and then retry package installation.
#10 424.6
#10 424.6 If you did intend to build this package from source, try installing a Rust compiler from your system package manager and ensure it is on the PATH during installation. Alternatively, rustup (available at https://rustup.rs) is the recommended way to download and update the Rust compiler toolchain.
#10 424.6 [end of output]
#10 424.6
#10 424.6 note: This error originates from a subprocess, and is likely not a problem with pip.
#10 424.7 ERROR: Failed building wheel for tiktoken

Mi DockerFile:
FROM python:3.9-alpine

ENV PYTHONFAULTHANDLER=1
PYTHONUNBUFFERED=1
PYTHONDONTWRITEBYTECODE=1
PIP_DISABLE_PIP_VERSION_CHECK=on

RUN apk --no-cache add ffmpeg

WORKDIR /app
COPY . .
RUN pip install -r requirements.txt --no-cache-dir

CMD ["python", "bot/main.py"]