Skip to content

How's the NPU support? Does Jan utilize NPUs? #3523

Answered by imtuyethan
imtuyethan asked this question in Get Help
Discussion options

You must be logged in to vote

We have an experimental implementation of ONNX, but are having some issues targeting the Snapdragon NPU.
Current Status

  • The current status is that it works (?) somewhat with the Adreno GPU, but we haven't gotten it to work on the NPU
  • We are currently busy implementing the Cortex CLI, but should be done in sprint 19 (6 August 2024)

Replies: 1 comment 1 reply

Comment options

imtuyethan
Sep 2, 2024
Maintainer Author

You must be logged in to vote
1 reply
@Neard-AI
Comment options

Answer selected by imtuyethan
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants