Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

在Npu环境上并没有使用npu进行推理 #1383

Open
liujiachang opened this issue Aug 22, 2024 · 2 comments
Open

在Npu环境上并没有使用npu进行推理 #1383

liujiachang opened this issue Aug 22, 2024 · 2 comments
Assignees

Comments

@liujiachang
Copy link

每个图片第一次被推理的时候速度都非常慢(10~100秒),第二次被推理时正常(0.5s)。并且第一次推理AICore利用率为0.
代码为PaddleOCR代码,运行ppstructure/predict_system.py。
image
image

@YanhuiDua
Copy link
Collaborator

你好,关于第一次推理慢的问题,请参考 #1118

@liujiachang
Copy link
Author

我看过了,最后的结论就是warmup么,检测模型的输入是固定的,但是识别不固定所以只warmup识别模型就可以了吧,我观察我的推理时间也都是卡在识别。但是我的识别模型输入的图片已经将近1000张,他的速度仍然很慢。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants