Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于整个框架的几个问题,请给建议。 #46

Open
myfreshcity opened this issue Aug 24, 2024 · 1 comment
Open

关于整个框架的几个问题,请给建议。 #46

myfreshcity opened this issue Aug 24, 2024 · 1 comment

Comments

@myfreshcity
Copy link

1,如果动态配置参数文件。是不是通过界面完成后只能重启程序,是否支持热加载。另外,如果重启怎么解决会打断正在运行的任务的情况呢?
2,stream框架除了易用上手这个由于SDK外,在运行效率上有无优势?如果有,具体体现在哪里?
3,stream框架的整体运行性能优化也是通过进程调度实现的吗? 如果对框架的进程进行管理和优化?
4,有无插件可以了解整体边缘设备负载,这样可以评估边缘设备整体的推理能力?

@Yi-sir
Copy link

Yi-sir commented Aug 25, 2024

  1. 支持动态修改参数,可以参考yolov5插件的readme
  2. 它就是个流水线,基本上能吃满推理性能。用户自己写也行,如果实现思路相似的话不会有很大差异
  3. stream只有一个进程,里面是一堆线程循环跑具体的功能。说优化也没啥大的优化空间可能,可以把循环用条件变量控制一下,也许可以降低cpu利用率
  4. 没有单独的插件能做到,无论如何也得是解码加一个模型一起跑

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants