New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

加速版AdderNet #44

Open

beiliu253 opened this issue Feb 20, 2021 · 1 comment

beiliu253 commented Feb 20, 2021 •

edited

Loading

您好，请问一下加速版AdderNet什么时候可以发布？之前有人问过这个问题，但是现在好像还没有(或者我没有找到)。
目前想将AdderNet用于其他领域的一些任务，但是由于训练速度太慢和GPU显存占用太高，目前版本的AdderNet实际中几乎无法使用。

感谢🙏🙏

yiakwy commented Mar 16, 2021

@beiliu253 可以自行编写 cuda kernel ，加分用reduce算法优化；梯度部分，可以使用推导出来的数值梯度。直接用portorch的python版本发论文，很没有诚意。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment