Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

mha enhance #180

Merged
merged 2 commits into from
Mar 21, 2024
Merged

mha enhance #180

merged 2 commits into from
Mar 21, 2024

Conversation

yuchengliu1
Copy link
Contributor

Type of Change

Fix bug

Description

exp in MHA will overflow in some case.

Expected Behavior & Potential Risk

the expected behavior that triggered by this PR

How has this PR been tested?

how to reproduce the test (including hardware information)

Dependency Change?

any library dependency introduced or removed

@yuchengliu1 yuchengliu1 requested a review from DDEle March 20, 2024 07:40
@airMeng airMeng merged commit 35c6d10 into main Mar 21, 2024
12 checks passed
@kevinintel
Copy link
Contributor

please benchamrk the performance data of
#137 with this PR

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants