Skip to content

Commit

Permalink
remove torch.git.script for squared_relu for 24.09
Browse files Browse the repository at this point in the history
Signed-off-by: Huiying Li <[email protected]>
  • Loading branch information
HuiyingLi committed Oct 30, 2024
1 parent 746611b commit 1430ee4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion nemo/collections/llm/fn/activation.py
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ def openai_gelu(x):
return gelu_impl(x)


@torch.jit.script
#@torch.jit.script # remove until we have serialization
def squared_relu(x):
"""Squared ReLU activation function."""
return torch.pow(torch.nn.functional.relu(x), 2)

0 comments on commit 1430ee4

Please sign in to comment.