problem in gemma 2 27b

[Alireza3242]

I want to awq gemma2 27b. but this awq get error with my Persian data.
I debugged the code in awq lib. In Gemma2DecoderLayer class:
The number hidden_states[0][0][4140] increases in the layers of the model and reaches infinity. Then all calculations are converted to nan.

I dont know how to solve the problem.