The Order Indicator

[JudgeLJX]

Hi, Thanks for your work.

Could you tell me is there the order indicator code here? although there is no spacing curve in the current code.
If not, could you please share this part of the code if possible?

Best Regards

[LMD0311]

Apologies for the delayed response. Due to a busy schedule, I have not yet organized the code. Here’s an example of the order indicator:

self.OrderScale_gamma_1, self.OrderScale_beta_1 = init_OrderScale(self.trans_dim)

def init_OrderScale(dim):
    gamma = nn.Parameter(torch.ones(dim))
    beta = nn.Parameter(torch.zeros(dim))
    nn.init.normal_(gamma, mean=1, std=.02)
    nn.init.normal_(beta, std=.02)
    return gamma, beta