the code with czsl

[Jianghao-Li]

Sorry to bother, i don't know how you insert batchformer to czsl tasks, could you please tell me more details? Thanks

[zhihou7]

Hi @liccoco, I mainly change the code in two parts:

1. batchformer:

   BatchFormer/czsl/utils/config_model.py

   Line 36 in 6f89e22

   def forward_feats(self, feature):

   ,

   BatchFormer/czsl/utils/config_model.py

   Line 81 in 6f89e22

   model = TransformerDecorator(model, args.model, args.add_bt)

2. repeat corresponding labels

   BatchFormer/czsl/models/graph_method.py

   Line 73 in 6f89e22

   if self.add_bt >= 1:

Besides, I choose a smaller lr (--lrb) for batchformer module because the network is quite small for cgqa.

Feel free to ask if you have any questions.

Regards,
Zhi Hou

[Jianghao-Li]

Thanks for your reply. I found the code on github is different from the code in your paper, such as batchv1. The code in your paper

i didn't find the module appear in your real code, could you please explain the meaning of y in your paper? Thanks

[zhihou7]

Hi @licoco,
Thanks for your comment. That is actually the same as the description in the paper. It is just because the code of czsl utilizes a semantic graph to infer the zero-shot classes. y is the label, that is the same as the pairs in czsl. I do not implement an individual function for batchformer in czsl. But the current implementation is the same as the description, please refer to the two links that I provide in last comment. It is not necessary to change the code base of czsl to implement batchformer.

Regards,