global image representations

[TerryMelody]

Hello dear authors！In the code "image_features, patch_tokens = model.encode_image(image, features_list)", is "image_features" the global image representations? Just like the source code in openclip: "image_features = model.encode_image(image)", as we always do. But you change the transformer to add additional outputs of assigned "features_list". I don't know whether my understanding is right or not.

[ByChelsea]

Yes, image_features is the global image representation.

By the way, you can use "copy permalink" to help others locate your issue more quickly. Like this.

[TerryMelody]

Copy link
Thank you for your suggestions! Can I understand the “image features” in your code to be the same as those implemented in Openclip source codes. It seems you make a lot of modifications to openclip (https://github.com/mlfoundations/open_clip/tree/main/src/open_clip)?

[ByChelsea]

Yes, image features are the class tokens in the original implementation.

[TerryMelody]

Yes, image features are the class tokens in the original implementation.

Thank you so much!