Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[email protected] #30

Open
rabbit218218 opened this issue Oct 21, 2024 · 3 comments
Open

[email protected] #30

rabbit218218 opened this issue Oct 21, 2024 · 3 comments

Comments

@rabbit218218
Copy link

I am currently facing a few issues:
(1) What is the purpose of pretraining?
(2) In the model section of PointMamba/cfgs/finetune_modelnet.yaml, the parameter NAME:PointMamba, which indicates that the PointMamba module from point_mamba.py is being used. However, it seems that no other sections, such as maskmamba, are utilized. Does this mean that when classifying the ModelNet40 dataset, there is no process of masking and reconstruction?

@LMD0311
Copy link
Owner

LMD0311 commented Oct 21, 2024

Thank you for your interest in our work. Mask modeling-based pre-training is commonly utilized to enhance performance, with the pre-trained weights serving as a starting point for fine-tuning downstream tasks. We use MaskMamba for pre-training, maintaining the same structure for fine-tuning.

@rabbit218218
Copy link
Author

modelnet40
pretrain
I noticed that the models used in the two .yaml files are different, so the model loaded into the network at runtime will be different, right? However, I've noticed that neither of these models mentions the use of the maskmamba module, and I now want to use the maskmamba module, but I don't know how to do it. Additionally, I also need your help to answer a question about Loss. I want to know what the two values in Losses=['data1','data2'] mean in the log after the network has been trained (using ModelNet40 as an example). If you have time, I would appreciate it if you could reply. Thank you very much.

@rabbit218218
Copy link
Author

Could you please reply to this message? I'm really eager to learn about the related work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants