README.md

PLA & RegionPLC

This repo contains the official implementation of PLA (CVPR2023) and RegionPLC (CVPR 2024)

---

PLA: Language-Driven Open-Vocabulary 3D Scene Understanding

Runyu Ding^*, Jihan Yang^*, Chuhui Xue, Wenqing Zhang, Song Bai^†, Xiaojuan Qi^†,

CVPR 2023

project page | arXiv

---

RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding

Jihan Yang^*, Runyu Ding^*, Weipeng Deng, Zhe Wang, Xiaojuan Qi,

CVPR 2024

project page | arXiv

Highlights:

• Official PLA implementation is contained in the main branch
• Official RegionPLC implementation is contained in the regionplc branch

Release

• [2024-05-05] Releasing RegionPLC implementation. Please checkout regionplc branch to try it!

Getting Started

Installation

Please refer to INSTALL.md for the installation.

Dataset Preparation

Please refer to DATASET.md for dataset preparation.

Training & Inference

Please refer to MODEL.md for training and inference scripts and pretrained models.

Citation

If you find this project useful in your research, please consider cite:

@inproceedings{ding2022language,
    title={PLA: Language-Driven Open-Vocabulary 3D Scene Understanding},
    author={Ding, Runyu and Yang, Jihan and Xue, Chuhui and Zhang, Wenqing and Bai, Song and Qi, Xiaojuan},
    booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
    year={2023}
}

@inproceedings{yang2024regionplc,
    title={RegionPLC: Regional point-language contrastive learning for open-world 3d scene understanding},
    author={Yang, Jihan and Ding, Runyu and Deng, Weipeng and Wang, Zhe and Qi, Xiaojuan},
    booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
    year={2024}
}

Acknowledgement

Code is partly borrowed from OpenPCDet, PointGroup and SoftGroup.