Regularizing RNNs for Caption Generation by Reconstructing The Past with The Present (ARNet)

Introduction

This paper was accepted by CVPR 2018 as poster. The proposed method is very effective in RNN-based models. In our framework, RNNs are regularized by reconstructing the previous hidden state with the current one. Therefore, the relationships between neighbouring hidden states in RNNs can be further exploited by our ARNet.

We validate our ARNet on the following tasks:

• Image Captioning
• Code Captioning
• Permuted Sequential MNIST

Citation

@InProceedings{Chen_2018_CVPR,
  author = {Chen, Xinpeng and Ma, Lin and Jiang, Wenhao and Yao, Jian and Liu, Wei},
  title = {Regularizing RNNs for Caption Generation by Reconstructing the Past With the Present},
  booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  month = {June},
  year = {2018}
}

License

ARNet is released under the MIT License (refer to the LICENSE file for details).

Authorship

This project is maintained by Xinpeng Chen.