Learning to Summarize and Answer Questions about a Virtual Robot's Past Actions Chad DeChant, Iretiayo Akinola, and Daniel Bauer
A question and answer dataset matched to episodes in the Alfred dataset accompanies this paper. It contains:
486,704 training set questions Dropbox link
18,891 valid-seen set questions Dropbox link
19,097 valid-unseen set questions Dropbox link
(Installation instructions coming soon)