DataParallel and next(self.parameter) causing problem when used together

[innocentius]

Hey, I'm writing this issue to inform you about an error occured to me when using multi-GPU training.

File "/home/[]/DETM-arxiv/detm.py", line 212, in init_hidden
    weight = next(self.parameters())
StopIteration
StopIteration: Caught StopIteration in replica 0 on device 0.

This is much of a known issue in Pytorch world. As Pytorch are moving away from Dataparallel they would much unlikely to solve this, and the better way to do this is to change the code to suit for the new DistributedDataParallel.

Thanks!