Ego-view video not aligned with exo-view video

[Zray26]

Hi, thanks for sharing this great dataset.

When I check ego_preview.mp4 of indiana_bike_01_2, I found ego-video video is not aligned with those exo-view videos, which is quite clear in the images below:

Then I extracted both ego-view and exo-view images from videos under /frame_aligned_videos following code here, and found ego-view is 5 frames behind exo-view. The person raises hand at frame 106 in exoview and at frame 111 in egoview.

I wonder if I overlooked any code that makes ego-view and exo-view videos aligned? Or there might be misalignment within several frames for videos in EGOEXO-4D dataset?

[suyogduttjain]

There can be a very small number of videos where alignment can be off by a few frames. Have you tried your script on other takes?