Pseduo VR for flight simulators

[searching46dof]

If you're interested in setting up a pseudo VR for flight simulators, see https://github.com/searching46dof/KinectV2MouseControl

You can change the pilot's view position using aitrack/opentrack. Then you can use the modified KinectV2MouseControl with a MS Kinect version 2 to manipulate a clickable cockpit such as in DCS.

The original KinectV2MouseControl was derived from https://github.com/TangoChen/KinectV2MouseControl and modified:

• ergonomic cursor movement from a seated position using wrist to shoulder or handtip to shoulder position where fewer joints are involved to reduce shaking/jitter.
• deadzone based on scaled forearm distance in front of base of neck for seated position instead of a fixed distance from lower spine
• unscented kalman filter from https://github.com/prozoroff/UKFSharp to smooth cursor movement and cursor jitter when still.
• more natural clicking motion via pinch instead of grasping which changes the hand position. so it is more natural to use either the wrist to track the cursor or the fingertip (handtip) which we can naturally compensate for. pinching with palm down is left click. pinching with palm to the side is right click. pinching with diagonal palm is middle click

Note that even with the filter there is still some cusror jitter. But it is small enough to manipulate the controls.
Have fun!