a short video of a quick proof of concept testing unity/max integration using OSC.ย All video processing is done in max, and the resulting data (x,y location data) is sent to Unity via OSC, and then mapped to the camera position.
A fundamental to the motion tracking are the cv.jit objects (computer vision for jitter) http://jmpelletier.com/cvjit/ . Next step in the process involves interpreting the video data to include movement on the z axis.