Vision-Based Camera Motion Tracking
Project Overview
With Visual effects becoming an increasingly popular mode of storytelling, product
showcasing, and artistic expression, camera tracking has become a more commonly faced hurdle. At the
very root of any visual effects project is the process of camera tracking. Visual effects (VFX) is
the process of integrating computer generated visuals into real-life camera
footage.
Oftentimes, these computer generated images come from 3D models. To composite these
two media sources, the 3D model has to move with the real environment in the camera’s footage, but
this is only possible if the motion of the camera is known. Fortunately, the camera’s motion can be
reconstructed with computer vision algorithms that look at the footage. While the algorithms under
the hood do much of the heavy lifting for an artist, the process of camera tracking is still
monotonous. There is a learning curve to get reliable results and even for experienced artists, the
process can be time consuming.
The goal is to provide a minimal-effort solution for solo
artists that is fairly robust and accurate as well. VFX is time consuming and therefore a
significant business expense. The ending product will significantly cut down on the time required
for the camera tracking step by completely automating the process of finding high-contrast points,
culling high error tracks, and more.
Photogrammetry Add-On Panel Inside of Blender's UI
An early implementation of our Camera Tracking algorithm.
sddec25 poster
A demo of the working Add-On.
Team Members
Eric Wittrock
Motion Estimation Solutions
Software Engineering
Experience in C++, Python, computer vision with OpenCV, Machine learning with pytorch, and Blender API
Will Ernatt
Camera Tracking Research +UI Tools and Development
Software Engineering
Experience in C, C++, Python, Machine Learning. Interest in healthcare software and hardware development.
Andrew Gooding
Process Automation +Automation Error Detection
Computer Engineering
Experience with Python, C, Java, minimum experience with image processing and 3D creation software.
Isaac Kenyon
UI Interface +Testing & Analysis
Computer Engineering
Experience in C, Python, VHDL, and BSD Systems. Has worked with embedded RTOS, low power systems, and FPGA design. Also experience with CI/CD pipelines for FPGA tools.
Weekly Reports
Report 2
Report 3
Report 4
Report 5
Report 6
Report 7
Report 8
Report 9
Report 10
Report 11
Report 12
Report 13
Report 14