Challenge
Light’s product is a software-defined camera that combines breakthrough optics technology with sophisticated computational software. Apart from creating more vivid and more detailed HDR images, it uses stereo vision and calculates the depth of the image. Accuracy of depth is an important part of providing high-quality, flawless images. Proper sensor geometric calibration is also critical as individual cameras are not glued to any surface and are prone to micro movements when the device is used.
Solution
Project goals To improve the sensor geometric calibration. To improve the quality of stereo depth reconstruction. To surpass the current state-of-the-art in the field. The project was divided into 3 parts: online calibration research, lense distortion correction research, and depth pipeline improvements. First, we focused on the theoretical and practical advantages of using online calibration, then we worked on improving the quality of stereo depth reconstruction The following deliverables were defined and successfully implemented: A framework for camera calibration testing with respect to synthetic 3D points A framework for online camera calibration configuration comparison using both synthetic and real-world data Tools for 3D point cloud storage and visualization A parameterized online calibration module allowing one to parameterize the bundle adjustment problem for camera intrinsics, camera extrinsics, point position and point depth
Results
An exhaustive evaluation of the impact which online calibration has on stereo depth quality. Conclusive proof that the correct set up of online calibration is capable of improving camera parameters that have been perturbed. Significantly improving the average reprojection error for both synthetic and real-world images.
Want fresh marketing stories in your inbox?
Get the weekly email that makes you a marketing genius.
Stay informed and inspired, for free.