Perceiver – A Five-view Stereo System for High-quality Disparity Generation and its Application in Video Post-Production

Element extraction from videos has always been a time-consuming process in the entertainment industry. In this research, we explored the possibility of simplifying the video object extraction technique with corresponding depth sequences. Based on post-production quality requirements, we developed our disparity enhancing system by integrating our two-axis-multi-view-stereo method that perceives an environment from five different perspectives on both x and y axes. Our research results have shown that the disparity quality of our approach is both visually and quantitatively more accurate than the traditional one-stereo-pair method, and its object extraction (i.e., matting) quality is comparable with existing mature matting technique to a certain extent. This research output can be applied in video object cut-out, visual effects composition, video's 2D to 3D conversion, and image post-processing. With further improvement, our system might be applicable in AR, VR, machine vision, and auto-pilot areas.