November 19, 2012
Title: Beyond Perspective Cameras: Multi-perspective Imaging, Reconstruction, Rendering and Projection
Speaker: Jingyi Yu (http://www.eecis.udel.edu/~yu/), University of Delaware, Newark, DE
Time: Monday, November 19th, 2:00pm-3:30pm
Location: Babbio Center 110
Host: Gang Hua
A perspective image represents the spatial relationships of objects in a scene as they appear from a single viewpoint. In contrast, a multi-perspective image combines what is seen from several viewpoints into a single image. Despite their incongruity of view, effective multi-perspective images are able to preserve spatial coherence and can depict, within a single context, details of a scene that are simultaneously inaccessible from a single view. In this talk, I will provide a complete framework for using multi-perspective imaging models in computer vision and graphics. Our multi-perspective framework consists of four key components: acquisition, reconstruction, rendering, and display. A multi-perspective camera captures a scene from multiple viewpoints in a single image. From the input image, intelligent software can recover 3D scene geometry using multi-perspective stereo matching algorithms or via shape-from-distortion approaches. Our solutions are particularly useful for reconstructing specular (reflective and refractive) surfaces such as dynamic 3D fluid surfaces which can also be viewed as general multi-perspective cameras. The recovered geometry, along with lighting and surface reflectance, can then be loaded into a new multi-perspective graphics pipeline for real-time rendering. Finally, we can visualize the rendering results on a special multi-perspective display that combines a single consumer projector and specially-shaped mirrors/lenses. Such displays will offer an unprecedented level of flexibility in terms of aspect ratio, size, field of view, etc.
Jingyi Yu is an Associate Professor in the Department of Computer & Information Sciences and the Department of Electrical & Computer Engineering at the University of Delaware. He received his B.S. from Caltech in 2000 and Ph.D. from MIT in 2005. His research interests span a range of topics in computer vision and computer graphics, especially on computational photography and mobile imaging systems and displays. He has served as a Program Chair of OMNIVIS '11, a General Chair of Projector-Camera Systems '08, and an Area and Session Chair of ICCV '11. He is a recipient of both the NSF CAREER Award and the AFOSR YIP Award.