Prof. Taehyun Rhee (Victoria University of Wellington, New Zealand)
- 일시: 11월 15일(화) 10:30-11:30
- 장소: 군자관 312호 계단강의실
- 주최: 세종대학교 모바일 가상현실 연구센터
Perceptually Based Lighting and Rendering for Mixed Reality on HMDs
Image based lighting (IBL) and differential rendering have been used for lighting and composition in live-action films. In visual effects studio, high-resolution high dynamic range (HDR) panoramic images have been used as the light maps providing real world lighting for photo realistic rendering and composition.
To provide a seamless mixture between the virtual and real world objects, intensive computation and additional refinement by skillful artists are often required.
The seamlessness is the measure of how perceivably apparent the synthetic object in the final composition is, and how indistinguishable it is from the photographed live action scene.
Given that the ultimate receiver of final image is the human eye, the seamlessness of final composition is determined by the Human Visual System (HVS). We conducted psychophysical studies to observe and capture the thresholds of the HVS’s ability to perceive illumination inconsistencies between the rendered subject and the photographed scene. Then, image based lighting (IBL) and illumination composition are perceptually optimized to provide real-time solution for mixed reality (MR).
Our method has been implemented into commercial game engines Unity/UE4, and provides seamless lighting for MR rendering
suitable for modern head mounted displays (HMDs) requires high frame rates.
Although HMDs represent an ideal set-up for immersive viewing for VR/MR content, they have a significant downside; people commonly report visual discomfort when using HMDs.
The discomfort symptoms include headaches, nausea, dizziness and eyestrain, comparable to the symptoms commonly reported by sufferers of motion sickness. We are studying the cause of the visual discomfort and developing a perceptually optimized rendering solution to mitigate it.
Our initial implementation realized in a commercial game engine shows approximately 30% reduction of visual discomfort on HMDs.
Dr. Taehyun Rhee is a senior lecturer (equivalent to a tenured associate professor in US based system) of School of Engineering and Computer Science at Victoria University of Wellington, New Zealand.
He is a founder and director of the Computer Graphics Research Lab in Victoria, and led their Computer Graphics Programme that has been established in collaboration with local industry partners including Weta Digital.
Before joining Victoria, he was a principal researcher and a leader of Computer Graphics and Medical Physics Modeling teams in the Mixed Reality Group at SAIT (Samsung Advanced Institute of Technology) in Korea from 2008 to 2012. Also, he was a senior
researcher/researcher of Research Innovation Center at Samsung Electronics from 1996 to 2003.
He received his Ph.D. in Computer Science from University of Southern California in U.S.A.
Taehyun Rhee's research interest is to solve scientific problems related to Computer Graphics, Computer Animation, Virtual Reality, Mixed Reality, Computer Vision, and Medical Images.
His current research activities have been focused on perceptually based lighting and rendering, mixed reality rendering, immersive visualization on HMDs, realistic human body modeling and animation, and human digital content interaction.