Titre de la thèse : Improving Perception and Interaction in Augmented Reality
Laboratoires / équipe : UMR 1563 AAU Nantes, équipe informatique, Inria Rennes, équipe Hybrid
Localisation : Nantes et Rennes
- directeurs de thèse
- Guillaume MOREAU, (+33) 240 37 68 47, guillaume.moreau [at] ec-nantes.fr
- Anatole LECUYER, (+33) 299 84 74 83, anatole.lecuyer [at] inria.fr
- Jean-Marie NORMAND, (+33) 240 37 16 02, jean-marie.normand [at] ec-nantes.fr
The principle of augmented reality (AR) consists of inserting digital information (virtual images) onto real images (captured in real-time from direct or indirect viewpoint). Adding this synthetic digital information must be made in a way that virtual images are registered with the real ones (it means that both the position and the orientation of the virtual camera must the same as for the real camera).
AR is generally divided between : 1) Video see-through AR (where real images are shot by the camera of a device : tablet, phone, etc.) before being visualized through the screen of this device; 2) Optical see-through AR: where digital information is directly displayed in front of the user’s eyes onto a semi transparent screen (as in Google Glasses); and 3) SAR (Spatially Augmented Reality): digital information is projected onto the real environment.
When considering both Video see-through and Optical see-though AR questions rapidly arise as to how users “understand” or “perceive” the digital information that are being displayed, and how potential perceptive biases can impair interaction in augmented reality.
However, this topic has been relatively scarcely addressed in the literature so far [SSE15].
Therefore, the ambition of this PhD thesis will be to study the perceptive biases induced by the display of 3D digital objects in AR applications, and to design dedicated 3D interactive techniques that can make up or take into account such perceptive biases. We will focus on several important factors such as : Depth perception (distance evaluation, spatial relations between real and virtual objects, etc.), Scale perception (relative size of objects), or Importance of display fidelity and properties (photorealism, lighting, shadowing etc).
Thus, the PhD program will consist first in designing and conducting experimental studies with participants in order to study and model human perception in Augmented Reality. The PhD work plan will then enable to design novel 3D interactive techniques taking into account our perceptual models, in order to improve the 3D interaction with both the real and virtual contents. Several interactive contexts and tasks are envisioned such as: selecting virtual targets, manipulating mixed objects, or labeling the augmented scene.
[MTM+] Madsen, J. ; Tatzgern, M. ; Madsen, C. ; Schmalstieg, D. & Kalkofen, D. (2016) Temporal coherence strategies for augmented reality labeling. To appear in Transactions on Visualization and Computer Graphics.
[SSE15] Swan, J.E ; Singh, G. & Ellis, S.R. (2015) Matching and Reaching Depth Judgments with Real and Augmented Reality Targets. Proc. ACM ISMAR, published in IEEE Transactions on Visualization and Computer Graphics 21(11) 1289-1298
MsC in computer science, computer vision
How to apply
Contact any (or all) the advisors with a detailed CV and your master’s grades when available. Applications will be welcomed until the position is filled.