Integration of spatio-temporal reasoning on mixed reality headsets using artificial intelligence

Starting: 01/01/2025
PhD Student: Benjamin Georges
Advisor(s): Iza Marfisi
Co-advisor(s): Charles Gouin-Vallerand, Kevin Boucard
Funding: MITACS et Région Pays de la Loire

My PhD thesis is a collaboration between LIUM in France and DOMUS in Canada.

The aim of this thesis is to assist a Mixed Reality (MR) headset user through spatio-temporal reasoning. To achieve this, we will use various Artificial Intelligence (AI) models, in particular object recognition models. Assistance to the user of an MR helmet can take many forms. In our case, we’re focusing on understanding the environment in which the user evolves, and identifying potential hazards. This new understanding will enable us to offer more precise assistance to the user in carrying out tasks.

Photo: test of the prototype application which recognizes the type of room (kitchen) the person is in.

This PhD thesis is part of the Spatio-Temporal ARIA project.