Enforced Telexistence: Teleoperating Using Photorealistic Virtual Body and Haptic Feedback

Providing the means of presence in a different location has been achieved in the fields of telepresence and telexistence. Some of these systems do have close to identical auditory and visual sensation but when the users find their hands as robotic arms (or in other systems with no arms or hands) then they would feel the remote body is not theirs. In this research, Enforced Telexistence, we introduce photorealistic virtual arms to the user where no physical arms presented in the remote robot. Having virtual arms and hands synchronized with voluntary movements provide the user the feeling as being with his own body in the remote robot place with visual, auditory and haptic sensation.

These real-time photorealistic virtual arms not only follows the user’s arm movements, but also reacts to the dynamic lighting conditions of real environment and allows the user to have an experience of embodied enforcement towards the remote environment. Furthermore, these virtual arms can be used to grab a functional virtual copy of a physical instance where device control is possible.

Enforced Telexistence not only allows a user to experience a non-existing arm in telexistence, but also gives the ability to enforce remote environment in various ways.

MHD Yamen Saraiji
Graduate School Of Media Design, Keio University

Charith Lasantha Fernando
Graduate School of Media Design, Keio University

Yusuke Mizushina
Graduate School of Media Design, Keio University

Masahiro Furukawa
Graduate School Of Information Science And Technology, Osaka University

Youichi Kamiyama
Graduate School of Media Design, Keio University

Kouta Minamizawa
Graduate School of Media Design, Keio University

Susumu Tachi
Graduate School of Media Design, Keio University