Enhancing spatial perception of virtual object through mid-air feedback for disabled users

Research output: Published contribution to conferencePoster

Abstract

There is an increasing demand to enhance the user’s ability to better identify the location of sound events and virtual objects in 3D space. The demand is not only within the gaming industry but also with users with disabilities looking to engage with VR technologies. In doing so, users can increase their ability to interact with virtual and digital worlds.

Wearable technologies that provide haptic feedback experience to users, such as gloves and gaming controllers, often require time to ‘put them on’; users are aware of the technology on their body; require calibration to the individual user and often restrict movement.

Our research explores the relationship between aural and haptic feedback modalities and how they may compensate each other. Specifically, we examine ways in which mid-air haptic feedback, using ultrasound technology, is used to improve our understanding regarding the position and direction of virtual sound objects. A prototype system, developed in Unity, enables objects on screen to provide information about their virtual location, direction and size through haptic feedback received on the palm as well as through binaural audio. For example, one may locate more accurately the direction and distance of a conversation taking place behind him through the combination haptic and aural feedback rather than with audio only. Our system can support visually-impaired children to learn about the world around them such as distance and shape of objects as well as improving accessibility in immersive applications for people with hearing loss.

Users are asked to identify to the position of sound objects through binaural listening with and without haptic feedback. We measure how well they perform in terms of accuracy. We have also examined how users experience movement such as left and right, front and back, and diagonal. Preliminary results show a higher rate of success when haptic feedback is used with the ability to enhance the spatial perception of users.
Original languageEnglish
Publication statusPublished - 16 Jul 2019
Event International Conference on Information, Communication Technologies in Education, ICICTE 2019 - Chania, Chania, Crete, Greece
Duration: 4 Jul 20196 Jul 2019
http://www.icicte.org/about.html

Conference

Conference International Conference on Information, Communication Technologies in Education, ICICTE 2019
Abbreviated titleICICTE 2019
CountryGreece
CityChania, Crete
Period4/07/196/07/19
Internet address

Fingerprint

Feedback
Air
Acoustic waves
Audition
Ultrasonics
Calibration
Controllers
Industry

Cite this

Michailidis, T. (2019). Enhancing spatial perception of virtual object through mid-air feedback for disabled users. Poster session presented at International Conference on Information, Communication Technologies in Education, ICICTE 2019, Chania, Crete, Greece.
Michailidis, Tychonas. / Enhancing spatial perception of virtual object through mid-air feedback for disabled users. Poster session presented at International Conference on Information, Communication Technologies in Education, ICICTE 2019, Chania, Crete, Greece.
@conference{4d9bd149cde34314b1fd89268109ee65,
title = "Enhancing spatial perception of virtual object through mid-air feedback for disabled users",
abstract = "There is an increasing demand to enhance the user’s ability to better identify the location of sound events and virtual objects in 3D space. The demand is not only within the gaming industry but also with users with disabilities looking to engage with VR technologies. In doing so, users can increase their ability to interact with virtual and digital worlds. Wearable technologies that provide haptic feedback experience to users, such as gloves and gaming controllers, often require time to ‘put them on’; users are aware of the technology on their body; require calibration to the individual user and often restrict movement. Our research explores the relationship between aural and haptic feedback modalities and how they may compensate each other. Specifically, we examine ways in which mid-air haptic feedback, using ultrasound technology, is used to improve our understanding regarding the position and direction of virtual sound objects. A prototype system, developed in Unity, enables objects on screen to provide information about their virtual location, direction and size through haptic feedback received on the palm as well as through binaural audio. For example, one may locate more accurately the direction and distance of a conversation taking place behind him through the combination haptic and aural feedback rather than with audio only. Our system can support visually-impaired children to learn about the world around them such as distance and shape of objects as well as improving accessibility in immersive applications for people with hearing loss.Users are asked to identify to the position of sound objects through binaural listening with and without haptic feedback. We measure how well they perform in terms of accuracy. We have also examined how users experience movement such as left and right, front and back, and diagonal. Preliminary results show a higher rate of success when haptic feedback is used with the ability to enhance the spatial perception of users.",
author = "Tychonas Michailidis",
year = "2019",
month = "7",
day = "16",
language = "English",
note = "International Conference on Information, Communication Technologies in Education, ICICTE 2019, ICICTE 2019 ; Conference date: 04-07-2019 Through 06-07-2019",
url = "http://www.icicte.org/about.html",

}

Michailidis, T 2019, 'Enhancing spatial perception of virtual object through mid-air feedback for disabled users' International Conference on Information, Communication Technologies in Education, ICICTE 2019, Chania, Crete, Greece, 4/07/19 - 6/07/19, .

Enhancing spatial perception of virtual object through mid-air feedback for disabled users. / Michailidis, Tychonas.

2019. Poster session presented at International Conference on Information, Communication Technologies in Education, ICICTE 2019, Chania, Crete, Greece.

Research output: Published contribution to conferencePoster

TY - CONF

T1 - Enhancing spatial perception of virtual object through mid-air feedback for disabled users

AU - Michailidis, Tychonas

PY - 2019/7/16

Y1 - 2019/7/16

N2 - There is an increasing demand to enhance the user’s ability to better identify the location of sound events and virtual objects in 3D space. The demand is not only within the gaming industry but also with users with disabilities looking to engage with VR technologies. In doing so, users can increase their ability to interact with virtual and digital worlds. Wearable technologies that provide haptic feedback experience to users, such as gloves and gaming controllers, often require time to ‘put them on’; users are aware of the technology on their body; require calibration to the individual user and often restrict movement. Our research explores the relationship between aural and haptic feedback modalities and how they may compensate each other. Specifically, we examine ways in which mid-air haptic feedback, using ultrasound technology, is used to improve our understanding regarding the position and direction of virtual sound objects. A prototype system, developed in Unity, enables objects on screen to provide information about their virtual location, direction and size through haptic feedback received on the palm as well as through binaural audio. For example, one may locate more accurately the direction and distance of a conversation taking place behind him through the combination haptic and aural feedback rather than with audio only. Our system can support visually-impaired children to learn about the world around them such as distance and shape of objects as well as improving accessibility in immersive applications for people with hearing loss.Users are asked to identify to the position of sound objects through binaural listening with and without haptic feedback. We measure how well they perform in terms of accuracy. We have also examined how users experience movement such as left and right, front and back, and diagonal. Preliminary results show a higher rate of success when haptic feedback is used with the ability to enhance the spatial perception of users.

AB - There is an increasing demand to enhance the user’s ability to better identify the location of sound events and virtual objects in 3D space. The demand is not only within the gaming industry but also with users with disabilities looking to engage with VR technologies. In doing so, users can increase their ability to interact with virtual and digital worlds. Wearable technologies that provide haptic feedback experience to users, such as gloves and gaming controllers, often require time to ‘put them on’; users are aware of the technology on their body; require calibration to the individual user and often restrict movement. Our research explores the relationship between aural and haptic feedback modalities and how they may compensate each other. Specifically, we examine ways in which mid-air haptic feedback, using ultrasound technology, is used to improve our understanding regarding the position and direction of virtual sound objects. A prototype system, developed in Unity, enables objects on screen to provide information about their virtual location, direction and size through haptic feedback received on the palm as well as through binaural audio. For example, one may locate more accurately the direction and distance of a conversation taking place behind him through the combination haptic and aural feedback rather than with audio only. Our system can support visually-impaired children to learn about the world around them such as distance and shape of objects as well as improving accessibility in immersive applications for people with hearing loss.Users are asked to identify to the position of sound objects through binaural listening with and without haptic feedback. We measure how well they perform in terms of accuracy. We have also examined how users experience movement such as left and right, front and back, and diagonal. Preliminary results show a higher rate of success when haptic feedback is used with the ability to enhance the spatial perception of users.

M3 - Poster

ER -

Michailidis T. Enhancing spatial perception of virtual object through mid-air feedback for disabled users. 2019. Poster session presented at International Conference on Information, Communication Technologies in Education, ICICTE 2019, Chania, Crete, Greece.