Sensory augmentation to aid training with retinal prostheses
- PMID: 32554868
- DOI: 10.1088/1741-2552/ab9e1d
Sensory augmentation to aid training with retinal prostheses
Abstract
Objective: Retinal prosthesis recipients require rehabilitative training to learn the non-intuitive nature of prosthetic 'phosphene vision'. This study investigated whether the addition of auditory cues, using The vOICe sensory substitution device (SSD), could improve functional performance with simulated phosphene vision.
Approach: Forty normally sighted subjects completed two visual tasks under three conditions. The phosphene condition converted the image to simulated phosphenes displayed on a virtual reality headset. The SSD condition provided auditory information via stereo headphones, translating the image into sound. Horizontal information was encoded as stereo timing differences between ears, vertical information as pitch, and pixel intensity as audio intensity. The third condition combined phosphenes and SSD. Tasks comprised light localisation from the Basic Assessment of Light and Motion (BaLM) and the Tumbling-E from the Freiburg Acuity and Contrast Test (FrACT). To examine learning effects, twenty of the forty subjects received SSD training prior to assessment.
Main results: Combining phosphenes with auditory SSD provided better light localisation accuracy than either phosphenes or SSD alone, suggesting a compound benefit of integrating modalities. Although response times for SSD-only were significantly longer than all other conditions, combined condition response times were as fast as phosphene-only, highlighting that audio-visual integration provided both response time and accuracy benefits. Prior SSD training provided a benefit to localisation accuracy and speed in SSD-only (as expected) and Combined conditions compared to untrained SSD-only. Integration of the two modalities did not improve spatial resolution task performance, with resolution limited to that of the higher resolution modality (SSD).
Significance: Combining phosphene (visual) and SSD (auditory) modalities was effective even without SSD training and led to an improvement in light localisation accuracy and response times. Spatial resolution performance was dominated by auditory SSD. The results suggest there may be a benefit to including auditory cues when training vision prosthesis recipients.
Similar articles
-
Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses.Sensors (Basel). 2022 Aug 30;22(17):6544. doi: 10.3390/s22176544. Sensors (Basel). 2022. PMID: 36081002 Free PMC article. Review.
-
A case study in phenomenology of visual experience with retinal prosthesis versus visual-to-auditory sensory substitution.Neuropsychologia. 2022 Aug 13;173:108305. doi: 10.1016/j.neuropsychologia.2022.108305. Epub 2022 Jun 22. Neuropsychologia. 2022. PMID: 35752268 Free PMC article.
-
Improved visual performance in letter perception through edge orientation encoding in a retinal prosthesis simulation.J Neural Eng. 2014 Dec;11(6):066002. doi: 10.1088/1741-2560/11/6/066002. Epub 2014 Oct 13. J Neural Eng. 2014. PMID: 25307496
-
Rehabilitation regimes based upon psychophysical studies of prosthetic vision.J Neural Eng. 2009 Jun;6(3):035009. doi: 10.1088/1741-2560/6/3/035009. Epub 2009 May 20. J Neural Eng. 2009. PMID: 19458400 Review.
-
Detection, eye-hand coordination and virtual mobility performance in simulated vision for a cortical visual prosthesis device.J Neural Eng. 2009 Jun;6(3):035008. doi: 10.1088/1741-2560/6/3/035008. Epub 2009 May 20. J Neural Eng. 2009. PMID: 19458397 Free PMC article.
Cited by
-
A systematic review of extended reality (XR) for understanding and augmenting vision loss.J Vis. 2023 May 2;23(5):5. doi: 10.1167/jov.23.5.5. J Vis. 2023. PMID: 37140911 Free PMC article.
-
Towards aSmart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness.J Neural Eng. 2022 Dec 7;19(6):10.1088/1741-2552/aca69d. doi: 10.1088/1741-2552/aca69d. J Neural Eng. 2022. PMID: 36541463 Free PMC article.
-
Immersive Virtual Reality Simulations of Bionic Vision.Augment Hum (2022). 2022 Mar;2022:82-93. doi: 10.1145/3519391.3522752. Epub 2022 Apr 18. Augment Hum (2022). 2022. PMID: 35856703 Free PMC article.
-
Using Non-linear Dynamics of EEG Signals to Classify Primary Hand Movement Intent Under Opposite Hand Movement.Front Neurorobot. 2022 Apr 28;16:845127. doi: 10.3389/fnbot.2022.845127. eCollection 2022. Front Neurorobot. 2022. PMID: 35574232 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources