Detection, eye-hand coordination and virtual mobility performance in simulated vision for a cortical visual prosthesis device
- PMID: 19458397
- PMCID: PMC3902177
- DOI: 10.1088/1741-2560/6/3/035008
Detection, eye-hand coordination and virtual mobility performance in simulated vision for a cortical visual prosthesis device
Abstract
In order to assess visual performance using a future cortical prosthesis device, the ability of normally sighted and low vision subjects to adapt to a dotted 'phosphene' image was studied. Similar studies have been conduced in the past and adaptation to phosphene maps has been shown but the phosphene maps used have been square or hexagonal in pattern. The phosphene map implemented for this testing is what is expected from a cortical implantation of the arrays of intracortical electrodes, generating multiple phosphenes. The dotted image created depends upon the surgical location of electrodes decided for implantation and the expected cortical response. The subjects under tests were required to perform tasks requiring visual inspection, eye-hand coordination and way finding. The subjects did not have any tactile feedback and the visual information provided was live dotted images captured by a camera on a head-mounted low vision enhancing system and processed through a filter generating images similar to the images we expect the blind persons to perceive. The images were locked to the subject's gaze by means of video-based pupil tracking. In the detection and visual inspection task, the subject scanned a modified checkerboard and counted the number of square white fields on a square checkerboard, in the eye-hand coordination task, the subject placed black checkers on the white fields of the checkerboard, and in the way-finding task, the subjects maneuvered themselves through a virtual maze using a game controller. The accuracy and the time to complete the task were used as the measured outcome. As per the surgical studies by this research group, it might be possible to implant up to 650 electrodes; hence, 650 dots were used to create images and performance studied under 0% dropout (650 dots), 25% dropout (488 dots) and 50% dropout (325 dots) conditions. It was observed that all the subjects under test were able to learn the given tasks and showed improvement in performance with practice even with a dropout condition of 50% (325 dots). Hence, if a cortical prosthesis is implanted in human subjects, they might be able to perform similar tasks and with practice should be able to adapt to dotted images even with a low resolution of 325 dots of phosphene.
Figures
![Figure 1](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/3902177/bin/nihms423809f1.gif)
![Figure 2](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/3902177/bin/nihms423809f2.gif)
![Figure 3](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/3902177/bin/nihms423809f3.gif)
![Figure 4](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/3902177/bin/nihms423809f4.gif)
![Figure 5](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/3902177/bin/nihms423809f5.gif)
![Figure 6](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/3902177/bin/nihms423809f6.gif)
![Figure 7](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/3902177/bin/nihms423809f7.gif)
![Figure 8](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/3902177/bin/nihms423809f8.gif)
Similar articles
-
Sensory augmentation to aid training with retinal prostheses.J Neural Eng. 2020 Jul 13;17(4):045001. doi: 10.1088/1741-2552/ab9e1d. J Neural Eng. 2020. PMID: 32554868
-
Improved visual performance in letter perception through edge orientation encoding in a retinal prosthesis simulation.J Neural Eng. 2014 Dec;11(6):066002. doi: 10.1088/1741-2560/11/6/066002. Epub 2014 Oct 13. J Neural Eng. 2014. PMID: 25307496
-
Microstimulation of visual cortex to restore vision.Prog Brain Res. 2009;175:347-75. doi: 10.1016/S0079-6123(09)17524-6. Prog Brain Res. 2009. PMID: 19660667 Free PMC article. Review.
-
Rehabilitation regimes based upon psychophysical studies of prosthetic vision.J Neural Eng. 2009 Jun;6(3):035009. doi: 10.1088/1741-2560/6/3/035009. Epub 2009 May 20. J Neural Eng. 2009. PMID: 19458400 Review.
-
Virtual wayfinding using simulated prosthetic vision in gaze-locked viewing.Optom Vis Sci. 2008 Nov;85(11):E1057-63. doi: 10.1097/OPX.0b013e31818b9f36. Optom Vis Sci. 2008. PMID: 18981914 Free PMC article.
Cited by
-
Towards biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses.Elife. 2024 Feb 22;13:e85812. doi: 10.7554/eLife.85812. Elife. 2024. PMID: 38386406 Free PMC article.
-
A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision.J Neural Eng. 2023 Aug 10;20(4):046027. doi: 10.1088/1741-2552/aceca2. J Neural Eng. 2023. PMID: 37531948 Free PMC article.
-
Towards aSmart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness.J Neural Eng. 2022 Dec 7;19(6):10.1088/1741-2552/aca69d. doi: 10.1088/1741-2552/aca69d. J Neural Eng. 2022. PMID: 36541463 Free PMC article.
-
Multichannel stimulation module as a tool for animal studies on cortical neural prostheses.Front Med Technol. 2022 Sep 13;4:927581. doi: 10.3389/fmedt.2022.927581. eCollection 2022. Front Med Technol. 2022. PMID: 36176924 Free PMC article.
-
Reading text works better than watching videos to improve acuity in a simulation of artificial vision.Sci Rep. 2022 Jul 28;12(1):12953. doi: 10.1038/s41598-022-10719-6. Sci Rep. 2022. PMID: 35902596 Free PMC article.
References
-
- Bak M, Girvin JP, Hambrecht FT, Kufta CV, Loeb GE, Schmidt EM. Visual sensations produced by intracortical microstimulation of the human occipital cortex. Med. Biol. Eng. Comput. 1990;28:257–259. - PubMed
-
- Boyle J, Maeder A, Boles W. Scene specific imaging for bionic vision implants. Proc. of 3rd International Symposium in Image and Signal Processing and Analysis. 2003;3:423–427.
-
- Bradley DC, et al. Visuotopic mapping through a multichannel stimulating implant in primate V1. J.Neurophysiol. 2005;93:1659–1670. - PubMed
-
- Brindley GS. Effects of electrical stimulation of the visual cortex. Hum. Neurobiol. 1982;1:281–283. - PubMed
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Research Materials
Miscellaneous