Human-in-the-loop optimization of visual prosthetic stimulation
- PMID: 35667363
- DOI: 10.1088/1741-2552/ac7615
Human-in-the-loop optimization of visual prosthetic stimulation
Abstract
Objective. Retinal prostheses are a promising strategy to restore sight to patients with retinal degenerative diseases. These devices compensate for the loss of photoreceptors by electrically stimulating neurons in the retina. Currently, the visual function that can be recovered with such devices is very limited. This is due, in part, to current spread, unintended axonal activation, and the limited resolution of existing devices. Here we show, using a recent model of prosthetic vision, that optimizing how visual stimuli are encoded by the device can help overcome some of these limitations, leading to dramatic improvements in visual perception.Approach. We propose a strategy to do this in practice, using patients' feedback in a visual task. The main challenge of our approach comes from the fact that, typically, one only has access to a limited number of noisy responses from patients. We propose two ways to deal with this: first, we use a model of prosthetic vision to constrain and simplify the optimization. We show that, if one knew the parameters of this model for a given patient, it would be possible to greatly improve their perceptual performance. Second we propose a preferential Bayesian optimization to efficiently learn these model parameters for each patient, using minimal trials.Main results. To test our approach, we presented healthy subjects with visual stimuli generated by a recent model of prosthetic vision, to replicate the perceptual experience of patients fitted with an implant. Our optimization procedure led to significant and robust improvements in perceived image quality, that transferred to increased performance in other tasks.Significance. Importantly, our strategy is agnostic to the type of prosthesis and thus could readily be implemented in existing implants.
Keywords: Bayesian optimisation; computational neuroscience; human-in-the-loop optimisation; visual prosthesis.
© 2022 IOP Publishing Ltd.
Similar articles
-
Restoring Color Perception to the Blind: An Electrical Stimulation Strategy of Retina in Patients with End-stage Retinitis Pigmentosa.Ophthalmology. 2021 Mar;128(3):453-462. doi: 10.1016/j.ophtha.2020.08.019. Epub 2020 Aug 25. Ophthalmology. 2021. PMID: 32858064 Free PMC article.
-
Cortical Interactions between Prosthetic and Natural Vision.Curr Biol. 2020 Jan 6;30(1):176-182.e2. doi: 10.1016/j.cub.2019.11.028. Epub 2019 Dec 26. Curr Biol. 2020. PMID: 31883811 Free PMC article.
-
Simulation of visual perception and learning with a retinal prosthesis.J Neural Eng. 2019 Apr;16(2):025003. doi: 10.1088/1741-2552/aaf270. Epub 2018 Nov 20. J Neural Eng. 2019. PMID: 30523985
-
Prosthetic vision: devices, patient outcomes and retinal research.Clin Exp Optom. 2015 Sep;98(5):395-410. doi: 10.1111/cxo.12342. Clin Exp Optom. 2015. PMID: 26390902 Review.
-
Artificial vision: needs, functioning, and testing of a retinal electronic prosthesis.Prog Brain Res. 2009;175:317-32. doi: 10.1016/S0079-6123(09)17522-2. Prog Brain Res. 2009. PMID: 19660665 Review.
Cited by
-
Towards biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses.Elife. 2024 Feb 22;13:e85812. doi: 10.7554/eLife.85812. Elife. 2024. PMID: 38386406 Free PMC article.
-
Hybrid Neural Autoencoders for Stimulus Encoding in Visual and Other Sensory Neuroprostheses.Adv Neural Inf Process Syst. 2022 Dec;35:22671-22685. Adv Neural Inf Process Syst. 2022. PMID: 37719469 Free PMC article.
-
An optimization framework for targeted spinal cord stimulation.J Neural Eng. 2023 Sep 28;20(5):056026. doi: 10.1088/1741-2552/acf522. J Neural Eng. 2023. PMID: 37647885 Free PMC article.
-
Towards aSmart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness.J Neural Eng. 2022 Dec 7;19(6):10.1088/1741-2552/aca69d. doi: 10.1088/1741-2552/aca69d. J Neural Eng. 2022. PMID: 36541463 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources