Image processing strategies based on saliency segmentation for object recognition under simulated prosthetic vision
- PMID: 29129481
- DOI: 10.1016/j.artmed.2017.11.001
Image processing strategies based on saliency segmentation for object recognition under simulated prosthetic vision
Abstract
Background and objective: Current retinal prostheses can only generate low-resolution visual percepts constituted of limited phosphenes which are elicited by an electrode array and with uncontrollable color and restricted grayscale. Under this visual perception, prosthetic recipients can just complete some simple visual tasks, but more complex tasks like face identification/object recognition are extremely difficult. Therefore, it is necessary to investigate and apply image processing strategies for optimizing the visual perception of the recipients. This study focuses on recognition of the object of interest employing simulated prosthetic vision.
Method: We used a saliency segmentation method based on a biologically plausible graph-based visual saliency model and a grabCut-based self-adaptive-iterative optimization framework to automatically extract foreground objects. Based on this, two image processing strategies, Addition of Separate Pixelization and Background Pixel Shrink, were further utilized to enhance the extracted foreground objects.
Results: i) The results showed by verification of psychophysical experiments that under simulated prosthetic vision, both strategies had marked advantages over Direct Pixelization in terms of recognition accuracy and efficiency. ii) We also found that recognition performance under two strategies was tied to the segmentation results and was affected positively by the paired-interrelated objects in the scene.
Conclusion: The use of the saliency segmentation method and image processing strategies can automatically extract and enhance foreground objects, and significantly improve object recognition performance towards recipients implanted a high-density implant.
Keywords: Image processing strategy; Objects recognition; Saliency segmentation; Simulated prosthetic vision; Visual prosthesis.
Copyright © 2017 Elsevier B.V. All rights reserved.
Similar articles
-
Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses.Sensors (Basel). 2022 Aug 30;22(17):6544. doi: 10.3390/s22176544. Sensors (Basel). 2022. PMID: 36081002 Free PMC article. Review.
-
The application of computer vision to visual prosthesis.Artif Organs. 2021 Oct;45(10):1141-1154. doi: 10.1111/aor.14022. Epub 2021 Jul 27. Artif Organs. 2021. PMID: 34318520 Review.
-
Simplification of Visual Rendering in Simulated Prosthetic Vision Facilitates Navigation.Artif Organs. 2017 Sep;41(9):852-861. doi: 10.1111/aor.12868. Epub 2017 Mar 21. Artif Organs. 2017. PMID: 28321887
-
Image Processing Strategies Based on a Visual Saliency Model for Object Recognition Under Simulated Prosthetic Vision.Artif Organs. 2016 Jan;40(1):94-100. doi: 10.1111/aor.12498. Epub 2015 May 15. Artif Organs. 2016. PMID: 25981202
-
Simulated Prosthetic Vision: The Benefits of Computer-Based Object Recognition and Localization.Artif Organs. 2015 Jul;39(7):E102-13. doi: 10.1111/aor.12476. Epub 2015 Apr 20. Artif Organs. 2015. PMID: 25900238
Cited by
-
A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision.J Neural Eng. 2023 Aug 10;20(4):046027. doi: 10.1088/1741-2552/aceca2. J Neural Eng. 2023. PMID: 37531948 Free PMC article.
-
A systematic review of extended reality (XR) for understanding and augmenting vision loss.J Vis. 2023 May 2;23(5):5. doi: 10.1167/jov.23.5.5. J Vis. 2023. PMID: 37140911 Free PMC article.
-
Towards aSmart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness.J Neural Eng. 2022 Dec 7;19(6):10.1088/1741-2552/aca69d. doi: 10.1088/1741-2552/aca69d. J Neural Eng. 2022. PMID: 36541463 Free PMC article.
-
Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses.Sensors (Basel). 2022 Aug 30;22(17):6544. doi: 10.3390/s22176544. Sensors (Basel). 2022. PMID: 36081002 Free PMC article. Review.
-
Detecting Salient Image Objects Using Color Histogram Clustering for Region Granularity.J Imaging. 2021 Sep 16;7(9):187. doi: 10.3390/jimaging7090187. J Imaging. 2021. PMID: 34564113 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources