Investigating the upper-bound performance of sparse-coding-based spectral reconstruction from RGB images

Tools

Lin, Yi-Tun and Finlayson, Graham D. (2021) Investigating the upper-bound performance of sparse-coding-based spectral reconstruction from RGB images. Color and Imaging Conference, 2021 (29). pp. 19-24. ISSN 2166-9635

Preview

PDF (Accepted_Manuscript) - Accepted Version
Download (8MB) | Preview

Abstract

In Spectral Reconstruction (SR), we recover hyperspectral images from their RGB counterparts. Most of the recent approaches are based on Deep Neural Networks (DNN), where millions of parameters are trained mainly to extract and utilize the contextual features in large image patches as part of the SR process. On the other hand, the leading Sparse Coding method ‘A+’—which is among the strongest point-based baselines against the DNNs—seeks to divide the RGB space into neighborhoods, where locally a simple linear regression (comprised by roughly 102 parameters) suffices for SR. In this paper, we explore how the performance of Sparse Coding can be further advanced. We point out that in the original A+, the sparse dictionary used for neighborhood separations are optimized for the spectral data but used in the projected RGB space. In turn, we demonstrate that if the local linear mapping is trained for each spectral neighborhood instead of RGB neighborhood (and theoretically if we could recover each spectrum based on where it locates in the spectral space), the Sparse Coding algorithm can actually perform much better than the leading DNN method. In effect, our result defines one potential (and very appealing) upper-bound performance of point-based SR.

Item Type:	Article
Uncontrolled Keywords:	computer vision and pattern recognition,electronic, optical and magnetic materials,atomic and molecular physics, and optics ,/dk/atira/pure/subjectarea/asjc/1700/1707
Faculty \ School:	Faculty of Science > School of Computing Sciences
UEA Research Groups:	Faculty of Science > Research Groups > Colour and Imaging Lab
Related URLs:	http://www.scopus.com/inward/record.url?... https://www.ingentaconnect.com/content/1...
Depositing User:	LivePure Connector
Date Deposited:	04 Dec 2021 01:41
Last Modified:	30 Jan 2024 02:50
URI:	https://ueaeprints.uea.ac.uk/id/eprint/82552
DOI:	10.2352/issn.2169-2629.2021.29.19

Downloads

Downloads per month over past year

Actions (login required)

View Item