Cosaliency detection based on intrasaliency prior transfer and deep intersaliency mining

Zhang, Dingwen, Han, Junwei, Han, Jungong and Shao, Ling (2016) Cosaliency detection based on intrasaliency prior transfer and deep intersaliency mining. IEEE Transactions on Neural Networks and Learning Systems, 27 (6). pp. 1163-1176. ISSN 2162-237X

Preview

PDF (Accepted manuscript) - Accepted Version Download (2MB) | Preview

Abstract

As an interesting and emerging topic, cosaliency detection aims at simultaneously extracting common salient objects in multiple related images. It differs from the conventional saliency detection paradigm in which saliency detection for each image is determined one by one independently without taking advantage of the homogeneity in the data pool of multiple related images. In this paper, we propose a novel cosaliency detection approach using deep learning models. Two new concepts, called intrasaliency prior transfer and deep intersaliency mining, are introduced and explored in the proposed work. For the intrasaliency prior transfer, we build a stacked denoising autoencoder (SDAE) to learn the saliency prior knowledge from auxiliary annotated data sets and then transfer the learned knowledge to estimate the intrasaliency for each image in cosaliency data sets. For the deep intersaliency mining, we formulate it by using the deep reconstruction residual obtained in the highest hidden layer of a self-trained SDAE. The obtained deep intersaliency can extract more intrinsic and general hidden patterns to discover the homogeneity of cosalient objects in terms of some higher level concepts. Finally, the cosaliency maps are generated by weighted integration of the proposed intrasaliency prior, deep intersaliency, and traditional shallow intersaliency. Comprehensive experiments over diverse publicly available benchmark data sets demonstrate consistent performance gains of the proposed method over the state-of-the-art cosaliency detection methods.

Item Type:	Article
Uncontrolled Keywords:	stacked denoising autoencoder (sdae),cosaliency detection,deep learning,prior transfer
Faculty \ School:	Faculty of Science > School of Computing Sciences
Depositing User:	Pure Connector
Date Deposited:	08 Mar 2017 01:41
Last Modified:	22 Oct 2022 02:10
URI:	https://ueaeprints.uea.ac.uk/id/eprint/62880
DOI:	10.1109/TNNLS.2015.2495161

Downloads

Actions (login required)

View Item