Video saliency detection using object proposals

Guo, Fang, Wang, Wenguan, Shen, Jianbing, Shao, Ling, Yang, Jian, Tao, Dacheng and Tang, YY (2018) Video saliency detection using object proposals. IEEE Transactions on Cybernetics, 48 (11). pp. 3159-3170. ISSN 2168-2267

[thumbnail of Accepted manuscript]
Preview
PDF (Accepted manuscript) - Accepted Version
Download (1MB) | Preview

Abstract

In this paper, we introduce a novel approach to identify salient object regions in videos via object proposals. The core idea is to solve the saliency detection problem by ranking and selecting the salient proposals based on object-level saliency cues. Object proposals offer a more complete and high-level representation, which naturally caters to the needs of salient object detection. As well as introducing this novel solution for video salient object detection, we reorganize various discriminative saliency cues and traditional saliency assumptions on object proposals. With object candidates, a proposal ranking and voting scheme, based on various object-level saliency cues, is designed to screen out nonsalient parts, select salient object regions, and to infer an initial saliency estimate. Then a saliency optimization process that considers temporal consistency and appearance differences between salient and nonsalient regions is used to refine the initial saliency estimates. Our experiments on public datasets (SegTrackV2, Freiburg-Berkeley Motion Segmentation Dataset, and Densely Annotated Video Segmentation) validate the effectiveness, and the proposed method produces significant improvements over state-of-the-art algorithms.

Item Type: Article
Faculty \ School: Faculty of Science > School of Computing Sciences
Related URLs:
Depositing User: Pure Connector
Date Deposited: 14 Nov 2017 06:05
Last Modified: 10 Jul 2023 16:30
URI: https://ueaeprints.uea.ac.uk/id/eprint/65433
DOI: 10.1109/TCYB.2017.2761361

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item