Perceptually guided photo retargeting

Xia, Yingjie, Zhang, Luming, Hong, Richang, Nie, Liqiang, Yan, Yan and Shao, Ling (2017) Perceptually guided photo retargeting. IEEE Transactions on Cybernetics, 47 (3). pp. 566-578. ISSN 2168-2267

Preview

PDF (Accepted manuscript) - Accepted Version Download (1MB) | Preview

Abstract

We propose perceptually guided photo retargeting, which shrinks a photo by simulating a human's process of sequentially perceiving visually/semantically important regions in a photo. In particular, we first project the local features (graphlets in this paper) onto a semantic space, wherein visual cues such as global spatial layout and rough geometric context are exploited. Thereafter, a sparsity-constrained learning algorithm is derived to select semantically representative graphlets of a photo, and the selecting process can be interpreted by a path which simulates how a human actively perceives semantics in a photo. Furthermore, we learn the prior distribution of such active graphlet paths (AGPs) from training photos that are marked as esthetically pleasing by multiple users. The learned priors enforce the corresponding AGP of a retargeted photo to be maximally similar to those from the training photos. On top of the retargeting model, we further design an online learning scheme to incrementally update the model with new photos that are esthetically pleasing. The online update module makes the algorithm less dependent on the number and contents of the initial training data. Experimental results show that: 1) the proposed AGP is over 90% consistent with human gaze shifting path, as verified by the eye-tracking data, and 2) the retargeting algorithm outperforms its competitors significantly, as AGP is more indicative of photo esthetics than conventional saliency maps.

Item Type:	Article
Uncontrolled Keywords:	shrink,active graphlet path (agp),retargeting,semantics
Faculty \ School:	Faculty of Science > School of Computing Sciences
Related URLs:	http://ieeexplore.ieee.org/document/7458...
Depositing User:	Pure Connector
Date Deposited:	09 Mar 2017 01:41
Last Modified:	04 Mar 2024 17:34
URI:	https://ueaeprints.uea.ac.uk/id/eprint/62913
DOI:	10.1109/TCYB.2016.2520959

Downloads

Actions (login required)

View Item