Describing unseen classes by exemplars: Zero-shot learning using grouped simile ensemble

Long, Yang and Shao, Ling (2017) Describing unseen classes by exemplars: Zero-shot learning using grouped simile ensemble. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). The Institute of Electrical and Electronics Engineers (IEEE). ISBN 978-1-5090-4822-9

[thumbnail of Accepted manuscript]
PDF (Accepted manuscript) - Accepted Version
Download (4MB) | Preview


Learning visual attributes is an effective approach for zero-shot recognition. However, existing methods are restricted to learning explicitly nameable attributes and cannot tell which attributes are more important to the recognition task. In this paper, we propose a unified framework named Grouped Simile Ensemble (GSE). We claim our contributions as follows. 1) We propose to substitute explicit attribute annotation by similes, which are more natural expressions that can describe complex unseen classes. Similes do not involve extra concepts of attributes, i.e. only exemplars of seen classes are needed. We provide an efficient scenario to annotate similes for two benchmark datasets, AwA and aPY. 2) We propose a graph-cut-based class clustering algorithm to effectively discover implicit attributes from the similes. 3) Our GSE can automatically find the most effective simile groups to make the prediction. On both datasets, extensive experimental results manifest that our approach can significantly improve the performance over the state-of-the-art methods.

Item Type: Book Section
Faculty \ School: Faculty of Science > School of Computing Sciences
Depositing User: Pure Connector
Date Deposited: 18 Jan 2017 00:04
Last Modified: 22 Oct 2022 23:50
DOI: 10.1109/WACV.2017.106

Actions (login required)

View Item View Item