Towards Fine-Grained Open Zero-Shot Learning: Inferring Unseen Visual Features from Attributes

Long, Yang, Liu, Li and Shao, Ling (2017) Towards Fine-Grained Open Zero-Shot Learning: Inferring Unseen Visual Features from Attributes. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). The Institute of Electrical and Electronics Engineers (IEEE). ISBN 978-1-5090-4823-6

Preview

PDF (Accepted manuscript) - Accepted Version Download (4MB) | Preview

Abstract

Zero-shot Learning (ZSL) can leverage attributes to recognise unseen instances. However, the training data is limited and cannot adequately discriminate fine-grained classes with similar attributes. In this paper, we propose a complementary procedure that inversely makes use of attributes to infer discriminative visual features for unseen classes. In this way, ZSL is fully converted into conventional supervised classification, where robust classifiers can be employed to address the fine-grained problem. To infer high-quality unseen data, we propose a novel algorithm named Orthogonal Semantic-Visual Embedding (OSVE) that can discover the tiny visual differences between different instances under the same attribute by an orthogonal embedding space. On two fine-grained benchmarks, CUB and SUN, our method remarkably improves the state-of-the-art results under standard ZSL settings. We further challenge the Open ZSL problem where the number of seen classes is significantly smaller than that of unseen classes. Substantial experiments manifest that the inferred visual features can be successfully fed to SVM which can effectively discriminate unseen classes from fine-grained open candidates.can be employed to address the fine-grained problem. To infer high-quality unseen data, we propose a novel algorithm named Orthogonal Semantic-Visual Embedding (OSVE) that can discover the tiny visual differences between different instances under the same attribute by an orthogonal embedding space. On two fine-grained benchmarks, CUB and SUN, our method remarkably improves the state-of-the-art results under standard ZSL settings. We further challenge the Open ZSL problem where the number of seen classes is significantly smaller than that of unseen classes. Substantial experiments manifest that the inferred visual features can be successfully fed to SVM which can effectively discriminate unseen classes from fine-grained open candidates.

Item Type:	Book Section
Faculty \ School:	Faculty of Science > School of Computing Sciences
Depositing User:	Pure Connector
Date Deposited:	18 Jan 2017 00:03
Last Modified:	21 Oct 2022 23:59
URI:	https://ueaeprints.uea.ac.uk/id/eprint/62137
DOI:	10.1109/WACV.2017.110

Downloads

Actions (login required)

View Item