Deep Attention-Based Spatially Recursive Networks for Fine-Grained Visual Recognition

doi:10.1109/TCYB.2018.2813971

Paper

Deep Attention-Based Spatially Recursive Networks for Fine-Grained Visual Recognition

Published May 1, 2019 · Lin Wu, Y. Wang, Xue Li

IEEE Transactions on Cybernetics

Q1 SJR score

213

Citations

3

Influential Citations

Full text Semantic Scholar

Abstract

Fine-grained visual recognition is an important problem in pattern recognition applications. However, it is a challenging task due to the subtle interclass difference and large intraclass variation. Recent visual attention models are able to automatically locate critical object parts and represent them against appearance variations. However, without consideration of spatial dependencies in discriminative feature learning, these methods are underperformed in classifying fine-grained objects. In this paper, we present a deep attention-based spatially recursive model that can learn to attend to critical object parts and encode them into spatially expressive representations. Our network is technically premised on bilinear pooling, enabling local pairwise feature interactions between outputs from two different convolutional neural networks (CNNs) that correspond to distinct region detection and relevant feature extraction. Then, spatial long-short term memory (LSTMs) units are introduced to generate spatially meaningful hidden representations via the long-range dependency on all features in two dimensions. The attention model is leveraged between bilinear outcomes and spatial LSTMs for dynamic selection on varied inputs. Our model, which is composed of two-stream CNN layers, bilinear pooling, and spatial recursive encoding with attention, is end-to-end trainable to serve as the part detector and feature extractor whereby relevant features are localized, extracted, and encoded spatially for recognition purpose. We demonstrate the superiority of our method over two typical fine-grained recognition tasks: fine-grained image classification and person re-identification.

Highly Cited

Study Snapshot

Key takeawayOur deep attention-based spatially recursive model effectively identifies and classifies fine-grained objects, outperforming methods like bilinear pooling and spatial LSTMs.

PopulationOlder adults (50-71 years)

Sample size24

MethodsObservational

OutcomesBody Mass Index projections

ResultsSocial networks mitigate obesity in older groups.

Sign up to use Study Snapshot

Consensus is limited without an account. Create an account or sign in to get more searches and use the Study Snapshot.

Create an account

Deep Attention-Based Spatially Recursive Networks for Fine-Grained Visual Recognition

Sign up to use Study Snapshot

References

Citations