Generalizing Eye Tracking With Bayesian Adversarial Learning

doi:10.1109/CVPR.2019.01218

Paper

Generalizing Eye Tracking With Bayesian Adversarial Learning

Published Jun 1, 2019 · Kang Wang, Rui Zhao, Hui Su

2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

UNKNOWN SJR score

79

Citations

14

Influential Citations

Full text

Semantic Scholar

Abstract

Existing appearance-based gaze estimation approaches with CNN have poor generalization performance. By systematically studying this issue, we identify three major factors: 1) appearance variations; 2) head pose variations and 3) over-fitting issue with point estimation. To improve the generalization performance, we propose to incorporate adversarial learning and Bayesian inference into a unified framework. In particular, we first add an adversarial component into traditional CNN-based gaze estimator so that we can learn features that are gaze-responsive but can generalize to appearance and pose variations. Next, we extend the point-estimation based deterministic model to a Bayesian framework so that gaze estimation can be performed using all parameters instead of only one set of parameters. Besides improved performance on several benchmark datasets, the proposed method also enables online adaptation of the model to new subjects/environments, demonstrating the potential usage for practical real-time eye tracking applications.

Highly Cited

Study Snapshot

Key takeawayIntegrating adversarial learning and Bayesian inference into a unified framework improves generalization performance in appearance-based gaze estimation, enabling online adaptation to new subjects and environments.

PopulationOlder adults (50-71 years)

Sample size24

MethodsObservational

OutcomesBody Mass Index projections

ResultsSocial networks mitigate obesity in older groups.

Generalizing Eye Tracking With Bayesian Adversarial Learning

References

Citations