State-of-the-art in 360 video/image processing: Perception, assessment and compression

M Xu, C Li, S Zhang, P Le Callet - IEEE Journal of Selected …, 2020 - ieeexplore.ieee.org
Nowadays, 360° video/image has been increasingly popular and drawn great attention. The
spherical viewing range of 360° video/image accounts for huge data, which pose the …

Eye-tracked virtual reality: A comprehensive survey on methods and privacy challenges

E Bozkir, S Özdel, M Wang, B David-John… - arxiv preprint arxiv …, 2023 - arxiv.org
Latest developments in computer hardware, sensor technologies, and artificial intelligence
can make virtual reality (VR) and virtual spaces an important part of human everyday life …

Scandmm: A deep markov model of scanpath prediction for 360deg images

X Sui, Y Fang, H Zhu, S Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Scanpath prediction for 360deg images aims to produce dynamic gaze behaviors based on
the human visual perception mechanism. Most existing scanpath prediction methods for …

Predicting head movement in panoramic video: A deep reinforcement learning approach

M Xu, Y Song, J Wang, ML Qiao… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
Panoramic video provides immersive and interactive experience by enabling humans to
control the field of view (FoV) through head movement (HM). Thus, HM plays a key role in …

Cube padding for weakly-supervised saliency prediction in 360 videos

HT Cheng, CH Chao, JD Dong… - Proceedings of the …, 2018 - openaccess.thecvf.com
Automatic saliency prediction in 360 videos is critical for viewpoint guidance applications
(eg, Facebook 360 Guide). We propose a spatial-temporal network which is (1) …

Your attention is unique: Detecting 360-degree video saliency in head-mounted display for head movement prediction

A Nguyen, Z Yan, K Nahrstedt - Proceedings of the 26th ACM …, 2018 - dl.acm.org
Head movement prediction is the key enabler for the emerging 360-degree videos since it
can enhance both streaming and rendering efficiency. To achieve accurate head movement …

Saliency prediction in the deep learning era: Successes and limitations

A Borji - IEEE transactions on pattern analysis and machine …, 2019 - ieeexplore.ieee.org
Visual saliency models have enjoyed a big leap in performance in recent years, thanks to
advances in deep learning and large scale annotated data. Despite enormous effort and …

[HTML][HTML] DeepGaze III: Modeling free-viewing human scanpaths with deep learning

M Kümmerer, M Bethge, TSA Wallis - Journal of Vision, 2022 - iovs.arvojournals.org
Humans typically move their eyes in “scanpaths” of fixations linked by saccades. Here we
present DeepGaze III, a new model that predicts the spatial location of consecutive fixations …

Assessor360: Multi-sequence network for blind omnidirectional image quality assessment

T Wu, S Shi, H Cai, M Cao, J **ao… - Advances in Neural …, 2023 - proceedings.neurips.cc
Abstract Blind Omnidirectional Image Quality Assessment (BOIQA) aims to objectively
assess the human perceptual quality of omnidirectional images (ODIs) without relying on …

Beyond average: Individualized visual scanpath prediction

X Chen, M Jiang, Q Zhao - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Understanding how attention varies across individuals has significant scientific and societal
impacts. However existing visual scanpath models treat attention uniformly neglecting …