A review of multimodal human activity recognition with special emphasis on classification, applications, challenges and future directions

SK Yadav, K Tiwari, HM Pandey, SA Akbar - Knowledge-Based Systems, 2021 - Elsevier
Human activity recognition (HAR) is one of the most important and challenging problems in
the computer vision. It has critical application in wide variety of tasks including gaming …

Future transformer for long-term action anticipation

D Gong, J Lee, M Kim, SJ Ha… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
The task of predicting future actions from a video is crucial for a real-world agent interacting
with others. When anticipating actions in the distant future, we humans typically consider …

P3iv: Probabilistic procedure planning from instructional videos with weak supervision

H Zhao, I Hadji, N Dvornik… - Proceedings of the …, 2022 - openaccess.thecvf.com
In this paper, we study the problem of procedure planning in instructional videos. Here, an
agent must produce a plausible sequence of actions that can transform the environment …

Pdpp: Projected diffusion for procedure planning in instructional videos

H Wang, Y Wu, S Guo, L Wang - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
In this paper, we study the problem of procedure planning in instructional videos, which aims
to make goal-directed plans given the current visual observations in unstructured real-life …

Learning to anticipate egocentric actions by imagination

Y Wu, L Zhu, X Wang, Y Yang… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Anticipating actions before they are executed is crucial for a wide range of practical
applications, including autonomous driving and robotics. In this paper, we study the …

Procedure planning in instructional videos

CY Chang, DA Huang, D Xu, E Adeli, L Fei-Fei… - … on Computer Vision, 2020 - Springer
In this paper, we study the problem of procedure planning in instructional videos, which can
be seen as a step towards enabling autonomous agents to plan for complex tasks in …

Uncertainty-aware Action Decoupling Transformer for Action Anticipation

H Guo, N Agarwal, SY Lo, K Lee… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Human action anticipation aims at predicting what people will do in the future based on past
observations. In this paper we introduce Uncertainty-aware Action Decoupling Transformer …

Event-guided procedure planning from instructional videos with text supervision

AL Wang, KY Lin, JR Du, J Meng… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we focus on the task of procedure planning from instructional videos with text
supervision, where a model aims to predict an action sequence to transform the initial visual …

Rethinking learning approaches for long-term action anticipation

M Nawhal, AA Jyothi, G Mori - European Conference on Computer Vision, 2022 - Springer
Action anticipation involves predicting future actions having observed the initial portion of a
video. Typically, the observed video is processed as a whole to obtain a video-level …

Self-regulated learning for egocentric video activity anticipation

Z Qi, S Wang, C Su, L Su, Q Huang… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Future activity anticipation is a challenging problem in egocentric vision. As a standard
future activity anticipation paradigm, recursive sequence prediction suffers from the …