Deep Learning for Human Action Recognition: A Comprehensive Review

Duc Quang Vu, Trang Phung Thi Thu, Ngan Le, Jia Ching Wang

Research output: Contribution to journalArticlepeer-review

1 Scopus citations


Over the past several years, we have witnessed remarkable progress in numerous computer vision applications, particularly in human activity analysis. Human action recognition, which aims to automatically examine and recognize the actions taking place in the video, has been widely applied in many applications. This paper presents a comprehensive survey of approaches and techniques in deep learning-based human activity analysis. First, we introduce the problem definition in action recognition together with its challenges. Second, we provide a comprehensive survey of feature representation methods. Third, we categorize human activity methodologies and discuss their advantages and limitations. In particular, we divide human action recognition into three main categories according to training mechanisms, i.e., supervised learning, semi-supervised learning, and self-supervised learning. We further analyze the existing network architectures, their performance, and source code availability for each main category. Fourth, we provide a detailed analysis of the existing, publicly available datasets, including small-scale and large-scale datasets for human action recognition. Finally, we discuss some open issues and future research directions.

Original languageEnglish
Article numbere12
JournalAPSIPA Transactions on Signal and Information Processing
Issue number1
StatePublished - 2023


  • Action recognition
  • deep learning
  • deep neural networks
  • self-supervised learning
  • supervised learning


Dive into the research topics of 'Deep Learning for Human Action Recognition: A Comprehensive Review'. Together they form a unique fingerprint.

Cite this