Prediction of human activities based on a new structure of skeleton features and deep learning model

Neziha Jaouedi, Francisco J. Perales, José Maria Buades, Noureddine Boujnah, Med Salim Bouhlel

Research output: Contribution to journalArticlepeer-review

11 Citations (Scopus)

Abstract

The recognition of human activities is usually considered to be a simple procedure. Problems occur in complex scenes involving high speeds. Activity prediction using Artificial Intelligence (AI) by numerical analysis has attracted the attention of several researchers. Human activities are an important challenge in various fields. There are many great applications in this area, including smart homes, assistive robotics, human–computer interactions, and improvements in protection in several areas such as security, transport, education, and medicine through the control of falling or aiding in medication consumption for elderly people. The advanced enhancement and success of deep learning techniques in various computer vision applications encourage the use of these methods in video processing. The human presentation is an important challenge in the analysis of human behavior through activity. A person in a video sequence can be described by their motion, skeleton, and/or spatial characteristics. In this paper, we present a novel approach to human activity recognition from videos using the Recurrent Neural Network (RNN) for activity classification and the Convolutional Neural Network (CNN) with a new structure of the human skeleton to carry out feature presentation. The aims of this work are to improve the human presentation through the collection of different features and the exploitation of the new RNN structure for activities. The performance of the proposed approach is evaluated by the RGB-D sensor dataset CAD-60. The experimental results show the performance of the proposed approach through the average error rate obtained (4.5%).

Original languageEnglish
Article number4944
Pages (from-to)1-15
Number of pages15
JournalSensors (Switzerland)
Volume20
Issue number17
DOIs
Publication statusPublished - 01 Sep 2020

Keywords

  • Action recognition
  • Deep association metric
  • Deep learning
  • Human activities
  • Human detection
  • Motion tracking
  • Skeleton features

Fingerprint

Dive into the research topics of 'Prediction of human activities based on a new structure of skeleton features and deep learning model'. Together they form a unique fingerprint.

Cite this