Overview

Original Research

LEARNING SPATIO-TEMPORAL FEATURE EXTRACTION USING RESIDUAL FRAMES WITH NEURALNETWORKS FOR HUMAN ACTION RECOGNITION

C.INDHUMATHI 1, Dr.V.MURUGAN 2 and Dr.G.MUTHULAKSHMI 3

Vol 17, No 06 ( 2022 )   |  DOI: 10.5281/zenodo.6655091   |   Author Affiliation: Department of Computer Science and Engineering Manonmaniam Sundaranar University Abishekapatti,Tirunelveli,TamilNadu,India 1; Department of Computer Science Government Arts and Science College Kadayanallur,Tenkasi, Tirunelveli,TamilNadu 2; Department of Computer Science and Engineering Manonmaniam Sundaranar University Abishekapatti,Tirunelveli,TamilNadu,India 3.   |   Licensing: CC 4.0   |   Pg no: 389-399   |   To cite: C.INDHUMATHI,et al., (2022). LEARNING SPATIO-TEMPORAL FEATURE EXTRACTION USING RESIDUAL FRAMES WITH NEURALNETWORKS FOR HUMAN ACTION RECOGNITION. 17(06), 389–399. https://doi.org/10.5281/zenodo.6655091   |   Published on: 15-06-2022

Abstract

In recent times the growth of machine learning and artificial intelligence algorithms help to expand the use of image and video processing. The usage of different algorithms is applicable in various fields such as content-based video recognition, video surveillance, assistive living, autism care, and gaming. HAR (Human Action Recognition) highly demands efficient computation. This research proposed a method for selecting residual frames and keyframes toeliminate redundant information from videos. This method combines the extraction of spatial and temporal features. These features were extracted using the VGG16 (Visual Geometry Group) network and classified using Multi SVM classifier. The proposed research method was tested on HMDB51 and UCF101 datasets. The result of the proposed method achieved an accuracy of 85.6% and 98.71% onHMDB51andUCF101datasetsrespectively.

Keywords

Spatial features, Temporal features, Keyframes, Residual frames, VGG16