Video action recognition with visual privacy protection based on compressed sensing

Jixin LIU, Ruxue ZHANG, Guang HAN, Ning SUN, Sam KWONG

Research output: Journal PublicationsJournal Article (refereed)peer-review

9 Citations (Scopus)

Abstract

Action recognition in video involves interpreting complex semantic information, which remains a challenge in computer vision. Research on the use of deep neural networks for video action recognition has made significant progress in recent years, but most available recognition frameworks cannot satisfactorily perform the video action recognition task in privacy scene. In light of this issue, this paper proposes a method for video action recognition that employs a compressed sensing-based visual privacy protection framework. The proposed method protects visual privacy by balancing operational efficiency with the accuracy of recognition. It consists of three steps. First, compressed sensing is used to realize visual privacy protection and significantly enhance efficiency at the same time. Second, the convolutional 3D network model is used due to its speed to represent features of video actions in the compressed sensing data, and PCA is used to reduce the dimensionality of the extracted feature vectors to reduce temporal complexity. Finally, a sparse representation-based classification algorithm is integrated into the AdaBoost architecture to improve the recognition performance of the proposed method. Experiments were performed on three commonly used video action datasets to verify the proposed method, and the results show that it is robust in video action recognition tasks, and adequately protects visual privacy.
Original languageEnglish
Article number101882
JournalJournal of Systems Architecture
Volume113
Early online date19 Sept 2020
DOIs
Publication statusPublished - Feb 2021
Externally publishedYes

Bibliographical note

This work was supported by funds from the Provincial Natural Science Foundation of the Science and Technology Bureau of Jiangsu Province (Grant No. BK20180088 ), the China Postdoctoral Science Foundation (Grant No. 2019M651916 ), the Scientific Research Foundation of Nanjing University of Posts and Telecommunications (Grant No. NY218066 ) and the Natural Science Foundation of China (Grant No. 61871445 ).

Keywords

  • Action recognition
  • AdaBoost
  • Compressed sensing
  • Sparse representation-based classification
  • Visual privacy protection

Fingerprint

Dive into the research topics of 'Video action recognition with visual privacy protection based on compressed sensing'. Together they form a unique fingerprint.

Cite this