Spatio-temporal Laplacian pyramid coding for action recognition

Shao, Ling, Zhen, Xiantong, Tao, Dacheng and Li, Xuelong (2014) Spatio-temporal Laplacian pyramid coding for action recognition. IEEE Transactions on Cybernetics, 44 (6). pp. 817-827. ISSN 2168-2267

Full text not available from this repository.


We present a novel descriptor, called spatio-temporal Laplacian pyramid coding (STLPC), for holistic representation of human actions. In contrast to sparse representations based on detected local interest points, STLPC regards a video sequence as a whole with spatio-temporal features directly extracted from it, which prevents the loss of information in sparse representations. Through decomposing each sequence into a set of band-pass-filtered components, the proposed pyramid model localizes features residing at different scales, and therefore is able to effectively encode the motion information of actions. To make features further invariant and resistant to distortions as well as noise, a bank of 3-D Gabor filters is applied to each level of the Laplacian pyramid, followed by max pooling within filter bands and over spatio-temporal neighborhoods. Since the convolving and pooling are performed spatio-temporally, the coding model can capture structural and motion information simultaneously and provide an informative representation of actions. The proposed method achieves superb recognition rates on the KTH, the multiview IXMAS, the challenging UCF Sports, and the newly released HMDB51 datasets. It outperforms state of the art methods showing its great potential on action recognition.

Item Type: Article
Faculty \ School: Faculty of Science > School of Computing Sciences
Related URLs:
Depositing User: Pure Connector
Date Deposited: 07 Feb 2017 02:39
Last Modified: 11 Jul 2023 10:30
DOI: 10.1109/TCYB.2013.2273174

Actions (login required)

View Item View Item