Joint spatial-spectral hyperspectral image classification based on convolutional neural network

Mengxin HAN, Runmin CONG, Xinyu LI, Huazhu FU*, Jianjun LEI

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

53 Citations (Scopus)


Hyperspectral image (HSI) classification technology has been widely used in many earth observation tasks, such as detection, recognition, and surveillance. The traditional hyperspectral image classification methods mainly utilize hand-crafted features, such as edge and texture descriptors, which are not robust for different input data. By contrast, deep learning based methods exploit high-level features for hyperspectral image classification, but they usually degenerate the spatial-spectral structure, depend on a large number of training samples, and ignore a large amount of implicitly useful information. To address these problems, a new joint spatial-spectral hyperspectral image classification method based on different-scale two-stream convolutional network and spatial enhancement strategy is proposed in this paper. First, the pixel blocks at different scales around the center pixel are selected as the basic units to be processed. Then, a spatial enhancement strategy is designed to obtain various spatial location information under the limited training samples by the spatial rotation and row-column transformation. Finally, the spatial-spectral feature is learned by a different-scale two-stream convolutional network, and the classification result of the center pixel is obtained by a softmax layer. Experimental results on two datasets demonstrate that the proposed method outperforms other state-of-the-art methods qualitatively and quantitatively.

Original languageEnglish
Pages (from-to)38-45
Number of pages8
JournalPattern Recognition Letters
Early online date10 Feb 2020
Publication statusPublished - Feb 2020
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2018 Elsevier B.V.


  • CNN
  • Hyperspectral image classification
  • Joint spatial-spectral
  • Spatial enhancement


Dive into the research topics of 'Joint spatial-spectral hyperspectral image classification based on convolutional neural network'. Together they form a unique fingerprint.

Cite this