Dimensionality Reduction in

Hyperspectral Image Analysis

Using
Independent Component Analysis

Hongtao Du

Feb 18, 2003

1
Status Summary
 What is hyperspectral image? Introduction on Hyperspectral Image
 How to analyze hyperspectral
image?
 Why reduce dimensionality in Hyperspectral Image Analysis
hyperspectral image
analysis?
Independent Component Analysis
 What is independent
component analysis?
 How to use ICA to reduce Parallel ICA
dimensionality in HSI?
 Any parallel solution?
 Implement on FPGA?
Implementation on FPGA
2
Introduction on Hyperspectral Image

Electromagnetic Spectrum

Multispectral Image
Electromagnetic Spectrum
Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis

Parallel ICA

Implementation on FPGA

[1]

Criterion: wavelength
3
Number of Bands in Spectral Images

4
Introduction on Hyperspectral Image

Electromagnetic Spectrum

Multispectral Image
Multispectral Image
Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis

Parallel ICA
Simplest one: RGB images
Implementation on FPGA
Not necessarily contiguous
Multispectral sensor collect data
– Simultaneously
– Sequentially

5
Introduction on Hyperspectral Image

Electromagnetic Spectrum

Multispectral Image Hyperspectral Image

Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis In narrow and contiguous wavelength

Parallel ICA
bands.
Implementation on FPGA

Most Hyperspectral
– 100~300 bands
– Interval < 15 nm
Hyperspectral sensor collect data
– Simultaneously

6
Introduction on Hyperspectral Image

Spectral analysis
Hyperspectral Image Analysis

Analysis Spaces

Challenges and Approaches

Independent Component Analysis

Parallel ICA

Implementation on FPGA

Soil Rock

Water Vegetation
7
Introduction on Hyperspectral Image

Hyperspectral Image Analysis

Analysis Spaces
Analysis Spaces

Challenges and Approaches

Independent Component Analysis

Parallel ICA

Implementation on FPGA

Image Space Spectral Space

Feature Space 8
Analysis Spaces (Cont’)
Image space
– Pixels are displayed in grey scale.
– Spatial analysis
Spectral space
– Pixels are functions of wavelength.
– Spectral analysis
Feature space
– Pixels are points in N-dimensional space.
– Relationships among Pixels

9
Introduction on Hyperspectral Image

Hyperspectral Image Analysis

Challenges and Approaches
Analysis Spaces

Challenges and Approaches

Large Classification Pureness
Independent Component Analysis
Dimensionality Accuracy
Parallel ICA

Implementation on FPGA Many Bands Need More Resolution

Training pixels Not High

Band Feature Identifying Suitable Linear Projection

Selection Extraction Labeling Classifiers Unmixing
Training
Samples

Matrix Principal N_FINDER [4] Feed Forward ICA [6] Projection

Factorization Component Neural Network Pursuit [7]
[2] Transformation [5]
[3]
10
Introduction on Hyperspectral Image

FastICA Algorithm
Hyperspectral Image Analysis

Independent Component Analysis

FastICA
Initialize
Using ICA to Reduce Dimensionality
Weight Vector w
Parallel ICA

Implementation on FPGA

Update w  E{xg(wT x)}  E{g ' (wT x)}w

One Unit
Loop until
Process Converge
Normalize w  w / w

Decorrelate w p 1  w p 1   wTp 1w j w j

Multiple Loop until j 1

Units Converge
Decorrelation Normalize wp 1  wp 1 / wTp 1wp 1

Next 11
Introduction on Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis Using ICA to Reduce Dimensionality

FastICA

Using ICA to Reduce Dimensionality

Parallel ICA

Implementation on FPGA

12
Introduction on Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis Parallel ICA

Parallel ICA
nj
Diagram
iu  iu     jv jv T
iu
Internal
Decorrelation
v 1
Comparison

Implementation on FPGA
p
i ( p 1)  i ( p 1)  iuT iviv External
Decorrelation
v 1

p nj
i ( p 1)  i ( p 1)    T
i ( p 1) iviv    T
 jr jr
i ( p 1)
v 1 r 1

pn j
i ( p 1)   i ( p 1)   i ( p 1)vv
 T

v 1

13
Introduction on Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis

Parallel ICA
Parallel ICA Diagram
Diagram

Comparison

Implementation on FPGA

14
Introduction on Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis

Parallel ICA
Performance Comparison
Diagram

Comparison

Implementation on FPGA

15
Introduction on Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis Advantage and Disadvantage of FPGA

Parallel ICA

Implementation on FPGA

Advantage and Disadvantage Advantages

– Speedup
Synthesis Processes

– Parallel computation
Disadvantages
– Complexity
– Size of data set

16
Introduction on Hyperspectral Image

Hyperspectral Image Analysis

Independent Component Analysis

Synthesis Processes
Parallel ICA

Implementation on FPGA

Advantage and Disadvantage

Synthesis Processes

17
 Conclusions

 HSI and HSI Analysis

 Reduce dimensionality
 ICA
 Using ICA to reduce dimensionality
 Parallel ICA
 Implement on FPGA

18
 References
1. The office of Biological & Physical Research, “Introduction of Space Research”,
NASA, http://spaceresearch.nasa.gov/general_info/light_06-2002_lite.html
2. M. Velez-Reyes et al. “Comparison of matrix factorization algorithms for band
selection in hyperspectral imagery”. In SPIE 14th Annual International Symposium
on Aerospace/Defense Sensing, Simulation and Controls, volume 4049(2000),
pages 288–297, 2000.
3. P. Hsu and Y. Tseng. “Primary study of fourier spectrum feature extraction for
hyperspectral image”. In The 19th Asian Conference on Remote Sensing, Manila,
16-20 November 1998. Asian Association of Remote Sensing (AARS).
4. E. Winter and M. Winter. “Autonomous hyperspectral end-member determination
methods”. In EUROPTO Conference on Sensors, Systems, and Next-Generation
Satellites V, volume 3870, pages 150–158, Florence, Italy, September 1999.
5. S. Subramanian, et al. “Methodology for hyperspectral image classification using
novel neural network”. In A.Evan Iverson and Sylvia S. Shen, editors, SPIE:
Algorithms for Multispectral and Hyperspectral Imagery III, volume 3071, pages
128–137, Orlando, FL, USA, April 1997.
6. L. Parra and S. Sajda. “Unmixing hyperspectral data”, Advances in Neural
Information Processing Systems 12, MIT Press, pp. 942-948, 2000
7. S. Chiang, et al. “Unsupervised hyperspectral image analysis using independent
component analysis”. In Geoscience and Remote Sensing Symposium, 2000.
Proceedings. IGARSS 2000, volume 4, pages 3136 – 3138, Honolulu, HI, USA,
24-28 July 2000. IEEE.

19