- Research
- Open Access
- Published:

# Manifold regularization for sparse unmixing of hyperspectral images

*SpringerPlus*
**volume 5**, Article number: 2007 (2016)

## Abstract

### Background

Recently, *sparse unmixing* has been successfully applied to spectral mixture analysis of remotely sensed hyperspectral images. Based on the assumption that the observed image signatures can be expressed in the form of linear combinations of a number of pure spectral signatures known in advance, unmixing of each mixed pixel in the scene is to find an optimal subset of signatures in a very large spectral library, which is cast into the framework of sparse regression. However, traditional sparse regression models, such as *collaborative sparse regression*, ignore the intrinsic geometric structure in the hyperspectral data.

### Results

In this paper, we propose a novel model, called *manifold regularized collaborative sparse regression*, by introducing a manifold regularization to the collaborative sparse regression model. The manifold regularization utilizes a graph Laplacian to incorporate the locally geometrical structure of the hyperspectral data. An algorithm based on *alternating direction method of multipliers* has been developed for the manifold regularized collaborative sparse regression model.

### Conclusions

Experimental results on both the simulated and real hyperspectral data sets have demonstrated the effectiveness of our proposed model.

## Background

In recent years, remotely sensed hyperspectral images have been widely used for various applications ranging from civilian to military purposes (Somers and Delalieux 2009; Settle and Drake 1993; Chang and Heinz 2000; Shimabukuro and Carvalho 1997), since they can provide abundant wavelength information of the land covers with spectral resolution at the micron level (Shaw and Burke 2003). For example, the National Aeronautics and Space Administration (NASA) Hyperion sensor on Earth Observing-1 (EO-1) satellite can provide hyperspectral images with 220 bands and a spectral resolution of the order of 10 nm. Despite high spectral resolution, the relatively low spatial resolution of hyperspectral images leads to *mixed pixel* problem, i.e., a single pixel usually contains several distinct materials. The existence of mixed pixels seriously restricts the application of hyperspectral images. To cope with mixed pixels, *spectral unmixing* (Keshava 2003; Bioucas-Dias and Plaza 2012; Meer 2012), which aims at decomposing the observed mixed pixel spectrum into a collection of pure substance spectra, namely *endmembers*, and their corresponding fractional *abundances*, has been proposed and widely applied in hyperspectral remote sensing data analysis (Bioucas-Dias and Plaza 2013).

For spectral unmixing, two kinds of models—the *linear mixture model* (LMM) (Singer et al. 1979) and the *non-linear mixture model* (NMM) (Hapke 1981)—have been proposed to characterize the mixed pixels. Although the LMM is not as accurate as the NMM to capture the mixing behavior of mixed pixels, it is more popular than the NMM for solving the spectral unmixing problem because of its simplicity and efficiency in most cases (Fan et al. 2009). In addition, the rapidly developed methods in classical signal processing field also provide effective tools to the solution of the LMM (Ma et al. 2014). Nevertheless, modeling the mixed pixels is a very complex and difficult task. In practice, we have to make a compromise between model accuracy and tractability. Therefore, we here focus on the LMM in this study.

The standard LMM used for spectral unmixing assumes that each pixel spectrum is a linear combination of the endmembers present in the scene weighted by the corresponding abundances. From the convex geometry point of view, the LMM forces the mixed pixels to belong to a simplex (or a convex hull), and the vertices of simplex correspond to the endmembers. Based on the geometrical interpretation, many spectral unmixing algorithms have been proposed for endmember extraction such as the N-FINDR (Winter 1999), *pixel purity index* (PPI) (Boardman et al. 1995), *vertex component analysis* (VCA) (Nascimento and Bioucas-Dias 2005), *simplex growing algorithm* (SGA) (Chang 2006) and their variants (Chan et al. 2011; Liu and Zhang 2012; Chang et al. 2010), and for abundance estimation such as the *fully constrained least squares* (FCLS) (Heinz and Chang 2001), *distance geometry-based abundance estimation* (DGAE) (Pu et al. 2014), and so on. However, these geometrical-based algorithms are likely to fail when the pixels are highly mixed. As an alternative, the statistical algorithms have been developed by formulating the spectral unmixing as a statistical inference problem. Such algorithms include the *dependent component analysis* (DECA) (Nascimento and Bioucas-Dias 2012), *beta compositional model* (BCM) (Zare et al. 2013) and *normal compositional model* (NCM) (Stein 2003) methods. Although the statistical algorithms have a natural framework for incorporating various priors and *endmember variability* (Somers et al. 2011; Zare and Ho 2014), it is difficult to derive the close-form expressions of the inference parameters and thus they suffer from high computational complexity.

Most of the spectral unmixing algorithms based on the standard LMM can not automatically determine the number of endmembers present in the scene. In addition, some endmembers produced by these algorithms are not necessarily present in the image, producing the so-called *virtual* endmembers (Chen 2011). The virtual endmembers can compensate the approximation of the LMM but will result in unidentifiability of the materials. To tackle these problem, the standard LMM has been extended into a semisupervised version (Liu and Zhang 2014; Iordache et al. 2012; Zhong and Zhang 2014; Feng et al. 2014; Iordache et al. 2011), i.e., by assuming that the endmembers are known in advance. Typically, Iordache et al. (2011) have proposed the *sparse regression* (SR) model by assuming that the endmembers present in the scene belong to a subset of samples available a *priori* in a library. The unmixing based on SR is called *sparse unmixing*. Experimental results have illustrated the potential of sparse unmixing in abundance estimation. The success of sparse unmixing relies crucially on the availability of suitable hyperspectral libraries because the libraries are hardly acquired under the same conditions of the remotely sensed images. Fortunately, this problem can be overcome by a delicate calibration procedure to adapt the library to the image or learning of the libraries directly from the data set without other *priori* information (Charles et al. 2011). The SR problem can be efficiently solved via the *sparse unmixing algorithm via variable splitting and augmented Lagrangian* (SUnSAL) (Iordache et al. 2011; Bioucas-Dias and Figueiredo 2010) by exploiting the sparse prior induced by the \(\ell _1\) norm. However, a high correlation of the spectral signatures limits the unmixing accuracy. To mitigate this limitation, Iordache et al. (2014a) have developed a *collaborative* SR (CSR) model by considering the structured sparsity, which exploits the fact that only a few spectral signatures in the library are active, in other words, only a few lines of abundances collected in a matrix are nonzero. Some modifications of the CSR can be found in Iordache et al. (2014b), Tang et al. (2015). However, the improvements in Iordache et al. (2014b), Tang et al. (2015) are limited since only the spectral information is considered to estimated the abundances.

Generally, the size of spectral library is often large, while the number of endmembers present in the scene is very small. Therefore, the fractional abundances are more likely to reside on a low-dimensional submanifold of the high-dimensional ambient Euclidean space. However, existing sparse unmixing methods only consider the Euclidean structure of the data space while ignoring the intrinsic manifold structure of the hyperspectral data. Many previous studies (Lu et al. 2013; Zheng et al. 2011; Guan et al. 2011; Seung and Lee 2000; He and Niyogi 2004; Belkin et al. 2006) have shown that exploiting the local geometrical structure (i.e., the intrinsic manifold structure) is very important to the model learning and data representation. In this paper, we incorporate the *manifold regularization* (Belkin et al. 2006) to the CSR and develop a novel model, called *manifold regularized collaborative sparse regression* (MCSR) model. The manifold regularization is characterized by a *Laplacian graph* which captures the local geometrical structure of the data manifold such that nearby mixed pixels in the intrinsic geometry of the data space are likely to have similar fractional abundances. By adding an additional manifold structure learning term to CSR, our proposed MCSR model is expected to have higher unmixing accuracy than CSR. To solve the MCSR, an optimization algorithm based on *alternating direction method of multipliers* (ADMM) is developed. It should be noted that similar works of using the manifold regularization have also been introduced in Lu et al. (2013), Tong et al. (2014), but they are different with ours in the following two main aspects. First, the works in Lu et al. (2013), Tong et al. (2014) are based on the standard LMM while our model is an extension of the SR model. Second, multiplicative iterative algorithm is used to optimize the nonnegative matrix factorization model in Lu et al. (2013), Tong et al. (2014), whereas the ADMM is used to cope with the proposed MCSR model.

## Related work

In this section, we first describe the sparse unmixing problem and then briefly review the CSR model.

### Sparse unmixing

The standard LMM signors the intimate mixture and holds at a macroscopic level (Bioucas-Dias and Plaza 2012). For a pixel spectrum \({y}\in {\mathscr {R}}^l\) with *l* spectral bands, LMM assume that it is a linear combination of the endmembers present in the scene weighted by the corresponding abundances, i.e.,

where \({\alpha }=(\alpha _1,\ldots ,\alpha _p)^T\in {\mathscr {R}}^p\) is the abundance vector, \({M}\in {\mathscr {R}}^{l\times p}\) is the endmember matrix with each column \({m}_i\in {\mathscr {R}}^l\) being an endmember present in the scene, \({e}\in {\mathscr {R}}^l\) denotes the noise or error term, and *p* is the number of endmembers present in the scene. To be physically meaningful, the abundance vector is usually *subject to* (*s.t.*) the *sum-to-one* and *nonnegativity* constraints

Over the past decades, lots of spectral unmixing algorithms (Keshava 2003; Bioucas-Dias and Plaza 2012, 2013) have been developed based on the above LMM. However, the abundance estimation by these algorithms usually relies on the availability of pure spectral signatures in the input data or on their capacities of extracting endmembers. In addition, some algorithms perform unmixing by assuming all of the endmembers in \({M}\) are present in the scene and by exploiting the sparsity prior of abundance \({\alpha }\). If the abundance \({\alpha }\) is not sparse or sufficiently sparse, the results obtained by these algorithms will not be as accurate as we expect. To cope with these problems, *sparse unmixing* (Iordache et al. 2011) has been introduced based on the assumption that the endmember set \(\{{m}_1,{m}_2,\ldots ,{m}_p\}\) present in the scene is contained in a spectral library denoted by \(\{{a}_1,{a}_2,\ldots ,{a}_m\}\) known in advance, i.e., \(\{{m}_1,{m}_2,\ldots ,{m}_p\}\subset \{{a}_1,{a}_2,\ldots ,{a}_m\}\). With the ever-growing availability of spectral libraries, the number of endmembers present in the scene is much less than the total number of endmembers in spectral library; thus, we have \(p\ll m\). By this way, unmixing is to find the optimal subset of signatures for the mixed pixels in the spectral library. The sparse unmixing model can be written as

where \({A}=[{a}_1,{a}_2,\ldots ,{a}_m]\in {\mathscr {R}}^{l\times m}\) is the spectral library, and \({x}\in {\mathscr {R}}^{m}\) is the abundance vector corresponding the spectral library \({A}\). Clearly, \({x}\) is sparse. By exploiting the sparse prior of abundance \({x}\) through the well-known \(\ell _1\) norm, we can estimate abundance vector \({x}\) by the following *sparse regression* (SR) problem:

where \(\Vert {x}\Vert _1=\sum _{i=1}^m|x_i|\) and \(\lambda _{\text {SR}}>0\) is a sparse regularization parameter. It is worth to note that the sum-to-one constraint is no longer necessary since the nonnegativity constraint can automatically lead to the sum-to-one constraint as stated in Bioucas-Dias and Plaza (2012), Iordache et al. (2011). However, the high mutual coherence of the spectral library \({A}\) limits the unmixing accuracy.

### Collaborative sparse regression

In fact, sparse unmixing, as a semi-supervised model, is a typical underdetermined linear system. To solve it, sparsity prior for the fractional abundance of each individual pixel is imposed in (6). Although the high level of sparsity of fractional abundances can enhance the recovery ability of the \(\ell _1\)-*minimization* problem (6), the highly correlated samples in library still restrict the capability of model (6) to obtain a desirable solution. To tackle this problem, the CSR model has been recently proposed in Iordache et al. (2014a). Unlike the \(\ell _1\)-*minimization* problem (6), the CSR model simultaneously (or collaboratively) imposes a sparsity to all pixels in the data set by exploiting the fact that pixels in a scene should share the same set of active endmembers, and thus only a few rows of the abundance matrix are nonzero.

Let \({Y}=[{y}_1,{y}_2,\ldots ,{y}_n]\in {\mathscr {R}}^{l\times n}\) be the *n* observed pixels arranged in a matrix, we can rewrite the sparse unmixing model (5) in the matrix form as

where \({E}=[{e}_1,{e}_2,\ldots ,{e}_n]\in {\mathscr {R}}^{l\times n}\) is the noise matrix and \({X}=[{x}_1,{x}_2,\ldots ,{x}_n]\in {\mathscr {R}}^{m\times n}\) is the fractional abundance matrix. With the collaborative sparsity induced by the row-sparsity regularizer \(\ell _{2,1}\) norm, the CSR problem can be formulated as

where \(\Vert {X}\Vert _{2,1}=\sum _{i=1}^m\Vert {x}^i\Vert _2\), \({x}^i\) represents the *i*th row of abundance fraction matrix \({X}\) and \(\lambda _{\text {CSR}}\) is a regularization parameter. An algorithm called *collaborative sparse unmixing via variable splitting and augmented Lagrangian* (CLSUnSAL) is provided in Iordache et al. (2014a) and a number of experiments have shown that the imposed collaborative sparsity prior can significantly reduce the probability of recovery failure.

## Methods

In this section, we introduce an enhanced CSR model, called *manifold regularized* CSR (MCSR) model, by incorporating a manifold regularization to CSR, and then an alternating direction method is developed to solve the resulting optimization problem.

### MCSR

As for CSR problem (8), the data fitting term \(\Vert {Y}-{AX}\Vert _F^2\) is useful for learning the Euclidean structures in the hyperspectral data space. As we have previously mentioned, the size of spectral library is usually very large, while the number of endmembers present in the scene is very small. From a geometric viewpoint, the fractional abundances are more likely to reside on a low-dimensional submanifold of the high-dimensional ambient Euclidean space. Recent studies (Lu et al. 2013; Zheng et al. 2011; Guan et al. 2011; Seung and Lee 2000; He and Niyogi 2004; Belkin et al. 2006) have shown that intrinsic geometric structures on manifolds are very important to the data representation and many manifold learning methods (Tenenbaum et al. 2000; Roweis and Saul 2000; Donoho and Grimes 2003; Belkin and Niyogi 2003; Lin and Zha 2008) have been proposed to recover the geometry of a data set. In the literature of spectral unmixing, many existing methods (Lu et al. 2013) only explore the Euclidean structure while fail to discover the intrinsic geometry structure of the data manifold. Therefore, we want to explore the ability of the intrinsic geometry structure of the hyperspectral data in improving the unmixing accuracy.

To preserve the intrinsic geometry structure of the data, a natural assumption, referred to the *manifold assumption* (He and Niyogi 2004), is that nearby data points are also nearby points in their low-dimensional representations. However, modeling the global geometric structures of the data is a very big challenge due to the insufficient number of samples and the high dimensionality of the ambient space. In practice, a nearest neighbor graph on the data points is often used to characterize the underlying local geometric structures.

Given *n* data points \(\{{y}_1,{y}_2,\ldots ,{y}_n\}\in {\mathscr {R}}^l\) sampled from the underlying submanifold, we construct a nearest neighbor graph \({\mathscr {G}}\) with its *i*th node corresponding to the data point \({y}_i, i=1,2,\ldots ,n\). For each node \({y}_i\), one can put an edge between it and its *k* nearest neighbors. Let \({\mathscr {N}}_k({y}_i)=\{{y}_i^1,\ldots ,{y}_i^k\}\) be the set of its *k* nearest neighbors. And we define the weight matrix \({W}\) on the graph \({\mathscr {G}}\) as

The weight \(w_{ij}\) is used to measure the similarity between data points \({y}_i\) and \({y}_j\), other similarity measures can also be used to evaluate the similarity (Cai et al. 2011). For the manifold assumption, i.e., if two points \({y}_i\) and \({y}_j\) are close to each other, then their low-dimensional representations \({x}_i\) and \({x}_j\) are close as well, a natural choice is to minimize the following manifold regularization \({\mathscr {T}}\), defined by

where \({L}={D}-{W}\) and \({D}\) is a diagonal matrix with the *i*th diagonal element \(d_{ii}=\sum _{j}w_{ij}\). The matrix \({L}\) is usually called *graph Laplacian* (Cai et al. 2011; He et al. 2011). It is apparent that minimizing the manifold regularization \({\mathscr {T}}\) imposes smoothness of the representation coefficients, or equally the prior assumption that if neighboring points \({y}_i\) and \({y}_j\) are similar (with a relatively bigger weight \(w_{ij}\)), their low-dimensional representations \({x}_i\) and \({x}_j\) should be very close. Therefore, minimizing (9) is an attempt to ensure the manifold assumption.

By incorporating the above manifold regularization \({\mathscr {T}}\) into the CSR, we have the MCSR problem as

where \(\lambda _{\text {MR}}>0\) is a manifold regularization parameter. The problem (10) has the following equivalent form

where \(\iota _{{\mathscr {R}}_+}\) is an indicator function, defined by

### Application of ADMM to MCSR

In this subsection, we propose to apply the *alternating direction method of multipliers* (ADMM) (Afonso et al. 2011; Yang and Zhang 2011) method to the MCSR problem (10). The ADMM method has recently attracted more attention because it can decouple the variables, and it is usually used to solve the problems of a convex, non-smooth objective function with structured linear constraints.

Consider the following structured optimization problem with linear constraints:

where both \(f({x})\) and \(g({v})\) are convex functions, \({G}\) is a known matrix with full column rank. For this problem, the augmented Lagrangian function is given by

where \({\alpha }\) is the Lagrange multipliers, \(\mu >0\) is a penalty parameter, and \({d}=-{\alpha }/\mu\). ADMM alternately minimizes \({\mathscr {L}}({x},{v},{\alpha })\) with respect to \({x}\) and \({v}\) in a Gauss–Seidel manner. The general procedures of ADMM are summarized in Algorithm 1.

The convergence of ADMM is guaranteed by the following theorem given in Eckstein and Bertsekas (1992) (see Theorem 8).

###
**Theorem 1**

*Consider problem* (13) *with*
\({G}\)
*having full columns rank and*
*f*, *g*
*being closed, proper, convex functions. Then, for arbitrary*
\(\mu >0\)
*and*
\({x}^0, {v}^0, {d}^0\), *if problem* (13) *has a solution, the*
*sequences*
\(\{{x}^t,{v}^t,{d}^t\}\)
*generated by Algorithm 1 converges to it; otherwise, at least one of the sequences*
\(\{{d}^t\}\)
*and*
\(\{({x}^t,{v}^t)\}\)
*diverges.*

According to the above framework of ADMM, and let

where \({I}\) is an identity matrix, and

we have the corresponding augmented Lagrangian function as

Then, we apply the alternating minimization idea to update the variables \({X}, {V}_1, {V}_2\) and the Lagrange multipliers \({D}_1, {D}_2\). Given the current point \({X}^t, {V}_1^t\), \({V}_2^t\), \({D}_1^t, {D}_2^t\), we get the next step of \({X}\) by minimizing \({\mathscr {L}}\) with respect to \({X}\), i.e.,

which yields the following updating rule

where \(\zeta ^t={V}_1^t+{V}_2^t+{D}_1^t+{D}_2^t\). To update \({V}_1\) and \({V}_2\), we have the augmented Lagrangian subproblems

Before solving \({V}_1\), we first define the well-known *vector-soft thresholding* (VST) operator \({\mathscr {V}}_{\tau }\) of a matrix \({Q}=[{q}_1^T,{q}_2^T,\ldots ,{q}_m^T]^T\in {\mathscr {R}}^{m\times n}\) as

where the *i*th row of \({Q}^*\) is \({q}_i^*\), defined by

By the VST operator, it is easy to get the updating rule of \({V}_1\) as

As for \({V}_2\), we have

The Lagrangian multipliers \({D}_1, {D}_2\) can be updated as

Finally, the proposed *manifold regularized collaborative sparse unmixing* via ADMM (MCSUnADMM) algorithm for MCSR is summarized in Algorithm 2.

The convergence of Algorithm 2 is guaranteed by Theorem 1, since it can be expressed as an instance of problem (13). \({G}\) is a full column rank matrix, and functions *f*, *g* are closed, proper, convex. These meet the conditions in Theorem 1, and hence the convergence of Algorithm 2 is guaranteed.

## Experiments

In this section, we evaluate the performance of our proposed MCSUnADD algorithm, and compare it with the CLSUnSAL algorithm (Iordache et al. 2014a) for the CSR problem (8), the SUnSAL algorithm (Iordache et al. 2011) for the SR problem (6), and the total variation regularized SUnSAL (TVSUnSAL) algorithm (Iordache et al. 2012). Experiments are carried out on two simulated hyperspectral data sets and one real hyperspectral data set, and the accuracy assessment of all the experiments is made by computing the *signal to reconstruction error* (SRE) (Iordache et al. 2011), defined by

where \(\mathbb {E}({x})\) is the expectation of \({x}\) and \(\hat{{x}}\) is the corresponding reconstructed abundance vector. The higher the SRE, the better the reconstruction. In our experiments, the regularization parameters \(\lambda _{\text {SR}}, \lambda _{\text {CSR}}\) and \(\lambda _{\text {MR}}\) are selected from

to obtain the best unmixing accuracy. As for stopping criterion, we set as the maximum iteration number and the Frobenius norm of reconstruction errors of the pixels, i.e. \(\Vert {Y}-{A}{X}\Vert _F^2\), less than \(\tau =1e^{-4}\).

### Synthetic image experiments

Our experiments are first performed on two synthetic images, which were generated from the USGS library \({A}\in {\mathscr {R}}^{224\times 445}\) that contains 445 materials with each having 224 spectral bands that uniformly distribute in the interval 0.4–2.5 μm.

###
*Synthetic Image 1 (SI-1)*

This synthetic image of size \(80 \times 80\) is produced by a hyperspectral imagery synthesis tools, which is developed by the computational intelligence group of the Basque Country University. Five endmembers as shown in Fig. 1a are randomly selected from the spectral library \({A}\) to generate the synthetic image, as shown in Fig. 1b. In this image, the fractional abundances are created by the *Gaussian fields* method with *spheric* type (refer to Boris 1999 for more details) to model the natural scene such as the distribution of forest, and satisfy the LMM, together with the nonnegative and sum-to-one constraints.

###
*Synthetic Image 2 (SI-2)*

This synthetic image is to simulate a scene with land covers arranged in discrete patches, and was designed in Miao and Qi (2007). In the image, seven endmembers, randomly selected from the spectral library \({A}\) and as shown in Fig. 2a, are used to produce a hyperspectral image with \(100\times 100\) pixels. The image is first divided into several \(10\,\text {pixels}\times 10\,\text {pixels}\) regions with each initialized with one of the seven endmember spectra, and then a \(8\,\text {pixels}\times 8\,\text {pixels}\) spatial low-pass filter is used to generate the mixed pixels. In order to model the scene without pure pixels, all of the pixels whose abundances are larger than 0.8 are replaced with a mixture of all endmembers with equal abundances. By this way, the produced fractional abundances naturally satisfy the LMM with the nonnegative and sum-to-one constraints.

## Results

To test the performances of algorithms influenced by the noises, zero-mean Gaussian noises are added to the above two synthetic images to achieve different *signal-to-noise ratios* (SNRs) of 15, 25, 35, and 45 dB. The results with SREs obtained by the MCSUnADMM, CLSUnSAL, TVSUnSAL, and SUnSAL algorithms for these two synthetic images with different noise levels are reported in Table 1. As we can see, our proposed MCSUnADMM algorithm achieved the best unmixing accuracy than both SUnSAL and CLSUnSAL algorithms in two different simulated scenarios, and CLSUnSAL performs a little better than the SUnSAL algorithm. The TVSUnSAL algorithm has a little better performances for the SI-1 scene than that for the SI-2 scene. This may be because the two simulated scenes have different spatial characteristics (e.g., SI-1 are with a heterogeneous background while SI-2 has a relatively homogeneous background) while the TVSUnSAL algorithm aims at exploiting the spatial homogeneity to improve the unmixing accuracy. The improvement of MCSUnADMM demonstrates that the manifold regularization term is capable of enhancing the unmixing performance.

Table 2 reports the times of the MCSUnADMM, CLSUnSAL, TVSUnSAL, and SUnSAL algorithms for these two synthetic experiments with different SNRs when the stopping criterion (i.e., the maximum iteration number or the Frobenius norm of the pixel reconstruction errors, i.e. \(\Vert {Y}-{A}{X}\Vert _F^2\), less than \(\tau =1e^{-4}\)) is reached. As can been see from this table, the proposed MCSUnADMM algorithm converges faster than the other three algorithms to reach the minima of the objective function \(\Vert {Y}-{A}{X}\Vert _F^2\) because of the use of the locally geometrical structure of the hyperspectral data introduced by the manifold regularization. Note that a proper and efficient regularization introduced to the model will benefit the descending of the objective function. However, it must be pointed out that the computational complexity of solving model (10) is a little higher than solving the models (6) and (8) in theory. Table 3 gives the computational times for the SI-1 and SI-2 experiments by all of the four algorithms when setting the maximum iteration number (to be 2000) as the stopping criterion. According to this table, we can see that the SUnSAL and CLSUnSAL algorithms need almost the same computational times, while the TVSUnSAL and the MCSUnADMM algorithms have almost the same computational times, which are higher than that of the SUnSAL and CLSUnSAL algorithms. This is consistent with the theoretical analysis of the complexity (Iordache et al. 2012, 2014a). In addition, Fig. 3 plots the evolution of the objective function (10) versus time in the SI-1 experiments with \(\hbox {SNR}=25\,\hbox {dB}\) to illustrate the convergence of the proposed MCSUnADMM algorithm.

Additionally, the estimated fractional abundances obtained by the three algorithms, along with the ground-truth abundances, are shown in Figs. 4, 5, 6, 7, 8, 9, 10, 11, 12 and 13. For space consideration, only the fractional abundance maps of SI-1 with the lowest SNR of 15 dB and the fractional abundance maps of SI-2 with the highest SNR of 45 dB are reported. By visual comparisons of these fractional abundance maps, it can be seen that our proposed MCSUnADMM algorithm based on MCS model outperforms the other two algorithms for SR and CSR models and the incorporated manifold regularization can impose spatial consistency such that the spatially similar pixels have similar abundances as shown in Figs. 5, 6, 7, 8, 9 and 10. From Fig. 7, we can see that the results obtained by the TVSUnSAL algorithm exhibits more spatial homogeneity due to the total variation regularization. However, the proposed MCSUnADMM algorithm can deal with the pixels in the transaction areas, as shown in Fig. 5, since its incorporated manifold regularization has applied different weights (9) for different pixels.

## Real hyperspectral image experiments

In this section, we apply the proposed MCSUnADMM algorithm to real hyperspectral data collected by the Airborne Visible/InfRared Imaging Spectrometer (AVIRIS). The AVIRIS instrument can cover a spectral region from 0.41 to 2.45 μm in 224 bands with a 10 nm bandwidth.

### Data sets

The studied real hyperspectral image is collected by AVIRIS over the Cuprite mining site, Nevada, on June 19, 1997 and is publicly available online. The Cuprite data contains some exposed minerals included in the above used USGS spectral library \({A}\), and is well understood mineralogically. The mineral map produced by USGS is shown in Fig. 14. It should be noted that we only exhibit this figure as a reference to visually compare the results obtained by different methods, since the mineral map was produced in 1995 while the Cuprite data was collected in 1997 (Iordache et al. 2014a). This scene is often used for the assessment of the abundance maps obtained by spectral unmixing algorithms (Iordache et al. 2012).

### Results analysis

We conduct our experiment on a subscene with a size of \(250\times 190\) pixels and 224 bands. However, the bands 1–2, 104–113, 148–167, and 221–224 were removed due to water absorption and noise, and thus only a total of 188 bands were used in the experiment. In addition, the corresponding water absorption and noise bands are also removed from the spectral library \({A}\).

The fractional abundance maps of three typical minerals estimated by the MCSUnADMM, CLSUnSAL, and SUnSAL methods are shown in Fig. 15. By visually comparison, we can find that the abundance maps obtained by our proposed MCSUnADMM method are more sparse and have less outliers than that of the CLSUnSAL and SUnSAL methods, this may be due to the incorporated manifold regularization can consider the geometric structure of the dataset such that the performances of the MCSUnADMM method exhibit good spatial consistency.

## Conclusions

This paper presents a novel sparse unmixing model, which incorporate the manifold regularization into the collaborative sparse regression. The manifold regularization is induced by a Laplacian graph, which can characterize the locally geometrical structure of the hyperspectral data. In this way, the proposed manifold regularized collaborative sparse (MCS) model can consider both the Euclidean structures and underlying manifold structures. To solve the proposed model, an efficient algorithm based on ADMM, called MCSUnADMM, has been developed. And the convergence of the proposed MCSUnADMM algorithm can be guaranteed based on the framework of ADMM. Experimental results with both simulated and real hyperspectral datasets demonstrate the effectiveness of the proposed model and algorithm. However, the efficiency of the proposed MCSUnADMM algorithm is affected by two regularization parameters. Therefore, our future work will focus on designing a strategy to adaptively set these parameters. In addition, further experiments with different scenes of real hyperspectral images are need to investigate the performances of our proposed model and method.

## References

Afonso MV, Bioucas-Dias JM, Figueiredo MAT (2011) An augmented Lagrangian approach to the constrained optimization formulation of image inverse problems. IEEE Trans Image Process 20:681–695

Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15:1373–1396

Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434

Bioucas-Dias J, Figueiredo M (2010) Alternation direction algorithms for constrained sparse regression: application to hyperspectral unmixing. In: Proceedings of 2nd workshop hyperspectral image signal processing—evolution in remote sensing

Bioucas-Dias JM, Plaza A et al (2012) Hyperspectral unmixing overview: geometrical, statistical, and sparse regression-based approaches. IEEE J Sel Top Appl Earth Obs Remote Sens 5:354–379

Bioucas-Dias JM, Plaza A et al (2013) Hyperspectral remote sensing data analysis and future challenges. IEEE Geosci Remote Sens Mag 1:6–36

Boardman JM, Kruse FA, Green RO (1995) Mapping target signatures via partial unmixing of aviris data. In: Proceedings of summer JPL ariborne earth science workshop, Pasadena, CA

Boris K (1999) Computations with Gaussian random fields. PhD thesis, Institute for System Research, University of Maryland

Cai D, He X, Han J, Huang TS (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33:1548–1560

Chan TH, Ma WK, Ambikapathi A, Chi CY (2011) A simplex volume maximization framework for hyperspectral endmember extraction. IEEE Trans Geosci Remote Sens 49:4177–4193

Chang CI, Heinz DC (2000) Constrained subpixel target detection for remotely sensed imagery. IEEE Trans Geosci Remote Sens 38:1144–1159

Chang CJ et al (2006) A new growing method for simplex-based endmember extraction algorithm. IEEE Trans Geosci Remote Sens 44:2804–2819

Chang CI, Wu CC, Chen HM (2010) Random pixel purity index. IEEE Geosci Remote Sens Lett 7:324–328

Charles AS, Olshausen BA, Rozell CJ (2011) Learning sparse codes for hyperspectral imager. IEEE J Sel Top Signal Process 5:963–978

Chen X et al (2011) A quantitative analysis of virtual endmembers in creased impact on the collinearity effect in spectral unmixing. IEEE Trans Geosci Remote Sens 49:2945–2956

Donoho D, Grimes C (2003) Hessian eigenmaps: locally linear embedding techniques for high dimensional data. Proc Natl Acad Sci 100:5591–5596

Eckstein J, Bertsekas D (1992) On the Douglas–Rachford splitting method and the proximal point algorithm for maximal monogone operators. Math Program 55:293–318

Fan W, Hu B, Miller J, Li M (2009) Comparative study between a new nonlinear model and common linear model for analysing laboratory simulated-forest hyperspectral data. Int J Remote Sens 30:2951–2962

Feng R, Zhong Y, Zhang L (2014) Apdative non-local euclidean medians sparse unmixing for hyperspectral imagery. ISPRS J Photogramm Remote Sens 97:9–24

Guan N, Tao D, Luo Z, Yuan B (2011) Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. IEEE Trans Image Process 20:2030–2048

Hapke B (1981) Bidirectional reflectance spectroscopy 1. Theory. J Geophys Res 86:3039–3054

He X, Niyogi P (2004) Locality preserving projections. Adv Neural Inf Process Syst 16:153–160

He X, Cai D, Shao Y, Bao H, Han J (2011) Laplacian regularized gaussian mixture model for data clustering. IEEE Trans Knowl Data Eng 23:1406–1418

Heinz D, Chang CI (2001) Fully constrained least squares linear mixture analysis for material quantification in hyperspectral imagery. IEEE Trans Geosci Remote Sens 39:529–545

Iordache MD, Bioucas-Dias JM, Plaza A (2011) Sparse unmixing of hyperspectral data. IEEE Trans Geosci Remote Sens 97:2014–2039

Iordache MD, Bioucas-Dias JM, Plaza A (2012) Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans Geosci Remote Sens 50:4484–4502

Iordache MD, Bioucas-Dias JM, Plaza A (2014a) Collaborative sparse regression for hyperspectral unmixing. IEEE Trans Geosci Remote Sens 52:341–354

Iordache MD, Bioucas-Dias JM, Plaza A (2014b) Music-CSR: hyperspectral unmixing via multiple signal classification and collaborative sparse regression. IEEE Trans Geosci Remote Sens 52:4364–4382

Keshava N (2003) A survey of spectral unmixing algorithms. Linc Lab J 14:55–68

Lin T, Zha H (2008) Riemannian manifold learning. IEEE Trans Pattern Anal Mach Intell 30:796–809

Liu JM, Zhang JS (2012) A new maximum simplex volume method based on householder transformation for endmember extraction. IEEE Trans Geosci Remote Sens 50:104–118

Liu J, Zhang J (2014) Spectral unmixing via compressive sensing. IEEE Trans Geosci Remote Sens 52:7099–7110

Lu X, Wu H, Yuan Y, Yan P, Li X (2013) Manifold regularized sparse nmf for hyperspectral unmixing. IEEE Trans Geosci Remote Sens 51:2815–2826

Ma W, Bioucas-Dias JM, Chan TH et al (2014) A signal processing perspective on hyperspectral unmixing: insights from remote sensing. IEEE Signal Process Mag 31:67–81

Meer FVD (2012) Remote-sensing image analysis and geostatistics. Int J Remote Sens 33:5644–5676

Miao L, Qi H (2007) Endmember extraction from highly mixed data using minimum volume constrained nonnegative matrix factorization. IEEE Trans Geosci Remote Sens 45:765–777

Nascimento J, Bioucas-Dias JM (2005) Vertex component analysis: a fast algorithm to unmix hyperspectral data. IEEE Trans Geosci Remote Sens 43:898–910

Nascimento JMP, Bioucas-Dias M (2012) Hyperspectral unmixing based on mixtures of Dirichlet components. IEEE Trans Geosci Remote Sens 50:863–878

Pu H, Xia W, Wang B, Jiang G (2014) A fully constrained linear spectral unmixing algorithm based on distance geometry. IEEE Trans Geosci Remote Sens 52:1157–1176

Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326

Settle JJ, Drake NA (1993) Linear mixing and the estimation of ground cover proportions. Int J Remote Sens 14:1159–1177

Seung HS, Lee DD (2000) The manifold ways of perception. Science 290:2268–2269

Shaw GA, Burke HK (2003) Spectral imaging for remote sensing. Linc Lab J 14:3–28

Shimabukuro YE, Carvalho VC, Rudorff BFT (1997) NOAA-AVHRR data processing for the mapping of vegetation cover. Int J Remote Sens 18:671–677

Singer RB, Mccord TB (1979) Mars: large scale mixing of bright and dark surface materials and implications for analysis of spectral reflectance. In: Proceedings of 10th lunar planetary science conference, Washington, DC

Somers B, Delalieux S et al (2009) A weighted linear spectral mixture analysis approach to address endmember variability in agricultural production systems. Int J Remote Sens 30:139–147

Somers B, Asnerc GP, Tits L, Coppin P (2011) Endmember variability in spectral mixture analysis: a review. Remote Sens Environ 115:1603–1616

Stein D (2003) Application of the normal compositional model to the analysis of hyperspectral imagery. In: Proceedings of IEEE workshop advances in techniques for analysis of remotely sensed data (2003)

Tang W, Shi Z, Wu Y, Zhang C (2015) Sparse unmixing of hyperspectral data using spectral a priori information. IEEE Trans Geosci Remote Sens 53:770–783

Tenenbaum JB, Silva V, Landford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323

Tong L, Zhou J, Bai X, Gao Y (2014) Dual graph regularized NMF for hyperspectral unmixing. In: Digital image computing techniques and applications

Winter ME (1999) N-findr: an algorithm for fast autonomous spectral endmember determination in hyperspectral data. In: Proceedings of SPIE conference on imaging spectrometry, Pasadena, CA

Yang JF, Zhang Y (2011) Alternating direction algorithms for \(\ell _1\)-problems in compressive. SIAM J Sci Comput 33:250–278

Zare A, Ho KC (2014) Endmember variability in hyperspectral analysis: addressing spectral variability during spectral unmixing. IEEE Signal Process Mag 31:95–104

Zare A, Gader P, Dranishnikov D, Glenn T (2013) Spectral unmixing using the beta compositional model. In: Proceedings of IEEE workshop. Hyperspectral image and signal processing: evolution in remote sensing, Gainesville, FL

Zheng M, Bu J, Chen C, Wang C, Zhang L, Qiu G, Cai D (2011) Graph regularized sparse coding for image representation. IEEE Trans Image Process 20:1327–1560

Zhong Y, Zhang L (2014) Non-local sparse unmixing for hyperspectral remote sensing imagery. IEEE J Sel Top Appl Earth Obs Remote Sens 7:1889–1909

## Authors' contributions

JL and JZ gave the basic idea. CZ and HL participated in the collection and analysis of the data. JL and YG participated in the design of the study and coordination and helped to draft the manuscript. All authors read and approved the final manuscript.

### Acknowledgements

This work was supported in part by the National Basic Research Program of China (973) (Grant No. 2013CB329404), in part by the National Natural Science Foundation of China (Grant Nos. 11401465, 61572393, 11601415, 11671317, and 61561001), the Projects funded by China Postdoctoral Science Foundation (Grant Nos. 2014M560781, 2016M590934), and by the Natural Science Basic Research Plan in Shaanxi Province of China (Grant No. 2014JM2-6098).

### Competing interests

The authors declare that they have no competing interests.

### Availability of data and materials

the USGS library can be available at http://speclab.cr.usgs.gov/spectral.lib06, the synthetic image is produced by a hyperspectral imagery synthesis tools at http://www.ehu.es/ccwintco/index.php, the real hyperspectral data sets can be available at http://aviris.jpl.nasa.gov/html/aviris.freedata.html, and the mineral map for the real hyperspectral image is in http://speclab.cr.usgs.gov/cuprite95.tgif.2.2um_map.gif.

## Author information

### Affiliations

### Corresponding author

## Rights and permissions

**Open Access** This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## About this article

### Cite this article

Liu, J., Zhang, C., Zhang, J. *et al.* Manifold regularization for sparse unmixing of hyperspectral images.
*SpringerPlus* **5, **2007 (2016). https://doi.org/10.1186/s40064-016-3671-6

Received:

Accepted:

Published:

### Keywords

- Hyperspectral images
- Spectral unmixing
- Manifold regularization