Partial least squares block

Partial least-squares path modeling with latent variables (PLS), a newer, general method of handling regression problems, is finding wide apphcation in chemometrics. This method allows the relations between many blocks of data ie, data matrices, to be characterized (32—36). Linear and multiple regression techniques can be considered special cases of the PLS method. 

Other chemometrics methods to improve caUbration have been advanced. The method of partial least squares has been usehil in multicomponent cahbration (48—51). In this approach the concentrations are related to latent variables in the block of observed instmment responses. Thus PLS regression can solve the colinearity problem and provide all of the advantages discussed earlier. Principal components analysis coupled with multiple regression, often called Principal Component Regression (PCR), is another cahbration approach that has been compared and contrasted to PLS (52—54). Cahbration problems can also be approached using the Kalman filter as discussed (43). 

Partial least squares regression (PLS). Partial least squares regression applies to the simultaneous analysis of two sets of variables on the same objects. It allows for the modeling of inter- and intra-block relationships from an X-block and Y-block of variables in terms of a lower-dimensional table of latent variables [4]. The main purpose of regression is to build a predictive model enabling the prediction of wanted characteristics (y) from measured spectra (X). In matrix notation we have the linear model with regression coefficients b ... 

A drawback of the method is that highly correlating canonical variables may contribute little to the variance in the data. A similar remark has been made with respect to linear discriminant analysis. Furthermore, CCA does not possess a direction of prediction as it is symmetrical with respect to X and Y. For these reasons it is now replaced by two-block or multi-block partial least squares analysis (PLS), which bears some similarity with CCA without having its shortcomings. 

B program, PLS-2, uses the partial least squares (PLS) method. This method has been proposed by H. Wold (37) and was discussed by S. Wold (25). In such a problem there are two blocks of data, T and X. It is assumed that T is related to X by latent variables u and t is derived from the X block and u is derived from the Y block. 

Spatial Interrelationships In the chemical composition among two or more blocks (sites) can be calculated by partial least squares (PLS) (9 ). PLS calculates latent variables slmlllar to PG factors except that the PLS latent variables describe the correlated (variance common to both sites) variance of features between sites. Regional Influences on rainwater composition are thus Identified from the composition of latent variables extracted from the measurements made at several sites. Gomparlson of the results... 

PLS (partial least squares) multiple regression technique is used to estimate contributions of various polluting sources in ambient aerosol composition. The characteristics and performance of the PLS method are compared to those of chemical mass balance regression model (CMB) and target transformation factor analysis model (TTFA). Results on the Quail Roost Data, a synthetic data set generated as a basis to compare various receptor models, is reported. PLS proves to be especially useful when the elemental compositions of both the polluting sources and the aerosol samples are measured with noise and there is a high correlation in both blocks. 

The method which satisfies these conditions is partial least squares (PLS) regression analysis, a relatively recent statistical technique (18, 19). The basis of tiie PLS method is that given k objects, characterised by i descriptor variables, which form the X-matrix, and j response variables which form the Y-matrix, it is possible to relate the two blocks (or data matrices) by means of the respective latent variables u and 1 in such a way that the two data sets are linearly dependent ... 

Partial least square (PLS) regression model describes the dependences between two variables blocks, e.g. sensor responses and time variables. Let the X matrix represent the sensor responses and the Y matrix represent time, the X and Y matrices could be approximated to few orthogonal score vectors, respectively. These components are then rotated in order to get as good a prediction of y variables as possible [25], Linear discriminant analysis (LDA) is among the most used classification techniques. The method maximises the variance between... 

Partial Least Squares Regression is one of the many available regression techniques. Regression techniques are used to model the relation between 2 blocks of variables, called independent or x variables and dependent or y variables (figure 12.15 a). The general regression equation is (figure 12.15 b) ... 

Geladi, P. and Kowalski, B.R., An example 2-block predictive partial least-squares regression with simulated data, Anal. Chim. Acta, 185, 19-32, 1986. 

Direct-infusion MS is a very interesting approach, especially when sample characteristics allow MS analysis with minimum sample treatment. Thus, ESI can be used to directly ionize analytes in liquid samples in a high electric field. A small flow of the liquid sample is conducted through a capillary to the high electric field for ESI. Usually, sample solutions must be carefully cleaned and filtered to avoid potential capillary blocking. Following this idea, direct-infusion ESI-FTICR (Fourier transform ion cyclotron resonance) MS of a coffee drink combined with partial least-squares multivariate statistical analysis was successfully employed to predict the blend composition of commercial coffee varieties (28). In a different work, minimal sample manipulation was carried out to obtain detailed molecular composition of edible oils and fats analyzed by flow-injection ESI-Orbitrap MS for quality assessment and authenticity control purposes (29). Commonly, when using direct infusion approaches, sample needs to be treated to dissolve the compounds of interest in the appropriate solvent. 

PLS is a method by which blocks of multivariate data sets (tables) can be quantitatively related to each other. PLS is an acronym Partial Least Squares correlation in latent variables, or Projections to Latent Structures. The PLS method is described in detail in Chapter 17. 

With a different meaning, the term hierarchical QSAR was also used to denote the application of Partial Least Squares (PLS) and Principal Component Analysis (PGA) to different logical blocks of molecular descriptors to summarize descriptors of each block into a few latent variables or components, which were called supervariables [Eriksson, Johansson et al, 2002]. 

In the above examples there is a natural way to order the complete data set in two blocks, where both blocks have one mode in common. In Chapter 3 the methods of multiple linear regression, principal component regression, and partial least squares regression will be discussed on an introductory level. 

In this illustration, we have only considered one dependent (y) variable, LD25. In fact, partial least squares can deal with multivariate problems, where there is more than one dependent variable, such as different measures of biological activity or different properties. Indeed, for the above set of compounds five different measures of biological activity were reported in the original paper and a partial least-squares analysis performed on the entire data set [Dunn et al. 1984]. The algorithm effectively finds pairs of vectors through both the x data and the y data such that the vector pairs are maximally correlated with each other whilst simultaneously explaining as much of the variance in their individual data blocks as possible... 

The most promising new approach in multivariate statistical methods is the PLS (partial least squares in latent variables) method [26, 27, 38, 607 — 610]. Many, even hundreds or thousands of independent variables (the X block) can be correlated with one or several dependent variables (the Y block). PLS analysis is a principal component-like method, with the main difference that the vectors are not indepen-... 

Saebo S, Martens M, Martens H. Three-block data modeling by endo- and exo-LPLS regression. In Vinzi VE, Chin WM, Henseler J, et al., editors. Handbook of Partial Least Squares Concepts, Methods and Applications. Heidelberg Springer 2010. p 359-379. 

Parameter change detection, 27 Partial least squares, 42, 79 convergence, 81 inner relations, 81 multi-block, 113 multipass PLS for sensor auditing, 204... 

How can one relate T, U, P and Q in such a way First, our previous knowledge of the problem and the analytical technique suggests that these blocks of data, which represent two different aspects of the same true materials (solutions, slurries, etc.), must be related (we do not know how, but they must ). The algorithm developed by H. Wold (called non-linear iterative partial least squares , NIPALS sometimes it is also termed non-iterative partial least squares ) started from this idea and was formulated as presented below. The following ideas have roots in works by Geladi (and co-workers) and Otto. We consider seven major steps. 

Rohlf, E.J. and Corti, M. (2000) Use of two-block partial least-squares to study covariationin shape. Systematic Biology, 49(4) 740-753. 

The PLS approach was developed around 1975 by Herman Wold and co-workers for the modeling of complicated data sets in terms of chains of matrices (blocks), so-called path models . Herman Wold developed a simple but efficient way to estimate the parameters in these models called NIPALS (nonlinear iterative partial least squares). This led, in turn, to the acronym PLS for these models, where PLS stood for partial least squares . This term describes the central part of the estimation, namely that each model parameter is iteratively estimated as the slope of a simple bivariate regression (least squares) between a matrix column or row as the y variable, and another parameter vector as the x variable. So, for instance, in each iteration the PLS weights w are re-estimated as u X/(u u). Here denotes u transpose, i.e., the transpose of the current u vector. The partial in PLS indicates that this is a partial regression, since the second parameter vector (u in the... 

---