Partial least squares techniques

The infrared technique has been described in numerous publications and recent reviews were published by Davies and Giangiacomo (2000), Ismail et al. (1997) and Wetzel (1998). Very few applications have been described for analysis of additives in food products. One interesting application is for controlling vitamin concentrations in vitamin premixes used for fortification of food products by attenuated total reflectance (ATR) accessory with Fourier transform infrared (FTIR) (Wojciechowski et al., 1998). Four vitamins were analysed - Bi (thiamin), B2 (riboflavin), B6 (vitamin B6 compounds) and Niacin (nicotinic acid) - in about 10 minutes. The partial least squares technique was used for calibration of the equipment. The precision of measurements was in the range 4-8%, similar to those obtained for the four vitamins by the reference HPLC method. 

On the other hand, techniques like Principle Component Analysis (PCA) or Partial Least Squares Regression (PLS) (see Section 9.4.6) are used for transforming the descriptor set into smaller sets with higher information density. The disadvantage of such methods is that the transformed descriptors may not be directly related to single physical effects or structural features, and the derived models are thus less interpretable. 

The field points must then be fitted to predict the activity. There are generally far more field points than known compound activities to be fitted. The least-squares algorithms used in QSAR studies do not function for such an underdetermined system. A partial least squares (PLS) algorithm is used for this type of fitting. This method starts with matrices of field data and activity data. These matrices are then used to derive two new matrices containing a description of the system and the residual noise in the data. Earlier studies used a similar technique, called principal component analysis (PCA). PLS is generally considered to be superior. 

Partial least-squares path modeling with latent variables (PLS), a newer, general method of handling regression problems, is finding wide apphcation in chemometrics. This method allows the relations between many blocks of data ie, data matrices, to be characterized (32—36). Linear and multiple regression techniques can be considered special cases of the PLS method. 

For many applications, quantitative band shape analysis is difficult to apply. Bands may be numerous or may overlap, the optical transmission properties of the film or host matrix may distort features, and features may be indistinct. If one can prepare samples of known properties and collect the FTIR spectra, then it is possible to produce a calibration matrix that can be used to assist in predicting these properties in unknown samples. Statistical, chemometric techniques, such as PLS (partial least-squares) and PCR (principle components of regression), may be applied to this matrix. Chemometric methods permit much larger segments of the spectra to be comprehended in developing an analysis model than is usually the case for simple band shape analyses. 

We are about to enter what is, to many, a mysterious world—the world of factor spaces and the factor based techniques, Principal Component Analysis (PCA, sometimes known as Factor Analysis) and Partial Least-Squares (PLS) in latent variables. Our goal here is to thoroughly explore these topics using a data-centric approach to dispell the mysteries. When you complete this chapter, neither factor spaces nor the rhyme at the top of this page will be mysterious any longer. As we will see, it s all in your point of view. 

A Brief Review of the QSAR Technique. Most of the 2D QSAR methods employ graph theoretic indices to characterize molecular structures, which have been extensively studied by Radic, Kier, and Hall [see 23]. Although these structural indices represent different aspects of the molecular structures, their physicochemical meaning is unclear. The successful applications of these topological indices combined with MLR analysis have been summarized recently. Similarly, the ADAPT system employs topological indices as well as other structural parameters (e.g., steric and quantum mechanical parameters) coupled with MLR method for QSAR analysis [24]. It has been extensively applied to QSAR/QSPR studies in analytical chemistry, toxicity analysis, and other biological activity prediction. On the other hand, parameters derived from various experiments through chemometric methods have also been used in the study of peptide QSAR, where partial least-squares (PLS) analysis has been employed [25]. 

Since that time thousands of QSARs, covering a wide and diverse range of end points, have been published [9] most of these have used MLR, but numerous other statistical techniques have also been used, such as partial least squares, principal component analysis, artificial neural networks, decision trees, and discriminant analysis [f4]. 

Several techniques from statistics, such as partial least-squares regression, and from artificial intelligence, such as artificial neural networks have been used to learn empirical input/ output relationships. Two of the most significant disadvantages of these approaches are the following ... 

Because of peak overlappings in the first- and second-derivative spectra, conventional spectrophotometry cannot be applied satisfactorily for quantitative analysis, and the interpretation cannot be resolved by the zero-crossing technique. A chemometric approach improves precision and predictability, e.g., by the application of classical least sqnares (CLS), principal component regression (PCR), partial least squares (PLS), and iterative target transformation factor analysis (ITTFA), appropriate interpretations were found from the direct and first- and second-derivative absorption spectra. When five colorant combinations of sixteen mixtures of colorants from commercial food products were evaluated, the results were compared by the application of different chemometric approaches. The ITTFA analysis offered better precision than CLS, PCR, and PLS, and calibrations based on first-derivative data provided some advantages for all four methods. ... 

Partial Least Squares (PLS) regression (Section 35.7) is one of the more recent advances in QSAR which has led to the now widely accepted method of Comparative Molecular Field Analysis (CoMFA). This method makes use of local physicochemical properties such as charge, potential and steric fields that can be determined on a three-dimensional grid that is laid over the chemical stmctures. The determination of steric conformation, by means of X-ray crystallography or NMR spectroscopy, and the quantum mechanical calculation of charge and potential fields are now performed routinely on medium-sized molecules [10]. Modem optimization and prediction techniques such as neural networks (Chapter 44) also have found their way into QSAR. 

A difficulty with Hansch analysis is to decide which parameters and functions of parameters to include in the regression equation. This problem of selection of predictor variables has been discussed in Section 10.3.3. Another problem is due to the high correlations between groups of physicochemical parameters. This is the multicollinearity problem which leads to large variances in the coefficients of the regression equations and, hence, to unreliable predictions (see Section 10.5). It can be remedied by means of multivariate techniques such as principal components regression and partial least squares regression, applications of which are discussed below. 

While principal components models are used mostly in an unsupervised or exploratory mode, models based on canonical variates are often applied in a supervisory way for the prediction of biological activities from chemical, physicochemical or other biological parameters. In this section we discuss briefly the methods of linear discriminant analysis (LDA) and canonical correlation analysis (CCA). Although there has been an early awareness of these methods in QSAR [7,50], they have not been widely accepted. More recently they have been superseded by the successful introduction of partial least squares analysis (PLS) in QSAR. Nevertheless, the early pattern recognition techniques have prepared the minds for the introduction of modem chemometric approaches. 

B. Waiczack and D.L. Massart, The radial basis functions — partial least squares approach as a flexible non-linear regression technique. Anal. Chim. Acta, 331 (1996) 177-185. 

Partial least squares (PLS) projections to latent structures [40] is a multivariate data analysis tool that has gained much attention during past decade, especially after introduction of the 3D-QSAR method CoMFA [41]. PLS is a projection technique that uses latent variables (linear combinations of the original variables) to construct multidimensional projections while focusing on explaining as much as possible of the information in the dependent variable (in this case intestinal absorption) and not among the descriptors used to describe the compounds under investigation (the independent variables). PLS differs from MLR in a number of ways (apart from point 1 in Section 16.5.1) ... 

Calculating the Solution for Regression Techniques Part 3 - Partial Least Squares Regression Made Simple... 

Since in many applications minor absorption changes have to be detected against strong, interfering background absorptions of the matrix, advanced chemometric data treatment, involving techniques such as wavelet analysis, principle component analysis (PCA), partial least square (PLS) methods and artificial neural networks (ANN), is a prerequisite. 

Always based on the use of IR spectrophotometry, a novel attenuated total reflection-Fourier-transform infrared (ATR-FTIR) sensor [42] was proposed for the on-line monitoring of a dechlorination process. Organohalogenated compounds such as trichloroethylene (TCE), tetrachloroethylene (PCE) and carbon tetrachloride (CT) were detected with a limit of a few milligrams per litre, after extraction on the ATR internal-reflection element coated with a hydro-phobic polymer. As for all IR techniques, partial least squares (PLS) calibration models are needed. As previously, this system is promising for bioprocess control and optimization. 

The application of near-IR spectroscopy for real-time monitoring of glucose, lactic acid, acetic acid and biomass in liquid cultures of microorganisms of the genera Lactobacillus and Staphylococcus has been recently published [76]. The NIR spectrum acquired by the optical-fibre probe immersed in the culture is exploited using a partial least squares (PLS) calibration step, a classical method for IR techniques. 

Rosipal, R., Kramer, N. in Saunders, C., Grobelnik, M., Gunn, S. R., Shawe-Taylor, J. (Ed.), Subspace, Latent Structure and Feature Selection Techniques. Lecture Notes in Computer Science, Vol. 3940, Springer, Berlin, Germany, 2006, pp. 34—51. Overview and recent advances in partial least squares. 

The multivariate techniques which reveal underlying factors such as principal component factor analysis (PCA), soft Independent modeling of class analogy (SIMCA), partial least squares (PLS), and cluster analysis work optimally If each measurement or parameter Is normally distributed In the measurement space. Frequency histograms should be calculated to check the normality of the data to be analyzed. Skewed distributions are often observed In atmospheric studies due to the process of mixing of plumes with ambient air. 

PLS (partial least squares) multiple regression technique is used to estimate contributions of various polluting sources in ambient aerosol composition. The characteristics and performance of the PLS method are compared to those of chemical mass balance regression model (CMB) and target transformation factor analysis model (TTFA). Results on the Quail Roost Data, a synthetic data set generated as a basis to compare various receptor models, is reported. PLS proves to be especially useful when the elemental compositions of both the polluting sources and the aerosol samples are measured with noise and there is a high correlation in both blocks. 

In the past few years, PLS, a multiblock, multivariate regression model solved by partial least squares found its application in various fields of chemistry (1-7). This method can be viewed as an extension and generalization of other commonly used multivariate statistical techniques, like regression solved by least squares and principal component analysis. PLS has several advantages over the ordinary least squares solution therefore, it becomes more and more popular in solving regression models in chemical problems. 

---