Chemometrics regression

Although the term theoretical techniques in relation to electronic effects may commonly be taken to refer to quantum-mechanical methods, it is appropriate also to mention the application of chemometric procedures to the analysis of large data matrices. This is in a way complementary to analysis through substituent constants based on taking certain systems as standards and applying simple or multiple linear regression. Chemometrics involves the analysis of suitable data matrices through elaborate statistical procedures,... 

Bro R, Smilde AK, de Jong S, On the difference between low-rank and subspace approximation improved model for multi-linear PLS regression, Chemometrics and Intelligent Laboratory Systems, 2001, 58, 3-13. 

Kvalheim, O.M. (1990). Latent-variable regression models with higher-order terms An extension of response modelling by orthogonal design and multiple linear regression. Chemometrics and Intelligent Laboratory Systems, Vol.8, No.l, (May 1990), pp. 59-67, ISSN 0169-7439... 

Karjalainen, E.J., Karjalainen, U.P. Simultaneous analysis of multiple chromatographic runs and samples with alternating regression. Chemometr. InteU. Lab. Syst. 14(1-3), 423 27 (1992)... 

Semeels S, Croux C, Filzmoser P, et al. Partial Robust M-regression. Chemometr Intell Lab Syst 2005 79 55-64. 

Gort SM, Hoogerbrugger R (1995) A user-friendly spreadsheet program for calibratimi using weighted regression. Chemometr Intell Lab Syst 28 193-199... 

To gain insight into chemometric methods such as correlation analysis, Multiple Linear Regression Analysis, Principal Component Analysis, Principal Component Regression, and Partial Least Squares regression/Projection to Latent Structures... 

Partial least-squares path modeling with latent variables (PLS), a newer, general method of handling regression problems, is finding wide apphcation in chemometrics. This method allows the relations between many blocks of data ie, data matrices, to be characterized (32—36). Linear and multiple regression techniques can be considered special cases of the PLS method. 

Other chemometrics methods to improve caUbration have been advanced. The method of partial least squares has been usehil in multicomponent cahbration (48—51). In this approach the concentrations are related to latent variables in the block of observed instmment responses. Thus PLS regression can solve the colinearity problem and provide all of the advantages discussed earlier. Principal components analysis coupled with multiple regression, often called Principal Component Regression (PCR), is another cahbration approach that has been compared and contrasted to PLS (52—54). Cahbration problems can also be approached using the Kalman filter as discussed (43). 

Most of the 2D QSAR methods are based on graph theoretic indices, which have been extensively studied by Randic [29] and Kier and Hall [30,31]. Although these structural indices represent different aspects of molecular structures, their physicochemical meaning is unclear. Successful applications of these topological indices combined with multiple linear regression (MLR) analysis are summarized in Ref. 31. On the other hand, parameters derived from various experiments through chemometric methods have also been used in the study of peptide QSAR, where partial least square (PLS) [32] analysis has been employed [33]. 

For many applications, quantitative band shape analysis is difficult to apply. Bands may be numerous or may overlap, the optical transmission properties of the film or host matrix may distort features, and features may be indistinct. If one can prepare samples of known properties and collect the FTIR spectra, then it is possible to produce a calibration matrix that can be used to assist in predicting these properties in unknown samples. Statistical, chemometric techniques, such as PLS (partial least-squares) and PCR (principle components of regression), may be applied to this matrix. Chemometric methods permit much larger segments of the spectra to be comprehended in developing an analysis model than is usually the case for simple band shape analyses. 

We will explore the two major families of chemometric quantitative calibration techniques that are most commonly employed the Multiple Linear Regression (MLR) techniques, and the Factor-Based Techniques. Within each family, we will review the various methods commonly employed, learn how to develop and test calibrations, and how to use the calibrations to estimate, or predict, the properties of unknown samples. We will consider the advantages and limitations of each method as well as some of the tricks and pitfalls associated with their use. While our emphasis will be on quantitative analysis, we will also touch on how these techniques are used for qualitative analysis, classification, and discriminative analysis. 

Because of peak overlappings in the first- and second-derivative spectra, conventional spectrophotometry cannot be applied satisfactorily for quantitative analysis, and the interpretation cannot be resolved by the zero-crossing technique. A chemometric approach improves precision and predictability, e.g., by the application of classical least sqnares (CLS), principal component regression (PCR), partial least squares (PLS), and iterative target transformation factor analysis (ITTFA), appropriate interpretations were found from the direct and first- and second-derivative absorption spectra. When five colorant combinations of sixteen mixtures of colorants from commercial food products were evaluated, the results were compared by the application of different chemometric approaches. The ITTFA analysis offered better precision than CLS, PCR, and PLS, and calibrations based on first-derivative data provided some advantages for all four methods. ... 

All these methods give similar results but their sensitivities and resolutions are different. For example, UV-Vis spectrophotometry gives good results if a single colorant or mixture of colorants (with different absorption spectra) were previously separated by SPE, ion pair formation, and a good previous extraction. Due to their added-value capability, HPLC and CE became the ideal techniques for the analysis of multicomponent mixtures of natural and synthetic colorants found in drinks. To make correct evaluations in complex dye mixtures, a chemometric multicomponent analysis (PLS, nonlinear regression) is necessary to discriminate colorant contributions from other food constituents (sugars, phenolics, etc.). 

The similarity in approach to LDA (Section 33.2.2) and PLS (Section 33.2.8) should be pointed out. Neural classification networks are related to neural regression networks in the same way that PLS can be applied both for regression and classification and that LDA can be described as a regression application. This can be generalized all regression methods can be applied in pattern recognition. One must expect, for instance, that methods such as ACE and MARS (see Chapter 11) will be used for this purpose in chemometrics. 

I.E. Frank and J.H. Friedman, A statistical view of some chemometrics regression tools. Technometrics, 35 (1993) 109-135. 

J.M. Sutter, J.H. Kalivas and P.M. Lang, Which principal components to utilize for principal component regression. J. Chemometr., 6 (1992) 217-225. 

E. Vigneau, D. Bertrand and E.M. Qannari, Application of latent root regression for calibration in near-infrared spectroscopy. Comparison with principal component regression and partial least squares. Chemometr. Intell. Lab. Syst., 35 (1996) 231-238. 

A homogeneity index or significance coefficienf has been proposed to describe area or spatial homogeneity characteristics of solids based on data evaluation using chemometrical tools, such as analysis of variance, regression models, statistics of stochastic processes (time series analysis) and multivariate data analysis (Singer and... 

Penrose R (1955) A generalized inverse for matrices. Proc Cambridge Phil Soc 51 406 Rousseeuw PJ, Leroy AM (1987) Robust regression and outlier detection. Wiley, New York Sachs L (1992) Angewandte Statistik. Springer, Berlin Heidelberg New York Sharaf MA, Illman DL, Kowalski BR (1986) Chemometrics. Wiley, New York... 

Another very useful series of chemometric related articles has been written by David Coleman and Lynn Vanatta. Their series is on the subject of regression analysis. It has appeared in American Laboratory in a set of over twenty-five articles. Copies of the back articles are available on the web at the URL address found in reference [18]. 

Nonlinearity is a subject the specifics of which are not prolifically or extensively discussed as a specific topic in the multivariate calibration literature, to say the least. Textbooks routinely cover the issues of multiple linear regression and nonlinearity, but do not cover the issue with full-spectrum methods such as PCR and PLS. Some discussion does exist relative to multiple linear regression, for example in Chemometrics A Textbook by D.L. Massart et al. [6], see Section 2.1, Linear Regression (pp. 167-175) and Section 2.2, Non-linear Regression, (pp. 175-181). The authors state,... 

Workman, J. and Mark, H., Chemometrics in Spectroscopy Comparison of Goodness of Fit Statistics for Linear Regression - Part 1, Introduction , Spectroscopy 19(4), 32-35 (2004). 

This definition is convenient because it allows us to then jump directly to what is arguably the simplest Chemometric technique in use, and consider that as the prototype for all chemometric methods that technique is multiple regression analysis. Written out in matrix notation, multiple regression analysis takes the form of a relatively simple matrix equation ... 

The second critical fact that comes from equation 70-20 can be seen when you look at the Chemometric cross-product matrices used for calibrations (least-squares regression, for example, as we discussed in [1]). What is this cross-product matrix that is often so blithely written in matrix notation as ATA as we saw in our previous chapter Let us write one out (for a two-variable case like the one we are considering) and see ... 

---