Principal component regression factors

Factor spaces are a mystery no more We now understand that eigenvectors simply provide us with an optimal way to reduce the dimensionality of our spectra without degrading them. We ve seen that, in the process, our data are unchanged except for the beneficial removal of some noise. Now, we are ready to use this technique on our realistic simulated data. PCA will serve as a pre-processing step prior to ILS. The combination of Principal Component Analysis with ILS is called Principal Component Regression, or PCR. 

Because of peak overlappings in the first- and second-derivative spectra, conventional spectrophotometry cannot be applied satisfactorily for quantitative analysis, and the interpretation cannot be resolved by the zero-crossing technique. A chemometric approach improves precision and predictability, e.g., by the application of classical least sqnares (CLS), principal component regression (PCR), partial least squares (PLS), and iterative target transformation factor analysis (ITTFA), appropriate interpretations were found from the direct and first- and second-derivative absorption spectra. When five colorant combinations of sixteen mixtures of colorants from commercial food products were evaluated, the results were compared by the application of different chemometric approaches. The ITTFA analysis offered better precision than CLS, PCR, and PLS, and calibrations based on first-derivative data provided some advantages for all four methods. ... 

The application of principal components regression (PCR) to multivariate calibration introduces a new element, viz. data compression through the construction of a small set of new orthogonal components or factors. Henceforth, we will mainly use the term factor rather than component in order to avoid confusion with the chemical components of a mixture. The factors play an intermediary role as regressors in the calibration process. In PCR the factors are obtained as the principal components (PCs) from a principal component analysis (PC A) of the predictor data, i.e. the calibration spectra S (nxp). In Chapters 17 and 31 we saw that any data matrix can be decomposed ( factored ) into a product of (object) score vectors T(nxr) and (variable) loadings P(pxr). The number of columns in T and P is equal to the rank r of the matrix S, usually the smaller of n or p. It is customary and advisable to do this factoring on the data after columncentering. This allows one to write the mean-centered spectra Sq as ... 

The suffix in T (nxA) and P (< xA) indicates that only the first A columns of T and P are used, A being much smaller than n and q. In principal component regression we use the PC scores as regressors for the concentrations. Thus, we apply inverse calibration of the property of interest on the selected set of factor scores ... 

Fourier transform infrared (FTIR) spectroscopy of coal low-temperature ashes was applied to the determination of coal mineralogy and the prediction of ash properties during coal combustion. Analytical methods commonly applied to the mineralogy of coal are critically surveyed. Conventional least-squares analysis of spectra was used to determine coal mineralogy on the basis of forty-two reference mineral spectra. The method described showed several limitations. However, partial least-squares and principal component regression calibrations with the FTIR data permitted prediction of all eight ASTM ash fusion temperatures to within 50 to 78 F and four major elemental oxide concentrations to within 0.74 to 1.79 wt % of the ASTM ash (standard errors of prediction). Factor analysis based methods offer considerable potential in mineral-ogical and ash property applications. 

Haaland and coworkers (5) discussed other problems with classical least-squares (CLS) and its performance relative to partial least-squares (PLS) and factor analysis (in the form of principal component regression). One of the disadvantages of CLS is that interferences from overlapping spectra are not handled well, and all the components in a sample must be included for a good analysis. For a material such as coal LTA, this is a significant limitation. 

Experience in this laboratory has shown that even with careful attention to detail, determination of coal mineralogy by classical least-squares analysis of FTIR data may have several limitations. Factor analysis and related techniques have the potential to remove or lessen some of these limitations. Calibration models based on partial least-squares or principal component regression may allow prediction of useful properties or empirical behavior directly from FTIR spectra of low-temperature ashes. Wider application of these techniques to coal mineralogical studies is recommended. 

Factor The result of a transformation of a data matrix where the goal is to reduce the dimensionality of the data set. Estimating factors is necessary to construct principal component regression and partial least-squares models, as discussed in Section 5.3.2. (See also Principal Component.)... 

Principal Component (PC) In this book, the tenn principal component is used as a generic term to indicate a factor or dimension when using SIMCA, principal components analysis, or principal components regression. Using this terminology, there are scores and loadings associated with a given PC. (See also Factor.)... 

The diffusion of correlation methods and related software packages, such as partial-least-squares regression (PLS), canonical correlation on principal components, target factor analysis and non-linear PLS, will open up new horizons to food research. 

When all of the individual component spectra are not known, implicit calibration methods are often adopted. Among these, factor analysis methods such as principal component regression (PCR)24 and partial least squares (PLS)25 are frequently used because they can function under conditions in which the number of spectra used for calibration is less than the number of wavelengths sampled. For example, a calibration set may include 30 spectra with each spectrum having 500 data points (wavelengths). 

Principal component regression and partial least squares are two widely used methods in the factor analysis category. PCR decomposes the matrix of calibration spectra into orthogonal principal components that best capture the variance in the data. These new variables eliminate redundant information and, by using a subset of these principal components, filter noise from the original data. With this compacted and simplified form of the data, equation (12.7) may be inverted to arrive at b. 

CONTENTS 1. Chemometrics and the Analytical Process. 2. Precision and Accuracy. 3. Evaluation of Precision and Accuracy. Comparison of Two Procedures. 4. Evaluation of Sources of Variation in Data. Analysis of Variance. 5. Calibration. 6. Reliability and Drift. 7. Sensitivity and Limit of Detection. 8. Selectivity and Specificity. 9. Information. 10. Costs. 11. The Time Constant. 12. Signals and Data. 13. Regression Methods. 14. Correlation Methods. 15. Signal Processing. 16. Response Surfaces and Models. 17. Exploration of Response Surfaces. 18. Optimization of Analytical Chemical Methods. 19. Optimization of Chromatographic Methods. 20. The Multivariate Approach. 21. Principal Components and Factor Analysis. 22. Clustering Techniques. 23. Supervised Pattern Recognition. 24. Decisions in the Analytical Laboratory. 

Depezynski, U., Frost, V.J. and Molt, K. (2000) Genetic algorithms applied to the selection of factors in principal component regression. Anal. Chim. Aaa, 420, 217-227. 

Roy, K. and Ghosh, G. (2004c) QSTR with extended topochemical atom indices. 4. Modeling of the acute toxicity of phenylsulfonyl carboxylates to Vibrio fischeri using principal component factor analysis and principal component regression analysis. QSAR Comb. Sci., 23, 526-535. 

Several factors are important in quantitative work. First, an internal reference band is needed for calculating relative intensity (either area or peak) of the band being used in quantitation. Although an external standard can be used, the internal band-ratio calculation is more reliable. However, if a chemometrics approach (e.g., principal components analysis [PCA], principal components regression [PCR], or PLS) is used, a standard is not required. 

In this section we shall consider the rather general case where for a series of chemical compounds measurements are made in a number of parallel biological tests and where a set of descriptor variables is believed to be related to the biological potencies observed. In order to imderstand the data in their entirety and to deal adequately with the mathematical properties of such data, methods of multivariate statistics are required. A variety of such methods is available as, for example, multivariate regression, canonical correlation, principal component analysis, principal component regression, partial least squares analysis, and factor analysis, which have all been applied to biological or chemical problems (for reviews, see [1-11]). Which method to choose depends on the ultimate objective of an analysis and the property of the data. We have found principal component and factor analysis particularly useful. For this reason and also since many multivariate methods make use of components for factors we will start with these methods in some detail, while the discussion of other approaches will be less extensive. 

---