Regression analysis ridge

The regression analysis of multicollinear data is described in several papers e.g. [MANDEL, 1985 HWANG and WINEFORDNER, 1988], HWANG and WINEFORD-NER [1988] also discuss the principle of ridge regression, which is, essentially, the addition of a small contribution to the diagonal of correlation matrix. The method of partial least squares (PLS) described in Section 5.7.2 is one approach to solving this problem. 

Ridge regression analysis is used when the independent variables are highly interrelated, and stable estimates for the regression coefficients cannot be obtained via ordinary least squares methods (Rozeboom, 1979 Pfaffenberger and Dielman, 1990). It is a biased estimator that gives estimates with small variance, better precision and accuracy. 

Once the data have been rescaled, perform the regression analysis and check again for collinearity. If it is present, move to ridge regression. 

The ridge regression analysis can be extremely useful with regressions that have correlated x, predictor values. When the data are in correlation form, it is useful to mn a variety of other tests, such as ANOVA, for the model to be sure, it is adequate. In matrix form, the computations are... 

In this paper the PLS method was introduced as a new tool in calculating statistical receptor models. It was compared with the two most popular methods currently applied to aerosol data Chemical Mass Balance Model and Target Transformation Factor Analysis. The characteristics of the PLS solution were discussed and its advantages over the other methods were pointed out. PLS is especially useful, when both the predictor and response variables are measured with noise and there is high correlation in both blocks. It has been proved in several other chemical applications, that its performance is equal to or better than multiple, stepwise, principal component and ridge regression. Our goal was to create a basis for its environmental chemical application. 

Example 3,5.1 Analysis of the rate coefficient of an acid-catalysed reaction by ridge regression... 

Regression coefficients, partial, 172 standardized, 168 Regression, linear, 156 multivariate, 171 polynomial, 163 through origin, 162 Residuals, 13 Residuals analysis, 159 Ridge regression, 203 RMS noise, 31 Roots, characteristic, 73... 

Zhang, P., Lee, C., Verweij, H., Akbar, S.A., Hunter, G. and Dutta, P.K. (2007) High temperatiue sensor array for simultaneous determination of O2, CO, and CO2 with kernel ridge regression data analysis. Sens. Actuators B, 123 (2), 950-63. 

Sreerama, N. and Woody, R. W. (1994) Protein secondary structure from circular dichroism spectroscopy combining variable selection principle and cluster analysis with neural network, ridge regression and self-consistent methods. Journal of Molecular Biology, 242, 497-507. 

---