Regression ANOVA

Alius, M.A., Brereton, R.G., and Nickless, G. (1989), The Use of Experimental Design, Multilinear Regression, ANOVA, Confidence Bands and Leverge in a Study of the Influence of Metals on the Growth of Barley Seedlings, Chemom. Intel. Lab. Sys., 6, 65-80. 

Extending non-parametric tests to more complex settings, such as regression, ANOVA and ANCOVA is not straightforward and this is one aspect of these methods that limits their usefulness. 

What type of data analysis is required (regression, ANOVA, etc.) ... 

The six-step procedure can be easily applied to the regression ANOVA for determining if /3i = 0. Let us now use the data in Example 2.1 to construct an ANOVA table. 

Factors with regression coefficients having confidence coefficients > 90% None ANOVA F-ratIo 13.65... 

Regression and ANOVA An Integrated Approach Using SAS Software by Keith E. Muller and Bethel A. Fetterman... 

For the basic evaluation of a linear calibration line, several parameters can be used, such as the relative process standard deviation value (Vxc), the Mandel-test, the Xp value [28], the plot of response factor against concentration, the residual plot, or the analysis of variance (ANOVA). The lowest concentration that has been used for the calibration curve should not be less than the value of Xp (see Fig. 4). Vxo (in units of %) and Xp values of the linear regression line Y = a + bX can be calculated using the following equations [28] ... 

Other statistical parameters that can be used include examination of residuals and the output from the ANOVA table of regression statistics. This may indicate that a non-linear response function should be checked [9]. 

Note also that we can use the correlation test statistic (described in the correlation coefficient section) to determine if the regression is significant (and, therefore, valid at a defined level of certainty. A more specific test for significance would be the linear regression analysis of variance (Pollard, 1977). To so we start by developing the appropriate ANOVA table. 

The ANOVA test, which is also recommended by the Analytical Methods Committee of The Royal Society of Chemistry (UK), can be generalized to other regression models, and it can be extended to handle heteroscedasticity. For a more detailed prescription and the extension of the test see further reading. 

Figure 9.4 emphasizes the relationship among three sums of squares in the ANOVA tree - the sum of squares due to the factors as they appear in the model, SSf (sometimes called the sum of squares due to regression, SS ) the sum of squares of residuals, SS, and the sum of squares corrected for the mean, (or the total sum of squares, SSj, if there is no Pq term in the model). 

Traditionally, the determination of a difference in costs between groups has been made using the Student s r-test or analysis of variance (ANOVA) (univariate analysis) and ordinary least-squares regression (multivariable analysis). The recent proposal of the generalized linear model promises to improve the predictive power of multivariable analyses. 

This link applies also to the p-value from the unpaired t-test and the confidence interval for p, the mean difference between the treatments, and in addition extends to adjusted analyses including ANOVA and ANCOVA and similarly for regression. For example, if the test for the slope b of the regression line gives a significant p-value (at the 5 per cent level) then the 95 per cent confidence interval for the slope will not contain zero and vice versa. 

The t-tests and their extensions ANOVA, ANCOVA and regression all make assumptions about the distribution of the data in the background populations. If these assumptions are not appropriate then strictly speaking the p-values coming out of those tests together with the associated confidence intervals are not valid. 

In the paired t-test setting it is the normality of the differences (response on A — response on B) that is required for the validity of the test. The log transformation on the original data can sometimes be effective in this case in recovering normality for these differences. In other settings, such as ANOVA, ANCOVA and regression, log transforming the outcome variable is always worth trying, where this is a strictly positive quantity, as an initial attempt to recover normality. 

In Chapter 6 we covered methods for adjusted analyses and analysis of covariance in relation to continuous (ANOVA and ANCOVA) and binary and ordinal data (CMH tests and logistic regression). Similar methods exist for survival data. As with these earlier methods, particularly in relation to binary and ordinal data, there are numerous advantages in accounting for such factors in the analysis. If the randomisation has been stratified, then such factors should be incorporated into the analysis in order to preserve the properties of the resultant p-values. 

ANOVA of the data confirms that there is a statistically significant relationship between the variables at the 99% confidence level. The i -squared statistic indicates that the model as fitted explains 96.2% of the variability. The adjusted P-squared statistic, which is more suitable for comparing models with different numbers of independent variables, is 94.2%. The prediction error of the model is less than 10%. Results of this protocol are displayed in Table 18.1. Validation results of the regression model are displayed in Table 18.2. 

Figure 3. Relationship between leaf area (A), epidermal cell density (B), stomatal density (C) and stomatal index (D) versus altitude for Nothofagus solandri leaves growing on the slope of Mt. Ruapehu, New Zealand (collected in 1999). Black diamonds indicate the mean of ten counting fields on each leaf, white squares are the averages of five to eight leaves per elevation, with error bars of 1 S.E.M. Nested mixed-model ANOVA with a general linear model indicates significant differences for all factors (p = 0.000). Averages per elevation were used for regression analysis A. y = -0.0212 + 73.1 R2 = 0.276 p = 0.147. B. y = 1.70 + 3122 R2 = 0.505 p = 0.048. C. y = 0.164 + 360 R2 = 0.709 p = 0.009. D. linear (dashed) y = 0.004 + 9.33 R2 = 0.540 p = 0.038 non-linear (solid) y = 0.00001 2 - 0.0206 + 21.132 R2 = 0.770.

Results were analyzed by nested mixed-model ANOVA s using general linear procedures, in the MINITAB 15 statistical program. Nested mixed-model ANOVA was used when multiple leaves per tree and multiple trees per treatment were available. Additional analyses were linear and quadratic regressions (performed in MINITAB 15 and Excel), and when significant differences occurred, means were compared using Student s t-test or nested mixed-model ANOVA. 

Analysis of variance (ANOVA and MANOVA) has been used to investigate the influence of location on forms of metals in roadside soil (Nowak, 1995). Multiple regression analysis has proved valuable in processing sequential extraction data to obtain information on plant availability of trace metals in soils (Qian et al, 1996 ... 

The suitability of the regression model should be proven by a special statistical lack-of-fit-test, which is based on an analysis of variance (ANOVA). Here the residual sum of squares of regression is separated into two components the sum of squares from lack-of-fit (LOF) and the pure error sum of squares (PE, pure errors)... 

---