Regression, multivariate

To this point, the discussion of regression analysis and its applications has been limited to modelling the association between a dependent variable and a 

In the simplest example, the dependent response variable, y, may be a function of two such independent variables, jci and X2. 

Again a is the intercept on the ordinate y-axis, and b and 62 are the partial regression coefficients. TTiese coefficients denote the rate of change of the mean of y as a fimction of Xi, with X2 constant, and the rate of change of y as a function of X2 with Xj constant. 

Multivariate regression analysis plays an important role in modem process control analysis, particularly for quantitative UV-visible absorption spectrometry and near-IR reflectance analysis. It is conunon practice with these techniques to monitor absorbance, or reflectance, at several wavelengths and relate these individual measures to the concentration of some analyte. The results from a simple two-wavelength experiment serve to illustrate the details of multivariate regression and its application to multivariate calibration procedures. 

Despite the apparently high value for this model (r = 0.943), its predictive ability is poor as can be demonstrated with the three test samples  

To this point, the discussion of regression analysis and its applications has been limited to modelling the association between a dependent variable and a single independent variable. Chemometrics is more often concerned with multivariate measures. Thus it is necessary to extend our account of regression to include cases in which several or many independent variables contribute to the measured response. It is important to realize at the outset that the term independent variables as used here does not imply statistical independence, as the response variables may be highly correlated. 

---

Multivariable Regression Approach for Porosity Determination in Composite Materials. 

In this paper we propose a multivariable regression approach for estimating ultrasound attenuation in composite materials by means of pulse-echo measurements, thus overcoming the problems with limited access that is the main drawback of through-transmission testing. 

In this paper we propose a method to measure (estimate) the attenuation in composites by means of PE measurements using a multivariable regression approach. 

As we have mentioned, the particular characterization task considered in this work is to determine attenuation in composite materials. At our hand we have a data acquisition system that can provide us with data from both PE and TT testing. The approach is to treat the attenuation problem as a multivariable regression problem where our target values, y , are the measured attenuation values (at different locations n) and where our input data are the (preprocessed) PE data vectors, u . The problem is to find a function iy = /(ii ), such that i), za jy, based on measured data, the so called training data. 

One might suspect that fitting all T-variables simultaneously, i.e. in one overall multivariate regression, might make a difference for the regression model. This is not the case, however. To see this, let us state the multivariate (i.e. two or more dependent variables) regression model as ... 

The total residual sum of squares, taken over all elements of E, achieves its minimum when each column Cj separately has minimum sum of squares. The latter occurs if each (univariate) column of Y is fitted by X in the least-squares way. Consequently, the least-squares minimization of E is obtained if each separate dependent variable is fitted by multiple regression on X. In other words the multivariate regression analysis is essentially identical to a set of univariate regressions. Thus, from a methodological point of view nothing new is added and we may refer to Chapter 10 for a more thorough discussion of theory and application of multiple regression. 

A. Burnham, R. Viveros, J.F. MacGregor, Frameworks for latent variable multivariate regression. J. Chemom., 10 (1996) 31 6. 

Beilken et al. [ 12] have applied a number of instrumental measuring methods to assess the mechanical strength of 12 different meat patties. In all, 20 different physical/chemical properties were measured. The products were tasted twice by 12 panellists divided over 4 sessions in which 6 products were evaluated for 9 textural attributes (rubberiness, chewiness, juiciness, etc.). Beilken etal. [12] subjected the two sets of data, viz. the instrumental data and the sensory data, to separate principal component analyses. The relation between the two data sets, mechanical measurements versus sensory attributes, was studied by their intercorrelations. Although useful information can be derived from such bivariate indicators, a truly multivariate regression analysis may give a simpler overall picture of the relation. 

The above study was replicated later with 75 asymptomatic black children, 3-7 years old, of uniformly low socioeconomic status (Hawk et al. 1986 Schroeder and Hawk 1987). Backward stepwise multivariate regression analysis revealed a highly significant negative linear relationship between Stanford-Binet IQ scores and contemporary PbB levels over the entire range of 6-47 pg/dL (mean,... 

Multiple linear regression (MLR) is a classic mathematical multivariate regression analysis technique [39] that has been applied to quantitative structure-property relationship (QSPR) modeling. However, when using MLR there are some aspects, with respect to statistical issues, that the researcher must be aware of ... 

In our next chapter, we will be applying the lessons reviewed over these past three chapters toward a better understanding of the geometric concepts relative to multivariate regression. 

Calculating the Solution for Regression Techniques Part 1 - Multivariate Regression Made Simple... 

For the next several chapters in this book we will illustrate the straight forward calculations used for multivariate regression. In each case we continue to perform all mathematical operations using MATLAB software [1, 2], We have already discussed and shown the manual methods for calculating most of the matrix algebra used here in references [3-6]. You may wish to program these operations yourselves or use other software to routinely make these calculations. 

A more detailed analysis using multivariable regression of the ibuprofen data demonstrated that a three-parameter model accurately fit the data (Table 7). The Bonding Index and the Heywood shape factor, a, alone explained 86% of the variation, while the best three-variable model, described in what follows, explained 97% of the variation and included the Bonding Index, the Heywood shape factor, and the powder bed density. All three parameters were statistically significant, as seen in Table 7. Furthermore, the coefficients are qualitatively as... 

Rieckmann and Volker fitted their kinetic and mass transport data with simultaneous evaluation of experiments under different reaction conditions according to the multivariate regression technique [116], The multivariate regression enforces the identity of kinetics and diffusivities for all experiments included in the evaluation. With this constraint, model selection is facilitated and the evaluation results in one set of parameters which are valid for all of the conditions investigated. Therefore, kinetic and mass transfer data determined by multivariate regression should provide a more reliable data basis for design and scale-up. 

---