Multivariate linear regression models

The PLS approach to multivariate linear regression modeling is relatively new and not yet fully investigated from a theoretical point of view. The results with calibrating complex samples in food analysis 122,123) j y jnfj-ared reflectance spectroscopy, suggest that PLS could solve the general calibration problem in analytical chemistry. 

Linear Regression with Several Response Variables 6.4.2.1 The Multivariate Linear Regression Model... 

Computes a multivariate linear regression model of the form y = Af and returns the following parameters ... 

Calibration models developed for spectroscopic applications are generally represented as hnear functions of the measured responses obtained at certain wavelengths. Commonly, multivariate linear regression models in the form... 

An important aspect of all methods to be discussed concerns the choice of the model complexity, i.e., choosing the right number of factors. This is especially relevant if the relations are developed for predictive purposes. Building validated predictive models for quantitative relations based on multiple predictors is known as multivariate calibration. The latter subject is of such importance in chemo-metrics that it will be treated separately in the next chapter (Chapter 36). The techniques considered in this chapter comprise Procrustes analysis (Section 35.2), canonical correlation analysis (Section 35.3), multivariate linear regression... 

Step 4. The RRR model coefficients are then found by a multivariate linear regression of the RRR fit, Y = ( a] + In y ) original X, which should have a... 

Using multivariable linear regression, a set of equations can be derived from the parameterized data. Statistical analysis yields the "best equations to fit the en irical data. This mathematical model forms a basis to correlate the biologicsd activity to the chemical structures. 

The model equation for multivariable linear regression can be generalized and written in a compact form by using matrices for each of the q dependent variables y for the n data sets... 

From a data analytical point of view, data can be categorised according to structure, as exemplified in Table 1. Depending on the kind of data acquired, appropriate data analytical tools must be selected. In the simplest case, only one variable/number is acquired for each sample in which case the data are commonly referred to as zeroth-order data. If several variables are collected for each sample, this is referred to as first-order data. A typical example could be a ID spectrum acquired for each sample. Several ID spectra from different samples may be organised in a two-way table or a matrix. For such a matrix of data, multivariate data analysis is commonly employed. It is clearly not possible to analyse zeroth-order data by multivariate techniques and one is restricted to traditional statistics and linear regression models. When first- or second-order data are available, multivariate data analysis may be used and several advantages may be exploited,... 

Table 2.6 Results of multivariate linear regression of data in Table 2.3 using Ln-transformed 5-FU clearance as the dependent variable without MTX included in the model.

Two datasets are fist simulated. The first contains only normal samples, whereas there are 3 outliers in the second dataset, which are shown in Plot A and B of Figure 2, respectively. For each dataset, a percentage (70%) of samples are randomly selected to build a linear regression model of which the slope and intercept is recorded. Repeating this procedure 1000 times, we obtain 1000 values for both the slope and intercept. For both datasets, the intercept is plotted against the slope as displayed in Plot C and D, respectively. It can be observed that the joint distribution of the intercept and slope for the normal dataset appears to be multivariate normally distributed. In contrast, this distribution for the dataset with outliers looks quite different, far from a normal distribution. Specifically, the distributions of slopes for both datasets are shown in Plot E and F. These results show that the existence of outliers can greatly influence a regression model, which is reflected by the odd distributions of both slopes and intercepts. In return, a distribution of a model parameter that is far from a normal one would, most likely, indicate some abnormality in the data. 

PLSR nowadays is a reference method for multivariate calibration and its utilization has overcome limitations in the use of multiple linear regressions. In the PLSR approach, the full spectrum is used to establish a linear regression model, where the significant information contained in the near-infrared spectra is concentrated in a few latent variables that are optimized to produce the best correlation with the desired property to be determined. 

GBM, gradient boosting models MLR, multivariate linear regression NN, artificial neural net RF, random forest, n, descriptors, number of descriptors used n, train, size of training set, n, test, size of test set. Fivefold cross-validated results. 

The plasma characteristics of an axially viewed ICP where amounts of vapours or aerosols were injected were investigated. Experimental designs and empirical modelling (multivariate linear regression) were combined to select robust conditions. 

PLSR is an extension of the multiple linear regression model. It is probably the least restrictive of the various multivariate extensions of the multiple linear regression model. This flexibility allows it to be used in situations where the use of traditional multivariate methods is severely limited, such as the case that when there are fewer observations than predictor variables. Furthermore, PLSR can be used as an exploratory analysis tool to select suitable predictor variables and to identify outliers before classical linear regression. Especially in chemometrics, PLSR has become a standard tool for modeling linear relationships between multivariate measurements. 

When we have n independent observations from the normal linear regression model where the observations all have the same known variance, the conjugate prior distribution for the regression coefficient vector /3 is multivariate normal(bo, Vq). The posterior distribution of /3 will be multivariate nor-mal y>i, Vi), where... 

---