Decision, multivariable

Brodley, C.E. and Utgoff, P.E., 1995. Multivariate Decision Trees. Machine Learning, 19, 45. 

Bayesian networks for multivariate reasoning about cause and effect within R D with a flow bottleneck model (Fig. 11.6) to help combine scientific and economic aspects of decision making. This model can, where research process decisions affect potential candidate value, further incorporate simple estimation of how the candidate value varies based on the target product profile. Factors such as ease of dosing in this profile can then be causally linked to the relevant predictors within the research process (e.g., bioavailability), to model the value of the predictive methods that might be used and to perform sensitivity analysis of how R D process choices affect the expected added... 

We also make a distinction between parametric and non-parametric techniques. In the parametric techniques such as linear discriminant analysis, UNEQ and SIMCA, statistical parameters of the distribution of the objects are used in the derivation of the decision function (almost always a multivariate normal distribution... 

In Section 1.5 we briefly discussed the relationships of equality and inequality constraints in the context of independent and dependent variables. Normally in design and control calculations, it is important to eliminate redundant information and equations before any calculations are performed. Modem multivariable optimization software, however, does not require that the user clearly identify independent, dependent, or superfluous variables, or active or redundant constraints. If the number of independent equations is larger than the number of decision variables, the software informs you that no solution exists because the problem is overspecified. Current codes have incorporated diagnostic tools that permit the user to include all possible variables and constraints in the original problem formulation so that you do not necessarily have to eliminate constraints and variables prior to using the software. Keep in mind, however, that the smaller the dimensionality of the problem introduced into the software, the less time it takes to solve the problem. 

Always start pattern recognition by performing a preliminary multivariate data exploration PCA is a perfect tool for this purpose, being useful to visualize structures (groupings, correlation) within the data and to make decisions about the subsequent processing steps. 

Fig. 3.2 Typical applications using chemical multivariate data (schematically shown for 2-dimensional data) cluster analysis (a) separation of categories (b), discrimination by a decision plane and classification of unknowns (c) modelling categories and principal component analysis (d), feature selection (X2 is not relevant for category separation) (eY relationship between a continuous property Y and the features Xi and X2 (f)...

CONTENTS 1. Chemometrics and the Analytical Process. 2. Precision and Accuracy. 3. Evaluation of Precision and Accuracy. Comparison of Two Procedures. 4. Evaluation of Sources of Variation in Data. Analysis of Variance. 5. Calibration. 6. Reliability and Drift. 7. Sensitivity and Limit of Detection. 8. Selectivity and Specificity. 9. Information. 10. Costs. 11. The Time Constant. 12. Signals and Data. 13. Regression Methods. 14. Correlation Methods. 15. Signal Processing. 16. Response Surfaces and Models. 17. Exploration of Response Surfaces. 18. Optimization of Analytical Chemical Methods. 19. Optimization of Chromatographic Methods. 20. The Multivariate Approach. 21. Principal Components and Factor Analysis. 22. Clustering Techniques. 23. Supervised Pattern Recognition. 24. Decisions in the Analytical Laboratory. 

The analyst should check the Shepard diagram that represents a step line so-called D-hat values. If all reproduced distances fall onto the step-line, then the rank ordering of distances (or similarities) would be perfectly reproduced by the dimensional model, while deviations from the step-line mean lack of fit. The interpretation of the dimensions usually represents the final step of this multivariate procedure. As in factor analysis, the final orientation of axes in the plane (or space) is mostly the result of a subjective decision by the researcher since the distances between objects remain invariable regardless of the type of the rotation. However, it must be remembered that MDS and FA are different methods. FA requires that the underlying data be distributed as multivariate normal, whereas MDS does not impose such a restriction. MDS often yields more interpretable solutions than FA because the latter tends to extract more factors. MDS can be applied to any kind of distances or similarities (those described in cluster analysis), whereas FA requires firstly the computation of the correlation matrix. Figure 7.3 shows the results of applying MDS to the samples described in the CA and FA sections (7.3.1 and 7.3.2). 

---