Regression analyses optimal technique

To conclude the list of approachesfor variable selection, we briefly mention the idea of using the output from an all variable selection run as input into a latent variables regression analysis." This technique is expensive computationally as it requires not only the subsets of variables to be found but also the number of latent variables needed to optimize some criterion function. 

A non-linear regression analysis is employed using die Solver in Microsoft Excel spreadsheet to determine die values of and in die following examples. Example 1-5 (Chapter 1) involves the enzymatic reaction in the conversion of urea to ammonia and carbon dioxide and Example 11-1 deals with the interconversion of D-glyceraldehyde 3-Phosphate and dihydroxyacetone phosphate. The Solver (EXAMPLEll-l.xls and EXAMPLEll-3.xls) uses the Michaehs-Menten (MM) formula to compute v i- The residual sums of squares between Vg(,j, and v j is then calculated. Using guessed values of and the Solver uses a search optimization technique to determine MM parameters. The values of and in Example 11-1 are ... 

Optimization techniques may be classified as parametric statistical methods and nonparametric search methods. Parametric statistical methods, usually employed for optimization, are full factorial designs, half factorial designs, simplex designs, and Lagrangian multiple regression analysis [21]. Parametric methods are best suited for formula optimization in the early stages of product development. Constraint analysis, described previously, is used to simplify the testing protocol and the analysis of experimental results. 

Linear discriminant analysis (LDA) is also a probabilistic classifier in the mold of Bayes algorithms but can be related closely to both regression and PCA techniques. A discriminant function is simply a function of the observed vector of variables (K) that leads to a classification rule. The likelihood ratio (above), for example, is an optimal discriminant for the two-class case. Hence, the classification rule can be stated as... 

Hall and Kier reexamined this BCF data set using the response surface optimization technique as reported for a neurotoxicity data set.In this approach the nonlinear parabolic form is extended to a general two-variable parabolic form. The analysis can be performed using ordinary multiple linear regression programs or an extended form of the analysis can be performed using SAS. For the 20 compounds investigated by Sabljic, Hall and Stewart " used the sum and difference of the zero order chi indexes, "x "id defined as follows ... 

For the regression analysis, the experimental data are fixed and the model parameters are varied to minimize SS nsing any of the optimization techniques discussed in Chapter 6. An analytical solution to the minimization problem is possible when the model has a linear form such as odei = ka. The fitting process is then known as linear regression analysis and is summarized in Appendix 7.1. Unfortunately, the more complex rate expressions are nonlinear. It is sometimes possible to transform the model to a linear form, but the transformation causes a bias so that some portions of the operating space will be better fit than other portions. This book... 

Factor spaces are a mystery no more We now understand that eigenvectors simply provide us with an optimal way to reduce the dimensionality of our spectra without degrading them. We ve seen that, in the process, our data are unchanged except for the beneficial removal of some noise. Now, we are ready to use this technique on our realistic simulated data. PCA will serve as a pre-processing step prior to ILS. The combination of Principal Component Analysis with ILS is called Principal Component Regression, or PCR. 

Partial Least Squares (PLS) regression (Section 35.7) is one of the more recent advances in QSAR which has led to the now widely accepted method of Comparative Molecular Field Analysis (CoMFA). This method makes use of local physicochemical properties such as charge, potential and steric fields that can be determined on a three-dimensional grid that is laid over the chemical stmctures. The determination of steric conformation, by means of X-ray crystallography or NMR spectroscopy, and the quantum mechanical calculation of charge and potential fields are now performed routinely on medium-sized molecules [10]. Modem optimization and prediction techniques such as neural networks (Chapter 44) also have found their way into QSAR. 

The technique allows immediate interpretation of the regression equation by including the linear and interaction (cross-product) terms in the constant term (To or stationary point), thus simplifying the subsequent evaluation of the canonical form of the regression equation. The first report of canonical analysis in the statistical literature was by Box and Wilson [37] for determining optimal conditions in chemical reactions. Canonical analysis, or canonical reduction, was described as an efficient method to explore an empirical response surface to suggest areas for further experimentation. In canonical analysis or canonical reduction, second-order regression equations... 

A reported application of canonical analysis involved a novel combination of the canonical form of the regression equation with a computer-aided grid search technique to optimize controlled drug release from a pellet system prepared by extrusion and spheronization [28,29]. Formulation factors were used as independent variables, and in vitro dissolution was the main response, or dependent variable. Both a minimum and a maximum drug release rate was predicted and verified by preparation and testing of the predicted formulations. Excellent agreement between the predicted values and the actual values was evident for the four-component pellet system in this study. 

CONTENTS 1. Chemometrics and the Analytical Process. 2. Precision and Accuracy. 3. Evaluation of Precision and Accuracy. Comparison of Two Procedures. 4. Evaluation of Sources of Variation in Data. Analysis of Variance. 5. Calibration. 6. Reliability and Drift. 7. Sensitivity and Limit of Detection. 8. Selectivity and Specificity. 9. Information. 10. Costs. 11. The Time Constant. 12. Signals and Data. 13. Regression Methods. 14. Correlation Methods. 15. Signal Processing. 16. Response Surfaces and Models. 17. Exploration of Response Surfaces. 18. Optimization of Analytical Chemical Methods. 19. Optimization of Chromatographic Methods. 20. The Multivariate Approach. 21. Principal Components and Factor Analysis. 22. Clustering Techniques. 23. Supervised Pattern Recognition. 24. Decisions in the Analytical Laboratory. 

Test the plan Optimize the process Start by testing the top few suspected variables through observational analysis. Develop and update a regression model as each new variable is tested. Check the production model to verify any improvement in the process and quality that may have occurred. Now optimize the process using EWIMA, linear programming, iterative solving, and process simulation techniques. 

---