Validation experimental design

The second stage is the proof of principle In this phase, we take the initial theoretical library idea and begin to apply chemistry experiments to validate experimental designs and potential library schemes at this stage, one also evaluates the method of library production (solid/solution/hybrid phases). In this phase, which is usually the longest phase in any library production process, we will perform the initial experiments, optimize the chemical yields and purities, modify the experiments to generate easily removable by-products, which can be removed by traditional parallel purification methods (i.e. SPE, Resin capture), and determine the most feasible route to the final product. 

Skill 1.2 Developing valid experimental designs for collecting and analyzing data and testing hypotheses... 

The potential benefits of using a structured statistically valid experimental design rather than using traditional one factor at a time experimentation are summarised below and are illustrated by the examples given later in this section. 

When an analytical method is being developed, the ultimate requirement is to be able to determine the analyte(s) of interest with adequate accuracy and precision at appropriate levels. There are many examples in the literature of methodology that allows this to be achieved being developed without the need to use complex experimental design simply by varying individual factors that are thought to affect the experimental outcome until the best performance has been obtained. This simple approach assumes that the optimum value of any factor remains the same however other factors are varied, i.e. there is no interaction between factors, but the analyst must be aware that this fundamental assumption is not always valid. 

The reliability of multispecies analysis has to be validated according to the usual criteria selectivity, accuracy (trueness) and precision, confidence and prediction intervals and, calculated from these, multivariate critical values and limits of detection. In multivariate calibration collinearities of variables caused by correlated concentrations in calibration samples should be avoided. Therefore, the composition of the calibration mixtures should not be varied randomly but by principles of experimental design (Deming and Morgan [1993] Morgan [1991]). 

The first precise or calculable aspect of experimental design encountered is determining sufficient test and control group sizes to allow one to have an adequate level of confidence in the results of a study (that is, in the ability of the study design with the statistical tests used to detect a true difference, or effect, when it is present). The statistical test contributes a level of power to such a detection. Remember that the power of a statistical test is the probability that a test results in rejection of a hypothesis, H0 say, when some other hypothesis, H, say, is valid. This is termed the power of the test with respect to the (alternative) hypothesis H. ... 

The assumptions that the depletion of the sediment phase is insignificant, and that the contaminant desorption kinetics are not rate-limiting for exposures to sediment slurries, are only valid if some critical conditions regarding experimental design are met. For compounds that attain equilibrium, the total amount in the SPMDs should be much smaller than the total amount in the sediment phase. This condition can be expressed as... 

The typical cDNA microarray study can be described in nine steps (1) establishing an appropriate experimental design (2) isolation and conversion of mRNA to labeled cDNA (3) hybridization of labeled cDNA to the microarray slide (4) image acquisition, (5) data storage, (6) normalization (7) statistical analysis (8) data mining and (9) validation of the results. Each of these steps is multifaceted and the introduction of error at any point in the process can lead to costly loss of data. The following section describes the steps followed in experimental design. 

Current practice in microarray experimentation suggests that a balance design with adequate replication be used. Good experimental design and execution will produce data that minimize technical variance, allowing the statistical analyses to evaluate biological variance more effectively Still, the nature of the data requires that an estimate of the FDR be included in the statistical analysis. This enables the researcher to assess the reliability/validity of the results of the statistical analysis. As discussed earlier, cDNA microarray... 

The full-scale industrial experiment demonstrated the feasibility of a convenient, nonintrusive aconstic chemometric facility for reliable ammonia concentration prediction. The training experimental design spanned the industrial concentration range of interest (0-8%). Two-segment cross-validation (test set switch) showed good accnracy (slope 0.96) combined with a satisfactory RMSEP. It is fully possible to further develop this pilot study calibration basis nntil a fnll industrial model has been achieved. There wonld appear to be several types of analogous chemical analytes in other process technological contexts, which may be similarly approached by acoustic chemometrics. 

The in situ spectroscopies and the signal processing have limitations. Therefore, the set of observable species is a proper subset of all liquid phase species S. The validity of Eq. (4), namely, that the number of observable species is less than the number of species, is easily verified. Regardless of the instrument, the sensitivity is finite, and some dilute and most trace species must be lost in the experimental noise. In addition, numerous experimental design shortcomings further contribute to the validity of Eq. (4). 

For theexample discussed here, the calibration sets for classes A and B are selected gs hically, and for class C are selected as the extremes and centers of each ofdie three levels in the experimental design. The selection results in 15 samples in each of the calibration sets and 12 in each of the validation sets. A score pS>t of all samples in class A is shown in Figure 4.69 with the calibration set samples indicated by X and the validation samples indicated by O. Similarly, SCO plots of clas.es B and C with calibration and validation samples identifiedsre shown in Figures 4.70 and 4.71, respectively. 

FIGURE 5.42. Experimental design for ICLS Example 2 x = calibration O = validation. 

Furthermore, optimal design theory assumes that the model is true within the region defined by the candidate design points, since the designs are optimal in terms of minimizing variance as opposed to bias due to lack-of-fit of the model. In reality, the response surface model is only assumed to be a locally adequate polynomial approximation to the truth it is not assumed to be the truth. Consequently, the experimental design chosen should reflect doubt in the validity of the model by allowing for model lack-of-fit to be tested. 

---