ROC analysis

CTA and MRA are described in more detail in Chapter 2 therefore, this section will focus on CDUS. CDUS is widely available, well-validated, and is free of the risks and complications of radiographic contrast administration. Using ROC analysis, velocity criteria for detecting a residual lumen diameter of <1.5 mm have been developed based on pathological correlation with CEA plaques.In addition, transcranial Doppler can play an adjunctive role in dehning the hemodynamic signihcance of a lesion. ... 

Egan, J. P. (1975) Signal detection theory and ROC analysis, Academic Press, New York. 

U. Brefeld and T. Scheer, in Proceedings of the ICML 2005 Workshop on ROC Analysis in Machine Learning, Bonn, Germany, 2005. 

The Receiver Operator Characteristic curve (ROC curve) is a graphical plot of the sensitivity Sn versus false positive rate FPR for a binary classifier system as its discrimination threshold is varied. The ROC curve can also be represented equivalently by plotting the fraction of true positives (TP) versus the fraction of false positives (FP) (Figure C3). ROC analysis provides tools to select possibly optimal classification models. 

V6. Vuoristo, M. S., Kellokumpu-Lehtinen, P., Parvinen, L. M., Hahka-Kemppinen, M., Korpela, M., Kumpulainen, E., and Laine, S., Serum matrix metalloproteinase-2 as a prognostic marker in advanced cutaneous melanoma. Acta Oncol. 39, 877-879 (2000). Walsh, K. M., Timms, P., Campbell, S., MacSween, R. N., and Morris, A. J., Plasma levels of matrix metalloproteinase-2 (MMP-2) and tissue inhibitors of metalloprotei-nases-1 and-2 (TlMP-1 and TlMP-2) as noninvasive markers of hver disease in chronic hepatitis C Comparison using ROC analysis. Dig. Dis. Sci. 44, 624-630 (1999). 

Obtaining valid data for ROC analysis requires attention to the following important steps (1) define carefully the specific clinical question to be addressed (2) choose subjects who are representative of the population to which the test is ultimately to be applied (3) perform all tests being evaluated on all subjects (4) determine the "true diagnosis by rigorous and complete means independent of the test(s) being studied and (5) evaluate and compare test performance at all decision levels using ROC curves. 

The principle of ROC analysis is to generate plots using a spreadsheet (e.g., EXCEL) in which ... 

ROC analysis is often used to evaluate the medical imaging technology, because it avoids the problem... 

Metz CE (1978) Basic principles of ROC analysis. Semin Nucl Med 8 283-298... 

Metz CE (1996) Evaluation of digital mammography by ROC analysis. In Doi K, Giger ML, Nishikawa RM, et al (eds) Digital mammography 96. Elsevier Science, Amsterdam, pp 61-68... 

Metz CE (2000) Fundamental ROC analysis. In Beutel J, Kmdel H, Van Metter R (eds) Handbook of medical imaging. SPIE, Bellingham, WA,pp 751-770... 

Reimer P, JShnke N, Fiebich M et al (2000) Hepatic lesion detection and characterization value of nonenhanced MR imaging, superparamagnetic iron oxide-enhanced MR imaging, and spiral CT - ROC Analysis. Radiology 217 152-158... 

Stroszczynski C, Gaffke G, Gretschel S et al (2003) Use of SPlO-enhanced Tl- and T2-weighted images for the differentiation of liver lesions an ROC analysis. Rdfo 175 1368-1375... 

Statistical Evaluation of Diagnostic Performance Topics in ROC Analysis... 

Fawcett, T, 2005. An introduction to ROC analysis. Pattern Recognit. Lett. 27, 861—874. 

Janes H, Longton G, Pepe M (2009). Accommodating covariates in ROC analysis. The Stata Journal, 9(1) 17-39. 

Brinkmann, B. Kohler, H. Banaschak, S. Berg, A. Eikelmann, B. et al. (2000) ROC analysis of alcoholism markers -100% specificity. International Journal of legal medicine. 113, 293-299. 

The overlay obtained for compound 123 shows a much better shape match to the template with an improved overlay of the aromatics in the bioisosteric head group. However, the acceptor features of the cyclic amide are less convincing, hence the lower rankings (Cresset rank 144 in both searches). The retrospective ROCS analysis ranked this exemplar 308th using the combo score (rank 96 by shape only and 840 by color), so this would have appeared much lower in the ROCS hits. The results summary shows that this monomer was not selected on the basis of the Cresset results but included as part of the additional chemists selection. This was due to the poor match of the FieldPoints around the head group with the reference compound. 

---