Randomized trial external usefulness

The Stroke-Thrombolytic Predictive Instrument (Stroke-TPI) has recently been developed in order to provide patient-specific estimates of the probability of a more favorable outcome with rt-PA, and has been proposed as a decision-making aid to patient selection for rt-PA." The estimates from this tool should, however, be treated with caution. The prediction rule is dependent on post hoc mathematical modeling, uses clinical trial data from subjects randomized beyond 3 hours who are not rt-PA-eligible according to FDA labeling and current best practice, and has not been externally validated. It is, therefore, not appropriate to exclude patients from rt-PA treatment based solely on Stroke-TPI predictions. 

External validity can also be affected if trials have protocols that differ from usual clinical practice. For example, prior to randomization in the trials of endarterectomy for symptomatic carotid stenosis patients had to be diagnosed by a neurologist and to have conventional arterial angiography, neither of which are routine in many centers. The trial intervention itself may also differ from that used in current practice, such as in the formulation and bioavailability of a drug, or the type of anesthetic used for an operation. The same can be true of the treatment in the control group in a trial, which may use a particularly low dose of the comparator drug or fall short of best current practice in some... 

Halyard MY. Randomized control trial evaluating aluminum-based antiperspirant use, axilla skin toxicity, and reported quality of life in women receiving external beam radiotherapy for treatment of stage 0,1, and II breast cancer. Breast Dis 2012 23(4) 369-71. 

---