Skip to main content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
CMAJ. 1995 Nov 15; 153(10): 1423–1431.
PMCID: PMC1487455
PMID: 7585368

No magic bullets: a systematic review of 102 trials of interventions to improve professional practice.

A D Oxman, M A Thomson, D A Davis, and R B Haynes
Author information Copyright and License information PMC Disclaimer

Abstract

OBJECTIVE: To determine the effectiveness of different types of interventions in improving health professional performance and health outcomes. DATA SOURCES: MEDLINE, SCISEARCH, CINAHL and the Research and Development Resource Base in CME were searched for trials of educational interventions in the health care professions published between 1970 and 1993 inclusive. STUDY SELECTION: Studies were selected if they provided objective measurements of health professional performance or health outcomes and employed random or quasi-random allocation methods in their study designs to assign individual subjects or groups. Interventions included such activities as conferences, outreach visits, the use of local opinion leaders, audit and feedback, and reminder systems. DATA EXTRACTION: Details extracted from the studies included the study design; the unit of allocation (e.g., patient, provider, practice, hospital); the characteristics of the targeted health care professionals, educational interventions and patients (when appropriate); and the main outcome measure. DATA SYNTHESIS: The inclusion criteria were met by 102 trials. Areas of behaviour change included general patient management, preventive services, prescribing practices, treatment of specific conditions such as hypertension or diabetes, and diagnostic service or hospital utilization. Dissemination-only strategies, such as conferences or the mailing of unsolicited materials, demonstrated little or no changes in health professional behaviour or health outcome when used alone. More complex interventions, such as the use of outreach visits or local opinion leaders, ranged from ineffective to highly effective but were most often moderately effective (resulting in reductions of 20% to 50% in the incidence of inappropriate performance). CONCLUSION: There are no "magic bullets" for improving the quality of health care, but there are a wide range of interventions available that, if used appropriately, could lead to important improvements in professional practice and patient outcomes.

Full text

Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (1.9M), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.

 
icon of scanned page 1423
1423
icon of scanned page 1424
1424
icon of scanned page 1425
1425
icon of scanned page 1426
1426
icon of scanned page 1427
1427
icon of scanned page 1428
1428
icon of scanned page 1429
1429
icon of scanned page 1430
1430
icon of scanned page 1431
1431
 

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  • Chalmers TC. The impact of controlled trials on the practice of medicine. Mt Sinai J Med. 1974 Nov-Dec;41(6):753–759. [PubMed] [Google Scholar]
  • Stross JK, Harlan WR. The dissemination of new medical information. JAMA. 1979 Jun 15;241(24):2622–2624. [PubMed] [Google Scholar]
  • Goodwin JS, Goodwin JM. Failure to recognize efficacious treatments: a history of salicylate therapy in rheumatoid arthritis. Perspect Biol Med. 1981 Autumn;25(1):78–92. [PubMed] [Google Scholar]
  • Schade RR, Donaldson RM., Jr How physicians use cimetidine: a survey of hospitalized patients and published cases. N Engl J Med. 1981 May 21;304(21):1281–1284. [PubMed] [Google Scholar]
  • Rockette HE, Redmond CK, Fisher B. Impact of randomized clinical trials on therapy of primary breast cancer: the NSABP overview. Control Clin Trials. 1982 Sep;3(3):209–225. [PubMed] [Google Scholar]
  • Garnier HS, Flamant R, Fohanno C. Assessment of the role of randomized clinical trials in establishing treatment policies. Control Clin Trials. 1982 Sep;3(3):227–234. [PubMed] [Google Scholar]
  • Friedman L, Wenger NK, Knatterud GL. Impact of the Coronary Drug Project findings on clinical practice. Control Clin Trials. 1983 Dec;4(4):513–522. [PubMed] [Google Scholar]
  • Lewis CE. Disease prevention and health promotion practices of primary care physicians in the United States. Am J Prev Med. 1988;4(4 Suppl):9–16. [PubMed] [Google Scholar]
  • Bass MJ, Elford RW. Preventive practice patterns of Canadian primary care physicians. Am J Prev Med. 1988;4(4 Suppl):17–26. [PubMed] [Google Scholar]
  • Stross JK. Relationships between knowledge and experience in the use of disease-modifying antirheumatic agents. A study of primary care practitioners. JAMA. 1989 Nov 17;262(19):2721–2723. [PubMed] [Google Scholar]
  • Williamson JW, German PS, Weiss R, Skinner EA, Bowes F., 3rd Health science information management and continuing education of physicians. A survey of U.S. primary care practitioners and their opinion leaders. Ann Intern Med. 1989 Jan 15;110(2):151–160. [PubMed] [Google Scholar]
  • Lau J, Antman EM, Jimenez-Silva J, Kupelnick B, Mosteller F, Chalmers TC. Cumulative meta-analysis of therapeutic trials for myocardial infarction. N Engl J Med. 1992 Jul 23;327(4):248–254. [PubMed] [Google Scholar]
  • Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992 Jul 8;268(2):240–248. [PubMed] [Google Scholar]
  • Ketley D, Woods KL. Impact of clinical trials on clinical practice: example of thrombolysis for acute myocardial infarction. Lancet. 1993 Oct 9;342(8876):891–894. [PubMed] [Google Scholar]
  • Eddy DM. Clinical policies and the quality of clinical practice. N Engl J Med. 1982 Aug 5;307(6):343–347. [PubMed] [Google Scholar]
  • Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. JAMA. 1992 Sep 2;268(9):1111–1117. [PubMed] [Google Scholar]
  • Tannenbaum TN, Gyorkos TW, Abrahamowicz M, Bédard L, Carsley J, Franco ED, Delage G, Miller MA, Lamping DL, Grover SA. Immunization delivery methods: practice recommendations. Can J Public Health. 1994 Jul-Aug;85 (Suppl 1):S37–S40. [PubMed] [Google Scholar]
  • Waddell DL. The effects of continuing education on nursing practice: a meta-analysis. J Contin Educ Nurs. 1991 May-Jun;22(3):113–118. [PubMed] [Google Scholar]
  • Mugford M, Banfield P, O'Hanlon M. Effects of feedback of information on clinical practice: a review. BMJ. 1991 Aug 17;303(6799):398–402. [PMC free article] [PubMed] [Google Scholar]
  • Murrey KO, Gottlieb LK, Schoenbaum SC. Implementing clinical guidelines: a quality management approach to reminder systems. QRB Qual Rev Bull. 1992 Dec;18(12):423–433. [PubMed] [Google Scholar]
  • Avorn J, Soumerai SB. Improving drug-therapy decisions through educational outreach. A randomized controlled trial of academically based "detailing". N Engl J Med. 1983 Jun 16;308(24):1457–1463. [PubMed] [Google Scholar]
  • Evans CE, Haynes RB, Birkett NJ, Gilbert JR, Taylor DW, Sackett DL, Johnston ME, Hewson SA. Does a mailed continuing education program improve physician performance? Results of a randomized trial in antihypertensive care. JAMA. 1986 Jan 24;255(4):501–504. [PubMed] [Google Scholar]
  • Lomas J, Enkin M, Anderson GM, Hannah WJ, Vayda E, Singer J. Opinion leaders vs audit and feedback to implement practice guidelines. Delivery after previous cesarean section. JAMA. 1991 May 1;265(17):2202–2207. [PubMed] [Google Scholar]
  • Marton KI, Tul V, Sox HC., Jr Modifying test-ordering behavior in the outpatient medical clinic. A controlled trial of two educational interventions. Arch Intern Med. 1985 May;145(5):816–821. [PubMed] [Google Scholar]
  • Meyer TJ, Van Kooten D, Marsh S, Prochazka AV. Reduction of polypharmacy by feedback to clinicians. J Gen Intern Med. 1991 Mar-Apr;6(2):133–136. [PubMed] [Google Scholar]
  • Maiman LA, Becker MH, Liptak GS, Nazarian LF, Rounds KA. Improving pediatricians' compliance-enhancing practices. A randomized trial. Am J Dis Child. 1988 Jul;142(7):773–779. [PubMed] [Google Scholar]
  • Wilson DM, Taylor DW, Gilbert JR, Best JA, Lindsay EA, Willms DG, Singer J. A randomized trial of a family physician intervention for smoking cessation. JAMA. 1988 Sep 16;260(11):1570–1574. [PubMed] [Google Scholar]
  • McConnell TS, Cushing AH, Bankhurst AD, Healy JL, McIlvenna PA, Skipper BJ. Physician behavior modification using claims data: tetracycline for upper respiratory infection. West J Med. 1982 Nov;137(5):448–450. [PMC free article] [PubMed] [Google Scholar]
  • Avorn J, Soumerai SB, Everitt DE, Ross-Degnan D, Beers MH, Sherman D, Salem-Schatz SR, Fields D. A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. N Engl J Med. 1992 Jul 16;327(3):168–173. [PubMed] [Google Scholar]
  • Cummings SR, Coates TJ, Richard RJ, Hansen B, Zahnd EG, VanderMartin R, Duncan C, Gerbert B, Martin A, Stein MJ. Training physicians in counseling about smoking cessation. A randomized trial of the "Quit for Life" program. Ann Intern Med. 1989 Apr 15;110(8):640–647. [PubMed] [Google Scholar]
  • Dietrich AJ, O'Connor GT, Keller A, Carney PA, Levy D, Whaley FS. Cancer: improving early detection and prevention. A community practice randomised trial. BMJ. 1992 Mar 14;304(6828):687–691. [PMC free article] [PubMed] [Google Scholar]
  • Putnam RW, Curry L. Impact of patient care appraisal on physician behaviour in the office setting. Can Med Assoc J. 1985 May 1;132(9):1025–1029. [PMC free article] [PubMed] [Google Scholar]
  • Stross JK, Hiss RG, Watts CM, Davis WK, Macdonald R. Continuing education in pulmonary disease for primary-care physicians. Am Rev Respir Dis. 1983 Jun;127(6):739–746. [PubMed] [Google Scholar]
  • Stross JK, Bole GG. Evaluation of an educational program for primary care practitioners, on the management of osteoarthritis. Arthritis Rheum. 1985 Jan;28(1):108–111. [PubMed] [Google Scholar]
  • Stross JK, Banwell BF, Wolf FM, Becker MC. Evaluation of an education program on the management of rheumatic diseases for physical therapists. J Rheumatol. 1986 Apr;13(2):374–378. [PubMed] [Google Scholar]
  • Gehlbach SH, Wilkinson WE, Hammond WE, Clapp NE, Finn AL, Taylor WJ, Rodell MS. Improving drug prescribing in a primary care practice. Med Care. 1984 Mar;22(3):193–201. [PubMed] [Google Scholar]
  • Hershey CO, Porter DK, Breslau D, Cohen DI. Influence of simple computerized feedback on prescription charges in an ambulatory clinic. A randomized clinical trial. Med Care. 1986 Jun;24(6):472–481. [PubMed] [Google Scholar]
  • Cohen SJ, Stookey GK, Katz BP, Drook CA, Smith DM. Encouraging primary care physicians to help smokers quit. A randomized, controlled trial. Ann Intern Med. 1989 Apr 15;110(8):648–652. [PubMed] [Google Scholar]
  • Cummings SR, Richard RJ, Duncan CL, Hansen B, Vander Martin R, Gerbert B, Coates TJ. Training physicians about smoking cessation: a controlled trial in private practice. J Gen Intern Med. 1989 Nov-Dec;4(6):482–489. [PubMed] [Google Scholar]
  • Vinicor F, Cohen SJ, Mazzuca SA, Moorman N, Wheeler M, Kuebler T, Swanson S, Ours P, Fineberg SE, Gordon EE, et al. DIABEDS: a randomized trial of the effects of physician and/or patient education on diabetes patient outcomes. J Chronic Dis. 1987;40(4):345–356. [PubMed] [Google Scholar]
  • Magruder-Habib K, Zung WW, Feussner JR. Improving physicians' recognition and treatment of depression in general medical care. Results from a randomized clinical trial. Med Care. 1990 Mar;28(3):239–250. [PubMed] [Google Scholar]
  • Rubenstein LV, Calkins DR, Young RT, Cleary PD, Fink A, Kosecoff J, Jette AM, Davies AR, Delbanco TL, Brook RH. Improving patient function: a randomized trial of functional disability screening. Ann Intern Med. 1989 Nov 15;111(10):836–842. [PubMed] [Google Scholar]
  • Jennett PA, Laxdal OE, Hayton RC, Klaassen DJ, Swanson RW, Wilson TW, Spooner HJ, Mainprize GW, Wickett RE. The effects of continuing medical education on family doctor performance in office practice: a randomized control study. Med Educ. 1988 Mar;22(2):139–145. [PubMed] [Google Scholar]
  • White CW, Albanese MA, Brown DD, Caplan RM. The effectiveness of continuing medical education in changing the behavior of physicians caring for patients with acute myocardial infarction. A controlled randomized trial. Ann Intern Med. 1985 May;102(5):686–692. [PubMed] [Google Scholar]
  • Putnam RW, Curry L. Physicians' participation in establishing criteria for hypertension management in the office: will patient outcomes be improved? CMAJ. 1989 Apr 1;140(7):806–809. [PMC free article] [PubMed] [Google Scholar]
  • Adams ID, Chan M, Clifford PC, Cooke WM, Dallos V, de Dombal FT, Edwards MH, Hancock DM, Hewett DJ, McIntyre N, et al. Computer aided diagnosis of acute abdominal pain: a multicentre study. Br Med J (Clin Res Ed) 1986 Sep 27;293(6550):800–804. [PMC free article] [PubMed] [Google Scholar]
  • Barnett GO, Winickoff RN, Morgan MM, Zielstorff RD. A computer-based monitoring system for follow-up of elevated blood pressure. Med Care. 1983 Apr;21(4):400–409. [PubMed] [Google Scholar]
  • Bass MJ, McWhinney IR, Donner A. Do family physicians need medical assistants to detect and manage hypertension? CMAJ. 1986 Jun 1;134(11):1247–1255. [PMC free article] [PubMed] [Google Scholar]
  • Berwick DM, Coltin KL. Feedback reduces test use in a health maintenance organization. JAMA. 1986 Mar 21;255(11):1450–1454. [PubMed] [Google Scholar]
  • Billi JE, Hejna GF, Wolf FM, Shapiro LR, Stross JK. The effects of a cost-education program on hospital charges. J Gen Intern Med. 1987 Sep-Oct;2(5):306–311. [PubMed] [Google Scholar]
  • Britton ML, Lurvey PL. Impact of medication profile review on prescribing in a general medicine clinic. Am J Hosp Pharm. 1991 Feb;48(2):265–270. [PubMed] [Google Scholar]
  • Bulpitt CJ, Beilin LJ, Coles EC, Dollery CT, Johnson BF, Munro-Faure AD, Turner SC. Randomised controlled trial of computer-held medical records in hypertensive patients. Br Med J. 1976 Mar 20;1(6011):677–679. [PMC free article] [PubMed] [Google Scholar]
  • Buntinx F, Knottnerus JA, Crebolder HF, Essed GG. Reactions of doctors to various forms of feedback designed to improve the sampling quality of cervical smears. Qual Assur Health Care. 1992 Jun;4(2):161–166. [PubMed] [Google Scholar]
  • Buntinx F, Knottnerus JA, Crebolder HF, Seegers T, Essed GG, Schouten H. Does feedback improve the quality of cervical smears? A randomized controlled trial. Br J Gen Pract. 1993 May;43(370):194–198. [PMC free article] [PubMed] [Google Scholar]
  • Chambers CV, Balaban DJ, Carlson BL, Ungemack JA, Grasberger DM. Microcomputer-generated reminders. Improving the compliance of primary care physicians with mammography screening guidelines. J Fam Pract. 1989 Sep;29(3):273–280. [PubMed] [Google Scholar]
  • Chase CR, Vacek PM, Shinozaki T, Giard AM, Ashikaga T. Medical information management: improving the transfer of research results to presurgical evaluation. Med Care. 1983 Apr;21(4):410–424. [PubMed] [Google Scholar]
  • Chassin MR, McCue SM. A randomized trial of medical quality assurance. Improving physicians' use of pelvimetry. JAMA. 1986 Aug 22;256(8):1012–1016. [PubMed] [Google Scholar]
  • Cheney C, Ramsdell JW. Effect of medical records' checklists on implementation of periodic health measures. Am J Med. 1987 Jul;83(1):129–136. [PubMed] [Google Scholar]
  • Cohen DI, Jones P, Littenberg B, Neuhauser D. Does cost information availability reduce physician test usage? A randomized clinical trial with unexpected findings. Med Care. 1982 Mar;20(3):286–292. [PubMed] [Google Scholar]
  • Cohen SJ, Weinberger M, Hui SL, Tierney WM, McDonald CJ. The impact of reading on physicians' nonadherence to recommended standards of medical care. Soc Sci Med. 1985;21(8):909–914. [PubMed] [Google Scholar]
  • Cohen SJ, Christen AG, Katz BP, Drook CA, Davis BJ, Smith DM, Stookey GK. Counseling medical and dental patients about cigarette smoking: the impact of nicotine gum and chart reminders. Am J Public Health. 1987 Mar;77(3):313–316. [PMC free article] [PubMed] [Google Scholar]
  • Cowan JA, Heckerling PS, Parker JB. Effect of a fact sheet reminder on performance of the periodic health examination: a randomized controlled trial. Am J Prev Med. 1992 Mar-Apr;8(2):104–109. [PubMed] [Google Scholar]
  • Davidoff F, Goodspeed R, Clive J. Changing test ordering behavior. A randomized controlled trial comparing probabilistic reasoning with cost-containment education. Med Care. 1989 Jan;27(1):45–58. [PubMed] [Google Scholar]
  • Dickinson JC, Warshaw GA, Gehlbach SH, Bobula JA, Muhlbaier LH, Parkerson GR., Jr Improving hypertension control: impact of computer feedback and physician education. Med Care. 1981 Aug;19(8):843–854. [PubMed] [Google Scholar]
  • Everett GD, deBlois CS, Chang PF, Holets T. Effect of cost education, cost audits, and faculty chart review on the use of laboratory services. Arch Intern Med. 1983 May;143(5):942–944. [PubMed] [Google Scholar]
  • Headrick LA, Speroff T, Pelecanos HI, Cebul RD. Efforts to improve compliance with the National Cholesterol Education Program guidelines. Results of a randomized controlled trial. Arch Intern Med. 1992 Dec;152(12):2490–2496. [PubMed] [Google Scholar]
  • Heale J, Davis D, Norman G, Woodward C, Neufeld V, Dodd P. A randomized controlled trial assessing the impact of problem-based versus didactic teaching methods in CME. Res Med Educ. 1988;27:72–77. [PubMed] [Google Scholar]
  • Hershey CO, Goldberg HI, Cohen DI. The effect of computerized feedback coupled with a newsletter upon outpatient prescribing charges. A randomized controlled trial. Med Care. 1988 Jan;26(1):88–94. [PubMed] [Google Scholar]
  • Johnson RE, Campbell WH, Azevedo DJ, Christensen DB. Studying the impact of patient drug profiles in an HMO. Med Care. 1976 Oct;14(10):799–807. [PubMed] [Google Scholar]
  • Johnson RE, Azevedo DJ, Campbell WH, Christensen DB. Examining physicians' drug order recording behavior. Med Care. 1978 May;16(5):408–416. [PubMed] [Google Scholar]
  • Kottke TE, Brekke ML, Solberg LI, Hughes JR. A randomized trial to increase smoking intervention by physicians. Doctors Helping Smokers, Round I. JAMA. 1989 Apr 14;261(14):2101–2106. [PubMed] [Google Scholar]
  • Levinson W, Roter D. The effects of two continuing medical education programs on communication skills of practicing primary care physicians. J Gen Intern Med. 1993 Jun;8(6):318–324. [PubMed] [Google Scholar]
  • Linn BS. Continuing medical education. Impact on emergency room burn care. JAMA. 1980 Aug 8;244(6):565–570. [PubMed] [Google Scholar]
  • Litzelman DK, Dittus RS, Miller ME, Tierney WM. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J Gen Intern Med. 1993 Jun;8(6):311–317. [PubMed] [Google Scholar]
  • Manheim LM, Feinglass J, Hughes R, Martin GJ, Conrad K, Hughes EF. Training house officers to be cost conscious. Effects of an educational intervention on charges and length of stay. Med Care. 1990 Jan;28(1):29–42. [PubMed] [Google Scholar]
  • Martin AR, Wolf MA, Thibodeau LA, Dzau V, Braunwald E. A trial of two strategies to modify the test-ordering behavior of medical residents. N Engl J Med. 1980 Dec 4;303(23):1330–1336. [PubMed] [Google Scholar]
  • Mayefsky JH, Foye HR. Use of a chart audit: teaching well child care to paediatric house officers. Med Educ. 1993 Mar;27(2):170–174. [PubMed] [Google Scholar]
  • McAlister NH, Covvey HD, Tong C, Lee A, Wigle ED. Randomised controlled trial of computer assisted management of hypertension in primary care. Br Med J (Clin Res Ed) 1986 Sep 13;293(6548):670–674. [PMC free article] [PubMed] [Google Scholar]
  • Mc Donald CJ. Use of a computer to detect and respond to clinical events: its effect on clinician behavior. Ann Intern Med. 1976 Feb;84(2):162–167. [PubMed] [Google Scholar]
  • McDonald CJ. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976 Dec 9;295(24):1351–1355. [PubMed] [Google Scholar]
  • McDonald CJ, Wilson GA, McCabe GP., Jr Physician response to computer reminders. JAMA. 1980 Oct 3;244(14):1579–1581. [PubMed] [Google Scholar]
  • McDonald CJ, Hui SL, Smith DM, Tierney WM, Cohen SJ, Weinberger M, McCabe GP. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med. 1984 Jan;100(1):130–138. [PubMed] [Google Scholar]
  • McDonald CJ, Hui SL, Tierney WM. Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. MD Comput. 1992 Sep-Oct;9(5):304–312. [PubMed] [Google Scholar]
  • McPhee SJ, Bird JA, Jenkins CN, Fordham D. Promoting cancer screening. A randomized, controlled trial of three interventions. Arch Intern Med. 1989 Aug;149(8):1866–1872. [PubMed] [Google Scholar]
  • McPhee SJ, Bird JA, Fordham D, Rodnick JE, Osborn EH. Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. JAMA. 1991 Jul 24;266(4):538–544. [PubMed] [Google Scholar]
  • Morgan M, Studney DR, Barnett GO, Winickoff RN. Computerized concurrent review of prenatal care. QRB Qual Rev Bull. 1978 Sep;4(9):33–36. [PubMed] [Google Scholar]
  • Nattinger AB, Panzer RJ, Janus J. Improving the utilization of screening mammography in primary care practices. Arch Intern Med. 1989 Sep;149(9):2087–2092. [PubMed] [Google Scholar]
  • Norton PG, Dempsey LJ. Self-audit: its effect on quality of care. J Fam Pract. 1985 Oct;21(4):289–291. [PubMed] [Google Scholar]
  • Palmer RH, Louis TA, Hsu LN, Peterson HF, Rothrock JK, Strain R, Thompson MS, Wright EA. A randomized controlled trial of quality assurance in sixteen ambulatory care practices. Med Care. 1985 Jun;23(6):751–770. [PubMed] [Google Scholar]
  • Perera DR, LoGerfo JP, Shulenberger E, Ylvisaker JT, Kirz HL. Teaching sigmoidoscopy to primary care physicians: a controlled study of continuing medical education. J Fam Pract. 1983 Apr;16(4):785–788. [PubMed] [Google Scholar]
  • Pollack MM, Getson PR. Pediatric critical care cost containment: combined actuarial and clinical program. Crit Care Med. 1991 Jan;19(1):12–20. [PubMed] [Google Scholar]
  • Pozen MW, D'Agostino RB, Mitchell JB, Rosenfeld DM, Guglielmino JT, Schwartz ML, Teebagy N, Valentine JM, Hood WB., Jr The usefulness of a predictive instrument to reduce inappropriate admissions to the coronary care unit. Ann Intern Med. 1980 Feb;92(2 Pt 1):238–242. [PubMed] [Google Scholar]
  • Pozen MW, D'Agostino RB, Selker HP, Sytkowski PA, Hood WB., Jr A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. A prospective multicenter clinical trial. N Engl J Med. 1984 May 17;310(20):1273–1278. [PubMed] [Google Scholar]
  • Restuccia JD. The effect of concurrent feedback in reducing inappropriate hospital utilization. Med Care. 1982 Jan;20(1):46–62. [PubMed] [Google Scholar]
  • Rodman JH, Jelliffe RW, Kolb E, Tuey DB, de Guzman MF, Wagers PW, Haywood LJ. Clinical studies with computer-assisted initial lidocaine therapy. Arch Intern Med. 1984 Apr;144(4):703–709. [PubMed] [Google Scholar]
  • Rogers JL, Haring OM. The impact of a computerized medical record summary system on incidence and length of hospitalization. Med Care. 1979 Jun;17(6):618–630. [PubMed] [Google Scholar]
  • Rogers JL, Haring OM, Wortman PM, Watson RA, Goetz JP. Medical information systems: assessing impact in the areas of hypertension, obesity and renal disease. Med Care. 1982 Jan;20(1):63–74. [PubMed] [Google Scholar]
  • Rosser WW, McDowell I, Newell C. Use of reminders for preventive procedures in family medicine. CMAJ. 1991 Oct 1;145(7):807–814. [PMC free article] [PubMed] [Google Scholar]
  • Sanazaro PJ, Worth RM. Concurrent quality assurance in hospital care. Report of a study by Private Initiative in PSRO. N Engl J Med. 1978 May 25;298(21):1171–1177. [PubMed] [Google Scholar]
  • Sibley JC, Sackett DL, Neufeld V, Gerrard B, Rudnick KV, Fraser W. A randomized trial of continuing medical education. N Engl J Med. 1982 Mar 4;306(9):511–515. [PubMed] [Google Scholar]
  • Steele MA, Bess DT, Franse VL, Graber SE. Cost effectiveness of two interventions for reducing outpatient prescribing costs. DICP. 1989 Jun;23(6):497–500. [PubMed] [Google Scholar]
  • Stross JK, Bole GG. Evaluation of a continuing education program in rheumatoid arthritis. Arthritis Rheum. 1980 Jul;23(7):846–849. [PubMed] [Google Scholar]
  • Tape TG, Campbell JR. Computerized medical records and preventive health care: success depends on many factors. Am J Med. 1993 Jun;94(6):619–625. [PubMed] [Google Scholar]
  • Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Med Care. 1986 Aug;24(8):659–666. [PubMed] [Google Scholar]
  • Tierney WM, McDonald CJ, Hui SL, Martin DK. Computer predictions of abnormal test results. Effects on outpatient testing. JAMA. 1988 Feb 26;259(8):1194–1198. [PubMed] [Google Scholar]
  • Tierney WM, Miller ME, McDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990 May 24;322(21):1499–1504. [PubMed] [Google Scholar]
  • Turner RC, Waivers LE, O'Brien K. The effect of patient-carried reminder cards on the performance of health maintenance measures. Arch Intern Med. 1990 Mar;150(3):645–647. [PubMed] [Google Scholar]
  • Wexler JR, Swender PT, Tunnessen WW, Jr, Oski FA. Impact of a system of computer-assisted diagnosis. Initial evaluation of the hospitalized patient. Am J Dis Child. 1975 Feb;129(2):203–205. [PubMed] [Google Scholar]
  • White RH, Hong R, Venook AP, Daschbach MM, Murray W, Mungall DR, Coleman RW. Initiation of warfarin therapy: comparison of physician dosing with computer-assisted dosing. J Gen Intern Med. 1987 May-Jun;2(3):141–148. [PubMed] [Google Scholar]
  • White PT, Pharoah CA, Anderson HR, Freeling P. Randomized controlled trial of small group education on the outcome of chronic asthma in general practice. J R Coll Gen Pract. 1989 May;39(322):182–186. [PMC free article] [PubMed] [Google Scholar]
  • Wigton RS, Zimmer JL, Wigton JH, Patil KD. Chart reminders in the diagnosis of anemia. JAMA. 1981 May 1;245(17):1745–1747. [PubMed] [Google Scholar]
  • Winickoff RN, Coltin KL, Morgan MM, Buxbaum RC, Barnett GO. Improving physician performance through peer comparison feedback. Med Care. 1984 Jun;22(6):527–534. [PubMed] [Google Scholar]
  • Wones RG. Failure of low-cost audits with feedback to reduce laboratory test utilization. Med Care. 1987 Jan;25(1):78–82. [PubMed] [Google Scholar]
  • Hong SW, Ching TY, Fung JP, Seto WL. The employment of ward opinion leaders for continuing education in the hospital. Med Teach. 1990;12(2):209–217. [PubMed] [Google Scholar]
  • Raisch DW, Bootman JL, Larson LN, McGhan WF. Improving antiulcer agent prescribing in a health maintenance organization. Am J Hosp Pharm. 1990 Aug;47(8):1766–1773. [PubMed] [Google Scholar]
  • Freemantle N, Grilli R, Grimshaw J, Oxman A. Implementing findings of medical research: the Cochrane Collaboration on Effective Professional Practice. Qual Health Care. 1995 Mar;4(1):45–47. [PMC free article] [PubMed] [Google Scholar]
Articles from CMAJ : Canadian Medical Association Journal are provided here courtesy of Canadian Medical Association
-