Medical School

Assessment Tools

Program Level Evaluations

• MCW Department of Surgery Conference & Presentation Evaluation - developed by Dr. John Weigelt, MD, DVM, Professor and Chief, Surgery (Trauma & Critical Care) and Mary Heffron, PhD, this evaluation was designed for residents to evaluate department conferences and presentations.

360-Degree Evaluation Instrument

• The Acceptability of 360-Degree Judgments as a Method of Assessing Undergraduate Medical Students' Personal and Professional Behaviors (2005). Rees & Shepherd.  Medical Education,39(1):49-57.
• A 360 Degrees Evaluation of a Night-Float System for General Surgery: A Response to Mandated Work-Hours Reduction (2004). Goldstein, Kim, Widmamnn, Hardy.  Current Surgery, 61(5):445-451.
• Patient, Faculty, & Self-Assessment of Radiology Resident Performance: A 360-Degree Method of Measuring Professionalism and Interpersonal and Communication Skills.  J. Wood, J. Collins, F. Kelez, J. Spilde, L. Schmaltz.  Academic Radiology, 2004;11(8):931-939.

Checklist Evaluation of Live or Recorded Performance

• Reliability of a Core Competency Checklist Assessment in the Emergency Department: The Standardized Direct Observation Assessment Tool (2006). Shayne, et. al., Academic Emergency Medicine, 13, 727-732. 

• Oregon Health & Science University - Program Curriculum & Evaluation Checklist and Physician Performance Diagnostic Inventory.
   

Global Rating of Live or Recorded Performance

• Do Global Rating Forms Enable Program Directors to Assess the ACGME Competencies? C.G. Silber, T.J. Nasca, D.L. Paskin, G. Eiger, M. Robeson, J.J. Veloski.  Academic Medicine, 2004;79(6):549-556.

---

Objective Structured Clinical Examination (OSCE)

• Beyond Fulfilling the Core Competencies: An Objective Structured Clinical Examination to Assess Communication and Interpersonal Skills in a Surgical Residency.  R, Yudkowsky, A. Alseidi, J. Cintron.  Current Surgery, 2004; 61(5):499-503.

Procedure, Operative, or Case Logs

• The Competencies Logbook.  D. Kuo & k. Holly-Whitaker.  To access, visit the ACGME RSVP Web site.
• Residents' Perception of Effectiveness of Twelve Evaluation Methods for Measuring Competencies.  Cogbill, Sullivan, Clardy.  Academic Psychiatry, 2005;29(1):76-81.

Patient Surveys

• A Patient Survey to Assess Resident Performance (PowerPoint presentation).  P. Jeppsen, D. Simpson, PhD and J. Robinson, MD, Medical College of Wisconsin.  Presented at the ACGME Annual Meeting, 2004.
  Poster
  Abstract
  

   

Portfolios

• Can One Portfolio Measure the Six ACGME General Competencies?  R. Jarvis, P. O'Sullivan, T. McClain, J. Clardy.  Academic Psychiatry, 2004;28(3):190-196.
• A Case Study in Medical Error: The Use of the Portfolio Entry, C.D. Chisholm and P. Croskerry.  Academic Emergency Medicine, 2004 11: 388-392.
• Department of Medicine Medical Clerkship - Medical Clerkship Portfolio.  University of Florida.  Portfolio includes all 6 ACGME competencies.
• Portfolios as a Novel Approach for Residency Evaluations. P. O'Sullivan, K. Cogbill, C. McClain, J. Clandy, M. Reckase.  Academic Psychiatry, 2002;261-267.
• Portfolio Based Evaluation of Night Float Rotation in Internal Medicine Residency, V. Rajput, MD and G. Newell, MD.   Found in Insight Summer 2003 on the Alliance for Academic Internal Medicine (AAIM) Web site.

Record Review

• Residents' Perception of Effectiveness of Twelve Evaluation Methids for Measuring Competency.  K. Cogbill, P. O;Sullivan, J. Clardy.  Academic Psychiatry, 2005;29:76-81.

Simulations and Models

• Using Simulation to Instruct Emergency Medicine Residents in Cognitive Forcing Strategies, W.F. Bond, L.M. Deitruck, D.C Arnold, M.A. Kostenbader, G.C. Barr, S.R Kimmel, C.C Worrilow. Academic Medicine, 2004;79(5):438-445.

Standardized Oral Examinations

• Using a Standardized Patient Assessment To Measure Professional Attributes.  M. Van Zanten, J. Boulet, J. Norcini, D. McKinley.  Medical Education, 2005;39(1):20-29.

Written Examinations (MCQ)

• National Board of Medical Examiners: Item Writing Manual -- Constructing Test Questions for Basic and Clinical Sciences.  An excellent resource for faculty to improve the quality of test items.  A complete PDF document is available on their Web site. 
  

Resources

• Objective Structured Video Examinations (OSVEs) for Geriatric Education. Simpson D, Helm R, Drewniak T, Ziebert M, Brown D, Mitchell J, Havas N, Denson K, Gehl S, Kerwin D, Bragg D, Denson S, Gleason-Heffron M, Harsch H, Duthie E.  Gerontology & Geriatrics Education, 2006; 26(4):7-24.

• Comprehensive Educational Performance Improvement (CEPI): An Innovative Competency-based Assessment Tool.  Mount Sinai Journal of Medicine, 2005; 72(9):300-306, Establishing Learning Curves for Surgical Residents Using Cummulative Summation (CUSUM) Analysis. 

• A. Young, J. Miller, K. Azarow.  Current Surgery, 2005;62(3):330-334.

• Assessing The Competencies in General Surgery Residency Training.  L. Chao, M. Wallack.  Current Surgery, 2005; 62(1):111-116.

• Assessing The Competencies in General Surgery Residency Training.  C. Anderson, A. Jentz, j. Harkima, R. Kareti, K. Apelgrein, C. Slomski.  The American Journal of Surgery, 2005; 189(3):288-292.

• Before and After Resident Work Hour Limitations: An Objective Assessment of the Well-Being of Surgical Residents.  T. Stamp, P. Termuhlen, S. Miller, D. Nolan, P. Hutzel, J. Gilchrist, R. Johnson.  Current Surgery, 2005;62(1):117-121.

• Evaluation of Student Performance: Clinical and Professional Performance.  SE. Farrell.  Academic Emergency Medicine, 2005:12(4):e6-10.

• Developing an OSTE to Address Lapses in Learners' Professional Behavior and an Instrument to Code Educators' Responses.  M. Srinivasan, D. Litzelman, R. Seshadri, K. Lane, W. Khou, S. Bogdewic, M. Gaffney, M. Galvin, G. Mitchell, P. Treadwell, L. Willis.  Academic Medicine, 2004;79(9):888-896.

• Quantitative Validation of a General Competency Composite Assessment Evaluation.  E. Reisdorff, D. Carlson, M. Reeves, G. Walker, O. Hayes, B. Reynolds.  Academic Emergency Medicine, 2004;11(8):881-884.