Medical School

Assessment Tools

Program Level Evaluations

• MCW Department of Surgery Conference & Presentation Evaluation - developed by Dr. John Weigelt, MD, DVM, Professor and Chief, Surgery (Trauma & Critical Care) and Mary Heffron, PhD, Medical Education Specialist, the Offices of Graduate Medical Education and Educational Services, this evaluation was designed for residents to evaluate department conferences and presentations.

360-Degree Evaluation Instrument

• The Acceptability of 360-Degree Judgements as a Method of Assessing Undergraduate Medical Students' Personal and Professional Behaviors. C. Rees, M. Shepherd.  Medical Education, 2005;39(1):49-57.
• A 360 Degrees Evaluation of a Night-Float System for General Surgery: A Response to Mandated Work-Hours Reduction.  M. Goldstein, E. Kim, W. Widmamnn, M. Hardy.  Current Surgery, 2004;61(5):445-451.
• Patient, Faculty, & Self-Assessment of Radiology Resident Performance: A 360-Degree Method of Measuring Professonalism and Interpersonal and Communication Skills.  J. Wood, J. Collins, F. Kelez, J. Spilde, L. Schmaltz.  Academic Radiology, 2004;11(8):931-939.
• Implementing the ACGME Competencies in a Cardiothoracic Surgery Resident Program Using 360-Degree Feedback.  R. Higgins, MD, J. Bridegs, BA, J. Burke, PhD, M.A. O'Donnell, PhD, N. Cohen, MD, and S. Wilkes, PhD.  Annals of Thoracic Surgery, 2004;77(1):12-17.
• Assessment of a 360-Degree Instrument to Evaluate Resident's Competency in Interpersonal and Communication Skills.  R. Joshi, MS, MBBS, MBA, F. Ling, MD, J. Jaeger, MPH.  Academic Medicine, 2004;79(5):458-463.
• 360-degree Feedback: Possibilities for Assessment of the ACGME Core Competencies for Emergency Medicine Residents.  K. G. Rodgers, MD and C. Manifold, DO.  Academic Emergency Medicine, 2002;9(11):1300-1304.

Chart Stimulated Recall Oral Examination (CSR)

• Needs Assessment in Postgraduate Medical Education.  S. Ratnapalaan, R. Hilliard.  Medical Education Online, 2002; 7(8).   

Checklist Evaluation of Live or Recorded Performance

• Oregon Health & Science University - Program Curriculum & Evaluation Checklist and Physician Performance Diagnostic Inventory.
   

• University of Buffalo Graduate Medical Education Presentation Evaluation Rubric an example of a form used to provide presenters with helpful/constructive feedback for professional development.  Also on the website:
  
  • Self Refelction Tool
  • 5 Tips for Presenters
  • Tips for Writing Good Objectives
  • Rotation Evaluation
  • Curriculum Aids
     
• University of British Columbia - Resident Self Evaluation.

Global Rating of Live or Recorded Performance

• Do Global Rating Forms Enable Program Directors to Assess the ACGME Competencies? C.G. Silber, T.J. Nasca, D.L. Paskin, G. Eiger, M. Robeson, J.J. Veloski.  Academic Medicine, 2004;79(6):549-556.
• A Feasibility Study Comparing Checklists and Global Rating Forms to Assess Resident Performance in Clinical Skills, C. Ringsted, D. Ostergaard, L. Ravin, J. Perdersen, P. Berlac, and C. Van Der Vleuten.  Medical Teacher, 2003; 25(6):654-658.

---

Objective Structured Clinical Examination (OSCE)

• Beyond Fulfilling the Core Competencies: An Objective Structured Clinical Examination to Assess Communication and Interpersonal Skills in a Surgical Residency.  R, Yudkowsky, A. Alseidi, J. Cintron.  Current Surgery, 2004; 61(5):499-503.
• Surgery Residents' Perception of the Objective Structured Clinical Examination. NJ. Zyromski, HW. Merrick, E. Staren.  Current Surgery, 2003;60(5):533-537.
• An Internet-Based Residency Assessment Application That Fufills The Outcome Project's Requirements.  A. Tabuenca, R. Catalano, G. Gollun, J. Shieck.  Current Surgery, 2003;60(1):89-93.
• Using Standardized Oral Examinations to Evaluate General Competencies.  O. W. Hayes, DO, MHSA, E. J. Reisdorff, MD, G. L. Walker, MD, D. J. Carlson, MM and B. Reinoehl, MD.  Academic Emergency Medicine, 2002;9(11):1334-13.

Procedure, Operative, or Case Logs

• Electronic Procedure Logs: Taking It Further.  D. Topps, D. Hall.  Academic Medicine, 2002;77(7):756.
• The Competencies Logbook.  D. Kuo & k. Holly-Whitaker.  To access, visit the ACGME RSVP Web site.
• Residents' Perception of Effectiveness of Twelve Evaluation Methods for Measuring Competenices.  K. Cogbill, P. Sullivan, J. Clardy.  Academic Psychiatry, 2005;29(1):76-81.

Patient Surveys

• A Patient Survey to Assess Resident Performance (PowerPoint presentation).  P. Jeppsen, D. Simpson, PhD and J. Robinson, MD, Medical College of Wisconsin.  Presented at the ACGME Annual Meeting, 2004.
  Poster
  Abstract
  

• Stony Brook Health Sciences Center -- Department of Othropaedics: Assessing the General Medical Competenices.  Examples of 360-degree evaluations, patient surveys, mini CEX and much more.

   

Portfolios

• Can One Portfolio Measure the Six ACGME General Competencies?  R. Jarvis, P. O'Sullivan, T. McClain, J. Clardy.  Academic Psychiatry, 2004;28(3):190-196.
• A Case Study in Medical Error: The Use of the Portfolio Entry, C.D. Chisholm and P. Croskerry.  Academic Emergency Medicine, 2004 11: 388-392.
• Department of Medicine Medical Clerkship - Medical Clerkship Portfolio.  University of Florida.  Portfolio includes all 6 ACGME competencies.
• Portfolios: Possibilities for Addressing Emergency Medicine Resident Competencies, P. O'Sullivan, EdD and C. Greene, MD, MHPE.  Academic Emergency Medicine, 2002;9(11):1305-1309.
• Portfolios as a Novel Approach for Residency Evaluations. P. O'Sullivan, K. Cogbill, C. McClain, J. Clandy, M. Reckase.  Academic Psychiatry, 2002;261-267.
• Portfolio Based Evaluation of Night Float Rotation in Internal Medicine Residency, V. Rajput, MD and G. Newell, MD.   Found in Insight Summer 2003 on the Alliance for Academic Internal Medicine (AAIM) Web site.
• The Use of Portfolio Learning in Medical Education.  D. Snadden, M. Thomas.  Medical Education, 1998;20:192-208.

Record Review

• Residents' Perception of Effectiveness of Twelve Evaluation Methids for Measuring Competency.  K. Cogbill, P. O;Sullivan, J. Clardy.  Academic Psychiatry, 2005;29:76-81.

Simulations and Models

• Using Simulation to Instruct Emergency Medicine Residents in Cognitive Forcing Strategies, W.F. Bond, L.M. Deitruck, D.C Arnold, M.A. Kostenbader, G.C. Barr, S.R Kimmel, C.C Worrilow. Academic Medicine, 2004;79(5):438-445.
• The Use of Simulation for Emergency Medicine Resident Assessment, W. F. Bond, MD and L. Spillane, MD the CORD Core Competencies Simulation Group.  Academic Emergency Medicine, 2002;9(11):1295-1299.

Standardized Oral Examinations

• Using a Standardised Patient Assessment To Measure Professional Attributes.  M. Van Zanten, J. Boulet, J. Norcini, D. McKinley.  Medical Education, 2005;39(1):20-29.
• Using Standardized Oral Examinations to Evaluate General Competencies. O. Hayes, E. Reisdorff, G. Walker, D. Carlson, and B. Reinoehl. Academic Emergency Medicine, 2002; 9(11):1334-1337. Standardized Patient Examinations (SP)

• The Use of Standardized Patients within a Procedural Competency Model to Teach Death Disclosure, T. E. Quest, MD, J. A. Otsuki, MD, MBA, J. Banja, PhD, J. J. Ratcliff, MPH, S. L. Heron, MD, MPH and N. J. Kaslow, PhD.  Academic Emergency Medicine, 2002;9(11):1326-1333.  

Written Examinations (MCQ)

•  National Board of Medical Examiners: Item Writing Manual -- Constructing Test Questions for Basic and Clinical Sciences.  An excellent resource for faculty to improve the quality of test items.  A complete PDF document is available on their Web site. 
  

Resources

• Objective Structured Video Examinations (OSVEs) for Geriatric Education.  . Simpson D, Helm R, Drewniak T, Ziebert M, Brown D, Mitchell J, Havas N, Denson K, Gehl S, Kerwin D, Bragg D, Denson S, Gleason-Heffron M, Harsch H, Duthie E.  Gerontology & Geriatrics Education, 2006; 26(4):7-24.

• Comprehensive Educational Performance Improvement (CEPI): An Innovative Competency-based Assessment Tool.  Mount Sinai Journal of Medicine, 72(9):300-306, 2005 Sep.

• Establishing Learning Curves for Sugrical Residents Using Cummulative Summation (CUSUM) Analysis.  A. Young, J. Miller, K. Azarow.  Current Surgery, 2005;62(3):330-334.

• Assessing The Competencies in General Surgery Residency Training.  L. Chao, M. Wallack.  Current Surgery, 2005; 62(1):111-116.

• Assessing The Competencies in General Surgery Residency Training.  C. Anderson, A. Jentz, j. Harkima, R. Kareti, K. Apelgrein, C. Slomski.  The American Journal of Surgery, 2005; 189(3):288-292.

• Before and After Resident Work Hour Limitations: An Objective Assessment of the Well-Being of SUrgical Residents.  T. Stamp, P. Termuhlen, S. Miller, D. Nolan, P. Hutzel, J. Gilchrist, R. Johnson.  Current Surgery, 2005;62(1):117-121.

• Evaluation of Student Performance: Clinical and Professional Performance.  SE. Farrell.  Academic Emergency Medicine, 2005:12(4):e6-10.

• Developing an OSTE to Address Lapses in Learners' Professional Behavior and an Instrument to Code Educators' Responses.  M. Srinivasan, D. Litzelman, R. Seshadri, K. Lane, W. Khou, S. Bogdewic, M. Gaffney, M. Galvin, G. Mitchell, P. Treadwell, L. Willis.  Academic Medicine, 2004;79(9):888-896.

• Quantitative Validation of a General Competency Composite Assessment Evaluation.  E. Reisdorff, D. Carlson, M. Reeves, G. Walker, O. Hayes, B. Reynolds.  Academic Emergency Medicine, 2004;11(8):881-884.

• Feedback and the Mini Clinical Evaluation Exercise.  E. Holmboe, M. Yepes, F. Williams, S. Huot.  Journal of General Internal Medicine, 2004;19(5):558-561.

• Meeting Requirements and Changing Culture: The Development of a Web-based Clinical Skills Evaluation System, M. Triola, H. Feldman, E. Pearlman, A. Kalet.  Journal of General Internal Medicine, 2004;19:492-495.

• Assessing Practice-Based Learning and Improvement, D.C. Lynch, S. R. Swing, S. D. Horowitz, K. Holt, J. V. Messer.  Teaching and Learning in Medicine, 2004;16(1):85-92.

• Reliability of a Visual Analog Scale in Measuring Resident Competency Skills, S.F. Li, M. Haber, A. Birnbaum, and A. Vecchia. Academic Emergency Medicine, 2004;11:480.

• Death Pronouncements: Using the Teachable Moment in End-of-Life Care Residency Training, L. Marchand, K. Kushner.  Journal of Palliative Medicine, 2004;7(1):80-84.

• Responding to the ACGME Competencies Requirement: An Innovative Instrument From the University of Virginia's Neurology Residence, K. Johnston.  Academic Medicine, 2003;78:217-1220.

• Assessing the ACGME General Competencies: General Considerations and Assessment Methods, S. R. Swing, PhD.  Academic Emergency Medicine, 2002;9(11):1278-1288.

• Protected Clinical Teaching Time and a Bedside Clinical Evaluation Instrument in an Emergency Medicine Training Program, P. Shayne, MD, K. Heilpern, MD, D. Ander, MD, V. Palmer-Smith, MD, and the Emory University Department of Emergency Medicine Education Committee - Academic Emergency Medicine, 2002;9(11):1342-1347.

• Online Evaluation in Radiology Residency Programs, K. B. Williamson, V. P. Jackson, L. A. Shuman, M. D. Stiefel, R. B. Gunderman - Academic Radiology, 2003;10(1):83-86.

• General Competencies in Radiology Residency Training, J. Collins, M. Rosado de Christenson, L. Gray, C. Hyde, K. K. Koeller, F. Laine, B. Wood, for the Association of Program Directors in Radiology Education Committee - Academic Radiology, 2002;6(6):721-726.

• Radiology Resident Evaluation: A Form That Addresses the Six Competencies of the Accreditation Council for Graduate Medical Education, J. Collins, C. Hyde, L.Gray, B. Wood, R. A. Blinder, M. L. Puckett, M. L. R. de Christenson, K. K. Koeller, for the Association of Program Directors in Radiology Education Committee.  Academic Radiology, 2002;9(7):815-816.