Academic and Student Services hero small

Academic and Student Services

Office of Measurement and Evaluation

The mission of the Office of Measurement and Evaluation (OME) is to consult with faculty, residents and students and provide assessment of undergraduate and graduate medical education outcomes. The OME provides reports on course and faculty evaluations, student performance, and institutional surveys. The OME will collaborate on and provide analytical support for medical education projects for peer-reviewed conference presentations and journal publications.

Our Services

Faculty and Residents

Faculty and Residents

Provide consultation on program evaluation using multi-method approaches, which includes quantitative and qualitative design.
Student Pathways

Student Pathways

Assist students with methodological and analytical support on Pathways projects.
Evaluation

Evaluation

Create and manage all student performance, faculty, and course evaluations and generate reports based on the outcomes for departments and committees.
Psychometrics

Psychometrics

Provide expertise for creating and implementing reliable and validated instruments using item response theory, factor analysis, categorical data analysis, and general/generalized linear models which increases the quality of examination and survey data.
Scholarship

Scholarship

Make original and collaborative contributions to the field of medical education through authorship of peer-reviewed journal articles and international, national and regional conference presentations.

Mixed-methods studies which require integrated elements of quantitative and qualitative analysis will be completed by the independent project analytical division (IPAD) which is an interdepartmental collaboration of OME and qualitative analysts.

Journal Publications

all
2021

Kruper A, Domeyer-Klenske A, Treat R, Pilarski A, Kaljo K. Secondary Traumatic Stress in Ob-Gyn: A Mixed Methods Analysis Assessing Physician Impact and Needs. J Surg Educ. 2021 May-Jun;78(3):1024-1034.

Vepraskas SH, Lauck S, Hadjiev J, Porada K, Toth H, Treat R, Weisgerber M. Developing Validity Evidence for a Patient- and Family-Centered Rounds Presenter Empowerment Action Rating Tool. Acad Pediatr. 2021 04;21(3):569-574.

Graff CJ, Kaljo K, Treat RW, Dielentheis K. The Adaptive Learner: How Faculty and Medical Students' Perceptions of Learning Needs and Desires Differ. WMJ. 2021 Apr;120(1):8-16.

Thompson Rodriguez K, Ponkratz A, Gallagher M, Treat R, St Clair NE, Chou E, Lauck SM. Establishment and Retrospective Analysis of a Pilot Peer Mentorship Program. WMJ. 2021 Apr;120(1):17-22.

Treat R, Hueston WJ, Fritz J, Prunuske A, Hanke CJ. Medical Student Burnout as Impacted by Trait Emotional Intelligence - Moderated by Three-Year and Four-Year Medical Degree Programs and Gender, WMJ. 2021 Oct;120(3):188-194.

2020

Blank JJ, Krausert TB, Olson LR, Goldblatt MI, Lewis BD, Redlich PN, Treat R, Kastenmeier AS, Resident Perception of Fundamental Endoscopic Skills Exam: A Single Institution's Experience, Surg Endosc 2020 Jan 10.

McMillan R, Redlich PN, Treat R, Goldblatt MI, Carver T, Dodgion CM, Peschman JR, Davis CS, Alizadegan S, Grushka J, Olson L, Krausert T, Lewis B, Malinowski MJ, Incoming Residents' Knot-Tying and Suturing Skills: Are Medical School Boot Camps Sufficient? Am J Surg 2020 Jan 21.

Hueston WJ, Treat R. Medical Education with 3-Year Regional Campuses: Do They Attract a Different Type of Applicant? WMJ. 2020 Mar;119(1):22-25.

Saudek K, Rogers A, Treat R, Pilon C, Auble B, Hahn D, Schuh A, Weisgerber M, A 3-Year Longitudinal Study Evaluating Predictors of Overall Resident Performance. J Grad Med Educ 2020 Jun;12(3):357-358

Campbell BH, Treat R, Johnson B, Derse AR. Creating Reflective Space for Reflective and "Unreflective" Medical Students: Exploring Seminal Moments in a Large-Group Writing Session. Acad Med. 2020 06;95(6):882-887.

Saudek K, Treat R, Rogers A, Hahn D, Lauck S, Saudek D, Weisgerber M. A novel faculty development tool for writing a letter of recommendation. PLoS One. 2020;15(12):e0244016. PMCID: PMC7743943

2018

Kastenmeier AS, Redlich PN, Fihn C, Treat R, Chou R, Homel A, Lewis BD, Individual Learning Plans Foster Self-Directed Learning Skills and Contribute to Improved Educational Outcomes in the Surgery Clerkship.  Am J Surg 2018 Jul;216(1):160-166.

Saudek K, Saudek D, Treat R, Bartz P, Weigert R, Weisgerber M, Dear Program Director: Deciphering Letters of Recommendation, J Grad Med Educ 2018 Jun;10(3):261-266

Tews M, Treat R, Implementing a Team-Based Fourth-Year Medical Student Rotation in Emergency Medicine. West J Emerg Med. 2018 Jan;19(1):137-138.

Conference Presentations

all
2021

Treat R, Falk-Steinmetz M, Crawford C, Kaljo K, Analyzing the Impact of Personality on Autonomy and the Mediator Role of Motivation, International Association of Medical Science Educators Annual Conference, Virtual, 06/12/2021 - 06/17/2021

Treat R, Fritz J, Prunuske A, Hueston WJ, Kaljo K, Hanke C, Falk-Steinmetz M, Analysis of the Relationship of Medical Student Personal Distress and Emotion Regulation using Machine Learning, International Association of Medical Science Educators Annual Conference, Virtual, 06/12/2021 - 06/17/2021

Treat R, Falk-Steinmetz M, Crawford C, Kaljo K, Mixed Methods Analysis of the Impact of Medical Student Self-Efficacy and Metacognition on Motivation, Association for Medical Education in Europe Annual Conference, Virtual, 08/27/2021 - 08/30/2021

Turner H, Treat R, Redlich P, Rossi P, Brown K, Malinowski M, Effect of Structured Cadaver Dissection on the Durability of Anatomic Learning in Surgery Residents, Association for Medical Education in Europe Annual Conference, Virtual, 08/27/2021 - 08/30/2021

Treat R, Falk-Steinmetz M, Crawford C, Kaljo K, Analysis of Medical Student Metacognition and the Impact of Motivation and Emotional Stability, University of Southern California Innovations in Medical Education Annual Conference, Virtual, 02/18/2021 - 02/19/2021

Treat R, Kaljo K, Prunuske A, Hanke C, Hueston WJ, Falk-Steinmetz M, Fritz J, Medical Student Social Awareness as Impacted by Anxiety and Personality across Time, University of Southern California Innovations in Medical Education Annual Conference, Virtual, 02/18/2021 - 02/19/2021

Treat R, Kaupla G, Naber L, Hueston WJ, Stretching the Limits of an Analytical Model from the US MCAT to the Medical Resident Step 3 Exam, University of Southern California Innovations in Medical Education Annual Conference, Virtual, 02/18/2021 - 02/19/2021

Treat R, Corliss SB, De Jong PGM, Gabbur N, Hall E, Hasbrouck C, Haughton M, Hurtubise L, Kochhar K, Stoddard HA, Stratton TD, Wyatt T, Innovative Strategies Implemented in the 2020 Online Generalists in Medical Education Conference to Enhance Virtual Meeting Experience, Group on Educational Affairs Joint Regional Conference, Virtual, 04/20/2021 - 04/22/2021

Treat R, Falk-Steinmetz M, Crawford C, Kaljo K, Analysis of Medical Student Metacognitive Strategies for Correcting Comprehension and Performance Errors, Group on Educational Affairs Joint Regional Conference, Virtual, 04/20/2021 - 04/22/2021

Treat R, Fritz J, Prunuske A, Hanke C, Kaljo K, Falk-Steinmetz M, Hueston WJ, Neural Network Analysis of Medical Student Burnout as Impacted by Emotion, Group on Educational Affairs Joint Regional Conference, Virtual, 04/20/2021 - 04/22/2021

2020

Treat R, Falk-Steinmetz M, Fritz J, Prunuske A, Hueston WJ, Kaljo K, Hanke C, Predictive Differences of Medical Student Emotional Intelligence on Perspective-Taking at Three-Year Medical Degree Programs, International Association of Medical Science Educators Annual Conference, Virtual, 06/15/2020 - 06/18/2020

Treat R, Hueston WJ, Prunuske A, Fritz J, Kaljo K, Hanke C, Falk-Steinmetz M, Predictive Differences of Medical Student Personal and Social Values on Authenticity across Time, International Association of Medical Science Educators Annual Conference, Virtual, 06/15/2020 - 06/18/2020

Treat R, Kaljo K, Falk-Steinmetz M, Crawford C, Medical Student Metacognition: The Predictive Personality Facets of Conscientiousness and Emotional Stability, International Association of Medical Science Educators Annual Conference, Virtual, 06/15/2020 - 06/18/2020

Treat R, Kaupla G, Johnson L, Hueston WJ, Calibration and Predictive Capacity of NBME Comprehensive Clinical Science Examination and Basic Science Course Scores for USMLE Step 2-CK Examination, International Association of Medical Science Educators Annual Conference, Virtual, 06/15/2020 - 06/18/2020

Kaupla G, Treat R, Johnson L, Hueston WJ, USMLE Step 2-CK and the Predictive Capacity of the NBME Comprehensive Clinical Science Examination, The Generalists in Medical Education Annual Meeting, Virtual, 11/11/2020 - 11/13/2020

Treat R, Kaljo K, Falk-Steinmetz M, Crawford C, Medical Student Metacognition and the Impact of Personality and Autonomy: A Mixed Methods Inquiry, Association of American Medical Colleges Annual Meeting, Virtual, 11/16/2020 - 11/18/2020

Treat R, Kaupla G, Johnson L, Hueston WJ, 2010-2019 Ten-Year Longitudinal Analysis of US Medical College Admissions Test and USMLE Step Scores, Association of American Medical Colleges Annual Meeting, Virtual, 11/16/2020 - 11/18/2020

Treat R, Prunuske A, Fritz J, Hanke C, Kaljo K, Falk-Steinmetz M, Hueston WJ, Neural Network Analysis of Medical Student Empathy as Predicted by Emotional Risk Factors, Association of American Medical Colleges Annual Meeting, Virtual, 11/16/2020 - 11/18/2020

Johnson L, Treat R, Kaupla G, Hueston WJ, Predicting the USMLE Step 1 Exam Scores from Grid-Calibrated NBME Comprehensive Basic Science Exam Domains for Three-Year and Four-Year Medical Degree Programs, Central Group on Educational Affairs Annual Spring Meeting, Virtual Compendium, 04/01/2020 - 04/03/2020

Johnson L, Treat R, Kaupla G, Regional Variation Across the United States in Resident Self-Assessment as Compared to their Peers using ACGME Competencies, Central Group on Educational Affairs Annual Spring Meeting, Virtual Compendium, 04/01/2020 - 04/03/2020

Johnson L, Treat R, Kaupla G, The Impact of First-Year Medical School Student's Lecture Attendance on Course Evaluation Outcomes, Central Group on Educational Affairs Annual Spring Meeting, Virtual Compendium, 04/01/2020 - 04/03/2020

Treat R, Falk-Steinmetz M, Fritz J, Kaljo K, Prunuske A, Hanke C, Hueston WJ, Analysis of the Impact of Medical Student Traits on Self-Esteem between Three-Year and Four-Year Medical Degree Programs, Central Group on Educational Affairs Annual Spring Meeting, Virtual Compendium, 04/01/2020 - 04/03/2020

Treat R, Kaljo K, Apps J, Thapa B, Quirk K, The Impact of Stress and Personality on Faculty Resilience as Mediated by Character Strengths and Reflexivity, Central Group on Educational Affairs Annual Spring Meeting, Virtual Compendium, 04/01/2020 - 04/03/2020

Treat R, Prunuske A, Clevert Z, Hueston WJ, Reflections of an Evolving Local Innovations in Healthcare Education Research Conference, Central Group on Educational Affairs Annual Spring Meeting, Virtual Compendium, 04/01/2020 - 04/03/2020

2019

Kaupla G, Treat R, Bigelow M, Analyzing First-Year Medical Resident Self-Assessed Performance vs. Program Director Assessments, Central Group on Educational Affairs Annual Spring Meeting, Grand Rapids, MI, 03/27/2019 - 03/29/2019.

Kaupla G, Treat R, Bigelow M, Residency Program Director’s Perception of Graduates of a New Medical School Curriculum, Association of American Medical Colleges Annual Meeting, Phoenix, AZ, 11/08/2019 - 11/12/2019.

Treat R, Prunuske A, Hueston WJ, Brown D, Hanke C, Fritz JD, Kaljo K, De Roo K, Falk-Steinmetz M, Analysis of Student Adaptability to the First Year in Medical School: A Facet of Emotional Intelligence Guided by Personal Traits Over Time, Central Group on Educational Affairs Annual Spring Meeting, Grand Rapids, MI, 03/27/2019 - 03/29/2019

Treat R, Kaljo K, Apps J, Thapa B, Quirk K, Faculty Grit, Reflexivity, and Character Strengths: Opposing Elements, Association of American Medical Colleges Annual Meeting, Phoenix, AZ, 11/08/2019 - 11/12/2019.

 

2018

Treat R, Hueston WJ, Prunuske A, Brown D, De Roo K, Kaljo K, Hanke C, Bragg D, Analysis of Medical Student Motivation and its Association to Resilience, Trait Affect, and Gender, International Association of Medical Science Educators Annual Conference, Henderson, NV, 06/09/2018 - 06/12/2018.

Treat R, Kaljo K, De Roo K, Fritz J, Hanke C, Hueston WJ, The Mediation of Medical Student Trait-Affect and Resilience with Trait-Emotional Intelligence, Association for Medical Education in Europe Annual Conference, Basel, Switzerland, 08/25/2018 - 08/29/2018.

Contact Us

Robert Treat, PhD
Associate Professor and Director
rtreat@mcw.edu
(414) 955-4867

 

Greg Kaupla
Database Analyst II
gkaupla@mcw.edu
(414) 955-8216

Lindsey Johnson
Educational Analyst I
lijohnson@mcw.edu
(414) 955-8693

IHER2018-020