Director of Clinical Assessment Team Program

Description

JOB SUMMARY:

The Director of the Clinical Assessment Team (CAT) Program leads groundbreaking work in the development, training, and implementation of observational coding systems designed to assess medical students' non-cognitive skills. This faculty position requires a Ph.D. in psychology, or a closely related field, with demonstrated expertise in observational coding and a robust background in both qualitative and quantitative research methods. As an expert in social-emotional learning in early or higher education, the Director will oversee a dedicated team of CATs, guide program strategy and quality, collect and analyze assessment data for clinical feedback and research, and uphold the integrity and confidentiality of assessment data.

MAJOR RESPONSIBILITIES / DUTIES / CRITICAL TASKS:

• Lead the development of the observational coding scheme codebook and ensure its effective application within the CAT program.
• Train and certify CATs in observational coding methodologies.
• Serve as an expert coder for complex scenarios and validate the standardization of assessments.
• Conduct ongoing evaluation of the CAT program, including regular meetings to address coding drift, conducting reliability analysis, and assessing CAT performance.
• Spearhead research initiatives related to observational coding, noncognitive skills, and social-emotional learning in medical education.
• Disseminate research findings through scholarly publications and presentations at national and international forums.
• Collaborate with the Phase 2 Director, Department of Medical Education, Faculty Affairs,
• Student Affairs, and affiliated healthcare system leadership to ensure program alignment with strategic goals.
• Perform data analysis at the student, cohort, and program levels, reporting outcomes to the leadership of the School of Medicine as directed by the Phase 2 Director.
• Uphold confidentiality and compliance with FERPA, HIPAA, and cybersecurity protocols.
• Develop and oversee the program budget and manage the performance reviews and retraining of CAT team members.
• Complete other duties as assigned.

ACCOMPANYING KNOWLEDGE, SKILLS, ABILITIES AND COMPETENCIES:

• Demonstrated leadership or management experience, preferably overseeing a small team of observational coders.
• Proficiency in educational assessment software (e.g., One45), OpenAI platform, Microsoft 365, and other relevant qualitative/quantitative research software preferred.
• Exceptional interpersonal skills and the ability to lead and work collaboratively within an interdisciplinary environment.
• Strong commitment to confidentiality and ethical handling of sensitive educational and medical data.
• Innovative thinker with an interest in the application of AI technologies in educational assessment.

Qualifications

REQUIRED EDUCATION / EXPERIENCE:

• Ph.D. in Psychology, Social Sciences, or related field with expertise in observational coding required.
• Three (3) or more years of experience in observational coding within an educational environment.
• Demonstrated experience in creation of observational coding systems preferred.
• Experience in leading or managing teams, with experience in budget management and performance evaluation.
• Familiarity with software tools relevant to educational assessment and data analysis.
• Record of scholarly research and publication in related fields.

WORKING ENVIRONMENT:

• Primarily an office and clinical environment within the University and affiliated clinical settings.
• Typical physical requirements of a faculty and administrative position, including occasional travel to attend conferences, meetings, and program sites.