Job Summary:

The Director of Assessment & Evaluation is responsible for the oversight, implementation, and delivery of the programs of curricular evaluation, continuous quality improvement (CQI), and assessment of student learning, including collaboration with other offices and departments at the Kaiser Permanente Bernard J. Tyson School of Medicine (KPSOM). The Director will oversee the operational management of the Assessment and Evaluation team, lead data analysis, and interface with Information Technology (IT) in the optimization of analytics to support assessment, evaluation, and CQI-related efforts.

Essential Responsibilities:

• Direct the ongoing development of curricular evaluation at the course and educational program levels including but not limited to reviews of courses, phases, the Curriculum as a Whole Review, and other aspects of curricular delivery

• Oversee the ongoing development of the assessment program, including programmatic and course-level assessment processes, efforts to support United States Medical Licensing Examination (USMLE) Step Exam success, the Academic Performance Coaching program, and analysis for the evaluation of equity in assessment

• Direct, design, and deliver faculty development efforts related to assessment (including but not limited to coaching, rubric development, grading, workplace-based assessment, assessment systems) and evaluation

• Direct the implementation plans for CQI initiatives for the educational program and its courses, collaborating with senior staff on continuous accreditation compliance

• Collaborates with KPSOM IT and Kaiser Permanente IT teams and participates in technology committees to optimize data flow and technology systems supporting assessment, evaluation and analytics.

• Oversee the development, implementation, and updating of policies and procedures related to assessment, evaluation, and CQI

• Monitor the literature and larger medical education environment for best practices to augment the effectiveness, efficiency, and creativity of Office of Assessment and Evaluation (OAE) work

• Conduct scholarship drawing on the findings of the work in assessment and evaluation

• Direct the development and refinement of assessment and evaluation operations to maximize effectiveness and efficiency

• Develop and monitor OAE budget, in collaboration with the Business Consultant

• Lead the OAE staff on the development, maintenance, and refinement of project management plans for existing and new assessment projects, and in maintaining the calendar of key assessment activities in service of curricular review processes, institutional communication, and student progress review processes

• Collaborate with various departmental directors as directed to ensure optimal use of resources and alignment with school and departmental goals

• Contribute to the content editing of the Medical Student Performance Evaluation (MSPE) by expanding on, organizing, and synthesizing content related to the students academic performance and experiences for residency

• Lead OAE data analysis, ensure accuracy and effective visualization, and provide data-driven guidance to curricular governance committees

• Manages compliance with institutional policies and procedures on data management, transfer, and sharing, including timely provision of summative assessment (in collaboration with the Registrar)

• Provides full range of supervision to a team comprised of full-time individual contributors, managers, and contingent staff as needed; oversees recruitment, assignment of work, performance management, mentoring, and coaching

• Conduct and contribute to performance evaluations, provide timely feedback, and work to identify and support professional development opportunities for staff, including support for scholarship as possible

• Other duties as assigned

Basic Qualifications:

Experience

• Minimum five (5) years of experience in educational research, assessment, and evaluation

• Minimum five (5) years of data analysis experience

• Minimum four (4) years of leadership experience with direct reports

Education

• Masters degree in related field.

License, Certification, Registration

• N/A

Additional Requirements:

• Experience with regional or professional accreditation processes, preferred.

• Experience in educational assessment and/ or evaluation in health professions education, preferred.

• Conceptual design and implementation of analytics systems, preferred.

• Demonstrated knowledge of key issues and concepts in higher education or health professions education and areas of program evaluation, assessment of student learning, and statistical analysis

• Exemplary communication skills (both written and oral), highly developed organizational and leadership skills, and an ability to work collaboratively with administrators, faculty, staff, students, and accreditors

• Comfortable working in a fast-paced, high-energy environment

• Strong presentation, communication, and interpersonal skills

• Demonstrate a commitment to diversity

• Demonstrate computer competency in various software packages and applications

• Strong organizational and project management skills

Preferred Qualifications:

• N/A

COMPANY: KAISER

TITLE: Director Assessment and Evaluation - School of Medicine

LOCATION: Pasadena, California

REQNUMBER: 1344370

External hires must pass a background check/drug screen. Qualified applicants with arrest and/or conviction records will be considered for employment in a manner consistent with Federal, state and local laws, including but not limited to the San Francisco Fair Chance Ordinance. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, protected veteran, or disability status.