The following describes the various aspects of the designated job. Some or all of these aspects may be changed over time, with or without notice, at the sole discretion of the Accreditation Council for Graduate Medical Education (ACGME).
Applicants must be currently authorized to work in the United States (U.S.) on a full-time basis. The ACGME will not provide employment sponsorship for this position (e.g., H-1B Visa or other U.S. employment authorization).
Title: Program Evaluation Associate, CLER
Department: Department of Institutional Accreditation
Reports To: Director of Program Evaluation, CLER
Work Schedule: Full-Time
ACGME is looking for a highly experienced Program Evaluation Associate with extensive knowledge and in-depth understanding of evaluation methodologies and designs to expand and implement the evaluation agenda of the Clinical Learning Environment Review (CLER) Program with particular focus on program improvement efforts and quality assurance. From planning and executing to analyzing and reporting, the Program Evaluation Associate is essential to successful program functioning. The Program Evaluation Associate will assist to refine, strengthen, and implement sections of the measurement, evaluation, and quality improvement plan across the program. The Program Evaluation Associate is committed to evaluation practices that are rigorous, innovative, and inclusive of stakeholders’ voices. The candidate should be proficient in both quantitative and qualitative research methods.
Primary Duties and Responsibilities
Assist with all phases of program evaluation from agenda setting to design and implementation.
Support the development of program monitoring and improvement strategies that increase program fidelity, and promote program quality and organizational learning.
Collaborate with CLER Program staff to undertake process and outcome evaluations to assess CLER Program performance against CLER Program objectives for programmatic decision-making and quality improvement.
Conduct and document observations of periodic site visits to assess the quality of data collected by the program, verify the accuracy of reported data, and report on program quality.
Monitor progress of program evaluation efforts and special projects, including evaluation methods, data collection and management, and findings.
Seek opportunities to expand program evaluation and research, seeking ways to assess additional aspects of the program, analyze preliminary data, and apply new methodologies to the design.
Strengthen the assessment and evaluation capacity of program staff through training and technical assistance.
Contribute to the design of specific data collection instruments (e.g., surveys and interview protocols) that ensure a robust stream of information.
Develop materials across multiple modes of dissemination (e.g., written reports, briefs, scientific papers, technical manuals) for various stakeholder groups.
Support development of longitudinal databases for quantitative and qualitative analyses.
Support the organization and management of data collection activities.
Implement appropriate data management strategies for a wide range of objectives.
Work closely with team members to validate and ensure data integrity.
Work with large and complex datasets and perform detailed and complex statistical analyses.
Perform data collection and analysis tasks utilizing qualitative research skills.
Other duties as assigned.
Education, Knowledge, Skills, and Abilities
Master’s degree required, PhD preferred, in monitoring and evaluation, the social sciences, statistics, or other related discipline that provides a solid foundation in mixed-methods methodology.
Minimum 5-7 years of professional experience in monitoring and evaluation or in an applied research setting.
Experience working in complex organizations with diverse operations and program evaluation needs.
Advanced knowledge of evaluation frameworks, principles, and methodology.
Strong quantitative and qualitative analytical skills.
Must have demonstrated experience in conducting and leading monitoring and evaluation studies.
Must have demonstrated expertise and experience in synthesizing evidence standards for program evaluation.
Must have proven ability to work collaboratively with other team members while taking lead for new initiatives.
Must have experience working on issues regarding development and utilization of integrated data systems.
Must have expertise in analyzing large data sets using SPSS or SAS and advanced statistical techniques (proficiency in SPSS preferred).
Must have experience with qualitative data analysis software required (e.g., NVivo, MAXQDA).
Must have experience with web-based surveys using commercially available software.
Must have advanced proficiency with Microsoft Office Suite.
Must have excellent research and data collection methodology skills.
Must have excellent organizational skills and proven ability to manage complex projects and move them forward to completion on time in a fast-paced environment with overlapping timelines.
Must have strong critical thinking and analytic skills, and the ability to summarize disparate information in a clear and concise manner.
Must have exceptional attention to detail and accuracy.
Must have excellent creative thinking, written, and verbal communication skills.
Must have flexibility to adapt to changing conditions and requirements.
Must have excellent interpersonal skills.
Must be able to work independently and as part of a team with optimism, efficiency, and enthusiasm.
Position requires the significant use of standard office equipment such as a computer, keyboard, mouse, photo copier, fax machine, telephone, etc.
Most of the work of the Program Evaluation Associate, CLER is done in the ACGME office with the typical physical demands of an office environment.
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this position. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of this job.
While performing the duties of this job, the Program Evaluation Associate, CLER:
Will frequently be required to sit and work for extended periods of time at computer terminal using various computer programs and other computer tools.
Will frequently be required to sit in meetings for long periods of time.
Will need to travel to various meetings and to observe site visits.
An Equal Opportunity/Affirmative Action/Pro Disabled and Veteran Employer
About Accreditation Council of Graduate Medical Education
The Accreditation Council for Graduate Medical Education (ACGME) is a private, non-profit, professional organization responsible for the accreditation of nearly 9,000 residency education programs and about 700 institutions that sponsor these programs in the United States. Residency programs are responsible for educating over 116,000 resident physicians in 135 specialties and subspecialties. The AC...GME's mission is to improve health care by assessing and advancing the quality of resident physicians’ education through exemplary accreditation.