Assessment Analyst

The American Registry of Radiologic Technologists (ARRT) is seeking an Assessment Analyst to join our growing team. This hybrid role offers the opportunity to collaborate onsite at our Mendota Heights office approximately 50% of the time and follows a standard full-time schedule of Monday through Friday, 8:00 a.m. to 4:30 p.m. In this role, you will transform complex data into actionable insights that support ARRT's mission and inform key organizational decisions. You will contribute to assessment operations, examination development, program evaluation, and strategic initiatives, helping ensure the validity, quality, and effectiveness of ARRT's credentialing programs. Duties and Responsibilities Assessments Work with assessment team to design assessment blueprints Work with assessment developers to align content within assessment blueprints Write assessment design training documents for various groups using appropriate style Document technical aspects of exams including item performance, practice analysis procedures, and standard setting reports Collaborate with staff to improve and automate processes for assessment activities Create research programs to evaluate assessment characteristics in the field Manage and operate the system for processing scores in a timely fashion Provide backup support for psychometricians in tasks as needed Data Management and Analysis Collect, clean, validate, and transform large datasets from certification systems, assessment platforms, CRM databases, and external sources Conduct descriptive and inferential statistical analyses to support certification program validity, exam performance reviews, and candidate experience improvements Build dashboards, reports, and data visualizations for internal and external stakeholders Exhibit Data Stewardship: Understand where data is, how to access it, and how it can be used Reporting and Communication Develop written and visual reports for leadership, committees, accreditation bodies, and partner organizations Translate complex analytical findings into clear, actionable recommendations Present data insights to cross-functional teams including, but not limited to, Education Requirements, Marketing and Strategic Communications, Finance, and Information Technology (IT) Assist with the design and development of Annual Reports for assessment programs Serve as a data liaison between departments Data Infrastructure and Quality Partner with IT to improve data pipelines, data quality, and overall system reliability. Document data definitions, processes, and best practices Ensure compliance with data privacy standards and accreditation requirements (e.g., NCCA, ISO/IEC 17024) Assessment Content and Eligibility Materials Contribute to periodic practice analysis projects for assigned programs, including survey development, data analysis, and report writing Contribute to the development and maintenance of the item bank quality metrics Assist with the development of procedures for a more standard presentation of practice analysis survey data where possible and incorporate documentation on those processes into the Practice Analysis Manual Assessment Scoring, Analysis, and Reporting Process exam results and conduct quality control (QC) for a variety of programs Conduct exam results processing, scoring, and QC for all programs Maintain procedures manual and other documentation required for exam processing and scoring Analyze exam results and collaborate with department staff in production and dissemination of annual examination summary reports and technical reports Recommend enhancements to scoring procedures and reports Analyze data to support department(s) Collaborate to create software tools that directly facilitate or automate psychometric work responsibilities Miscellaneous Continuously watch for, communicate, and seek validation of areas of quality improvement by initiating discussions and participating in evaluation of improved processes Write, review, or edit other ARRT documents as requested, including website material Assist with or prepare memos and reports for presentation to the Board of Trustees Assist with standard setting studies, as needed Support organizational priorities through active participation in ARRT Projects as assigned. Proactively manage and deliver assigned ARRT project work. Other duties as assigned and modified as business needs dictate.