POSITION REQUIREMENTS AND RESPONSIBILITIES
• Facilitates item development by the item writers through training, supervision, and technical guidance.
• Plans and implements item writing activities with the Assessment Project Manager.
• Train subject matter experts on the creation and review of test forms and on content appeals.
• Facilitates examination review meetings with the subject matter experts.
• Trains item writers on item development and review.
• Facilitates Examination Sensitivity Review Committee meetings for the assigned examinations.
• Implements item and analysis reports of the assigned examinations in the item bank.
• Collaborates with the Psychometricians on item bank maintenance and updates.
• Collaborates with the Assessment Project Manager for the recruitment of subject matter experts and item writers.
• Collaborates with the Appeals Specialist to resolve challenges of examination content.
• Seeks guidance and approval from subject matter experts and the Technical Advisory Committee regarding item and test development.
• Collaborates with Psychometricians, Item Bank Specialist, and other staff on the development, review, and publication of the designated examinations using test frameworks and related software.
• Manages established content development expectations with team members, stakeholders, and management.
• Works collaboratively with Psychometricians and Assessment Project Manager on the annual test publication calendars.
• Maintains and updates knowledge on item writing, item evaluation, and test development.
• Presents and publishes information related to the development, design, and performance of assigned examinations at conferences and other professional forums.
• Other duties as assigned.
EDUCATION AND EXPERIENCE
• Doctorate or ABD in counseling or related field with an emphasis on assessment and statistics.
• Three or more years of professional experience in developing test items.
• Equivalent combination of education and experience will be considered.
• Experience in developing and disseminating training on assessment or counseling-related topics.
• Working knowledge of assessment theories and concepts, such as Classical Test Theory (CTT), Item Response Theory (IRT), and Evidence-Centered Assessment Design, is preferred.
• Ability to provide instruction for the development and review of a variety of item types.
• Effective interpersonal, verbal, and written communication skills, including clear feedback and instructions.
• Team-building, collaboration, and intra-organizational cooperation.
• Leadership skills for the management of content development projects, assigning and assisting new staff, monitoring projects, and building a vibrant community of support around program.
• Professional, political, and cultural aptitude with an ability to work with diverse individuals, groups, and organizations,
• Commitment to self-development through continuous learning, position-related training, and professional development.
• Mastery with use of Microsoft Office Suite.
• Knowledge of item bank and statistical software systems.
The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
• The noise level in the work environment is usually quiet.
• Prolonged periods of sitting at a desk and working on a computer.
• Regularly required to use hands and reach with hands and arms.
• Regularly required to sit for long periods.