TITLE: Certification Test Developer SUPERVISOR: Certification Program Development Manager DEPARTMENT: NICET – Program Development FLSA STATUS: Exempt INCUMBENT: Vacant HOURS: TBD
EDUCATION/EXPERIENCE REQUIREMENTS: Bachelor’s degree in education, engineering, engineering technology, social science, management, communications, or other related specialty with course work in technical writing and 2 years work experience in certification or managerial/behavioral analysis, including working with associations, committees, and/or volunteers, or equivalent combination of education and experience.
COMPETENCIES:
Ability to develop and maintain professional relationships with customers, volunteers, colleagues, managers, and subordinates. Demonstrate willingness to assist teammates, ability to cultivate a team-based approach within the workplace, and promote a positive, productive work environment.
Expertise in assessment and measurement for item, test, and professional certification program development and maintenance. Understanding of accreditation criteria, and basic psychometric and statistical concepts. Strong analytical and organizational skills with a high level of attention to detail.
Leadership and organizational skills to effectively manage concurrent processes, people, and projects to meet established goals, deadlines, and quality standards. Willingness and ability to adjust to changing job requirements and work processes in a high-pressure environment.
Excellent communication skills in both written and spoken English, including ability to write collateral program materials and the ability to present to stakeholder groups and effectively exchange ideas. Efficiently lead, in-person and virtually, group/volunteer discussions, keeping them focused on the desired outcome.
Ability to write, analyze, and assess technical test questions and other materials for clarity, cognitive level, and appropriateness of technical content utilizing strong spelling and proofreading skills with excellent attention to detail.
Ability to train, manage, motivate, and coach volunteer subject matter experts (SMEs), efficiently lead group/volunteer discussions, keeping them focused on the desired outcome.
Solid computer software skills, including database, internet, email, word processing, item authoring and banking applications.
Ability to travel occasionally.
JOB PROCESSES: Develop new certification programs and maintain NICET’s growing offering of 13 (approximately 48 exams) engineering technology certification programs in accordance with accreditation best practices and NICET standards and policies.
Provide exam development and maintenance processes for certification programs including job task analysis, subject matter expert (SME) recruitment, item development & review, practice exams, beta exams, exam score setting and coordinating launch activities
Ensure process is on schedule, content fits and fulfills approved test specifications, and that form and structure is consistent with psychometric standards, NICET standards, and American English standards of grammar and spelling.
Train, motivate, and coach, volunteer SMEs. ,Coordinate SME workflows/assignments and maintain content security. Facilitate online and face-to face meetings.
Coordinate the identification, approval, and listing of reference/resource materials.
Analyze data and monitor the continued validity and reliability of exams, track the performance of exams and items; when necessary, revise and/or remove items and perform exam health check tasks such as reviewing item p-value, discrimination and correlation statistics and work with psychometrician(s) on these topics as necessary.
Participate in program development and maintenance planning, scheduling and prioritization and budgeting of development processes.
Assist with the modification of or separation into new processes of SOPs, style guides, and workflow charts to reflect evolving work practices.
Maintain the security of confidential program content, SME, candidate, and vendor information.
Make informational presentations to groups of stakeholders and work with Communications staff to coordinate programs’ marketing activities.
Provide guidance to stakeholders on the use of NICET certification programs.
Creating a world where the public can be confident that engineering decisions affecting their lives are made by qualified and ethically accountable professionals.