Assessment Specialist, Psychology
TheCollegeBoard

Director, Assessment Specialist, AP Psychology

College Board - AP & Instruction

Remote

About the Team

The AP Curriculum and Assessment Team at College Board (40+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP's 40+ courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level. AP's Course Leads and Assessment Leads ensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline, contribute to instructional resources and tools for teachers, and develop assessments that allow students in these courses to demonstrate their mastery of course content and skills. The STEM department, which includes computer science, mathematics, the sciences, and statistics, is currently made up of 15 people supporting 14 courses in the AP portfolio.

About the Opportunity

As the Assessment Specialist for AP Psychology, you are responsible for the quality and validity of all assessment content for the AP Psychology Exam.

The Director/Assessment Specialist is the primary point of contact in AP for all assessment content for AP Psychology, collaborating closely with the AP Psychology Course Lead (who leads curriculum development, guides instructional support, and reviews assessment content). The Assessment Specialist may provide assessment development support in other related subject areas. The Assessment Specialist is responsible for all item development and management from authoring to administration; training and collaborating with subject-matter experts (SMEs), typically college professors and secondary school teachers. S/he/they trains SMEs on assessment development protocols, translates between academics and technical experts (psychometricians), and collaborates to develop formative assessment materials and resources to support AP Psychology teachers worldwide.

In this role, you will:

Assessment Development and Scoring (85%)

• Serve as the assessment leader for AP Psychology, the primary person responsible for assessment development for AP Psychology
  
• Be responsible for authoring/revising assessment content and training educator constituents to author assessment content, including selection of appropriate stimulus material, and applying best assessment practices
  
• Lead the development and management of all assessment content through iterative review stages with multiple internal and external stakeholders, including the AP Psychology Course Lead, Assessment Production team, Test Development Committee, and the Chief Reader
  
• Be responsible for development of all assessment forms, ensuring the AP Exam development aligns with approved curricula and test specifications
  
• Conduct multiple face-to-face, weekend meetings, and virtual meetings (during work week, evenings, or weekends) annually with each of the committees within your stewardship as well as other committee meetings in the discipline as needed
  
• Lead the successful scoring of student AP Exams at the annual scoring event in person and online-the "AP Reading"-and produce AP Reading publications materials for teacher and student use
  

Assessment Quality and Process (15%)

• Contribute to current research and best practices related to assessment; participate in regular discussions with other AP Curriculum & Assessment members on the current assessment standards and practices to build a set of common, shared beliefs about AP's assessment directions within the larger educational and assessment community
  
• Contribute to processes for efficient, high quality assessment development
  
• Refine and improve question task models as well as exam design in collaboration with and aligned to other College Board initiatives
  
• Monitor and improve exam validity, reliability, fairness, and quality, as well as reader reliability in accordance with established Program thresholds
  
• Serve as a recognized and trusted resource within the community by collaboration with the AP Course Lead in engagement with the community to drive teacher satisfaction with the AP Psychology Exam
  

About You

You have:

• A Master's degree or PhD in psychology and knowledge of current trends in the discipline (required), although a doctorate in the discipline is strongly preferred
  
• Experience in standardized assessment development (preferred)
  
• Experience with digital assessment (preferred)
  
• Teaching experience (preferred)
  
• Superior oral and written communications skills
  
• Excellent organizational and planning skills, including the ability to effectively handle multiple tasks simultaneously
  
• Meticulous attention to detail, including the ability to closely proofread
  
• Excellent skills in process and procedure implementation, including adhering to project plans and schedules, and maintaining project management documentation for tracking
  
• Technical acumen and aptitude; proficiency with Microsoft Office and use of browser-based applications and tools
  
• Excellent interpersonal and collaboration skills, including the ability to deal with staff at all levels
  
• Willingness to give, accept, and address constructive feedback with positivity
  
• Strong customer service orientation
  
• Willingness to travel up to 6 times a year (domestic), with an additional 2 weeks in May/June for the Annual "AP Reading"
  

About Our Benefits and Compensation

College Board offers a strong compensation and benefits package that attracts top talent looking to make a difference in education.

• Our robust benefits package includes health, dental, and vision insurance, tuition assistance, paid time off, paid parental leave, retirement benefits with a generous matching program, and more
  
• We reward performance through annual bonuses and provide opportunities for salary growth over time through base compensation increases, merit raises and promotions
  
• We believe in compensating staff members fairly in relation to each other, their qualifications, and their impact. The salary range for a new employee in this position is $80,000-$130,000. The salary offer of an individual candidate within this range is specific to their location and qualifications
  
• Each salary offer is determined carefully using internal and external benchmarking and adjusting for the candidate's location. You will have an opportunity to discuss salary in more detail after you begin the application process
  

As a self-sustaining non-profit organization with global impact, College Board offers a job that matters, a team that cares, and a place to learn, innovate and thrive!

About Our Culture

Our community matters, and we strive to practice and improve our culture daily. Here are some headlines:

• We are motivated to positively impact the educational and career trajectories of millions of students a year
  
• We prioritize building a diverse and inclusive team where every employee can thrive, and every voice is heard
  
• We welcome staff to join any or all six of our affinity groups: ARISE (Alliance for Asian Retention, Inclusion, Success, and Engagement; DIASPORA (Alliance for Pan-African Success and Achievement); Pride (alliance for LGBTQ+ staff and allies); Resilience (alliance for Native staff and advocates); SALSA (Staff Alliance for Latinx Success and Achievement); and WIN (Women's Impact Network)
  
• We value learning and growth; we offer formal and informal ways to lead through your superpowers, sharpen your strengths, and meet your development goals
  
• We know that our impact is strongest together. Our College Board Cares program offers all staff up to $1,000 annual match against partner non-profit organizations
  
• We offer a transparent approach to promotions and merit raises, annual performance-based bonuses, and how to grow your career here over time
  

About the Process

• Interview Process Includes: Resume and Application; Recruiter Phone Screen; Hiring Manager Interview and Performance Exercise (responding to some assessment exercises); Panel Interview; Final Interview; Reference Checks (approximately 6-8 week process)
  

#LI-Remote

#LI-CW1

This job has expired.