Lead development and evaluation of high‑stakes adaptive law‑school assessments. Perform psychometric and statistical analyses, manage test data and score reporting, ensure validity/fairness and test security, consult on test design, manage projects and vendors, communicate with external stakeholders, support research/publications, and mentor staff.
Aspen Publishing is seeking a Manager of Testing & Psychometrics to be a part of our growing Company. You will work in partnership with many departments, as well as external stakeholders including law school deans and directors, to deliver on the mission of the JD-Next team. We are looking for a Manager of Testing & Psychometrics who is passionate about testing and assessments and wants to positively impact students’ first step on their legal education journey- is that you?
TITLE: Manager of Testing & Psychometrics
REPORTS TO: Director, JD-Next
DEPARTMENT: JD-Next
FLSA STATUS: Exempt
LOCATION: Burlington, MA (will consider remote for the right candidate)
RANGE: $110.6 (MIN)/$155.25 (MID)/$199.9 (MAX)
POSITION SUMMARY: Responsible for developing innovative systems for high-stakes adaptive educational assessments within the successful family of JD-Next products, including an online course and high-stake law school entrance exam delivered multiple times per year. Conduct psychometric and statistical analyses in support of product development and operations with the goal of ensuring the validity and fairness of the use of test scores provided to clients. Preference will be given to Boston-based candidates who will work in our Burlington, MA, office with an optional hybrid office/work-from home schedule; however, we will consider remote work for the right candidate.
ESSENTIAL DUTIES AND RESPONSIBILITIES:
- Oversee complex projects in a fast-paced environment
- Help ensure test security and excellence for both high-stakes and low-stakes testing environments; this includes ensuring that JD-Next has sufficient new content to maintain test security, validity, and fairness
- Perform psychometric evaluations and processes as necessary
- Oversee and maintain accountability for test results data management, analysis, and score reporting.
- Lead evaluation of the test design and test blueprints, determining when changes are warranted, in collaboration with the assessment team; provide psychometric consultation on form assembly to ensure exams meet psychometric and validity standards.
- Manage annual ABA Standard 509 Reporting, ensuring compliance with ABA requirements and preparing internal and external reports based on the data.
- Communicate JD-Next value and process with admissions office deans and directors and other key stakeholders
- Clearly communicate technical issues to internal and external stakeholders
- Enhance operational procedures and document best practices
- Ensure quality control processes for project deliverables
- Engage in a research program, contribute to publications, and present virtually and at conferences
- Support and mentor staff for professional development
- Collect and store data on sales numbers, market research, logistics, linguistics, or other behaviors as necessary; Bring technical expertise to ensure the quality and accuracy of that data
- Perform analysis to assess the quality and meaning of data for JD-Next and, as necessary, for Aspen; Utilize psychometric models and process, design, and communicate data in ways to help stakeholders, internal and external, interpret the data and make better decisions.
- Use automated tools to extract data from primary and secondary sources
- Develop and maintain databases, and data systems – reorganizing data in a readable format
- Travel as required for the role
- Perform other duties as assigned
QUALIFICATIONS:
- Master’s or Ph.D. in Educational Measurement, Psychometrics, Industrial Organization or Psychology or a related field with psychometric or statistical expertise preferred
- 7+ years work experience the testing industry preferred
- Knowledge of law school admissions and/or legal education a plus
- Record of leading complex projects in large-scale assessment
- Experience working directly with external clients including educational institutions and programs
- Demonstrated leadership in overseeing technical experts in large-scale psychometrics and statistics
- Proficiency in software packages for conducting psychometric and statistical analytical work and research (e.g., R, Python)
- Proficiency in communicating technical research and psychometric and statistical concepts to non-technical audiences and analyze applied measurement problems and purpose solutions
- Experience with Agile methods and collaborative problem-solving
- Collaborative mindset with a talent for providing innovative solutions
- Excellent interpersonal skills, including effective teamwork and communication skills
- Excellent written, verbal, and presentation skills
- Excellent with Microsoft Office (PowerPoint, Outlook, Excel, Word) and statistical tools
- Proven ability to manage multiple projects under strict deadlines
- Ability to analyze issues and provide solutions
- Customer service mindset
- Liaise between internal and external groups
- Manage multiple Vendors
- Troubleshoot and problem solve
- Willing to travel as needed
- Work with individuals at all levels of the organization
- Ability to work quickly and accurately in a fast paced, changing environment
- Ability to meet deadlines in a consistent and accurate manner
- Demonstrated ability in working independently and as part of a team
- Normal Office Environment
- Ability to sit for extended periods of time
- Ability to work on computer for extended periods of time
- Ability to listen and speak carefully while interacting with others
- Ability to lift up to 10 pounds occasionally
The salary range provided is a good faith estimate representative of all experience levels. Aspen considers several factors when extending an offer, including but not limited to, the role, function and associated responsibilities, a candidate’s work experience, location, education/training, and key skills.
In addition to competitive compensation, we offer a wide array of benefits including your choice of health and dental plans, generous paid time off and holidays, 401k with employer match, and an array of voluntary programs to cover all of life’s eventualities, from accidents to critical illness and pet insurance.
EOE disability/veteran
Aspen Publishing Boston, Massachusetts, USA Office
Boston, Massachusetts, United States
Similar Jobs
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The Senior Engineer - Boomi Architect leads enterprise integration projects, designing solutions using Boomi iPaaS, and mentoring junior engineers while ensuring scalability and quality standards.
Top Skills:
APIsAzure Integration ServicesBoomiCeligoEnterprise IntegrationIntegration SolutionsMulesoftWorkato
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Own and prioritize the Workday/ERP product backlog, translate business needs into epics and user stories, partner with Finance and business leaders, support Agile delivery and releases, manage integrations and reporting, ensure compliance and security, and drive continuous improvement and adoption across Workday modules.
Top Skills:
AgileWorkday FinancialsWorkday IntegrationsWorkday PsaWorkday Release ManagementWorkday Reporting
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Responsible for delivering financial reports, budgeting, providing technical accounting assistance, and developing team members in the construction industry.
Top Skills:
Quickbooks OnlineSage Intacct
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
