Duolingo The Language Measurement Scientist supports test development and research for the Duolingo English Test. They collaborate across disciplines to design and evaluate language assessments ensuring validity, reliability, and fairness.
Responsibilities
Duolingo is looking for a language assessment expert to support test development and research for the Duolingo English Test. You will join our Assessment Research and Development team, collaborating across disciplines to design and evaluate innovative language assessments. Your work will help ensure that assessment tasks and scores are valid, reliable, and fair while advancing Duolingo’s mission through science.
Collaborate with measurement researchers, engineers, and designers to develop innovative, research-driven language assessments.
Design and evaluate assessment tasks, including new interactive item formats.
Conduct qualitative and quantitative studies examining the validity, reliability, and fairness of assessment tasks and test scores.
Apply language assessment and measurement principles to improve test design, content, scoring, and quality assurance.
Translate research findings into clear recommendations for technical and non-technical partners.
Share findings through technical reports, research publications, blog posts, and presentations to professional and academic audiences.
A PhD in language testing, applied linguistics, second language acquisition, educational measurement, or a related field.
Experience developing or conducting research on high-stakes language assessments or comparable professional experience.
Expertise in language assessment, including test design, validity, reliability, fairness, and the measurement of language proficiency.
Experience designing and analyzing qualitative and quantitative research studies.
Experience communicating research through publications, reports, or presentations.
Qualification
PhD in language testingStrong collaboration
Required
PhD in language testing, applied linguistics, second language acquisition, educational measurement, or related field
Experience developing or conducting research on high-stakes language assessments or comparable professional experience
Expertise in language assessment including test design, validity, reliability, fairness, and measurement of language proficiency
Experience designing and analyzing qualitative and quantitative research studies
Experience communicating research through publications, reports, or presentations
Ability to explain complex measurement concepts clearly
Proficiency with data-analysis tools such as R or Python
Strong collaboration, project-management, and organizational skills
Preferred
Experience applying large language models, natural language processing, or related technologies to language assessment
Experience collaborating with software engineers or AI researchers to develop digital assessment products
Experience designing or developing computer-adaptive tests
