Afterquery Research Program Manager at AfterQuery responsible for running operations behind research programs and coordinating collaborations. The role involves technical tasks such as reading results tables and running evaluations.
Responsibilities
Serve as the point of contact for collaborations with academic and industry partners, including fellowships, grants, and joint research projects, and run each from scoping through delivery.
Coordinate benchmark releases end to end, from launch checklist through publication, and keep releases on cadence.
Maintain AfterQuery's leaderboards and benchmark sites, and verify every result before it goes to a community leaderboard or publication.
Track progress across all active research projects. Anticipate resourcing gaps and technical bottlenecks, unblock projects that fall behind, and escalate with a clear recommendation when a timeline or scope needs to change.
Coordinate the expert pool for upcoming benchmarks: forecast expert needs, manage capacity, and keep contributor logistics running.
Write the program's external and internal communications: launch briefs, partner updates, planning documents, and status memos that turn technical detail into clear, actionable summaries.
Qualification
1-3+ years in research operationsEvaluation literacyContributed to a benchmarkExposure to expert or annotator poolsHealth Insurance
Required
1-3+ years in research operations, technical program management, or a similar role in a fast-moving research or engineering organization.
Technical background in computer science, machine learning, statistics, or a related field, with working Python and SQL.
Evaluation literacy: you have taken part in evaluating a product, an agent, or a foundation model, can read a results table, and can tell when a number should not be trusted.
Excellent written and verbal communication. You can distill a technical result into a summary a partner, executive, or academic collaborator can act on, and you write documents people actually read.
A track record of running cross-functional programs end to end, including managing external partners, contractors, or collaborators.
Comfort with ambiguity and building processes from scratch, and the judgment to keep processes light so researchers stay effective.
Preferred
Graduate degree or research experience in a technical field.
Contributed to a benchmark, dataset, or evaluation project in any role.
Familiarity with public leaderboards or open research communities.
Exposure to programs with external partners, such as fellowships, grants, or academic collaborations.
Exposure to expert or annotator pools, or other human-data work.
Comfort with lightweight dashboards or building small tools with AI assistants.