Member of Technical Staff (Search Quality Analyst)

Belgrade · Remotefull timeRemoteseniorH1B: yes

Perplexity Member of Technical Staff (Search Quality Analyst) at Perplexity focuses on building and improving core search technologies by designing metrics and building data pipelines. The role involves diagnosing search quality issues and improving search snippet quality and page selection algorithms.

Responsibilities

Find and diagnose quality issues in our search pipeline
Design metrics from scratch to track and measure search quality
Build datasets for model training, including LLM-as-a-judge labeling pipelines
Improve search snippet quality and page selection algorithms for indexing
Design and analyze A/B experiments to validate improvements

Qualification

Proficiency with SQL and Python

Required

4+ years of experience as a data analyst or in a related role
Strong coding skills — expected to write production-grade code at a mid-level backend engineer level
Proficiency with SQL and Python
Demonstrated hands-on experience with at least one of the following:
Designing metrics from scratch (not just analyzing existing A/B experiments)
Building labeling pipelines using LLM-as-a-judge
Training ML models that shipped to production with measurable metric improvements