Attorney Specialist - Freelance AI Trainer Project

Worldwide - Remote

Apply on Employer Site

full time

Remote

$135k

H1B: no

Agency Attorney Specialist for a freelance AI trainer project focused on evaluating advanced agentic audio models in customer support scenarios. Responsible for designing evaluation frameworks, auditing AI model performance, and generating high-quality audio datasets.

Responsibilities

Role-Play Scenario Execution: Creating and executing complex, role-play-based evaluation scenarios that simulate realistic customer service interactions across travel, finance, and technical support domains.
Model Performance Auditing: Evaluating AI model performance across standardized qualitative and quantitative metrics, focusing strictly on task completion accuracy, conversational naturalness, and audio comprehension.
Technical Metric Evaluation: Assessing the model's basic computer programming literacy, including its understanding of JSON structures, functions, methods, and ability to reason about structured data within a support context.
Representative Dataset Generation: Contributing to the development of diverse, high-quality audio datasets that accurately reflect real customer expectations for clarity, efficiency, and natural conversational flow.

Qualification

Basic computer programming literacyA meticulousRequired Equipment

Required

Demonstrable professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
Native or bilingual proficiency in the target language, including fluency across all language skills (reading, listening, writing, and speaking), alongside strong analytical and verbal communication skills to confidently conduct simulated customer support role-plays.
Basic computer programming literacy, specifically a comfortable understanding of JSON structures, functions, methods, and simple logic.
A meticulous, detail-oriented approach to working with structured prompts, complex evaluation rubrics, and technical guidelines.
Required Equipment: Access to a high-quality microphone to ensure clean, reliable audio input during voice evaluations.

Benefits

Medical
PTO

Company

Agency

View company page

10000+ employees

Industrial

Founded 1892

Source: greenhouse

Active within the past hour

Remote-friendly

More roles at Agency

Manager, Growth & Insights

New York, NY

Manager, Client Accounting

Los Angeles, CA

Director, Talent Partnerships & Entertainment Marketing

Los Angeles, CA

Vice President, UTA Advisory Business Operations

New York, NY