As an AI Red Teamer, you will stress-test large language models by intentionally trying to break them. Rather than checking whether an answer is correct, you will design creative, adversarial prompts that expose vulnerabilities: unsafe content, bias, broken guardrails, hallucinations, prompt injection weaknesses, and unexpected behaviors. Your work directly supports AI safety and model robustness for leading research labs.

This is a generalist red teaming role. You will probe models across the full spectrum of risk categories, including content safety, CBRN (chemical, biological, radiological, nuclear), cybersecurity, persuasion and influence operations, child safety, self-harm, over-companionship, and regulatory compliance. Red teaming may span text, image, voice, and agentic model capabilities depending on project needs.

This role requires creativity, curiosity, and an ability to think like an adversary while operating with strong ethical judgment.

Day-to-Day Responsibilities

Craft creative prompts and multi-turn scenarios to stress-test AI guardrails across diverse risk categories

Discover ways around safety filters, restrictions, and defenses using jailbreak, evasion, and prompt injection techniques

Explore edge cases to provoke disallowed, harmful, or incorrect outputs

Evaluate and score model responses against structured harm taxonomies and severity rubrics

Document experiments clearly, including what you tried, why you tried it, and what it revealed

Review and refine adversarial prompts generated by other team members

Contribute to harm taxonomy development, calibration exercises, and inter-rater reliability work

Collaborate with engineers, data scientists, and researchers to share findings and strengthen defenses

AI Red Teamer (LLM Generalist) - Remote

Responsibilities

Qualification

Required

Preferred

Company

Handshake

More roles at Handshake