Systems Test Engineer, End-to-End Validation | Consumer Devices at OpenAI · LumiJobs

Responsibilities

As a Systems Test Engineer, End-to-End Validation, you will design and execute end-to-end testing for complex device experiences spanning hardware, software, connectivity, cloud services, and accessories. You’ll translate product behavior and real-world use cases into structured, reproducible test procedures and build test environments that allow failures to be reliably reproduced and diagnosed.
You’ll also identify opportunities to automate repetitive or high-value scenarios, working with engineers to turn complex manual workflows into scalable validation systems. Because this is a new category of devices, you’ll have the opportunity to build the end-to-end validation foundation early—shaping test coverage, environments, and workflows from prototype through launch.
We’re looking for someone who combines strong systems thinking, hands-on testing skills, technical curiosity, and a rigorous approach to reproducing and diagnosing failures across multiple components.
This role is based in San Francisco, CA. We use a hybrid work model of four days in the office per week and offer relocation assistance to new employees.
Design end-to-end test coverage: Develop structured test plans and reproducible procedures for user journeys, realistic usage patterns, edge cases, degraded conditions, and failure scenarios across devices, services, connectivity, and accessories.
Build and operate complex test environments: Maintain setups involving devices, servers, networks, accounts, peripherals, accessories, and controlled environmental conditions; prepare devices and environments for release validation, execute test campaigns, track results, and communicate risks and blocking issues.
Reproduce failures and diagnose systems: Reproduce complex failures, isolate contributing components, collect logs and telemetry, and provide engineers with clear reproduction steps and supporting evidence.
Automate high-value scenarios: Identify repeatable manual workflows that benefit from automation and develop or partner on tooling for device control, setup, measurement, data collection, and test execution.
Strengthen regression coverage: Convert field issues, production failures, and previously discovered bugs into repeatable regression tests and maintain coverage across product releases.
Partner across teams: Work with embedded, systems, cloud, hardware, QA, and product teams to understand system behavior, improve testability, and close gaps in validation coverage.

Qualification

Experience with system-levelYou might thrive in this role if youAre comfortable working with logsWe are an equal opportunity employerFor additional information

Required

Experience with system-level, integration, end-to-end, or validation testing for complex hardware-software products.
Skill in translating loosely defined product behavior into clear, repeatable, and measurable test procedures.
Experience testing systems that span devices, networks, backend services, mobile applications, or connected accessories.
You might thrive in this role if you:
Enjoy hands-on debugging and can methodically isolate failures across hardware, firmware, software, connectivity, and cloud services.
Are comfortable working with logs, diagnostics, command-line tools, network tools, and device configuration utilities.
Have experience automating tests or test setups using Python or similar scripting tools, while recognizing when manual testing provides better coverage.
Understand how to create reliable test environments with controlled setup, configuration, preconditions, expected results, and recovery procedures.
Are comfortable working across engineering disciplines and communicating complex failures with clear evidence and reproducible steps.
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Systems Test Engineer, End-to-End Validation | Consumer Devices

Responsibilities

Qualification

Required

Benefits

Company

OpenAI

More roles at OpenAI