Become part of an iconic brand that is set to revolutionize the electric pick-up truck & rugged SUV marketplace by achieving the following:

Design, develop and deploy AI agents on Databricks, owning the full lifecycle from prototyping to production – including versioning, monitoring, and maintenance of multiple agents running in parallel

Build and maintain robust evaluation frameworks using MLflow's evaluation suite, implementing and customizing judges (built-in, guideline-based, and custom) to systematically assess agent quality across correctness, safety, and business-specific criteria

Drive continuous quality improvement of AI agents through structured offline evaluation pipelines (curated datasets, benchmarks) and online production monitoring, leveraging MLflow tracing to understand agent execution patterns

Collect, structure and incorporate human feedback from diverse stakeholder groups (engineering, quality, business) into evaluation workflows and agent improvement cycles

Collaborate with Data Engineers, IT, and R&D to define data configurations and pipelines that feed AI agents with reliable, high-quality inputs

Leverage and combine multiple data sources (on-site, off-site, connected vehicle data) to build agents that identify trends, anomalies, and quality signals at scale

Surface agent outputs and quality insights to Quality business stakeholders through dashboards and visual reporting tools, translating complex model behavior into understandable and actionable information

Identify and close data quality gaps, ensuring that data feeding into agents is clean, consistent, and continuously improving through well-defined requirements and automated checks

Location & Travel Expectations:

This role may be based out of the Scout Motors corporate headquarters in Charlotte, NC.

This role requires 4-5 days per week in the office, with regular in-person meetings and events.

AI Agent Engineer

Responsibilities

Benefits

Company

Scoutmotors

More roles at Scoutmotors