Bright AI Senior AI Engineer at Bright AI owning and evolving on-device conversational AI for industrial safety wearables. The role focuses on dialog systems engineering under strict latency and safety constraints.
Responsibilities
Own the on-device dialog pipeline end to end: intent routing, hybrid intent classification (pattern matching combined with embedding similarity and out-of-domain detection), text normalization for noisy speech input, and the multi-step guided-procedure engine.
Maintain and extend the deterministic safety layer that wraps the language model—confirmation and echo-back gating, criticality tagging, negation handling—so that a misheard answer on a safety-critical step cannot pass silently.
Run SLM inference on-device under memory, computational complexity, and latency budgets, and reduce the per-turn inference cost through model selection, quantization, and runtime optimization.
Preserve and extend the zero-shot configuration model, in which new device commands and customer procedures are authored as data rather than released as code, so that a new customer can be onboarded in hours rather than weeks.
Coordinate the device deployment pipeline with the edge team
Maintain the API contract with on-device voice pipeline & its speech-to-text (STT) stack.
Define and run on-device benchmarks: latency, accuracy, and false-accept/reject rates on safety-critical steps; use measurements to drive engineering decisions.
Build and maintain golden datasets and a non-regression suite, and use them as the release gate as the command and procedure catalogs grow.
Lead the migration from zero-shot to fine-tuned on-device models in order to reduce latency, without reintroducing a per-customer retraining burden.
Collaborate with product, firmware, and cloud teams, and bring new capabilities online, including additional languages, device commands, and guided workflows.
Educational Background
Trained in AI, Machine Learning, Electrical/Computer Engineering, or a related field, with specialization in NLP, speech, or deep learning; or equivalent industry experience delivering production conversational AI systems.
Qualification
5+ years of experience in ML/AIStrong applied experience with LLMsDisambiguation and repairPractical embedded development workflow
Required
LLM and retrieval foundation — the baseline for this role
5+ years of experience in ML/AI, with a strong focus on NLP, LLMs, or conversational AI.
Strong applied experience with LLMs: prompting, structured output, tool and function calling, evaluation, and retrieval-augmented generation (RAG) – together with the judgment to recognize when a model should not be used at all.
Solid command of embeddings and semantic similarity (e.g., cosine similarity, centroid versus maximum-similarity strategies, threshold tuning, and out-of-domain detection).
Strong Python with the ability to write clean, tested, reviewable code. Fluent with pytest, and Git and has CI discipline.
Edge dialog systems engineering — what this role additionally requires
Strong experience building edge conversational systems, including multi-turn dialog/state management and efficient intent/NLU pipelines using local-first, cheap-to-expensive inference strategies.
Disambiguation and repair: resolving ambiguous intent and noisy spoken references, and asking a clarifying question or re-prompting rather than committing to a confident wrong answer.
Comfort placing deterministic guardrails around a probabilistic model, including safety floors, confirmation gating, and negation handling, and experience with state-machine or workflow engines covering branching, variable capture, and resumability.
Experience running models on constrained hardware such as NPUs, mobile, or embedded targets, under real latency, memory budgets. This includes ONNX and onnxruntime, model quantization, and cross-architecture packaging for aarch64.
Practical embedded development workflow: Linux, Docker, adb, systemd services, and the ability to diagnose problems from device logs.
The ability to take ownership of an existing, non-trivial codebase and keep it healthy.
