Platform Reliability Engineer

New Yorkfull time

On Site

mid

H1B: no

Appnovation Platform Reliability Engineer at Appnovation builds observability and reliability features for an internal agent platform on AWS Bedrock AgentCore. Responsibilities include instrumentation, observability integration, tracing, SLOs, alerting, cost monitoring, and incident readiness.

Responsibilities

ROLE RESPONSIBILITIES
Instrumentation: Build OpenTelemetry instrumentation standards for agents, tools and platform services, and make it easy for teams to adopt.
Observability Integration: Connect AgentCore Observability and CloudWatch with the client’s existing observability tools (e.g., Datadog, Splunk, Grafana).
Tracing: Set up end-to-end tracing across agent steps, model calls, tool calls and multi-agent handoffs so issues can be traced to their source.
SLOs and Alerting: Define SLOs for latency, availability and error rates, and build alerting that is useful and not noisy.
Cost Monitoring: Track token usage and compute spend by team, agent and environment, with dashboards, budgets and alerts for unexpected spikes.
Incident Readiness: Write runbooks, support incident response and run post-incident reviews that lead to real fixes.

Qualification

6+ years in SREExperience defining and running SLOsScripting and coding skills in PythonYou treat cost as a reliability concernExperience in pharma

Required

6+ years in SRE, platform reliability or observability engineering, with strong hands-on AWS experience.
Hands-on experience with OpenTelemetry (SDKs, collectors, exporters) and distributed tracing.
Experience with Amazon CloudWatch and at least one enterprise observability platform (Datadog, Splunk, Grafana, New Relic or similar).
Experience defining and running SLOs, error budgets and alerting strategies.
Experience building cost visibility and FinOps reporting on AWS (Cost Explorer, CUR, tagging strategies).
Scripting and coding skills in Python, Go or TypeScript.
Clear communication and able to turn data into decisions for technical and non-technical audiences.
You want to know what’s happening in a system before a user tells you
You build alerts people trust and dashboards people actually open
You treat cost as a reliability concern, not an afterthought
You stay calm in incidents and focus on learning afterward
You work well inside a client team and build trust quickly

Preferred

Experience monitoring LLM or agent-based applications, including token usage, latency and quality signals.
Familiarity with LLM observability tools (e.g., Langfuse, Arize, LangSmith) or AgentCore Observability.
Experience with infrastructure as code (Terraform or AWS CDK) for monitoring resources.
Experience in pharma, life sciences or another regulated industry.

Benefits

Equity/RSU

Company

Appnovation

View company page

Source: greenhouse

Active within the past hour

More roles at Appnovation

Senior Developer (Python)

Remote

Senior Product Owner, Adobe Experience Manager (AEM)

New York

Senior Web Technical Product Manager

New York

Web Platforms Engineer

New York

Apply on Employer Site