Site Reliability Engineer, AI Observability

Required

• Hands-on experience with Kubernetes on AWS (managed EKS), with routine work done through Helm values and Argo CD applications.
• Hands-on experience running ClickHouse in production, including replication and Keeper quorum, shard and replica topology, and backup and restore, ideally run through an operator.
• Experience building monitoring and alerting from scratch, including service levels that reflect what users actually experience rather than what is easy to measure.
• Experience upgrading self-hosted software safely, including schema migrations, rehearsal in a lower environment and a rollback plan for a partly completed migration.
• PostgreSQL and Redis operations deep enough to debug metadata-store and queue problems, including backpressure and worker drain.
• Strong operational writing: runbooks, SOPs and post-incident reviews that a colleague can follow unaided during an incident.
• You don’t trust a backup until you’ve restored from it
• You want to find problems before users do
• You write runbooks for the person on call at 3am, not for yourself
• You stay calm in incidents and focus on fixing the process afterward
• You automate anything you have to do twice
• You work well inside a client team and build trust quickly