Nod CareersAuto-apply free

AI Engineer II

klaviyo · Boston, MA · Boston, Massachusetts, United States
Auto-apply to this job with Nod →
<div class="content-intro"><p><em>At Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every day. We believe everyone deserves a fair shot at success and appreciate the experiences each person brings beyond the traditional job requirements. If you’re a close but not exact match with the description, we hope you’ll still consider applying. Want to learn more about life at Klaviyo? Visit <a class="_ymio1r31 _ypr0glyw _zcxs1o36 _mizu194a _1ah3dkaa _ra3xnqa1 _128mdkaa _1cvmnqa1 _4davt94y _4bfu18uv _1hms8stv _ajmmnqa1 _vchhusvi _kqswh2mm _ect4ttxp _syaz13af _1a3b18uv _4fpr8stv _5goinqa1 _f8pj13af _9oik18uv _1bnxglyw _jf4cnqa1 _30l313af _1nrm18uv _c2waglyw _1iohnqa1 _9h8h12zz _10531ra0 _1ien1ra0 _n0fx1ra0 _1vhv17z1" href="http://klaviyo.com/careers" data-renderer-mark="true">klaviyo.com/careers</a> to see how we empower creators to own their own destiny.</em></p></div><h1>AI Engineer, Customer Agent</h1> <h2>About the Role</h2> <p>At Klaviyo, we believe the future of software lies not only in tools that help people work more efficiently, but in intelligent systems that can take action, learn from outcomes, and improve customer experiences over time.</p> <p>Klaviyo serves more than 167,000 customers and processes billions of consumer profiles, messages, interactions, and conversion signals. This creates a unique opportunity to build state-of-the-art AI systems that help businesses create and execute better customer experiences at scale.</p> <p>We’re looking for an <strong>AI Engineer</strong> to join the Customer Agent team, Klaviyo’s AI-native conversational platform. You’ll help build scalable backend systems and AI-powered product experiences that enable agents to retrieve context, use tools, and take reliable action on behalf of customers.</p> <p>This is a <strong>backend-heavy role with opportunities to contribute to user-facing experiences</strong>. You’ll independently own meaningful pieces of larger systems, contribute to technical decisions, and continue developing your depth across backend engineering, applied AI, and production reliability.</p> <h2>How You Will Make a Difference</h2> <ul> <li>Build and improve reliable backend systems and APIs that power AI-driven customer experiences.</li> <li>Develop production agentic features involving tool use, context management, retrieval, structured outputs, orchestration, and multi-step workflows.</li> <li>Contribute to solving applied AI problems across retrieval and RAG, grounding, hallucination mitigation, model selection, and choosing between LLM-based, deterministic, or hybrid approaches.</li> <li>Build and use evaluation approaches including representative datasets, automated and human evaluation, regression testing, qualitative error analysis, and production signals.</li> <li>Improve system reliability through guardrails, retries, fallbacks, observability, monitoring, and thoughtful failure handling.</li> <li>Build asynchronous and distributed processing workflows that support AI workloads at scale.</li> <li>Participate in an on-call rotation and help diagnose, mitigate, and learn from production incidents.</li> <li>Work with external customers and cross-functional partners to understand workflows, identify pain points, and translate feedback into product improvements.</li> <li>Monitor shipped experiences and use quality metrics, system performance, and customer feedback to guide iteration.</li> </ul> <h2>Who You Are</h2> <ul> <li>You have <strong>3+ years of professional software engineering experience</strong>, with experience building backend systems or distributed applications.</li> <li>You have hands-on experience building or contributing to <strong>generative AI or agentic AI applications</strong>, ideally used by real users or in production environments.</li> <li>You are proficient in <strong>Python</strong> and have experience with modern backend frameworks such as FastAPI or Django.</li> <li>You have experience with asynchronous processing or distributed task/event systems such as Celery, Kafka, SQS, RabbitMQ, or Redis.</li> <li>You have working knowledge of databases, data modeling, APIs, and persistence patterns used in production systems.</li> <li>You are comfortable working in cloud environments and have experience with technologies such as AWS, containers, Kubernetes, infrastructure automation, or CI/CD systems.</li> <li>You can reason about tradeoffs among quality, latency, cost, reliability, and implementation complexity, and know when to seek additional technical context.</li> <li>You are comfortable working through ambiguity, breaking larger problems into smaller pieces, and making progress without every requirement being fully specified.</li> <li>You have experience with, or strong interest in, <strong>working directly with external customers</strong> to understand problems and improve products.</li> <li>You care about shipping useful, reliable products and are motivated to deepen your engineering judgment in a rapidly evolving technical space.</li> </ul> <h2>Nice to Have</h2> <ul> <li>Experience training, fine-tuning, distilling, or otherwise adapting machine learning or language models.</li> <li>Experience with reinforcement learning or feedback-driven optimization.</li> <li>Experience with evaluation infrastructure such as LLM-as-judge systems, evaluator calibration, benchmark datasets, or AI quality tooling

Let Nod apply for you →

More jobs at klaviyo

Large Enterprise Sales Manager — klaviyoLarge Enterprise Sales Manager — klaviyoLarge Enterprise Sales Manager — klaviyoSenior Security Engineer - Detection and Response — klaviyoFull Stack Software Engineer - People Systems — klaviyoLead, Global Services Strategy & Operations — klaviyo