Nod CareersAuto-apply free

Software Architect - SambaRack

sambanovasystems · Bengaluru, Karnataka, India · Bengaluru, Karnataka, India
Auto-apply to this job with Nod →
<div class="content-intro"><p style="text-align: left;"><span style="font-size: 12pt;">SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customers deploy state-of-the-art models with better performance, greater energy efficiency, and faster time to value.</span></p></div><h3><strong>About the team</strong></h3> <p>Our products include SambaRack, a rack-scale AI infrastructure system, and SambaStack, our inference serving platform. Together, they enable customers to deploy and operate production AI environments with performance, reliability, and control.</p> <p>We are a team of engineers and innovators building next-generation AI infrastructure systems designed for enterprise-scale deployments.</p> <h3><strong>About the role</strong></h3> <p>SambaNova is hiring Software Architects for the SambaRack platform.</p> <p>You will help design and build the software architecture that enables customers to monitor, control, update, and diagnose SambaRack systems safely and reliably.</p> <p>This is a hands-on software development role requiring significant technical expertise in systems and infrastructure, focused on building rack-scale hardware management and infrastructure software that operates in direct contact with hardware across diverse production environments, including customer-managed and air-gapped deployments.</p> <p>As a Software Architect on the SambaRack team, you will:</p> <ul> <li>Design scalable infrastructure services for rack-scale AI systems</li> <li>Define platform architecture and technical direction for infrastructure components</li> <li>Improve observability, telemetry, and diagnostics capabilities</li> <li>Drive software design for infrastructure tightly integrated with hardware systems</li> </ul> <p>This is a high-impact, high-visibility role at the intersection of:</p> <ul> <li>AI infrastructure</li> <li>Distributed systems</li> <li>Hardware-software integration</li> </ul> <h3><strong>Responsibilities</strong></h3> <p>Some of your responsibilities will include:</p> <ul> <li>Own the end-to-end technical architecture of the SambaRack infrastructure and management platform, ensuring it enables safe, reliable control, monitoring, and diagnostics for rack-scale AI systems.</li> <li>Define and drive architectural strategy across engineering teams, aligning long-term platform direction with product and business objectives.</li> <li>Lead design reviews for hardware-software integration points and infrastructure services, providing authoritative guidance on rack-scale system architecture and improving overall system reliability.</li> <li>Proactively identify and resolve systemic risks, including performance bottlenecks, reliability gaps, and scaling constraints, before they impact customers.</li> <li>Establish and evolve architectural standards, patterns, and best practices across the engineering organization.</li> <li>Partner with Hardware Engineering, DevOps, QA, and Product teams to translate infrastructure requirements into sound, robust architectural decisions.</li> <li>Serve as a technical thought leader and mentor, fostering architectural excellence and systems-level thinking within the infrastructure software team.</li> <li>Evaluate emerging technologies and industry trends to inform the platform's technical roadmap.</li> <li>Architect new systems, components, and capabilities to solve new and interesting problems in the AI inference space.</li> </ul> <h3><strong>Required qualifications</strong></h3> <ul> <li>12-15 years of software engineering experience</li> <li>Strong experience architecting infrastructure, systems, or platform software</li> <li>Solid programming experience in Go, Rust, Python, or C/C++</li> <li>Strong understanding of Linux, networking, concurrency, and distributed systems</li> <li>Experience designing reliable backend or control-plane services for production systems</li> <li>Experience with hardware management systems such as BMCs, Redfish, IPMI, or OpenBMC</li> <li>Experience with monitoring, telemetry, or observability systems for infrastructure platforms</li> <li>Excellent problem-solving skills and attention to detail</li> <li>Ability to collaborate across cross-functional teams</li> <li>Knowledge of software development best practices and coding standards</li> </ul> <h3><strong>Preferred qualifications</strong></h3> <ul> <li>Experience with rack management, server management, or bare-metal infrastructure platforms</li> <li>Experience with Prometheus, Grafana, and metrics exporter design</li> <li>Familiarity with fleet management, diagnostics systems, and hardware health monitoring</li> <li>Experience supporting enterprise or air-gapped deployments</li> <li>Solid understanding of Kubernetes, Helm Charts, and Kubernetes ecosystem</li> <li>Experience designing scalable infrastructure and distributed systems</li> <li>Familiarity with t

Let Nod apply for you →

More jobs at sambanovasystems

Rack Level Manufacturing Test Engineer — sambanovasystemsData Center Operations Technician — sambanovasystemsPrincipal Design Verification Engineer — sambanovasystemsSenior Principal Hardware Emulation Engineer — sambanovasystemsSenior Principal Machine Learning Engineer — sambanovasystemsSoftware Architect — sambanovasystems