Senior Product Manager - Inference Platform

nebius · Remote - United States · United States

<div class="content-intro">About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI. Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.</div>  <h3>The role </h3> We’re building Nebius Token Factory, an AI inference platform for high-performance, cost-efficient workloads at scale, serving both developers and managed enterprise customers. As a Senior/Principal Product Manager, Inference Platform, you’ll join a team of PMs under the Inference Platform lead and own a core platform stream end to end, from strategy and roadmap to launch and adoption. The scope evolves quickly with the market (new models, modalities, hardware and customer needs), with a strong emphasis on scalability and reliability. You are welcome to work remotely from the US.   Your responsibilities will include:  <ul class="ak-ul" data-local-id="85fb6cfc-039b-4e50-a5a3-76f2583ffc04" data-indent-level="1"> <li> Own the roadmap and outcomes for a part of the inference platform, aligning several cross-functional engineering teams across public API, routing, performance, reliability and enterprise enablement features. </li> <li> Work with engineering and research to make inference more scalable, reliable and cost-efficient, and turn that into capabilities customers can depend on. </li> <li> Stay close to customers through research, interviews and hands-on PoCs, especially in managed enterprise. </li> <li> Track the market: open-source models, inference economics, and how businesses actually apply AI. Turn what you see into product bets. </li> </ul>   We expect you to have:  <ul> <li> Experience shipping technical platform products, with the seniority to lead work across multiple engineering teams. </li> <li> Real technical depth in how AI inference works, including model serving, distributed systems and production infrastructure. You think problems through yourself rather than relying on engineers to define them. </li> <li> Strong communication and expectations management across engineering, research, sales, support and leadership. You write crisp PRDs, RFCs and release notes. </li> <li> B2B/enterprise experience with technical buyers. </li> <li> Comfort with ambiguity and shifting scope </li> </ul>   It will be an added bonus if you have:  <ul> <li>Post-training experience, including training draft models.</li> <li>Experience with third-party technical partnerships.</li> </ul>   Key employee benefits in the US: <ul> <li>Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families.</li> <li>401(k) plan: Up to 4% company match with immediate vesting.</li> <li>Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.</li> <li>Remote work reimbursement: Up to $85/month for mobile and

Let Nod apply for you →

More jobs at nebius

Federal Affairs Leader — nebius Engineering Manager/Network Team Lead — nebius Manager, ML Solutions Architecture - Token Factory — nebius Project Development Manager- Data Centers, EMEA — nebius Data Center IT Technician - Masmiya — nebius Payroll Systems Specialist — nebius