Senior Software Engineer - GPU Kernel Authoring & Optimization

<div class="content-intro"><div> <div> <div class="gmail_quote"> <div> <div><span id="m_1770241969069985273m_-2746164444908759431gmail-docs-internal-guid-131e4fb0-7fff-b4e9-ff50-e8cf32449b1b">CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at <a href="http://www.coreweave.com/" target="_blank" data-saferedirecturl="https://www.google.com/url?q=http://www.coreweave.com&source=gmail&ust=1762613132717000&usg=AOvVaw3D-UOhNaqEvF5BEWxjYyAU">www.coreweave.com</a>.</span></div> </div> </div> </div> </div></div><h3 class="font-claude-response-body break-words whitespace-normal"><strong>About the role:</strong></h3> <p class="font-claude-response-body break-words whitespace-normal">CoreWeave is the top-rated AI-cloud for high-performance GPU infrastructure across AI/ML, visual effects, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost-efficiency—an unmatched alternative to traditional hyperscalers. At CoreWeave, infrastructure is the product.</p> <p class="font-claude-response-body break-words whitespace-normal">We're looking for a Senior Engineer for CoreWeave's Benchmarking & Performance team, focused on kernel authoring and optimization. You will write, profile, and tune the GPU kernels that sit on the critical path of large-scale model serving—squeezing maximum throughput and minimum latency out of every SM, tensor core, and byte of memory bandwidth. You will also aid us in achieving industry-leading end-to-end performance benchmarking publications such as MLPerf.</p> <p class="font-claude-response-body break-words whitespace-normal">You will be an owner who leads designs, raises engineering standards, and delivers measurable improvements to latency, throughput, and reliability across our inference stack. You'll partner with product, orchestration, and hardware teams to turn kernel-level wins into end-to-end gains and meet strict P99 SLAs at scale.</p> <ul class="[li_&]:mb-0 [li_&]:mt-1 [li_&]:gap-1 [&:not(:last-child)_ul]:pb-1 [&:not(:last-child)_ol]:pb-1 list-disc flex flex-col gap-1 pl-8 mb-3"> <li class="font-claude-response-body whitespace-normal break-words pl-2">Author, profile, and optimize CUDA kernels—GEMMs, attention, MoE routing, quantization, KV-cache, and fused epilogues—on the critical path of LLM inference.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Optimize for the hardware: exploit tensor cores and tune occupancy, memory coalescing, shared-memory/register usage, and overlap of compute with data movement.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Use kernel-authoring DSLs and compilers to prototype and ship kernels quickly without sacrificing performance.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Benchmark rigorously: build reproducible microbenchmarks and roofline analyses, and validate that kernel-level wins translate to end-to-end latency/throughput gains across model-serving stacks (vLLM, TensorRT-LLM, llm-d, SGLang).</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Implement and maintain benchmarking workflows for end-to-end MLPerf Inference (and Training) runs, including workload setup, cluster configuration, runbooks, and result validation.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Lead design reviews and drive architecture within the team; decompose multi-service work into clear milestones.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Mentor junior engineers; review cross-team designs and elevate coding/testing standards.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Help ensure reproducible, well-documented benchmarking and kernel-optimization processes.</li> </ul> <h3 class="font-claude-response-body break-words whitespace-normal"><strong>Who You Are:</strong></h3> <ul class="[li_&]:mb-0 [li_&]:mt-1 [li_&]:gap-1 [&:not(:last-child)_ul]:pb-1 [&:not(:last-child)_ol]:pb-1 list-disc flex flex-col gap-1 pl-8 mb-3"> <li class="font-claude-response-body whitespace-normal break-words pl-2">5+ years of experience building high-performance computing, GPU/accelerator software, or performance-critical systems.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Hands-on CUDA experience is required—you have written and optimized custom kernels and are fluent with the CUDA programming and memory model.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Deep understanding of GPU architecture and performance: tensor cores, warp/occupancy tuning, the memory hierarchy and bandwidth, NVLink/PCIe, and profiling with Nsight Compute/Systems.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Strong coding in C++ and Python; comfortable reading and writing low-level, performance-sensitive code.</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Familiarity with model-serving stacks (vLLM, TensorRT-LLM, llm-d, SGLang) and the kernels that dominate their inference