Nod CareersAuto-apply free

Senior Data Platform Engineer

komodohealth · San Francisco, CA · USA
Auto-apply to this job with Nod →
<div class="content-intro"><p><strong>We Breathe Life Into Data</strong></p> <p><span style="font-weight: 400;">At Komodo Health, our mission is to reduce the global burden of disease. And we believe that smarter use of data is essential to this mission. That’s why we built the <a href="https://www.komodohealth.com/technology/healthcare-map?hsLang=en" target="_blank">Healthcare Map</a> — the industry’s largest, most complete, precise view of the U.S. healthcare system — by combining de-identified, real-world patient data with innovative algorithms and decades of clinical experience. The Healthcare Map serves as our foundation for a powerful suite of software applications, helping us answer healthcare’s most complex questions for our partners. Across the healthcare ecosystem, we’re helping our clients unlock critical insights to track detailed patient behaviors and treatment patterns, identify gaps in care, address unmet patient needs, and reduce the global burden of disease. </span></p> <p><span style="font-weight: 400;">As we pursue these goals, it remains essential to us that we stay grounded in our values: be awesome, seek growth, deliver “wow,” and enjoy the ride. At Komodo, you will be joining a team of ambitious, supportive Dragons with diverse backgrounds but a shared passion to deliver on our mission to reduce the burden of disease — and enjoy the journey along the way. </span></p></div><p><strong>The Opportunity at Komodo Health</strong></p> <p>Join Komodo Health’s Data Foundations team and play a critical role in shaping the core data products that fuel our Healthcare Map. You’ll transform massive, complex healthcare datasets into performant, trustworthy data assets that power customer-facing products, internal innovation, and AI/ML use cases. By building and scaling our foundational data systems, you’ll directly enable the transparency and efficiency required to drive better health outcomes across the industry.</p> <p><strong>Mission</strong></p> <p>The Senior Data Platform Engineer will design, build, operate, and improve the large-scale pipelines and foundational data platform behind Komodo’s Healthcare Map. This is a hands-on engineering role focused on processing complex healthcare data at scale, improving reliability and performance, and contributing to the technical direction of core data systems.</p> <p><strong>Looking back on your first 12 months at Komodo Health, you will have…</strong></p> <ul> <li><strong>Architectural Advancement:</strong> Delivered high-impact technical initiatives that improve pipeline performance, scalability, and system efficiency.</li> <li><strong>Platform Hardening:</strong> Improved the reliability, observability, and cost-efficiency of core Data Foundations systems.</li> <li><strong>Healthcare Data Innovation:</strong> Built deep domain expertise and contributed new approaches to challenges such as patient journey mapping and identity resolution.</li> <li><strong>Cross-Functional Delivery:</strong> Partnered with Data Product and Engineering teams to ship scalable, production-grade data solutions.</li> <li><strong>Architecture Partnership: </strong>Raised the bar across the team through mentorship, design reviews, and engineering best practices.</li> </ul> <p><strong>Key Responsibilities</strong></p> <ul> <li>Build, operate, and optimize large-scale batch pipelines using Python, SQL, Spark, and Airflow on AWS</li> <li>Make storage and data layout decisions (table formats, partitioning, file sizing, compaction) that keep large datasets fast to query and cost-efficient</li> <li>Ingest data from many external sources and keep pipelines correct through frequent schema changes</li> <li>Transform healthcare claims, EHR, and reference data into trusted, serving-ready data products for customers and internal teams</li> <li>Strengthen reliability through data quality checks, validation, lineage, observability, and alerting</li> <li>Debug complex data, system, and performance issues across compute-heavy workflows</li> <li>Contribute to system design, code quality, testing, documentation, CI/CD, and rotational production support</li> </ul> <p><strong>What you bring to Komodo Health:</strong></p> <ul> <li>Strong hands-on experience building, owning, and debugging production data pipelines at multi-terabyte scale</li> <li>Advanced Python, including performant, memory-efficient code for large-scale data processing, plus strong SQL</li> <li>Deep production experience with Airflow, including operating and scaling it, not just writing DAGs</li> <li>A solid understanding of how data is physically stored: columnar vs. row formats, and open table formats like Iceberg, Delta Lake, or Hudi (updates, compaction, small files, partitioning)</li> <li>Experience with Spark or a comparable distributed processing framework</li> <li>Proven experience designing and operating data systems in AWS</li> <li>Strong instincts for data correctness, root-cause analysis, and production troubleshooting</li> <li>The ability to communicate technical trade-offs clearly with engineering, product, and data partners</li> <li>Comfort using AI-assisted engineering tools for coding, debugging, documentation, and technical exploration</li> </ul> <p data-section-id="1emn294" data-start="4785" data-end="4825"><strong>AI-Augmented Engineering Expectations:</strong></p> <ul> &lt

Let Nod apply for you →

More jobs at komodohealth

Senior Infrastructure Engineer — komodohealthPrincipal Product Manager, AI Products — komodohealthSupport Specialist — komodohealthIT Analyst (Contract) — komodohealthSenior Product Manager, GTM Systems — komodohealthTechnical Engagement Manager — komodohealth