<div class="content-intro"><p>ABOUT DEFCON AI</p> <p>RESILIENCE IN THE FACE OF DISRUPTION. DEFCON AI is an insights company that leverages artificial intelligence, mathematical optimization, data analytics, and software engineering for resilient optimization of complex systems.<br>In today’s dynamically changing world, DEFCON AI’s technology aligns outcomes with operational goals, better decision making, and empowers customers to anticipate assess, and mitigate the impacts of disruptions.</p></div><p><em><span data-contrast="auto">Be the independent voice that keeps the whole program honest — your evaluation is the standard everyone else is held to.</span></em><span data-ccp-props="{"335559739":200}"> </span></p> <p><strong><span data-contrast="none"><span data-ccp-parastyle="heading 2">About the Role</span></span></strong><span data-ccp-props="{"335559738":260,"335559739":120}"> </span></p> <p><span data-contrast="auto"><span data-ccp-parastyle="heading 2">You'll join the analytics and AI engineering team behind a system that genuinely matters: an AI-assisted platform that brings together records from dozens of disparate data sources, resolves them to the correct individual, highlights what analysts should review first, and provides transparent, explainable recommendations that users can trust. Operating within a secure government cloud environment, the platform tackles complex challenges in AI, data integration, and decision support where quality, trust, and accountability are </span><span data-ccp-parastyle="heading 2">mission-critical</span><span data-ccp-parastyle="heading 2">.</span></span><span data-ccp-props="{"335559738":260,"335559739":120}"> </span></p> <p><span data-contrast="auto"><span data-ccp-parastyle="heading 2">As a Model Test & Measurement Engineer, </span><span data-ccp-parastyle="heading 2">you'll</span><span data-ccp-parastyle="heading 2"> own the evaluation framework that helps ensure those systems perform as intended. </span><span data-ccp-parastyle="heading 2">You'll</span><span data-ccp-parastyle="heading 2"> build and </span><span data-ccp-parastyle="heading 2">maintain</span><span data-ccp-parastyle="heading 2"> labeled ground truth datasets, design statistically sound audit and sampling methodologies, measure model performance across releases, and create the evidence packages that support deployment decisions. </span><span data-ccp-parastyle="heading 2">You'll</span><span data-ccp-parastyle="heading 2"> independently </span><span data-ccp-parastyle="heading 2">validate</span><span data-ccp-parastyle="heading 2"> both scoring and generative AI capabilities, helping the team understand not only whether a model works, but how confidently its outputs can be trusted.</span></span><span data-ccp-props="{"335559738":260,"335559739":120}"> </span></p> <p><span data-contrast="none"><span data-ccp-parastyle="heading 2">This is a role with genuine influence. Your assessments will inform release decisions, drive improvement efforts, and provide the objective evidence customers rely on when evaluating system performance. </span><span data-ccp-parastyle="heading 2">You'll</span><span data-ccp-parastyle="heading 2"> work closely with data scientists, AI engineers, and technical leadership while </span><span data-ccp-parastyle="heading 2">maintaining</span><span data-ccp-parastyle="heading 2"> the independence needed to provide clear, defensible evaluations. </span><span data-ccp-parastyle="heading 2">You do not build the models you validate, and you do not approve thresholds or release authorization against your own evidence.</span></span><span data-ccp-props="{"335559738":260,"335559739":120}"> </span></p> <p><span data-contrast="auto"><span data-ccp-parastyle="heading 2">If </span><span data-ccp-parastyle="heading 2">you're</span><span data-ccp-parastyle="heading 2"> energized by measurement, validation, and making complex AI systems more trustworthy, this is an opportunity to have an outsized impact on both the technology and the mission it supports.</span></span><span data-ccp-props="{"335559738":260,"335559739":120}"> </span></p> <p><span data-contrast="auto"><span data-ccp-parastyle="heading 2">This is a fully remote role with occasional travel to DEFCON AI headquarters, customer sites, and partner facilities as needed.</span></span><span data-ccp-props="{"335559738":260,"335559739":120}"> </span></p> <p><strong><span data-contrast="none"><span data-ccp-parastyle="heading 2">Key Responsibilities</span></span></strong><span data-ccp-props="{"335559738":260,"335559739":120}"> </span></p> <ul> <li data-leveltext="●" data-font="" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769242":[8226],"469777803":"left","469777804":"●","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="auto">Construct labeled ground truth for model evaluation</span><span data-ccp-props="{"335559739":100}"> </span></li> </ul> <ul> <li data-leveltext="●" data-font="" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769242":[8226],"469777803":"left","469777804":"●","469777815":"hybridMultilevel"}" data-aria