<div class="content-intro"><p class="p1">Figure is an AI robotics company developing autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in the home and commercial markets. Figure is headquartered in San Jose, CA.</p></div><p>We are looking for a Reinforcement Learning Engineer to develop, train, deploy, and evaluate advanced reinforcement learning algorithms for whole body control of our humanoid robot.</p> <p><strong>Responsibilities:</strong></p> <ul> <li> <p>Develop, train, and deploy reinforcement learning algorithms for whole body control.</p> </li> <li> <p>Determine the observations, actions, and model types that unlock maximum performance.</p> </li> <li> <p>Identify and close the most important sim-to-real gaps.</p> </li> <li> <p>Define, test, and evaluate performance metrics for learned policies.</p> </li> <li> <p>Harden the control stack to ensure rock solid robustness.</p> </li> </ul> <p><strong>Requirements:</strong></p> <ul> <li> <p>Strong background in dynamics and control, ideally of legged robots.</p> </li> <li> <p>Experience with reinforcement learning algorithms for robotics: PPO, SAC, etc.</p> </li> <li> <p>Experience tuning hyperparameters and cost functions for these RL algorithms.</p> </li> <li> <p>Familiarity with common RL techniques such as: domain randomization, curriculum learning, reward shaping, etc.</p> </li> <li> <p>Capable of leading complex controls projects and mentoring junior engineers.</p> </li> </ul> <p><strong>Bonus Qualifications:</strong></p> <ul> <li>Experience with behavior cloning techniques (e.g. distillation).</li> </ul> <p>The US base salary range for this full-time position is $150,000 to $350,000 per year.</p> <p>The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended. </p>