View All Jobs 1340
Research Engineer, Human Data
Design and execute evaluations to assess AI model capabilities and safety.
San Francisco, California, United States
Mid-Level
$295,000 - 360,000 USD / year
1 month ago
✨ About The Role
- The research engineer will design, execute, and analyze evaluations of advanced AI models to assess their capabilities and safety.
- The role involves writing clean non-ML code to build interfaces for trainers to interact with models and manage human data.
- Collaboration with a small team is necessary to balance flexibility and iteration speed with project stability and reliability.
- The engineer will curate large datasets of prompts and investigate coverage of boundary cases.
- Measuring the effectiveness of evaluation techniques and building infrastructure to support evaluations will be key responsibilities.
- The position is based in San Francisco, CA, with a hybrid work model of three days in the office per week.
âš¡ Requirements
- The ideal candidate will have a strong background in machine learning engineering and research experience.
- A deep understanding of Human-Machine Interaction challenges, particularly with advanced AI models, is essential.
- The candidate should be proficient in Python and familiar with frontend technologies such as JavaScript or TypeScript.
- They should be able to operate effectively in a fast-paced research environment and manage projects from start to finish.
- A bachelor's degree in computer science, AI, machine learning, or a related field is required.
- The candidate should be goal-oriented and willing to engage in tedious but valuable work when necessary.
- A strong motivation aligned with OpenAI's mission of building safe and beneficial AGI is crucial.
Research Engineer, Human Data
San Francisco, California, United States
$295,000 - 360,000 USD / year
Engineering
About OpenAI
Building artificial general intelligence