OpenAI
Data Scientist, Safety Systems
OpenAI, San Francisco, California, United States, 94199
About the Team
The Safety Systems team is dedicated to ensuring the safety, robustness, and reliability of AI models and their deployment in the real world.
Building on the many years of our practical alignment work and applied safety efforts, Safety Systems addresses emerging safety issues and develops new fundamental solutions to enable the safe deployment of our most advanced models and future AGI, to make AI that is beneficial and trustworthy.
Learn more about OpenAI's approach to safety
About the Role
As a Data Scientist in Safety Systems, you will establish the data-driven approach for understanding, evaluating, and monitoring the safety of our production systems. You should expect to collaborate with our partners across the company to define north-star metrics, own and implement the statistical methods to productionize those metrics, conduct analysis to understand the impact of our products, and establish source-of-truth dashboards that the entire company can use to answer safety-related questions. Most importantly, you will be a core member of the Safety Systems team, collaborating with researchers and engineers to advance our goals of safe, robust, and reliable AI.
This role is based in our San Francisco HQ. We offer relocation assistance to new employees.
In this role, you will:Lead our efforts in understanding and measuring the real-world safety impacts of OpenAI's current and upcoming productsUncovering new ways to improve our approaches to measuring and mitigating harm and abuseDevelop and implement statistical methods necessary to operationalize safety-related metricsProvide direction, guidance, and coordination of projects in the spaceEstablish a data-driven culture within Safety Systems by driving the definition, tracking, and operationalizing of feature-, product-, and company-level metricsCreate and disseminate dashboards, reports, and tools that enable the team and company to answer safety-related questions independentlyDevelop safety data flywheel and provide safety research with production insights/data for training and evaluation.You might thrive in this role if you have:
5+ years experience in a quantitative role navigating highly ambiguous environments, ideally as a founding data scientist or team lead at a hyper-growth product company or research orgProven leadership skills, including leading multiple data scientists and cross-functional teamsExpertise in defining and implementing metrics, with a track record of operationalizing new feature and product-level metrics from scratchExcellent communication skills with demonstrated ability to communicate with product managers, engineers, and executives alikeStrategic insights that extend beyond traditional statistical significance testing.You could be an especially great fit if you have:
Experience in trust and safety, integrity, anti-abuse, or related fieldsDemonstrated prior experience in NLP, large language models, or generative AIStrong statistical background, including knowledge of sampling, regression, causal analysis, and more
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.
OpenAI Affirmative Action and Equal Employment Opportunity Policy Statement
For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
The Safety Systems team is dedicated to ensuring the safety, robustness, and reliability of AI models and their deployment in the real world.
Building on the many years of our practical alignment work and applied safety efforts, Safety Systems addresses emerging safety issues and develops new fundamental solutions to enable the safe deployment of our most advanced models and future AGI, to make AI that is beneficial and trustworthy.
Learn more about OpenAI's approach to safety
About the Role
As a Data Scientist in Safety Systems, you will establish the data-driven approach for understanding, evaluating, and monitoring the safety of our production systems. You should expect to collaborate with our partners across the company to define north-star metrics, own and implement the statistical methods to productionize those metrics, conduct analysis to understand the impact of our products, and establish source-of-truth dashboards that the entire company can use to answer safety-related questions. Most importantly, you will be a core member of the Safety Systems team, collaborating with researchers and engineers to advance our goals of safe, robust, and reliable AI.
This role is based in our San Francisco HQ. We offer relocation assistance to new employees.
In this role, you will:Lead our efforts in understanding and measuring the real-world safety impacts of OpenAI's current and upcoming productsUncovering new ways to improve our approaches to measuring and mitigating harm and abuseDevelop and implement statistical methods necessary to operationalize safety-related metricsProvide direction, guidance, and coordination of projects in the spaceEstablish a data-driven culture within Safety Systems by driving the definition, tracking, and operationalizing of feature-, product-, and company-level metricsCreate and disseminate dashboards, reports, and tools that enable the team and company to answer safety-related questions independentlyDevelop safety data flywheel and provide safety research with production insights/data for training and evaluation.You might thrive in this role if you have:
5+ years experience in a quantitative role navigating highly ambiguous environments, ideally as a founding data scientist or team lead at a hyper-growth product company or research orgProven leadership skills, including leading multiple data scientists and cross-functional teamsExpertise in defining and implementing metrics, with a track record of operationalizing new feature and product-level metrics from scratchExcellent communication skills with demonstrated ability to communicate with product managers, engineers, and executives alikeStrategic insights that extend beyond traditional statistical significance testing.You could be an especially great fit if you have:
Experience in trust and safety, integrity, anti-abuse, or related fieldsDemonstrated prior experience in NLP, large language models, or generative AIStrong statistical background, including knowledge of sampling, regression, causal analysis, and more
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.
OpenAI Affirmative Action and Equal Employment Opportunity Policy Statement
For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.