Google
Principal Data Scientist, Gemini Core Modeling and Evaluations
Google, Mountain View, California, us, 94039
Minimum qualifications:
Bachelor's degree in Machine Learning, Data Science, Information Management, Computer Science, or other Engineering discipline, or equivalent practical experience.15 years of experience in data science or other quantitative fields such as: statistics, machine learning, software engineering, or ML engineering.Experience working on algorithmic products, production machine learning systems, and defining model evaluation metrics.Experience in using data insights to drive product excellence.
Preferred qualifications:
Experience developing high-growth technology products and services.Ability to influence without direct authority, working on and with technical and cross-functional or highly matrixed teams who do not report into this role.Ability to turn ambiguous problem spaces into clear solutions, and comfortable with new technology and thinking outside the box to develop and implement short- and long-term creative solutions.Ability to work well cross-functionally, and manage organizational complexities and competing priorities.Excellent project/product management and technical architecture skills, and the ability to deliver projects on time.Excellent strategic thinking, data science, and analytical skills.About the job
As a Principal Data Scientist, you will be a deeply technical and strategic data science leader for Gemini Core Modeling and Evaluations. You (along with a small team of data scientists) will be responsible for defining the model evaluation criteria, influencing the supervised fine tuning data and evaluation prompt sets, identifying valuable signals for reinforcement learning human feedback, and improving human rater efficiencies.Responsibilities
Develop deep product and user analytics that will help to drive quality and design directions, such as identifying signals that are predictive of user engagement or analyzing Gemini use cases (e.g., coding, fact finding, or creativity and summarization). Develop insights around trends and drive model improvements that help achieve goals.Drive forward the science of measuring Gemini, ensuring that our quality, factuality, and safety model evaluation metrics are indicative of the end-user experience, and help guide launch decisions for Gemini.Manage experimentation and comparative evaluation, including the science, methodologies, tools, and measurement approaches to accelerate Gemini experimentation and innovation.Guide the model's human evaluation process, including analyzing rater performance, influencing rater templates, updating training, and evolving our approach to ensure precise and accurate evaluations.
#J-18808-Ljbffr
Bachelor's degree in Machine Learning, Data Science, Information Management, Computer Science, or other Engineering discipline, or equivalent practical experience.15 years of experience in data science or other quantitative fields such as: statistics, machine learning, software engineering, or ML engineering.Experience working on algorithmic products, production machine learning systems, and defining model evaluation metrics.Experience in using data insights to drive product excellence.
Preferred qualifications:
Experience developing high-growth technology products and services.Ability to influence without direct authority, working on and with technical and cross-functional or highly matrixed teams who do not report into this role.Ability to turn ambiguous problem spaces into clear solutions, and comfortable with new technology and thinking outside the box to develop and implement short- and long-term creative solutions.Ability to work well cross-functionally, and manage organizational complexities and competing priorities.Excellent project/product management and technical architecture skills, and the ability to deliver projects on time.Excellent strategic thinking, data science, and analytical skills.About the job
As a Principal Data Scientist, you will be a deeply technical and strategic data science leader for Gemini Core Modeling and Evaluations. You (along with a small team of data scientists) will be responsible for defining the model evaluation criteria, influencing the supervised fine tuning data and evaluation prompt sets, identifying valuable signals for reinforcement learning human feedback, and improving human rater efficiencies.Responsibilities
Develop deep product and user analytics that will help to drive quality and design directions, such as identifying signals that are predictive of user engagement or analyzing Gemini use cases (e.g., coding, fact finding, or creativity and summarization). Develop insights around trends and drive model improvements that help achieve goals.Drive forward the science of measuring Gemini, ensuring that our quality, factuality, and safety model evaluation metrics are indicative of the end-user experience, and help guide launch decisions for Gemini.Manage experimentation and comparative evaluation, including the science, methodologies, tools, and measurement approaches to accelerate Gemini experimentation and innovation.Guide the model's human evaluation process, including analyzing rater performance, influencing rater templates, updating training, and evolving our approach to ensure precise and accurate evaluations.
#J-18808-Ljbffr