Grid Dynamics
Data Analyst - Python
Grid Dynamics, San Ramon, CA, United States
Description
Position at Grid Dynamics Responsibilities:- Design, develop, and oversee the implementation of processes and tools to access the quality of data used in LLM model training.
- Study dataset and quality requirements, develop automated metrics to measure/ monitor data quality at scale.
- Evaluate the annotation data for instruction tuning, preference alignment, and model optimization;
- Proficiency with applying quantitative methods to structured & unstructured data for complex data analysis , pattern recognition, insights generation and metrics development.
- Experience with understanding the complexity of user behavior via deep-diving investigations as well as designing, analyzing, and interpreting A/B experiments.
- Strong programming skills in data manipulation &processing (SQL &Python preferred)
- Proven expertise in data wrangling and developing data visualizations & reporting with toolings such as Tableau, AWS etc.
- Strong understanding of Machine learning principles, especially in the context of NLP and LLMs.
- Collaborate with Data Scientists to scrutinize annotation data and develop strategies for continuous data quality improvement.
- Recommend and implement enhancements to our quality processes, tools, and methodologies based on industry best practices.
- 5+ years of design/ test/ implementation/ consulting experience in data quality management for machine learning model training.
- Demonstrated experience in project management and cross – functional collaboration
- Exceptional analytical, problem- solving, and organizational skills.
- Strong verbal and written communication skills with the ability to work effectively across internal and external organization and virtual teams.
- Fluent in another language is a big plus.
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Benefits package - medical insurance
- Professional development opportunities