Amazon
Software Development Engineer, Search Relevance Measurement
Amazon, Indiana, Pennsylvania, us, 15705
Software Development Engineer, Search Relevance Measurement
We are looking for a passionate, hard-working, and talented Software Development Engineer who can build innovative & mission critical system software applications & tools to measure Search Relevance. You will have an enormous opportunity to make a large impact on the design, architecture, and development of Amazon Search Measurement which paves the path for the Search business.Amazon Search Science builds the core machine learning algorithms used by 100’s of millions of customers worldwide to discover products to buy amongst billions of available items at Amazon.com.The Relevance Measurement team builds systems and metrics powered by search and browse attributed user behavioural datasets that are used by search algorithms. This team has a singular mission to improve relevance and search quality for Amazon customers. We will analyze peta bytes of data to enable Amazon Search to measure customer success metrics and identify ways to improve search. We run the Search Defects process to provide training data for defect classifiers, to help matching and ranking experimenters build and evaluate experiments for defect improvements, and to measure customers’ overall defect experience with Amazon Search.As a Software Development Engineer, you will create and maintain large-scale systems that will help us better understand customer behaviour, highlight pain points, and help identify opportunities to improve search for Amazon customers. The main focus will be to design, develop, and implement an array of full stack applications, UX, data pipelines, analytics and debuggability tools that will provide valuable insights into customer feedback and behaviour. The systems you develop will be instrumental in helping the Amazon Search team find and resolve issues and shape our product strategy. You will be interfacing and building infrastructure for machine learning based inference to measure relevance at scale using LLMs.You will be given significant authority and ownership, but also be supported with strong mentors. You will have the opportunity to work on software development using cutting edge big data technologies, while taking products and features from conception to production. You will work closely with a stellar team of engineers, applied scientists, business intelligence engineers, and product managers to ensure Amazon’s data is a powerful and innovative business advantage.A Day in the Life
Oncall for maintenance of Airflow DAGs and EMR jobs which builds Data Cubes for Search metrics and Model Training dataBuild UX for Analytics portal for 100+ customersBuild Services and Library for Sampling, Snapshotting, Labelling and Scoring SearchBuild Services for LLM inference, distillation, Fine tuning and Prompt CachingSolve for Policy Engine Risks and Software RisksGenerate offender clusters and insights for Search debuggabilityBuild tools for debugging Search layerwiseBuild ML applications for time series analysis and hypothesis testing for A/B testing Search algorithmsMinimum Requirements
3+ years of non-internship professional software development experience2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experienceExperience programming with at least one software programming language3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experienceBachelor's degree in computer science or equivalentStrong, object-oriented design and coding skills (C/C++ and/or Java preferably on a UNIX or Linux platform)Knowledge of Python or other scripting languages a plusExperience with distributed (multi-tiered) systems, algorithms, and relational databasesExperience in ML and/or statistics background is preferableExperience in map-reduce, EMR or Spark highly preferredAbility to effectively articulate technical challenges and solutionsDeal well with ambiguous/undefined problems; ability to think abstractlyPrevious technical internship(s) preferredCompetitive Coding experience preferred
#J-18808-Ljbffr
We are looking for a passionate, hard-working, and talented Software Development Engineer who can build innovative & mission critical system software applications & tools to measure Search Relevance. You will have an enormous opportunity to make a large impact on the design, architecture, and development of Amazon Search Measurement which paves the path for the Search business.Amazon Search Science builds the core machine learning algorithms used by 100’s of millions of customers worldwide to discover products to buy amongst billions of available items at Amazon.com.The Relevance Measurement team builds systems and metrics powered by search and browse attributed user behavioural datasets that are used by search algorithms. This team has a singular mission to improve relevance and search quality for Amazon customers. We will analyze peta bytes of data to enable Amazon Search to measure customer success metrics and identify ways to improve search. We run the Search Defects process to provide training data for defect classifiers, to help matching and ranking experimenters build and evaluate experiments for defect improvements, and to measure customers’ overall defect experience with Amazon Search.As a Software Development Engineer, you will create and maintain large-scale systems that will help us better understand customer behaviour, highlight pain points, and help identify opportunities to improve search for Amazon customers. The main focus will be to design, develop, and implement an array of full stack applications, UX, data pipelines, analytics and debuggability tools that will provide valuable insights into customer feedback and behaviour. The systems you develop will be instrumental in helping the Amazon Search team find and resolve issues and shape our product strategy. You will be interfacing and building infrastructure for machine learning based inference to measure relevance at scale using LLMs.You will be given significant authority and ownership, but also be supported with strong mentors. You will have the opportunity to work on software development using cutting edge big data technologies, while taking products and features from conception to production. You will work closely with a stellar team of engineers, applied scientists, business intelligence engineers, and product managers to ensure Amazon’s data is a powerful and innovative business advantage.A Day in the Life
Oncall for maintenance of Airflow DAGs and EMR jobs which builds Data Cubes for Search metrics and Model Training dataBuild UX for Analytics portal for 100+ customersBuild Services and Library for Sampling, Snapshotting, Labelling and Scoring SearchBuild Services for LLM inference, distillation, Fine tuning and Prompt CachingSolve for Policy Engine Risks and Software RisksGenerate offender clusters and insights for Search debuggabilityBuild tools for debugging Search layerwiseBuild ML applications for time series analysis and hypothesis testing for A/B testing Search algorithmsMinimum Requirements
3+ years of non-internship professional software development experience2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experienceExperience programming with at least one software programming language3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experienceBachelor's degree in computer science or equivalentStrong, object-oriented design and coding skills (C/C++ and/or Java preferably on a UNIX or Linux platform)Knowledge of Python or other scripting languages a plusExperience with distributed (multi-tiered) systems, algorithms, and relational databasesExperience in ML and/or statistics background is preferableExperience in map-reduce, EMR or Spark highly preferredAbility to effectively articulate technical challenges and solutionsDeal well with ambiguous/undefined problems; ability to think abstractlyPrevious technical internship(s) preferredCompetitive Coding experience preferred
#J-18808-Ljbffr