Sr. Applied Science Manager, Perfect Order Experience (POE) AI

The Perfect Order Experience (POE) AI team combines artificial intelligence, machine learning, and economic insights to ensure exceptional customer experiences and seller success on Amazon. We develop advanced scientific solutions that protect product authenticity, maintain quality standards, and safeguard intellectual property across Amazon's vast catalog. Our work spans from building detection systems using state-of-the-art Large Language Models to creating automated investigation processes and risk treatment mechanisms. Our solutions directly impact billions of customer interactions and enable millions of sellers to thrive while maintaining the highest standards of trust and quality. We are seeking an exceptional Senior Applied Science Manager to lead key AI initiatives to ensure a perfect order experience for Amazon customers. In this role, you will spearhead the development of a domain specific large language model designed to comprehend complex seller behaviors and relationships. You will lead the research and implementation on LLM pre-training, fine-tuning and reinforcement learning for LLM reasoning. You will implement and influence ranker models that intelligently adjust product visibility based on risk signals and trust metrics. Key job responsibilities - Drive AI strategy and lead a team of applied scientists in developing ML solutions. - Lead the end-to-end development of a domain specific LLM. - Drive the development of large-scale pre-training and post-training strategies for the LLM using domain-specific datasets. - Architect automated risk detection and treatment systems that combine multi-modal signals to identify product quality issues and implement optimization-based mitigation strategies. - Collaborate with other science teams to develop/ influence ranker models that optimize product visibility. About the team About the Perfect Order Experience (POE) AI Team The POE AI Science team sits at the forefront of Amazon's efforts to ensure customers can shop with confidence. Our team combines artificial intelligence, machine learning, and economic insights to protect product authenticity, maintain quality standards, and safeguard intellectual property across Amazon's vast catalog. The work we do directly impacts billions of customer interactions and enables millions of sellers to thrive while maintaining the highest standards of trust and quality. Minimum qualifications - Ph.D. in Computer Science, Machine Learning, or related technical field, or equivalent practical experience - Experience leading and managing teams of scientists/engineers in delivering ML solutions at scale - Strong track record in developing and deploying production ML systems - Strong publication record or proven industrial innovations (e.g., patents) in ML/AI Preferred qualifications - Strong communication skills with ability to translate complex technical concepts to various audiences - Experience with LLM development, including pre-training, fine-tuning, and reinforcement learning - Knowledge of search, ranking, or recommendation systems - Experience with multi-modal ML systems combining text, image, and structured data Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits . USA, WA, Seattle - 218,800.00 - 295,900.00 USD annually