Sr Technical Program Manager, AWS Generative AI & ML Servers

AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain — and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. Our team designs, builds and operates Amazon's fleet of GPU-accelerated servers using Nvidia's latest GPU offerings to power AI/ML workloads across AWS's compute infrastructure. We solve systemic hardware issues and build hardware and software systems to detect and mitigate future recurrences so that our customers can experience the highest quality of service possible. AWS Infrastructure Services is seeking a Senior Technical Program Manager to drive end-to-end delivery of GPU-accelerated servers powering AI/ML workloads across our global fleet. You will facilitate requirements gathering with internal customers, coordinate cross-functional engineering teams spanning hardware and software disciplines, manage ODM partnerships across multiple continents, and establish closed-loop quality feedback systems connecting operational data to design improvements. This role requires technical depth to challenge engineering workstreams and translate technical constraints into program risk, combined with program management excellence to deliver complex hardware at global scale. You will maintain program schedules by identifying blockers early, escalate dependencies before they impact critical path, and ensure our AI/ML infrastructure meets reliability commitments through data-driven quality systems. Key job responsibilities Requirements & Planning: Facilitate requirements gathering sessions with internal customers and stakeholders. Work with engineering teams to validate feasibility, identify dependencies, and establish clear success criteria. Build program timelines with milestone tracking, critical path analysis, and proactive risk assessment. Translate business objectives into program deliverables that engineering teams can execute against. Execution & Coordination: Drive cross-functional alignment across hardware, firmware, software, and operations teams to maintain development schedules. Manage ODM partnerships by tracking design reviews, manufacturing readiness gates, and quality checkpoints. Identify blockers early and escalate dependencies before they impact critical path. Facilitate decision-making when teams are stuck on technical trade-offs. Communicate program status to stakeholders with clear visibility into progress against milestones. Risk & Issue Management: Identify program risks by challenging technical workstreams and connecting technical constraints to schedule impact. Escalate risks proactively with quantified business impact and proposed mitigation plans. Lead root cause analysis of fleet-wide hardware failures, driving engineering teams to implement corrective actions that improve operational metrics. Establish feedback loops connecting operational telemetry back to validation criteria for future designs. Quality & Deployment: Define acceptance criteria and coordinate qualification testing across teams. Manage deployment readiness by tracking open issues, validating documentation completeness, and ensuring operations teams are prepared for production handoff. Facilitate go/no-go decisions with clear risk posture and mitigation status for mission-critical AI/ML workloads. Transition & Closure: Conduct knowledge transfer sessions with receiving teams. Document lessons learned with actionable recommendations that improve future program execution. Ensure all program artifacts are complete and accessible. A day in the life Your day-to-day responsibilities will include interfacing with internal and external customers to understand project requirements and facilitate system development on GPU-accelerated server platforms. You will analyze operational challenges across the existing fleet with the goal of improving current customer experience and implementing design improvements for future generations. You will work directly with ODM partners to coordinate development activities, manage vendor relationships, and drive manufacturing readiness at scale. As the end-to-end owner of complex server platforms, you will lead root cause analysis of fleet issues and implement closed-loop corrective actions that drive improvements back into development processes and design specifications. About the team The Ultra Server Hardware Engineering team is a group of engineers and technical program managers directly responsible for launching GPU-accelerated servers into the AWS fleet. Located in Seattle and Cupertino, we collaborate with global development teams and ODM partners to deliver next-generation AI/ML infrastructure deployed in datacenters worldwide. Our team members bring diverse technical backgrounds but share a common commitment to Bias for Action and strong Ownership. We operate with a startup mentality, delivering fully functional solutions that power AWS's most demanding AI/ML workloads. Minimum qualifications - 5+ years of technical product or program management experience - 7+ years of working directly with engineering teams experience - Experience managing programs across cross functional teams, building processes and coordinating release schedules - Experience leading engineering design projects and interacting with cross-functional teams Preferred qualifications - 8+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience - Knowledge of the electrical and mechanical systems involved in critical data center operations including systems such as feeders, transformers, generators, switchgear, UPS systems, ATS units, PDU units, chillers, pumps, air handling units, and CRAC units - Experience in machine learning, data mining, information retrieval, statistics or natural language processing, or experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware - Experience developing and driving projects with tight schedules and multiple dependencies - Experience using data and metrics to drive improvements - Experience coordinating programs with ODM partners across multiple geographies, managing design reviews, manufacturing readiness gates, and quality checkpoints - Ability communicating program status to executive stakeholders by connecting technical constraints to business impact Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits . USA, CA, Cupertino - 171,000.00 - 231,400.00 USD annually USA, WA, Seattle - 148,700.00 - 201,200.00 USD annually