Program Manager II Tooling, Rufus and Alexa Ops

Rufus and Alexa Shopping Operations strives to become the most reliable source for dataset generation and annotations. We work in collaboration with Shopping feature teams to enhance customer experience (CX) quality across shopping features, devices, and locales. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior shopping experience to customers worldwide. Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human Feedback (RLHF) across various categories at high speed. We aspire to provide an end-to-end data solution for the LLM lifecycle, leveraging cutting-edge technology alongside our operational excellence. By joining us, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide. Program Manager (PM) in OPTIMA Programs Org has to work on defined projects with limited guidance. PM will apply project-management best practices to make the process more efficient and facilitate delivery. PM should be able to assign individual responsibilities, develop appropriate milestones and launch schedules to ensure timely and successful delivery of a project. The PM works backward starting with customers, stakeholders, and any related team owners and work to understand their needs/problem(s) and incorporate their context into project plans. PM negotiates process improvements and needed features (and their priority), distinguishing between important and urgent, accordingly establish milestones and drive sensible deadlines. PM manages project communications like weekly/monthly flashes and may serve as the first point of contact for OPTIMA projects. PM runs effective meetings and is able to dive deeply into details as easily as conveying high-level plans. PM’s verbal and written style are clear and concise. A PM should be able to transform raw thoughts into clear documentation and requirements (e.g., project charter, requirements documentation, responsibility matrix, UAT summary, implementation approach, reporting, etc.)

Key job responsibilities Manage HiTL(Human in The Loop) annotation tooling roadmap and periodically collect new requirements from internal customers through workshops, stakeholder discussions, voice of customer sessions etc. Work closely with Operations and Software development teams to improve tools, processes and reporting dashboards. Drive the roadmap prioritization discussions across stakeholder groups, Ops sites, tech teams etc. Enabling flawless launch and adoption of new features for Operations team and other internal customers through pre planned change management activities. Ensuring adherence to new feature launch mechanism and highlight any exception on timely basis. Keeping the cross functional team (CFT) updated about the projects and progress through weekly/monthly flashes and proactive communication management tools. Work with Privacy team to plan periodic compliance activities and ensure OPTIMA’s platforms are compliant with Privacy policies. Maintaining WBS (Work breakdown structure) for each project and tracking the action items closely and proactively escalate the risks foreseen (tech and non tech) to drive mitigation. Maintaining clear documentation of project files like business requirements, UAT summary, agreements, MoMs etc. and use them to resolve disputes. Working closely with Ops PoCs in triaging UAT issues, adoption issues and any tooling related blockers.