Rufus & Alexa Shopping Operations team strives to become the most reliable source for dataset generation and annotations. We work in collaboration with Shopping feature teams to enhance customer experience (CX) quality across shopping features, devices, and locales. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior shopping experience to customers worldwide. Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human Feedback (RLHF) across various categories at high speed. We aspire to provide an end-to-end data solution for the LLM lifecycle, leveraging technology alongside our operational excellence. By joining us, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide. Key job responsibilities · Manage day to day operations with a team of AI Data Validators and AI Validator Leads · Manage work prioritization and delivery based on business needs . Ensure high quality delivery under tight deadlines . Plan capacity and commit to volume by managing resources, queue, shift management, cross training, and leave management · Track weekly/monthly metrics and process reviews with internal and external stakeholders across time zones. · Maximize productivity and process efficiency through process standardization, strong process documentation, supervision, analysis and performance feedback on a periodic basis · Initiate and lead process improvement projects, presents solution proposals, and implement them to other applicable/in-scope operational areas · Own team’s hiring, performance and development through performance metrics, training, feedback and coaching on an ongoing basis. ### Basic qualifications - Bachelor's degree in any field of study - 4+ years of management, or 2+ years of people management experience - Experience that includes strong analytical skills, attention to detail, and effective communication abilities, or experience in managing and troubleshooting network - Experience managing multiple projects in parallel through prioritization, planning, and task delegation - Comfortable working in a fast paced, highly collaborative, dynamic work environment ### Preferred qualifications - Experience with SQL and advanced Excel - Six Sigma Black Belt Certification, or Six Sigma Green Belt - Master's degree Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.