Description

Rufus & Alexa Shopping Operations team strives to become the most reliable source for dataset generation and annotations. We work in collaboration with Shopping feature teams to enhance customer experience (CX) quality across shopping features, devices, and locales. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior shopping experience to customers worldwide. Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human Feedback (RLHF) across various categories at high speed. We aspire to provide an end-to-end data solution for the LLM lifecycle, leveraging cutting-edge technology alongside our operational excellence. By joining us, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide.

Key job responsibilities

· Manage day to day operations with a team of AI Data Validators and AI Validator Leads

· Manage work prioritization and delivery based on business needs

. Ensure high quality delivery under aggressive deadlines

. Plan capacity and commit to volume by managing resources, queue, shift management, cross training, and leave management

· Track weekly/monthly metrics and process reviews with internal and external stakeholders across time zones.

· Maximize productivity and process efficiency through process standardization, strong process documentation, supervision, analysis and performance feedback on a periodic basis

· Initiate and lead process improvement projects, presents solution proposals, and implement them to other applicable/in-scope operational areas

· Own team’s hiring, performance and development through performance metrics, training, feedback and coaching on an ongoing basis.

Basic Qualifications

· A Bachelors Degree in any stream

· 4+ years of work experience with 2+ years of managing at least 20 employees

· Excellent communication (written & oral), strong organizational skills and detail oriented

· Strong analytical, problem-solving, and critical-thinking skills

· Comfortable working in a fast paced, highly collaborative, dynamic work environment

· Willingness to support multiple projects at one time, and to accept re-prioritization as necessary

Preferred Qualifications

· Hands on experience with MS Excel, SQL, Power BI

· Six Sigma/Green Belt Certification

· Masters Degree