Applied Scientist II, Alexa International Team

Amazon is seeking a passionate and talented Applied Scientist to join their Alexa International team, focusing on developing industry-leading technology with Large Language Models (LLMs) and multimodal systems. The role involves creating novel algorithms and modeling techniques, analyzing customer behavior, and collaborating with cross-functional teams to enhance Alexa's international products and services.

Responsibilities:

• Analyze, understand, and model customer behavior and the customer experience based on large-scale data
• Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants
• Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF
• Set up experimentation frameworks for agile model analysis and A/B testing
• Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies
• Contribute to end-to-end delivery of solutions from research to production, including reusable science components
• Communicate solutions clearly to partners and stakeholders
• Contribute to the scientific community through publications and community engagement