Senior Machine Learning Engineer, Computer Vision/VLM

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. They are seeking a Senior Machine Learning Engineer specializing in Computer Vision and Vision-Language Models to develop and train advanced models, design scalable AI frameworks, and collaborate with various teams to enhance their autonomous vehicle technology.

Responsibilities:

• Develop and train state-of-the-art computer vision / multimodal models (e.g., Gemini) to extract the rich semantic information (e.g., object attributes, scene properties, interaction dynamics) required by the AI agent
• Design and implement a scalable AI agent framework that integrates large foundation models (e.g., Gemini) with the outputs of our perception models and internal knowledge bases
• Develop and apply Fine-tuning and Reinforcement Learning (RL) techniques to create a "data flywheel," continuously improving the system's captioning and reasoning abilities through automated feedback
• Develop and prototype novel prompting strategies for Vision-Language Models (VLMs) to elicit complex, causal reasoning about driving scenarios
• Collaborate closely with the ML Infra, Perception, Behavior, and AI Foundation teams to define data requirements and integrate the captioning system into the broader ML development lifecycle
• Own the full system lifecycle, from advanced model development and prototyping to production deployment and scaling for massive data generation