Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital One is an industry leader in using machine learning to create real-time, personalized customer experiences. The Senior Lead AI Engineer will partner with cross-functional teams to deliver AI-powered products, design and develop AI software components, and contribute to the technical vision of foundational AI systems.

Responsibilities:

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
• Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
• Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One