Distinguished Engineer, AI Applications

Role Overview

• Define, own, and evolve the foundational architecture for GEICO’s Generative AI and agentic workflow platforms.
• Serve as a final technical authority on complex architectural decisions impacting multiple products, teams, and business domains.
• Design interconnected, high-performance, and durable platform components that power end-to-end GenAI workflows, including: Knowledge curation and management, Search and retrieval systems, Prompt and context management, Workflow orchestration and action execution, Semantic and knowledge graph systems.
• Establish and drive multi-year technical strategy and roadmaps for both AI platform capabilities and Generative AI (GenAI) applications in close partnership with product and business leaders.
• Balance speed, scalability, reliability, and extensibility while ensuring platforms and GenAI applications can support future AI use cases, evolving business needs, and organizational growth.
• Influence investment decisions by evaluating build vs. buy tradeoffs and architectural choices for both the underlying platform and GenAI applications.
• Collaborate with business stakeholders to identify high-impact GenAI application opportunities and develop strategies to maximize business value and measurable outcomes.
• Ensure architectural consistency and technical rigor across open-source, cloud-agnostic, and managed service integrations.
• Collaborate across engineering, data science, ML, product, and design organizations to align on platform and GenAI application direction, technical standards, and business objectives.
• Drive alignment across teams by translating complex technical and business concepts into clear architectural guidance and decision frameworks.
• Lead deep technical reviews, architectural assessments, and design discussions for critical AI and GenAI application initiatives.
• Mentor senior engineers and technical leads, establishing best practices for platform and GenAI application design, reliability, observability, and operational excellence.

Requirements

• Master’s degree or higher in Computer Science, Engineering, Statistics, or a related field.
• 10+ years of professional software engineering experience, with deep expertise in large-scale distributed systems.
• Extensive experience architecting and building multi-component AI/ML platforms using technologies such as: Search and retrieval systems (e.g., Elasticsearch, Qdrant, Milvus, Pinecone, Weaviate)
• Data platforms (e.g., Snowflake, relational and NoSQL databases, and feature stores)
• Streaming and distributed processing (e.g., Kafka, Spark, Ray)
• Workflow orchestration (e.g., Airflow, Temporal, Prefect)
• LLM orchestration and application frameworks (e.g., LangChain, LlamaIndex)
• Observability, evaluation, and tracing for GenAI systems (e.g., LangSmith, Arize Phoenix, Weights & Biases, OpenTelemetry)
• Vector databases, embedding pipelines, and retrieval-augmented generation (RAG) architectures
• Agentic frameworks and multi-agent systems for complex task execution
• Strong background in full software development lifecycle ownership, including CI/CD, Kubernetes, monitoring, and production operations.
• Deep experience with major cloud platforms such as AWS and Azure.
• Demonstrated hands-on experience building production systems using LLMs and Generative AI technologies (e.g., GPT, Llama, Mistral, Claude) to power conversational and agentic workflows.

Tech Stack

• Airflow
• AWS
• Azure
• Cloud
• Distributed Systems
• ElasticSearch
• Kafka
• Kubernetes
• NoSQL
• Ray
• Spark

Benefits

• Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being.
• Financial benefits including market-competitive compensation; 401K savings plan vested from day one that offers a 6% match; performance and recognition-based incentives; and tuition assistance.
• Access to additional benefits like mental healthcare as well as fertility and adoption assistance.
• Supports flexibility
• We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year.