Staff AI Engineer

Teradata is a leading company in cloud analytics and data platforms for AI, empowering customers to make better decisions. The Staff AI Engineer will be responsible for designing and scaling enterprise AI platforms, influencing AI strategy, and leading initiatives across various AI technologies.

Responsibilities:

• Lead the design and evolution of large‑scale, distributed AI systems that power Teradata’s AI platform and AI‑native products
• Own end‑to‑end architecture for critical AI capabilities such as agentic workflows, RAG pipelines, vector search, semantic retrieval, and AI orchestration frameworks
• Drive technical strategy and architectural consistency across multiple engineering teams
• Design and implement production‑grade AI systems using LLMs, embeddings, vector databases, and agent‑based architectures
• Build scalable, secure, and reusable platform services and APIs supporting AI workloads across the software development lifecycle
• Define and implement guardrails for reliability, safety, governance, and cost control in enterprise AI systems
• Partner with product management, architecture, research, and cloud platform teams to translate business requirements into scalable AI solutions
• Influence roadmap decisions by providing deep technical insight, trade‑off analysis, and long‑term platform thinking
• Act as a technical escalation point for complex system design, performance, and reliability challenges
• Drive best practices for testing, observability, evaluation, and production readiness of AI systems
• Identify systemic performance bottlenecks and lead efforts to optimize distributed systems and AI pipelines
• Establish engineering standards that improve development velocity, quality, and operational resilience
• Mentor Senior and Staff‑level engineers, providing guidance on architecture, design reviews, and technical decision‑making
• Raise the overall engineering bar through design forums, technical reviews, and knowledge sharing
• Lead by example through hands‑on contributions to the most complex and business‑critical problems

Requirements:

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
• 8+ years of experience building backend services, distributed systems, or data/AI platforms
• Strong proficiency in Java, Go, or Python, with experience building large-scale services
• Deep understanding of distributed system design, scalability, fault tolerance, and cloud-native architectures
• Proven experience designing and operating production systems with SQL and NoSQL data stores
• Experience with LLMs, embeddings, vector databases, and AI orchestration frameworks
• Exposure to agentic AI patterns such as tool calling, planning, memory, and multi-step reasoning
• Experience building or operating AI systems in cloud environments (AWS, Azure, or GCP)
• Familiarity with Kubernetes, Docker, CI/CD pipelines, and production-grade observability