Engineer, Platform Engineering - AI

Intercontinental Exchange Holdings, Inc. is hiring an AI Platform Engineer to implement, maintain, and optimize AI/ML infrastructure. The role focuses on GPU clusters, containerized platform tooling, AI-enabled workflow automation, RAG and vector-store infrastructure, and agentic AI systems.

Responsibilities:

• Deploy, configure, and maintain GPU clusters and associated infrastructure
• Designing, building, and maintaining the workflow automation platform that uses AI capabilities (LLM/MCP/Agentic capabilities)
• Manage NVIDIA driver versions, CUDA toolkits, and container runtimes
• Build and maintain approved container images with ML frameworks (PyTorch, TensorFlow, etc.)
• Implement monitoring, alerting, and observability for GPU infrastructure
• Deploy and maintain vector store infrastructure for RAG pipelines, agent memory, and semantic search
• Implement and maintain end-to-end RAG workflows, including document ingestion, chunking, embedding generation, and retrieval optimization
• Maintain and tune agent memory systems, including short-term context windows, long-term persistent memory stores, and episodic memory retrieval patterns
• Deploy, operate, and maintain Agentic AI systems, including multi-agent orchestration frameworks and tool-use pipelines
• Deploy, host, and maintain MCP servers within the containerized platform infrastructure
• Manage MCP server configurations, versioning, access controls, and integration with agentic workflows
• Monitor MCP server health, performance, and availability; respond to incidents and perform root cause analysis
• Develop automation and tooling to improve platform reliability and efficiency
• Provide L2/L3 technical support and vendor escalation for complex issues
• Implement security controls including network policies, RBAC, and secrets management
• Execute change requests and maintain technical documentation
• Respond to and assist in production operations in a 24/7 environment
• Provide technical analysis, resolve problems, and propose solutions
• Provide support to, and coordinate with, developers, operations staff, release engineers, and end-users
• Educate and mentor team members and operations staff
• Participate in a weekly on-call rotation for after-hours support