NTT DATA North AmericaRemote
Platform Engineer (AI/LLM Infrastructure) Job Details | NTT DATA Services
United States of America
Full Time
5 hours ago
$105,000 - $219,000 USD
No H1B
Key skills
AILLMRAGVector DatabaseAzureTerraformKubernetesGitHub ActionsVaultEKSAKSArgoCDFluxAzure DevOpsDatadogOpenTelemetryGitHubGitOpsCI/CD
About this role
NTT DATA is a leading business and technology services provider, focused on delivering innovative solutions. They are seeking a Platform Engineer (AI/LLM Infrastructure) to design and implement scalable infrastructure platforms for AI solutions, while also leading a team of engineers and collaborating with clients.
Responsibilities:
- Lead the design, implementation, and operation of scalable infrastructure platforms supporting AI/LLM-based solutions for enterprise clients
- Act as a hands-on technical lead (player-coach), contributing to development while guiding a team of engineers
- Own end-to-end infrastructure architecture below the application layer, including compute, container orchestration, CI/CD, observability, and security
- Partner directly with clients and stakeholders to design, present, and deliver robust AI infrastructure solutions
- Architect and manage production-grade Kubernetes environments (AKS/EKS), including cluster operations and RBAC
- Design and operationalize RAG pipelines, including ingestion, chunking, embedding workflows, and vector database management
- Lead GPU infrastructure provisioning and optimization (NVIDIA A100/H100 or similar)
- Drive Infrastructure-as-Code adoption using Terraform and GitOps practices (ArgoCD/Flux)
- Build and maintain CI/CD pipelines using GitHub Actions and Azure DevOps
- Establish observability standards using Datadog, OpenTelemetry, and ELK/OpenSearch
- Lead incident response, on-call processes, and post-mortem analysis
- Ensure strong security posture and lead InfoSec review processes
- Coordinate delivery across multiple teams and client engagements
Requirements:
- 5+ years of experience in Platform Engineering, SRE, or Infrastructure Engineering
- 3+ years of experience delivering and leading infrastructure for AI/LLM-based production systems
- 3+ years of experience with Terraform and GitOps (ArgoCD/Flux)
- 3+ years of experience with Azure (Key Vault, Monitor, DevOps Pipelines)
- 3+ years of Experience with CI/CD and container registry management
- Must reside in the US