DevOps AI Engineer

RIT Solutions, Inc. is a company focused on AI solutions, and they are seeking a DevOps AI Engineer to maintain and optimize their AI platform. The role involves ensuring production deployment reliability and managing cloud infrastructure for AI workloads while adhering to enterprise security standards.

Responsibilities:

• Keeps the AI platform running, scalable, secure, and observable in production
• This person owns production deployment and ensures enterprise clients get bank-grade reliability

Requirements:

• Azure infrastructure: Container Apps, API Management, Virtual Networks, Key Vault, Log Analytics. Must build and maintain production cloud infrastructure for AI workloads
• CI/CD for AI systems: Azure DevOps pipelines that include eval runs as quality gates — not just build/deploy, but automated evaluation checkpoints before production promotion
• LLM operations: Model routing, proxy management, token economics, cost optimization at scale. Understands the difference between monitoring a traditional API and monitoring an AI system
• Enterprise security: Zero Trust networking, secrets management, compliance infrastructure (ISO 42001, EU AI Act). Bank-grade security posture is non-negotiable
• LiteLLM proxy configuration
• Langfuse observability setup (tracing, cost tracking, latency monitoring)
• Experience supporting compliance certifications