Senior Engineering Manager - Akamai Inference Cloud (Remote)

Akamai Technologies is a leading company in AI infrastructure and edge computing. They are seeking a Senior Engineering Manager to build and lead a high-performing team responsible for designing and developing a globally-distributed AI inference platform.

Responsibilities:

• Building and scaling a world-class engineering team from the ground up, recruiting top talent in AI infrastructure and ML operations
• Leading the technical strategy for a global AI inference platform that is performant, compliant, economical, and explainable
• Providing the availability, performance, scalability, and security of Akamai Inference Cloud
• Designing global traffic orchestration for AI workloads and establishing platform standards and blueprints for production-grade AI applications
• Making critical decisions on AI tooling based on technical evaluation while ensuring compliance with regulatory requirements (i.e. FedRAMP, GDPR, SOX)

Requirements:

• 10 years of relevant experience and a Bachelor's degree or its equivalent experience building and scaling high-performing teams that shipped successful AI/ML products
• Possess hands-on experience with AI inference optimization, model serving, and LLM deployment at scale with deep knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton)
• Have an understanding of containerization strategies for AI workloads with hardware-specific optimizations, and possess opinions on what makes an AI platform successful
• Show proficiency with cloud-native technologies including Kubernetes and distributed systems with proven experience operating services at global scale
• Demonstrate expertise in building highly available, low-latency platforms with strict SLOs and cost optimization strategies for compute-intensive AI workloads
• Knowledge of AI application platforms
• AI safety and GPU infrastructure
• Hardware acceleration is ideal