Akamai Technologies is a leading company in AI infrastructure and edge computing. They are seeking a Senior Engineering Manager to build and lead a high-performing team responsible for designing and developing a globally-distributed AI inference platform.
Responsibilities:
- Building and scaling a world-class engineering team from the ground up, recruiting top talent in AI infrastructure and ML operations
- Leading the technical strategy for a global AI inference platform that is performant, compliant, economical, and explainable
- Providing the availability, performance, scalability, and security of Akamai Inference Cloud
- Designing global traffic orchestration for AI workloads and establishing platform standards and blueprints for production-grade AI applications
- Making critical decisions on AI tooling based on technical evaluation while ensuring compliance with regulatory requirements (i.e. FedRAMP, GDPR, SOX)
Requirements:
- 10 years of relevant experience and a Bachelor's degree or its equivalent experience building and scaling high-performing teams that shipped successful AI/ML products
- Possess hands-on experience with AI inference optimization, model serving, and LLM deployment at scale with deep knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton)
- Have an understanding of containerization strategies for AI workloads with hardware-specific optimizations, and possess opinions on what makes an AI platform successful
- Show proficiency with cloud-native technologies including Kubernetes and distributed systems with proven experience operating services at global scale
- Demonstrate expertise in building highly available, low-latency platforms with strict SLOs and cost optimization strategies for compute-intensive AI workloads
- Knowledge of AI application platforms
- AI safety and GPU infrastructure
- Hardware acceleration is ideal