Akamai Technologies is a leader in cloud computing and digital security. They are seeking a Senior II Software Engineer Lead to drive the design and implementation of critical components for their AI inference platform, ensuring performance and scalability while mentoring other engineers.
Responsibilities:
- Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability
- Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads
- Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving
- Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale
- Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence
Requirements:
- 8 years of relevant experience and a Bachelor's degree or its equivalent
- Solid proficiency in distributed systems, cloud services, and platform engineering
- Hands-on experience with AI inference, model serving, or LLM deployment with working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton)
- Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures
- Proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code
- Solid technical leadership through mentoring, code quality advocacy, and ability to drive technical solutions for complex problems
- Familiarity with API design and development (REST/gRPC patterns), GPU infrastructure and hardware acceleration
- Knowledge of observability, monitoring, and debugging distributed systems