About this role

Oversee technical strategy and architecture in ML Inference Platform services
Design, implement, and scale critical engineering components and services to support ML inference and deployment
Work across teams to understand product requirements, evaluate trade-offs, and deliver the solutions needed to build innovative products or services
Advocate for and apply best practices when it comes to availability, scalability, operational excellence, and cost management
Provide technical direction that influences the entire company

Bachelors in technical field such as computer science, mathematics, statistics or equivalent years of experience
10+ years of post-Bachelor’s software development experience; or a Master’s degree in a technical field + 9+ year of post-grad software development experience; or a PhD in a related technical field + 6+ years of post-grad software development experience
2+ years of experience with technical leadership or acting as the domain-expert to a technical organization
Experience in technical leadership/ownership and setting technical direction for engineering projects
Experience architecting, designing, and developing large scale distributed systems and high-throughput RPC services
Experience with Tensorflow, PyTorch, Kubernetes, GPU, LLM inference is a plus

Principal Software Engineer – Machine Learning Infrastructure

Key skills