Senior Machine Learning Engineer (Inference Platform)

Wizard AI is building a top-performing AI Shopping Agent that delivers unmatched accuracy and quality. They are seeking a Senior Machine Learning Engineer to own the end-to-end lifecycle of production ML serving systems, ensuring reliability, efficiency, and scalability.

Responsibilities:

• Own and evolve our multi-engine inference platform, supporting a variety of model types and serving requirements
• Build and improve production ML pipelines — taking models from experimentation to reliable, high-throughput serving
• Define and implement model versioning, rollout, rollback, and lifecycle management strategies that ensure reproducibility and operational reliability
• Define and enforce serving-layer SLAs, including latency, availability, GPU utilization, Time-to-First-Token (TTFT), and Inter-Token Latency (ITL)
• Build observability, monitoring, alerting, and operational tooling for production inference systems
• Apply software engineering best practices, including testing, CI/CD integration, and reproducibility across ML workflows
• Optimize inference performance through efficient resource utilization, hardware-aware serving strategies, and cost-conscious infrastructure design
• Ensure ML serving systems are secure, scalable, and operationally resilient
• Partner with ML, Data, Product, and DevOps teams to turn ideas into production systems, driving the technical decisions on serving and scale