Staff AI Product Engineer

Nscale is hiring a Staff AI Engineer to set technical direction for key areas of its inference platform, including inference services, model deployments, and post-training. The role leads cross-team work to improve performance, reliability, cost, and model quality while developing engineers and aligning the platform with customer demand.

Responsibilities:

• Set technical direction for your focus areas and turn it into work that multiple teams can deliver
• Lead the resolution of systemic performance and reliability problems across the serving stack, from kernel bottlenecks to fleet-level capacity and multi-tenant isolation
• Own the trade-offs between cost, latency, throughput, and model quality in your area, and back them with measurement
• Build reusable frameworks, benchmarks, and tooling that make other AI engineers at Nscale more effective
• Evaluate emerging serving engines, kernel libraries, RL frameworks, and accelerators, and make clear build/adopt/contribute recommendations
• Coach and grow engineers across teams, and raise engineering quality broadly
• Work with research, product, and infrastructure leadership so the platform tracks customer demand
• Represent your area in cross-team technical reviews and planning