Software Engineer, ML Serving - Rime Ai

Rime is a foundation modeling company building voice AI for enterprise customer experiences at scale. The company is hiring a Software Engineer to own and scale real-time TTS model serving infrastructure, including GPU-backed inference engines, APIs, deployment workflows, reliability, and resource management.

Responsibilities:

• Architecture and implementation of Rime's TTS serving infrastructure, from GPU-backed inference engines to the API surface
• Model optimization from a single-node to disaggregated fleet serving
• Compatibility with different NVIDIA hardwares from Hopper to Blackwell and beyond for on-prem and cloud deployments
• Continuous integration and deployment workflows for the model serving pipeline
• Site reliability: on-call rotation, monitoring, alerting, and observability across the serving stack
• Resource provision, cost management across our GPU fleet