AI Inference Engineer

Nebulai is a Humans & AI Agents Marketplace that places vetted contract talent with enterprise teams. The AI Inference Engineer optimizes production model serving for latency, throughput, reliability, and cost, and works with ML and platform teams to move models from prototype to production.

Responsibilities:

• Optimize model serving for latency, throughput, and cost
• Tune batching, caching, quantization, and hardware use
• Build monitoring for inference performance and reliability
• Work with ML and platform teams to take models from prototype to production