Machine Learning Systems Engineer

Archetype AI is building a physical AI platform that uses its Newton foundation model to understand the physical world through sensor data and generate real-time insights. The Machine Learning Systems Engineer will own and optimize the serving path for Newton and related multimodal models, including Rust inference runtime components, GPU kernels, routing, productionization, and observability.

Responsibilities:

• Build and own model nodes in our Rust inference runtime: loading, warmup, batching, streaming, GPU memory pools
• Optimize kernels and the GPU path: custom CUDA kernels, mixed precision, quantization, parity against research
• Own inference routing and serving: streaming path API to GPU node, request batching, SLO-backed latency and cost
• Productionize research checkpoints: export, compilation, quantization, parity evals, and rollout
• Build the observability inference needs: latency histograms, GPU metrics, OOM signatures, replayable traces