Senior Software Engineer (AI Inference & Runtime Platform)

AZX is hiring a Senior Software Engineer to build and operate its AI inference control plane and secure agent-sandboxing platform. The role covers model serving, Kubernetes infrastructure, isolated runtime systems, stateful data services, and the supporting control plane and tooling.

Responsibilities:

• Manage the serving tier for open-weight models: engine deployment and configuration, cold-start strategy, per-model SLOs, and upgrade/canary discipline
• Administer the Kubernetes layer for inference and sandbox workloads: operators and CRDs, autoscaling (KEDA/Karpenter-class), GPU scheduling and sharing, and node lifecycle
• Own the stateful data plane end to end with restore procedures that are regularly tested
• Oversee the sandbox runtime and its host-side control plane: lifecycle, exec, snapshot/fork, teardown, metering, and the threat model of the isolation boundary
• Direct the FastAPI control-plane services, Terraform/OpenTofu, Bicep, and the dashboards
• Run the layer the backend services team builds on, expect to debug into their services, and expect them to read your dashboards
• Manage the open-source posture: build to OSS standards and release as it matures, with reviewed PRs, real docs, and reproducible builds