Staff Software Engineer, Applied AI

SuperDial is hiring a Staff Software Engineer, Applied AI to build and scale backend systems that power LLM applications in healthcare. The role focuses on reliable, secure, and cost-efficient LLM infrastructure, pipelines, observability, compliance, and technical leadership.

Responsibilities:

• Backend for LLMs – Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for healthcare use cases
• Data & Retrieval Pipelines – Build ingestion, preprocessing, and retrieval-augmented generation (RAG) pipelines to ground LLMs in clinical and revenue-cycle data
• LLMOps & Observability – Design systems for model monitoring, evaluation, cost tracking, and guardrails, ensuring reliability and responsible use
• Performance & Optimization – Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments
• Security & Compliance – Implement HIPAA-ready infrastructure, data governance, and auditability for LLM-powered applications
• Cross-Functional Collaboration – Partner with product, ML engineers, and healthcare experts to translate business workflows into robust backend systems
• Technical Leadership – Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in LLM system design