Senior ML Engineer, Agentic AI

Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing challenges using conversational AI. The Senior ML Engineer will be a core contributor and technical leader, responsible for driving the architecture and deployment of advanced agentic systems in collaboration with cross-functional teams.

Responsibilities:

• Act as the technical authority for the Agentic AI roadmap, steering engineering pods from initial research prototyping through to production scale
• Design, build, and optimize scalable systems and orchestration pipelines capable of deep multi-step reasoning, dynamic memory allocation, long-context evaluation, and high-fidelity tool utilization
• Bridge the gap between frontier machine learning research and enterprise software design. Implement and adapt state-of-the-art techniques in post-training fine-tuning, preference alignment, and automated prompt optimization
• Architect and maintain multi-dimensional quantitative evaluation frameworks and continuous testing infrastructure. Implement state-of-the-art LLM-as-a-judge rubrics, and statistical tracking to evaluate agent capabilities and guarantee zero-regression product updates
• Develop and scale automated data curation pipelines to extract, filter, and structure user feedback signals, execution logs, and expert labels into ultra-high-quality training datasets for model fine-tuning
• Work closely within a highly matrixed, collaborative organization alongside clinical experts, product managers, and software engineers to ensure AI platforms operate safely and ground outputs in validated healthcare protocols
• Foster a culture of technical rigor by setting high coding standards, leading design reviews, standardizing tooling, and mentoring other ML and software engineers across the team