Senior ML Engineer, Agentic AI

Ellipsis Health is building AI/ML products for healthcare using conversational AI and voice biomarker technology. The Senior ML Engineer, Agentic AI will lead the design, development, evaluation, and production deployment of agentic AI systems for secure, low-latency clinical applications.

Responsibilities:

• Technical Leadership & Vision: Act as the technical authority for the Agentic AI roadmap, steering engineering pods from initial research prototyping through to production scale
• Advanced Agentic Architecture: Design, build, and optimize scalable systems and orchestration pipelines capable of deep multi-step reasoning, dynamic memory allocation, long-context evaluation, and high-fidelity tool utilization
• Research-to-Production Translation: Bridge the gap between frontier machine learning research and enterprise software design. Implement and adapt state-of-the-art techniques in post-training fine-tuning, preference alignment, and automated prompt optimization
• Rigorous Evaluation & Benchmarking: Architect and maintain multi-dimensional quantitative evaluation frameworks and continuous testing infrastructure. Implement state-of-the-art LLM-as-a-judge rubrics, and statistical tracking to evaluate agent capabilities and guarantee zero-regression product updates
• Data Mix Optimization: Develop and scale automated data curation pipelines to extract, filter, and structure user feedback signals, execution logs, and expert labels into ultra-high-quality training datasets for model fine-tuning
• Cross-Functional & Clinical Collaboration: Work closely within a highly matrixed, collaborative organization alongside clinical experts, product managers, and software engineers to ensure AI platforms operate safely and ground outputs in validated healthcare protocols
• Mentorship & Engineering Excellence: Foster a culture of technical rigor by setting high coding standards, leading design reviews, standardizing tooling, and mentoring other ML and software engineers across the team