AI Engineer, Platform

Readily is building an AI platform for healthcare compliance. The AI Engineer will create shared frameworks, services, and tooling for reliable LLM features, including retrieval, evaluation, monitoring, and explainability systems used in compliance workflows.

Responsibilities:

• Architect multi-agent systems. Design the frameworks that orchestrate foundation LLMs into compliance workflows like regulatory change analysis, gap analysis and audit prep, with abstractions product engineers can build on
• Build and optimize AI pipelines. Own retrieval over regulations, contracts and policies, prompting and context design, and make pipelines faster, cheaper and more accurate through caching, batching, parallelism, model routing and smarter retrieval
• Make every flag explainable and traceable. Build the mechanisms that tie each compliance flag back to the rule, example or source document behind it, so customers can defend it to a regulator
• Turn compliance rules into agent-ready logic. Build systems that translate regulations and contract requirements into structured logic paths agents can execute
• Close the feedback loop. Use user feedback and outcomes data to improve prompts, retrieval and workflows over time, and adapt them to each customer
• Own evaluation and monitoring infrastructure. Build the eval harness, release gates, tracing and dashboards that keep quality reliable and auditable across customer deployments
• Run the model layer. Build a gateway across providers with routing, fallbacks, caching, cost tracking and HIPAA-grade data handling
• Enable the team. Partner with product engineers to integrate AI through APIs, data pipelines and the frontend; work with compliance users to turn complex rules into workflows; write the SDKs, docs and patterns others build on
• Stay current on AI. Prototype new techniques and bring the ones that move our metrics into the platform