Key skills
PythonAIMLLLM
About this role
Role Overview
- Diagnose where the product falls short, rigorously analyze root causes, build evaluations, and ship improvements that customers feel.
- Work directly with customers to understand the problems deeply.
- Design and refine tool-calling patterns and agent orchestration to handle multi-step research tasks that requires reasoning across thousands of related documents.
- Build ingestion and normalization systems for complex structured documents at scale
- millions of filings where formats vary and each version builds on the last.
- Build and iterate on reinforcement fine-tuning harnesses, including training graders for research tasks with non-verifiable reward.
- Develop tooling to measure, profile, and optimize agent pipeline performance
- latency, cost, and quality across millions of calls.
- Run experiments end-to-end: design, analyze, and translate into clear product recommendations.
Requirements
- 2
- 5 years of experience building software professionally, with strong programming fundamentals (we work mostly in Python).
- Proficiency with LLM APIs, agent frameworks, and modern retrieval patterns. You stay current as the field moves. We don't need classical ML expertise
- we need someone on the frontier of applied AI.
- Strong track record of shipping high-impact work in ambiguity. You take a vague problem, define what 'good' looks like, ship a v0, and iterate.
- Experience shipping user-facing products, either backend or full-stack.
- Drawn to the question 'how do we know this is actually better?'
- excited to build the evaluation infrastructure that answers it rigorously.
- Curiosity over domain experience. No insurance background needed
- you learn fast and care about understanding the problem space deeply.
- Strong written and spoken English
Tech Stack
- Python
Benefits
- Competitive salary + annual bonus
- Health insurance , Dental and Vision coverage (including spouse and family coverage)
- 401K Company match
- Life insurance
- Cell Phone & Internet reimbursement
- 25 days of PTO/year
- Commuter benefit
- Gym membership via ClassPass
- IT equipment allowance
- Professional development & trainings
- Team fun: regular company gatherings and team events