Key skills
Node.jsPythonTypeScriptAI
About this role
Role Overview
- Build and improve scalable eval runners and harnesses.
- Make it easy for engineers to add high-signal evals.
- Build and maintain benchmark and dataset tooling.
- Improve reliability and observability for eval execution.
- Partner closely with AI product, AI platform, and infrastructure teams.
Requirements
- Strong software engineering fundamentals and experience shipping production systems.
- Proficiency with TypeScript/Node and/or Python.
- Experience building reliable systems in distributed environments.
- Comfort working with data pipelines.
- Practical experience designing measurement or evaluation systems.
- Curiosity to adopt AI tools to work smarter.
Tech Stack
- Node.js
- Python
- TypeScript
Benefits
- Competitive cash compensation
- Equity
- Benefits