Catalyst Labs is a leading talent agency specializing in Applied AI, Machine Learning, and Data Science. They are seeking a Founding Product Engineer to lead the development of AI agent products and infrastructure, focusing on creating reliable and secure AI solutions.
Responsibilities:
- Lead end-to-end development of AI agent products and infrastructure, collaborating closely with the founding team
- Build and scale evaluation pipelines to detect AI agent failures in deployment (e.g., hallucinations, jailbreaks, brand risks, data leakage)
- Design and implement the gold standard for secure, safe, and reliable AI agents
- Develop and maintain full-stack systems, including backend (Python, LangChain) and frontend (React, TypeScript) components
- Create monitoring tools, filters, and authorization frameworks to support AI agent builders
- Work on-site in San Francisco, contributing to a fast-paced, high-agency startup environment
- Ship products frequently, gather user feedback, and iterate rapidly to improve reliability and safety of AI systems