Software Engineer, Backend

Role Overview

• Designing and building scalable infrastructure for AI-powered research tools.
• Collaborating closely with the rest of the engineering team on our RAG pipeline, continuously improving response quality, latency and robustness.
• Establishing best practices for prompt engineering and deployment of new models and workflows.
• Monitoring and optimizing system performance and costs, making pragmatic tradeoffs to keep us lean and moving fast.
• Owning the design and automation of eval pipelines to continuously measure, benchmark and improve AI agent quality and reliability.

Requirements

• You’ve worked on back end agent behaviors and have hands-on experience with LLMs, RAG, and agent architectures.
• Have independently built and scaled a product to at least a few thousand users (e.g. a side project or open-source project).
• Have worked in a high-growth, fast-paced environment (ideally another startup) and can drive things forward with relatively little oversight.

Benefits

• premium healthcare (medical, dental, etc.)
• flexible working hours
• office space with a beautiful view of the San Francisco marina and Golden Gate bridge.