TRM Labs is a company that provides blockchain analytics and AI solutions aimed at enhancing security for law enforcement and financial institutions. The role of Staff Software Engineer involves architecting and implementing frameworks for AI applications, particularly focusing on Large Language Models and agentic systems, while ensuring reliability and performance in high-sensitivity environments.
Responsibilities:
- Architect and implement a robust agentic framework that supports tool use, context retrieval, memory, and planning
- Build intelligent, modular agents that automate investigative tasks and augment analyst decision-making
- Extend and scale our LLM infrastructure (e.g. OpenAI, Anthropic, local models), including prompt engineering, RAG, and evaluation loops
- Design safe, observable, and auditable agent behaviors — ensuring reliability in high-sensitivity environments
- Evaluate performance across metrics like reasoning, latency, success rate, and hallucination, and iterate based on user feedback and system telemetry
- Contribute to a culture of high ownership, rapid experimentation, and ethical AI deployment
Requirements:
- Strong engineering background with deep experience in backend or systems work (Python preferred)
- Hands-on experience building with LLMs, agents, and tooling frameworks (LangChain, semantic caches, vector DBs, etc.)
- Comfort working with agentic pipelines and optimizing information flow into AI systems
- Thoughtful approach to system design, with an eye for safety, scalability, and explainability
- High product empathy - you care about how agents impact real users (analysts) and optimize accordingly
- Bias toward experimentation and iteration - you're excited to try, learn, and ship fast
- Previous experience with knowledge graphs, task orchestration, or AI safety a plus