Research Engineer, AI Security

Tolmo is building AI security agents that continuously test production systems and validate security findings. The Research Engineer, AI Security improves agent reasoning, evaluation, model selection, security, and reliability, turning research and customer-run insights into production improvements.

Responsibilities:

• Agent reasoning: improve how our agents plan, use tools, and reason over a live graph of code, cloud, and telemetry, so they reach real findings faster and with fewer dead ends
• Evaluation: build the evals, benchmarks, and graders that tell us whether an agent actually got better, and make them part of how every change ships
• Model selection and tuning: compare models, prompts, and agent designs on cost, latency, and quality, and turn the results into production decisions
• Model and agent security: defend our agents against prompt injection, data exfiltration, and manipulation by the very systems they test, and research the security of LLM-based applications our customers build
• Reliability at scale: make long-running agents dependable across thousands of runs: verification, self-checks, and sensible stopping
• Learning from the field: study agent runs from customer engagements, find where reasoning broke, and turn each failure into an eval and a fix