Key skills
AIMLNLP
About this role
Role Overview
- Execute structured test plans for AI Agent implementations
- Validate that intents, entities, and workflows trigger correctly
- Identify behavioral inconsistencies, misclassifications, or hallucinations
- Review and validate AI-generated suggestions, summaries, and classifications
- Provide actionable feedback to improve intent models and redaction/PII handling
- Run bias, redaction, and transcription accuracy checks
- Spot patterns or emerging issues across test sets
- Contribute ideas for improving internal QA processes and tools
Requirements
- AI/ML, NLP, or chatbots
- Product quality and user experience
- Linguistics, conversation analysis, or human–AI interaction
- Exploring a career in AI evaluation, AI ops, or product QA
- No advanced ML experience is required — just strong analytical thinking and curiosity about how intelligent systems behave.
Benefits
- Lunch can be expensed (up to $25) while working in the office.
- PTO: 4 days