Key skills
AzureDockerJestJMeterPythonTypeScriptRMLLLMPytestAzure DevOpsPostmanCI/CD
About this role
Role Overview
- Design, automate, and execute API test suites
- Define LLM evaluation strategies and build automated eval pipelines tied to releases
- Create PDLM deliverables: verification plans/protocols, test reports
- Integrate test infrastructure with Azure DevOps
- Partner with Product, Clinical, and R&D to refine requirements
Requirements
- 5+ years in backend/API test automation (REST, JSON, auth)
- Performance testing and CI/CD
- Hands-on with Python/TypeScript
- Postman/Newman or REST-assured
- PyTest/Jest, k6/JMeter, Docker
- Experience validating ML/LLM systems
- Strong documentation and traceability discipline
Tech Stack
- Azure
- Docker
- Jest
- JMeter
- Python
- TypeScript
Benefits
- Health insurance
- 401(k) matching
- Paid time off
- Flexible work arrangements
- Professional development opportunities