Design and implement model validation frameworks: accuracy, precision, recall, F1 across clinical subgroups (age, hearing loss severity, device type)
Write regression tests for model updates — detect silent accuracy degradation before any deployment to production
Design adversarial test cases: edge cases, out-of-distribution inputs, boundary conditions, and clinically implausible inputs
Design and maintain API test suites for AI feature endpoints consumed by the PMS frontend and microservices
Write contract tests between AI services and consuming services — prevent integration breakage when models are updated or retrained
Test latency, throughput, and graceful degradation under load
Validate error handling: model confidence thresholds, fallback behaviour when models are unavailable or return low-confidence outputs
Collaborate with the AQA on shared Playwright E2E coverage for AI-integrated UI flows
Design testing evidence for ISO 42001 AIM
Traceability from AI system requirements to test cases to results, supporting audit and certification
Design and implement model monitoring pipelines
track accuracy, confidence distribution, and prediction drift in production against baseline
Contribute to post-incident reviews when AI features cause unexpected clinical workflow impacts or regulatory flags
Feed production monitoring findings back into the regression test suite to prevent recurrence and improve model robustness

5+ years in software testing
1+ years specifically testing AI/ML systems, data pipelines, or model-serving APIs
Proficiency in automation frameworks: .NET, TypeScript / Playwright for AI-integrated UI coverage
Experience with API testing: contract testing, latency profiling, error scenario coverage
Deep understanding of QA methodologies, processes, and CI/CD practices
Understanding of service-oriented and microservice architectures
Understanding of ML fundamentals: train/test splits, evaluation metrics (precision, recall, F1, AUC)
Strong problem-solving and debugging skills, including backend and frontend issue investigation
Ability to think like an end-user and test accordingly, especially when product requirements are minimal or evolving
Strong communication in English (B2+).

Long-term engagement in a stable, growing SaaS company
Remote-first and async-friendly with flat organizational structure
High bar for engineering and product quality
A team that values depth over hype: production quality over flashy prototypes
A culture that values personal growth as much as business outcomes
A global team that spans Denmark, Ukraine, UK, Poland, Canada, Australia, USA, and more.

Software Engineer in Test – AI Services, Healthcare

Key skills