Prompt and Model Testing: Test AI-generated outputs, focusing on medical prompts and machine learning models used in healthcare applications.
Feedback Loop: Analyze AI output for accuracy, relevance, and clinical validity. Provide detailed feedback to the engineering team to enhance prompt performance and model behaviour.
Standard Operating Procedures (SOPs): Write, maintain, and update detailed SOPs for medical prompt engineering and testing, ensuring consistency and quality in prompt creation and validation.
Collaboration with Engineering: Work closely with the engineering team to troubleshoot, refine, and optimize machine learning models based on feedback from prompt testing and evaluation.
Quality Assurance: Ensure that the AI-generated responses align with clinical guidelines, best practices, and healthcare regulations.
Data Analysis: Assist in analyzing medical data sets and model outputs to evaluate the performance of AI models in clinical contexts.
Documentation: Document all testing procedures, outcomes, and improvements. Create user-friendly guides and best practice documents for prompt testing and optimization.
Continuous Improvement: Actively participate in the iterative process of improving prompt accuracy, functionality, and overall system performance in collaboration with cross-functional teams.
Other projects and duties as assigned

Claims Adjustment Background: 2+ years as a claims adjuster in P&C, Health and Life, Auto, Workers Compensation, BI, etc.
Experience with AI/ML: Familiarity with AI, machine learning models, and prompting, especially in healthcare, clinical and claims setting.
Testing and Quality Assurance: Experience with testing and evaluating technology solutions, particularly in the healthcare or technology space.
Desire to learn and grow your skillset!
SOP Writing: Experience writing clear, concise, and detailed Standard Operating Procedures (SOPs) and documentation.
Communication Skills: Excellent written and verbal communication skills, with the ability to deliver technical feedback in a clear and constructive manner.
Attention to Detail: Strong attention to detail, particularly when reviewing AI outputs for clinical accuracy and relevance.
Problem-Solving: Ability to identify issues, propose solutions, and collaborate with engineering teams to resolve challenges.
Preferred Qualifications: Familiarity with Healthcare Regulations: Knowledge of HIPAA, medical privacy laws, and healthcare compliance standards.
Technical Skills: Experience with data analysis tools, basic coding (Python, R, etc.) and SQL
Experience in Medical AI: Previous work with AI models in a medical context, such as AI-powered medical documentation systems, diagnostic tools, or virtual health assistants.

Flexible hybrid environment with the option to collaborate in-person at our Toronto HQ.
Modern employee benefits, including health and dental coverage
Competitive compensation, with valuable stock options, as we’re still a young company growing very quickly.
An opportunity to develop very rapidly in your career. We can offer you a super-immersive learning environment, and when you thrive there, you will have the opportunity to rapidly develop this opportunity into senior practitioner or management opportunities as you choose.
Access to a learning and professional development fund to help you level up your career while you’re working with us. We hope to be an incredible step up in your career if you decide to come and work with us.
Company events
Generous Paid Time Off
Paid Sick Days
Casual Dress code
Employee Referral Bonus
Tuition Assistance
Plus, many other Recognition Programs!

Prompt Engineer, Claims Analyst

Key skills