Key skills
AI
About this role
Prolific is building the biggest pool of quality human data in the world, serving over 35,000 AI developers and researchers. They are looking for Industrial Engineers to help train and evaluate AI models by reviewing and rating AI-generated responses to engineering scenarios.
Responsibilities:
- Reviewing AI-generated responses to engineering scenarios and rating them for accuracy, appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Requirements:
- Verified status as a Industrial engineer (e.g., by providing a professional profile that shows both educational and professional experience)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients