Prolific is building the biggest pool of quality human data in the world, and they are seeking Industrial Engineers to help train and evaluate cutting-edge AI models. The role involves reviewing AI-generated responses, rating them for accuracy, and providing structured feedback to improve model performance.
Responsibilities:
- Reviewing AI-generated responses to engineering scenarios and rating them for accuracy, appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Requirements:
- Verified status as a Industrial engineer (e.g., by providing a professional profile that shows both educational and professional experience)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients