Jobs via Dice is seeking a PhD Engineer for a remote hourly contract position. The role involves writing prompts for AI behavior in engineering scenarios, evaluating responses for technical accuracy, and ensuring clarity and structure in explanations for various audiences.
Responsibilities:
- Write and refine prompts to guide AI behavior in engineering-related scenarios
- Evaluate LLM-generated responses for technical accuracy, applied reasoning, and completeness
- Fact-check engineering claims using authoritative public sources and domain expertise
- Annotate model outputs by identifying strengths, weaknesses, and factual or conceptual errors
- Assess clarity, structure, and suitability of explanations for different audiences
- Ensure responses align with expected conversational behavior and system guidelines
- Apply consistent evaluation standards using defined taxonomies, benchmarks, and review frameworks
Requirements:
- PhD in Engineering or a closely related field
- Deep expertise in one or more engineering sub-domains, including mechanical, electrical, chemical, materials, civil, environmental, or infrastructure engineering
- Strong experience working with large language models and understanding real-world usage patterns
- Excellent written communication skills with the ability to explain complex engineering concepts clearly
- High attention to detail and strong analytical reasoning skills
- Experience reviewing or editing technical or academic content
- Fluency in English