Jobs via Dice is seeking an AI Engineering Expert to support AI model behavior in engineering scenarios. The role involves writing prompts, evaluating AI responses for technical accuracy, and ensuring clarity and structure in explanations for various audiences.
Responsibilities:
- Write and refine prompts to guide AI model behavior in engineering scenarios
- Evaluate LLM-generated responses for technical accuracy, applied reasoning, and completeness
- Fact-check and verify technical claims using domain knowledge and authoritative sources
- Annotate model outputs by identifying strengths, inaccuracies, and improvement areas
- Assess clarity, structure, and suitability of explanations for different audiences
- Ensure responses align with conversational standards and evaluation guidelines
- Apply consistent review frameworks, benchmarks, and taxonomies across tasks
Requirements:
- PhD in Engineering or a closely related field
- Deep expertise in at least one engineering domain (mechanical, electrical, chemical, materials, civil, environmental, or related disciplines)
- Strong understanding of applied engineering reasoning and quantitative analysis
- Experience using large language models and understanding of AI interaction patterns
- Excellent writing and technical communication skills
- High attention to detail and analytical rigor
- Comfortable working independently in a remote, evaluation-focused environment