Prompt Engineer

Steampunk, Inc. is a Change Agent in the Federal contracting industry, focusing on innovative solutions for clients in various sectors. They are seeking a Prompt Engineer to design, test, and refine interaction patterns for generative AI systems to enhance user experiences and ensure the relevance and reliability of AI outputs.

Responsibilities:

• Design, iterate, and optimize prompts, templates, and prompt chains that improve the accuracy, reasoning, and usability of generative AI outputs
• Develop context management strategies, including document selection, summarization, formatting, role instructions, and retrieval augmentation patterns
• Partner with developers to implement prompt engineering techniques within RAG pipelines, agentic workflows, evaluation harnesses, and application UX layers
• Conduct structured experiments—including A/B tests and rubric-based evaluations—to measure prompt performance and identify opportunities for improvement
• Collaborate with AI Evaluation Scientists to define evaluation metrics tied to quality, relevance, consistency, safety, and hallucination reduction
• Work closely with UX and product design teams to develop interaction flows that guide user inputs, clarify system capabilities, and reduce cognitive load
• Help translate complex subject-matter content into structured, LLM-friendly formats that improve system reasoning and reduce error rates
• Support the design of safe output behaviors by implementing guardrails, filtering strategies, and context constraints aligned with governance principles
• Document prompt patterns, style guides, failure modes, and best practices for internal reuse and team enablement
• Stay up to date on emerging prompting strategies (e.g., CoT, self-critique, tool use scaffolding, function calling, agentic behaviors) and share insights with the team