Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. They are seeking a skilled Prompt Engineering Architect to define and lead the strategy for designing prompts and LLM-based application architectures across the organization. The role involves collaborating with teams, developing evaluation frameworks, and mentoring engineers to enhance LLM application development.
Responsibilities:
- Define organization-wide standards, patterns, and reference architectures for LLM-based applications
- Design prompt structures, instruction templates, and retrieval strategies for diverse production use cases
- Architect agentic systems incorporating tool use, planning, memory, and multi-step reasoning
- Lead the design of retrieval-augmented generation pipelines including chunking, indexing, and reranking strategies
- Develop evaluation frameworks for prompt quality, agent reliability, and end-to-end task success
- Build internal tooling and libraries that accelerate LLM application development across teams
- Establish guardrails, safety filters, and policy enforcement patterns for LLM-powered products
- Collaborate with model engineering teams on prompt-model co-design and fine-tuning opportunities
- Conduct technical reviews of LLM application designs across multiple product teams
- Mentor engineers and applied scientists on prompt engineering and LLM application architecture
- Lead red-teaming exercises and continuously improve robustness against adversarial inputs
- Track latency, cost, and quality trade-offs in LLM application design and recommend optimizations
- Document patterns, anti-patterns, and lessons learned for broad internal reuse
- Stay current with LLM capabilities, tooling, and research, and translate advances into practical guidance