Key skills
AILLMAgenticAzure
About this role
Coforge is hiring an experienced GRC & Compliance Automation Engineer to design, build, and deploy agentic AI solutions aligned to business domains. The role involves creating evaluation pipelines, conducting various testing methodologies, and ensuring the quality and safety of AI outputs.
Responsibilities:
- Design evaluation pipelines (pre + post deployment)
- Perform Functional testing
- Bias/safety evaluation
- Regression testing
- Implement continuous monitoring of agent outputs
- Conduct red-teaming exercises
- Generate evaluation reports and quality benchmark
Requirements:
- 10+ Years' experience
- Experience with LLM evaluation frameworks: LangSmith, RAGAS, Azure AI Evaluation, DeepEval, etc
- Strong test automation skills
- Understanding of AI safety and bias mitigation
- Experience in AI QA / SDET roles