About this role

Evaluate, validate, and ensure reliability of AI agents, AI automation tools, and agentic workflows
Blend test engineering, GenAI understanding, Python/PySpark proficiency, and agent development lifecycle knowledge
Collaborate with Data Science, AI Engineering, and Platform teams

6-8 years of experience in AI/ML engineering, data science, or software engineering, with at least 2 years focused on GenAI
Strong programming expertise in Python, distributed computing using PySpark, and API development
Hands on experience with LLM frameworks (Lang Chain, Lang Graph, Transformers, OpenAI/Vertex/Bedrock SDKs)
Experience developing AI agents, retrieval pipelines, tool calling structures, or autonomous task orchestration
Solid understanding of GenAI concepts: prompting, embeddings, RAG, evaluation metrics, hallucination identification, model selection, fine tuning, context engineering
Experience with cloud platforms (Azure/AWS/GCP), containerization (Docker), and CI/CD pipelines for ML/AI
Strong problem solving, system design thinking, and ability to translate business needs into scalable AI solutions
Excellent verbal, written communication and presentation skills.

Senior Analyst – AI QA

Key skills