AI Engineer Quality Engineering AI CoE
Location: Atlanta, GA
Work Arrangement: Onsite
Experience: 5+ Years
Position Overview
We are seeking a hands-on AI Engineer to design, build, test, deploy, and continuously improve production-grade AI Agents, RAG pipelines, and orchestration services for the Quality Engineering AI Center of Excellence.
The role will develop AI capabilities supporting requirements review, code quality, test preparation, execution intelligence, defect triage, release assurance, and engineering productivity.
Key Responsibilities: AI Agent Development
Develop and deploy AI agents for requirements, code quality, test design, automation, execution, defect analysis, release assurance, and QE intelligence.
RAG & Knowledge Integration
Build grounded RAG pipelines using Jira, Confluence, Git repositories, test assets, defects, incidents, and application documentation.
Optimize embeddings, chunking, retrieval, reranking, and semantic search.
Agent Orchestration
Implement workflows coordinating multiple AI agents, tools, APIs, and Human-in-the-Loop approvals across SDLC processes.
Use frameworks such as LangChain, LangGraph, Semantic Kernel, or AutoGen.
Enterprise Integration
Develop REST APIs and microservices.
Integrate AI solutions with GitHub/GitLab, Azure DevOps, CI/CD tools, ServiceNow, monitoring platforms, and test-management applications.
Optimization & Evaluation
Improve prompts, retrieval quality, model selection, latency, groundedness, accuracy, and token consumption.
Implement AI/LLM evaluation and feedback mechanisms.
Deployment & Production Support
Containerize and deploy AI solutions through secure CI/CD pipelines.
Implement logging, observability, monitoring, reliability, security, and production-readiness controls.
Required Qualifications3 8 years of software engineering or AI engineering experience.
Strong Python programming skills.
Hands-on experience with LLM/Generative AI, Agentic AI, RAG, embeddings, vector databases, semantic search, prompt engineering, and model evaluation.
Experience with LangChain, LangGraph, Semantic Kernel, AutoGen, or equivalent frameworks.
Experience developing REST APIs and microservices using FastAPI or similar frameworks.
Working knowledge of JavaScript/TypeScript; Java exposure is a plus.
Experience with Docker, Kubernetes, Git, GitHub Actions/Azure DevOps pipelines, and cloud deployment.
Knowledge of Azure AI Search, Azure OpenAI, Google Vertex AI, AWS Bedrock, Claude, Gemini, Codex, or equivalent AI platforms.
Understanding of secure coding, secrets management, access controls, logging, monitoring, and software testing.
Preferred QualificationsBachelor s or Master s degree in Computer Science, AI, Data Science, Engineering, or related field.
Experience in Retail, Supply Chain, Logistics, Distribution, or related domains.
Relevant AI, cloud, architecture, software engineering, or Quality Engineering certifications.