GenAI Platform Engineer

Accenture Federal Services is dedicated to helping the US federal government enhance national security and public safety through innovative technology. The GenAI Platform Engineer will operationalize AI services, implement governance, and optimize performance while ensuring reliability and safety in production environments.

Responsibilities:

• Operationalize LLM/RAG: Stand up and harden AI services (cloud or on‑prem) that ground responses in mission data with low hallucination rates
• Guardrails & governance: Implement prompt/version management, policy‑based filtering, role‑based access, audit trails, and safety checks aligned to federal guidelines
• Observability & SRE for AI: Define SLIs/SLOs (quality, latency, safety, cost), instrument metrics, run on‑call, lead postmortems, and reduce MTTR
• Performance & cost engineering: Optimize p95 latency with caching/batching/autoscaling; meter usage and apply FinOps to keep token/spend within targets
• Reusable platform components: Ship SDKs, CI/CD templates, and Terraform/IaC modules that accelerate multiple mission teams not one‑off projects
• Applied theory (where it matters): Use IR metrics (e.g., NDCG) to improve retrieval quality; apply queueing/control principles to hit latency SLOs; run offline/online evals for helpfulness, safety, and factuality

Requirements:

• Must be a US Citizen
• Strong in Python
• Experience with retrieval/vector search (e.g., pgvector/Milvus/OpenSearch) and grounding AI in enterprise data
• Think in SLOs and dashboards; you improve reliability, latency, safety, and cost with data
• Communicate clearly with engineers, PMs, and security stakeholders especially in compliance‑heavy environments
• Own production systems end‑to‑end: Integration deployment observability incident response
• Experience integrating leading cloud AI services or on‑prem inference stacks
• Background in evaluation/safety testing or A/B experimentation for AI experiences
• FinOps for AI: metering, budgets, and optimization strategies for usage and spend
• Prior work in regulated/secure environments (e.g., FedRAMP‑like controls, ATO processes) with fast shipping
• Contributions to internal frameworks or open‑source tooling; mentorship of engineers
• Advanced degree welcome but not required high‑impact delivery matters most