Generative AI Platform Engineer
District of Columbia, United States of America
Full Time
3 weeks ago
$100,200 - $203,400 USD
No Visa Sponsorship
Key skills
CloudPythonTerraformAILLMRAGMilvusCachingCI/CDCommunication
About this role
Role Overview
- Operationalize LLM/RAG: Stand up and harden AI services (cloud or on‑prem)
- Implement prompt/version management, policy‑based filtering, role‑based access, audit trails, and safety checks
- Define SLIs/SLOs (quality, latency, safety, cost), instrument metrics, run on‑call, lead postmortems
- Optimize p95 latency with caching/batching/autoscaling; meter usage and apply FinOps
- Ship SDKs, CI/CD templates, and Terraform/IaC modules for multiple mission teams
- Use IR metrics to improve retrieval quality; apply queueing/control principles; run offline/online evals.
Requirements
- Must be a US Citizen
- Strong in Python
- Experience with retrieval/vector search (e.g., pgvector/Milvus/OpenSearch)
- Ability to think in SLIs/SLOs and enhance reliability, latency, safety, and cost with data.
- Clear communication with engineers, PMs, and security stakeholders especially in compliance-heavy environments.
Tech Stack
- Cloud
- Python
- Terraform
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Professional development opportunities