Full-Stack AI Engineer (Agentic Solutions) | USC/GC | W2 Only.

Xlysi LLC is hiring a Full-Stack AI Engineer to build, evaluate, and deploy agentic AI solutions from approved specifications. The role uses coding agents and Azure technologies to deliver instrumented, tested software and support business validation and handover.

Responsibilities:

• Size stories with the product owner, flag effort and risks, and confirm data and access early
• Test the spec for buildability, prepare the repo and agent context, and record open questions
• Slice stories into tasks, estimate in story points and commit the sprint with the POD
• Build with coding agents: code, unit and integration tests, and documentation
• Implement agents on Copilot Studio, Azure AI Foundry Agents or Microsoft Agent Framework, including prompts, tools, connectors, workflows and integrations
• Build the data and retrieval layer:
• Document extraction pipelines with Azure AI Document Intelligence, including validation and confidence handling
• Chunking, embedding, indexing and hybrid search in a vector store such as Azure AI Search
• Calls to decision and rules APIs, with the LLM handling interpretation and drafting only
• Apply context engineering: write and version prompts and instructions, manage context windows, memory and tool results, and keep token use within budget
• Handle LLM calls reliably: structured outputs, retries, fallbacks, caching and rate limits
• Build evaluation sets and run evals on every release: automated metrics, LLM-as-judge and human review samples. Fix findings and resubmit
• Instrument every agent with OpenTelemetry. Build traces, dashboards and alerts for latency, token use, cost, errors and quality
• Run A/B tests as the architect designs them: variant routing, metric capture and result readouts
• Deploy through CI/CD, compile release evidence for go/no-go, and support the business through validation and handover