Sr. AL/ML Engineer

Markon is a consulting firm dedicated to advancing critical national, intelligence, federal civilian, and defense missions. The Senior AI/ML Engineer will support a program in the Annapolis Junction area by designing and integrating agentic AI workflows, developing RAG and tool-broker systems, evaluating models, and implementing AI governance capabilities.

Responsibilities:

• Design and integrate LLM/agent orchestration workflows using agentic frameworks such as LangGraph, Agno, and the NVIDIA NeMo Agent Toolkit
• Tune model gateway routing logic to select, evaluate, and optimize across multiple frontier and open-weight models for cost, performance, and mission fit
• Develop and integrate RAG pipelines, vector databases, and memory services to give agents access to mission knowledge and context
• Implement MCP (Model Context Protocol)-based tool-broker integrations so agents can safely and securely access enterprise tools and data
• Evaluate, benchmark, and tune models and agent behaviors; build automated evaluation pipelines to track quality, safety, and performance over time
• Partner with data scientists and mission analysts to translate research and prototypes into production-grade AI capabilities for the command
• Implement AI governance guardrails — content/safety filters, policy enforcement, and approval gates — for agentic workflows, and document model/agent architectures and evaluation results for reuse
• Research and evaluate emerging LLM, agent, and AI tooling to keep the command's AI capability current and adaptable