Software Engineer III

JPMorganChase is a financial institution providing banking, investment, and financial services. The Software Engineer III will build and operate platform capabilities for agent-based artificial intelligence and large language model solutions. The role involves developing reusable services, evaluation and observability systems, and secure, governed production solutions in collaboration with cross-functional stakeholders.

Responsibilities:

• Deliver end-to-end platform features for agent-based artificial intelligence use cases, from technical design through production deployment, monitoring, and ongoing improvements
• Build and maintain reusable services and components that enable teams to create, evaluate, and operate LLM-powered agents at scale
• Implement evaluation and testing approaches for LLM systems, including quality measurement, regression testing, and error analysis to improve reliability over time
• Develop observability capabilities such as tracing, metrics, logs, and analytics to support healthy operations and fast troubleshooting
• Apply security, safety, and governance-by-design patterns, including guardrails, access controls, and audit-ready operational practices aligned to security and governance requirements
• Collaborate with product managers and stakeholders to define success metrics, prioritize work, and deliver measurable business impact
• Partner across engineering, data, security, and risk and compliance stakeholders to ensure solutions are secure, stable, and scalable
• Produce clear documentation and reference implementations that accelerate adoption and promote responsible, consistent engineering practices