AI Software Engineer

OpenArc is recruiting an AI Software Engineer for an unnamed client. The role focuses on building and operating backend systems, integrating LLMs into production applications, and improving reliability and engineering practices.

Responsibilities:

• Design, build, and operate maintainable, scalable backend systems — distributed systems, cloud architecture, microservices, concurrency, and messaging where they fit
• Own reliability and maintainability end to end: when something breaks for a user, build the observability and processes that let us find and fix it fast, and ideally prevent it
• Apply LLMs where they earn their place: RAG/retrieval, tool and agent patterns (e.g., MCP), and prompt/evaluation design — including squeezing reliable behavior out of constrained models
• Direct AI coding tools effectively and verify their output rigorously: know what to ask for, and how to confirm it’s correct, performant, and safe to ship
• Review code, mentor, and raise the engineering bar across the team

Requirements:

• Experience designing, building, and operating production software systems, not just shipping features
• Strong command of distributed systems, cloud architecture, microservices, concurrency/multithreading, and messaging
• A track record of owning reliability, observability, debugging, and refactoring in real production systems
• Able to reason about correctness and trade-offs independently of AI — you can explain why your code is right, debug it when it isn't, and stand behind architectural decisions under pushback
• Comfortable in a heavily AI-assisted workflow, and disciplined about verifying AI-generated work rather than trusting it
• Hands-on experience integrating LLMs into production applications, plus RAG/retrieval and tool/agent patterns
• Practical prompt and evaluation design, especially getting reliable results from smaller or older models