QualityWorks Consulting Group, LLC is seeking a mid-level Software Engineer / Application Developer to support an AI-enabled software platform in a federal and Department of Defense technology environment. The role focuses on troubleshooting and resolving application defects, maintaining secure production applications, and performing quarterly AI model tuning and optimization.

Responsibilities:

Investigate, troubleshoot, and resolve application bugs and system issues
Address confirmed defects identified through autonomous testing and human Test Engineer validation
Perform root-cause analysis for recurring and complex technical issues
Develop, test, document, and deploy reliable application fixes
Analyze application logs, APIs, databases, integrations, and infrastructure when diagnosing issues
Collaborate with Test Engineers to reproduce defects and validate implemented fixes
Address production issues and provide technical support for application incidents
Support application maintenance, upgrades, dependency updates, and security-related remediation
Participate in code reviews and follow established secure coding and development practices
Maintain technical documentation for application fixes, system behavior, configurations, and integrations
Support controlled application releases and deployments
Follow applicable government configuration-management and change-control processes
Protect government, sensitive, proprietary, and Controlled Unclassified Information (CUI), when applicable, in accordance with organizational and contractual requirements
Follow applicable access-control, cybersecurity, data-handling, and acceptable-use requirements
Conduct scheduled quarterly reviews and tuning of AI/model performance
Analyze AI behavior using autonomous testing results, human validation findings, production observations, and user feedback
Identify patterns of inaccurate, inconsistent, incomplete, or undesirable AI behavior
Adjust approved prompts, configurations, model parameters, workflows, guardrails, and integrations as appropriate
Establish baseline measurements before significant tuning activities
Validate proposed model/configuration changes in approved non-production environments before release
Collaborate with Test Engineers to independently validate AI behavior following tuning
Document significant model, prompt, configuration, and behavioral changes
Maintain appropriate traceability and version history for AI-related changes
Evaluate tuning results against defined quality and performance criteria
Monitor for regressions and unintended behavior following updates
Ensure model tuning activities comply with applicable government security, privacy, data-handling, and AI governance requirements

Requirements:

- 3–5 years of professional software engineering or application development experience
- Strong experience developing and maintaining production web applications
- Demonstrated experience troubleshooting and resolving application defects
- Strong debugging and root-cause analysis skills
- Experience working with APIs, databases, integrations, and distributed application components
- Proficiency in JavaScript/TypeScript, Python, Java, C#, or another relevant programming language
- Experience with modern frontend and/or backend development frameworks
- Experience with Git and modern source-control workflows
- Familiarity with CI/CD and controlled software deployment processes
- Experience collaborating with QA/Test Engineers to reproduce and resolve defects
- Understanding of secure software development principles
- Strong technical documentation and communication skills
- Be based in the United States
- Be legally authorized to work in the United States
- Be able to successfully complete the background investigation and adjudication required for the position
- Be eligible to obtain and maintain the required Public Trust determination for the assigned government program
- Be eligible to obtain and maintain access to applicable DoD/government information systems, including completion and approval of DD Form 2875 – System Authorization Access Request (SAAR) when required
- Complete required cybersecurity, information assurance, privacy, and security-awareness training
- Comply with government and organizational requirements governing credentials, system access, sensitive information, source code, application data, and acceptable use
- Maintain continued eligibility for government system access throughout employment when required by the assigned program
- Experience supporting U.S. federal government or Department of Defense applications
- Experience developing or maintaining applications incorporating generative AI or Large Language Models
- Experience integrating applications with AI/LLM APIs
- Experience with prompt engineering, model configuration, evaluation, or optimization
- Familiarity with AI model evaluation and performance measurement
- Experience with autonomous or agentic AI systems
- Experience with AWS, Azure, or other cloud environments
- Experience with application monitoring and observability
- Familiarity with Docker or other container technologies
- Familiarity with government cybersecurity, CUI, access-control, and change-management requirements
Existing Public Trust eligibility or previous federal/DoD experience is preferred but is not required unless specified by the applicable contract

Software Engineer / Application Developer

Key skills

About this role

Responsibilities:

Requirements: