ID Privacy - AI QA Engineer

IDPrivacy is seeking an AI QA Engineer to build end-to-end code and content testing processes and perform day-to-day QA with engineers. The role focuses on software quality and the accuracy of AI-generated content, including testing, debugging, and tracking quality metrics.

Responsibilities:

• Developing an overarching approach to QA and then designing processes to implement that approach
• Developing and executing exploratory and automated regression testing to ensure code quality
• Developing and executing exploratory and regression testing for AI-generated content to ensure its accuracy and remove hallucination
• Your duties will include designing and implementing tests, debugging, and defining corrective actions
• You will also review system requirements and track quality assurance metrics (e.g., defect densities and open defect counts)
• The QA Engineer role plays an important part in the company’s product development process
• You will be expected to monitor all stages of software development to identify and resolve system malfunctions to meet quality standards
• QA System conceptualization and design
• Review and analyze system specifications
• Collaborate with developers and product managers to develop effective strategies and test plans
• Execute test cases (manual or automated) and analyze results
• Evaluate product code according to specifications
• Create logs to document testing phases and defects
• Report bugs and errors to development teams
• Help troubleshoot issues
• Conduct post-release/post-implementation testing
• Work with cross-functional teams to ensure quality throughout the software development lifecycle
• Attend weekly project meetings, leadership calls, and external client calls as needed
• Perform other duties as assigned by the supervisor

Requirements:

• 4+ years of professional experience and a bachelor's degree in computer science, engineering, or a related field
• Understanding of testing and debugging of LLMs and LLM-derived products
• Highly organized and disciplined around QA testing, debugging, and bug prioritization
• Proven experience as a quality assurance tester or similar role
• Experience in project management and QA methodologies
• Familiarity with agile frameworks and regression testing
• Ability to document and troubleshoot errors
• Working knowledge of test management software (e.g., QTest, Zephyr) and SQL
• Excellent communication skills
• Attention to detail
• Analytical mind and problem-solving aptitude
• Experience with automated testing tools (e.g., Selenium, QTP, JMeter)
• Knowledge of programming languages (e.g., Java, Python) is a plus
• Experience in performance testing
• Familiarity with continuous integration tools (e.g., Jenkins, Bamboo)