Data QA Engineer / Data QA Lead
REMOTE
6+ Months
Position Details
* Position: Data QA Engineer / Data QA Lead
* Location: South Carolina preferred; remote candidates are acceptable.
* 1 Senior Onshore Resource: 10+ years
* 1 Senior Offshore Resource: 10+ years
* 1 Mid-Level Offshore Resource: 6+ years
Job Summary
We are seeking experienced Data QA professionals to lead and execute data quality testing, validation, and automation initiatives within a healthcare data environment. The resources will be responsible for developing QA strategies, validating healthcare payer data, implementing automated testing frameworks, and ensuring compliance with healthcare industry standards.
The senior resources will lead QA testing strategy and execution while mentoring and guiding junior QA team members.
Key Responsibilities
1. Data Testing & Validation
* Design and implement test plans, test cases, and test automation for data pipelines (ELT/ETL).
* Validate payer data, including claims, membership, provider, and clinical datasets.
* Conduct FHIR-based API testing for CMS interoperability compliance.
* Validate HEDIS measure calculations and quality reporting data.
2. CI/CD Integration
* Develop Azure DevOps test plans with QA gates for Databricks Jobs/DLT and ADF deployments.
3. Technical Delivery
* Collaborate with product owners, Azure Data Factory (ADF), and Databricks engineering teams to ensure end-to-end data quality.
* Build and maintain data quality automation frameworks leveraging PySpark, SQL, and Python.
* Work with data governance and business teams to resolve data quality issues.
4. Performance & Scalability
* Design automated load and stress tests for large-scale data pipelines.
5. Compliance & Best Practices
* Ensure data QA practices adhere to HIPAA, CMS, and payer industry standards.
* Document QA processes, test results, and provide audit-ready evidence.
* Mentor and guide junior QA resources.
Required Skills & Technical Expertise
* Strong expertise in Azure Databricks (Workflows, Delta Lake, Delta Live Tables, Unity Catalog).
* Hands-on experience with Azure Data Factory (pipelines, monitoring, CI/CD).
* Proficiency in Python, PySpark, and SQL for test automation.
* Knowledge of data governance, PII compliance, and data quality frameworks.
* Experience in CI/CD pipelines, DevOps practices, and cloud data platforms.
* Strong communication and leadership abilities for cross-functional teamwork
