Staff - Data Quality & Test Engineer, Development (51576)

Citrin Cooperman offers a dynamic work environment, fostering professional growth and collaboration. They are seeking a Staff – Data Quality & Test Engineer, Development to join their Development team within the Information Technology department, focusing on building and scaling their enterprise data platform using Microsoft Fabric while ensuring data integrity and accuracy throughout the transition from legacy systems.

Responsibilities:

• Source-to-Target Validation: Design and execute rigorous migration testing. Ensure data extracted from legacy on-premises SQL Servers and SaaS providers matches the data loaded into Fabric OneLake with 100% fidelity, accounting for structural transformations
• Automated Data Quality (ADQ): Develop and implement automated testing frameworks (e.g., using Python, PySpark, or tools like Great Expectations/dbt tests) to continuously check for data freshness, completeness, uniqueness, and referential integrity
• Pipeline & ETL QA: Test the logic of Azure Data Factory pipelines and Fabric notebooks. Validate that business rules and transformations are accurately applied before data reaches end-user reporting layers
• CI/CD Test Integration: Embed automated test scripts into Azure DevOps/GitHub Actions pipelines so that no new data model or pipeline code can be deployed to production without passing rigorous regression tests
• Performance & Load Testing: Partner with DBAs and Cloud Engineers to simulate heavy query loads, ensuring the Fabric capacities and SQL endpoints perform within strict enterprise SLAs
• Incident Triage & Alerting: Configure alerting thresholds for data anomalies. When a data pipeline runs successfully but generates bad data (e.g., an unexpected spike in null values), ensure the team is alerted immediately before stakeholders see the report

Requirements:

• Have a bachelor's degree in computer science, data engineering, mathematics, or equivalent practical experience
• Be Microsoft Certified: Fabric Data Engineer Associate (DP-700)
• Be Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Be an ISTQB Certified Tester Advanced Level – Test Analyst (CTAL-TA)
• Have 2–4+ years of experience in Software Quality Assurance, Data Testing, or Data Engineering within an enterprise environment
• Be extremely proficient in SQL for complex data querying, comparison, and validation across massive datasets
• Possess strong programming skills in Python (specifically using testing libraries like pytest or data manipulation libraries like Pandas/PySpark)
• Have experience testing data warehouse implementations, ETL/ELT pipelines, and BI reporting layers
• Be familiar with modern data stack concepts (Medallion architecture, Data Lakehouses) and cloud environments (Microsoft Fabric, Azure, or AWS)
• Have experience integrating test automation into CI/CD pipelines
• Be constructively skeptical: Never assumes a successful pipeline run means the data is correct. Always look for the edge cases that developers might have missed
• Be detail-obsessed: Deeply analytical and capable of tracking down a single dropped record or rounding error across millions of rows
• Be an automation champion: Refuses to rely on manual spot-checks. If a test needs to be run more than once, instinctively write a script to automate it