EDP Quality Engineer-

Steneral Consulting is seeking an EDP Quality Engineer to ensure data quality and integrity throughout the Enterprise Data Platform lifecycle. The role involves validating data, supporting migration efforts, and collaborating with various stakeholders to maintain high-quality standards in data processing and testing.

Responsibilities:

• Validate data throughout the Enterprise Data Platform (EDP) lifecycle (ingestion, transformation, processing) to ensure data quality and integrity for downstream use
• Work primarily with Google Cloud Platform (BigQuery, Dataflow, Cloud Composer, Dataform, Cloud Storage)
• Support migration of legacy on-prem EDW workloads and development of new enterprise data products
• Design and execute both automated and manual data quality tests
• Collaborate with QA/QE Lead, Tech Leads, Data Architects, Data Engineers, Product Managers, Business Analysts, and SMEs
• Participate in User Acceptance Testing (UAT) and support release readiness activities
• Validate data ingestion, transformation, mapping, and business rule implementation across EDP layers (bronze, silver, gold)
• Perform source-to-target validation and reconciliation, including row counts, aggregates, and field-level checks
• Assess data quality dimensions: completeness, accuracy, consistency, timeliness, validity, uniqueness, referential integrity
• Develop, execute, and maintain automated/manual data tests (e.g., using Great Expectations, Dataform) and integrate with CI/CD pipelines
• Validate and monitor Cloud Composer DAGs and pipeline orchestration (dependencies, scheduling, error handling)
• Monitor pipeline runs, triage failures, prioritize issues, and work with Data Engineers on root-cause analysis
• Conduct regression testing and manage defect lifecycle using Jira
• Contribute to team quality standards, tooling, test patterns, and validation rule libraries
• Support release readiness by ensuring quality gates are met and performing post-release validation in production

Requirements:

• Validate data throughout the Enterprise Data Platform (EDP) lifecycle (ingestion, transformation, processing) to ensure data quality and integrity for downstream use
• Work primarily with Google Cloud Platform (BigQuery, Dataflow, Cloud Composer, Dataform, Cloud Storage)
• Support migration of legacy on-prem EDW workloads and development of new enterprise data products
• Design and execute both automated and manual data quality tests
• Collaborate with QA/QE Lead, Tech Leads, Data Architects, Data Engineers, Product Managers, Business Analysts, and SMEs
• Participate in User Acceptance Testing (UAT) and support release readiness activities
• Validate data ingestion, transformation, mapping, and business rule implementation across EDP layers (bronze, silver, gold)
• Perform source-to-target validation and reconciliation, including row counts, aggregates, and field-level checks
• Assess data quality dimensions: completeness, accuracy, consistency, timeliness, validity, uniqueness, referential integrity
• Develop, execute, and maintain automated/manual data tests (e.g., using Great Expectations, Dataform) and integrate with CI/CD pipelines
• Validate and monitor Cloud Composer DAGs and pipeline orchestration (dependencies, scheduling, error handling)
• Monitor pipeline runs, triage failures, prioritize issues, and work with Data Engineers on root-cause analysis
• Conduct regression testing and manage defect lifecycle using Jira
• Contribute to team quality standards, tooling, test patterns, and validation rule libraries
• Support release readiness by ensuring quality gates are met and performing post-release validation in production