Senior Test Data Engineer

CGI is seeking a Senior Test Data Engineer to test enterprise data platforms, ETL/ELT pipelines, and data integration solutions. The role focuses on validating data quality and processing, developing and executing tests, managing defects, and collaborating with delivery teams in an Agile environment.

Responsibilities:

• Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions
• Perform end to end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems
• Develop and execute complex SQL queries for backend and data validation testing
• Test large scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF)
• Perform functional, integration, regression, system, and data quality testing across data pipelines and applications
• Validate batch processing, job scheduling, dependencies, and workflow execution using Control M and Unix/Linux environments
• Identify, document, track, and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution
• Develop and maintain reusable test scripts and automation solutions where applicable
• Participate in Agile/Scrum activities including sprint planning, refinement, daily stand ups, reviews, and retrospectives

Requirements:

• 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing
• Strong hands on SQL skills, including writing complex queries for source to target validation, reconciliation, and data quality testing
• Experience testing large scale data platforms and ETL/ELT pipelines
• Hands on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF)
• Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive
• Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control M
• Strong understanding of data quality concepts, data transformations, data mappings, and source to target validation
• Experience with defect management and test management processes within Agile/Scrum delivery environments
• Strong analytical, troubleshooting, communication, and collaboration skills
• Databricks
• Python
• SQL
• Test Analysis
• Test automation