Key skills
PythonAIETLELTData EngineeringData WarehousingAnalyticsBIRedshiftAirflowdbtAWSServerlessGlueAgileScrumCI/CD
About this role
EPITEC is a company focused on delivering cutting-edge data analytics and AI solutions. They are seeking two Senior Data Engineers to enhance a high-visibility AWS data ecosystem, focusing on data quality, test automation, and platform reliability.
Responsibilities:
- Define end-to-end testing scope aligned with solution architecture
- Design and implement scalable data testing strategies and frameworks
- Build and maintain automated test scripts for AWS Redshift serverless
- Perform validation across tools including:
- AWS Redshift, Glue, DMS
- PySpark Deequ, EventBridge
- Data Lakes, Airflow, dbt
- Ensure:
- Data ingestion accuracy
- Transformation integrity
- End-to-end pipeline reliability
- Conduct test coverage analysis and manage test data
- Review architecture, data models, and technical designs
- Partner with Data Engineering, BI, DevOps, and Product teams to ensure quality and mitigate risk
Requirements:
- Strong experience in data QA, ETL validation, or data engineering testing
- Hands-on expertise with AWS data services (Redshift, Glue, DMS)
- Proficiency in Python for automation and validation
- Experience with Airflow and orchestration testing
- Hands-on experience with dbt
- Knowledge of Data warehousing concepts
- ETL/ELT pipelines
- Data validation techniques (schema validation, reconciliation, anomaly detection)
- Experience designing enterprise-level testing strategies
- Knowledge of CI/CD pipelines for data platforms
- Agile/Scrum experience
- Familiarity with data observability frameworks
- Experience with BI testing (QuickSight preferred)
- Exposure to Gen AI technologies