Lumen Resources is seeking a Data Quality Engineer to join a collaborative team working on cutting-edge AI/ML-driven data solutions. This role combines data engineering expertise with quality assurance to ensure the accuracy and reliability of complex data pipelines and machine learning models.
Responsibilities:
- Perform data quality testing for AI/ML-driven data pipelines
- Conduct manual testing with a path toward automation
- Validate data transformations and ML model outputs
- Verify ML DAGs (Directed Acyclic Graphs) and ensure prediction accuracy
- Deep-dive into datasets to confirm outputs are accurate and reliable
- Compare data across systems and validate data transport processes
- Build and implement automated data validation frameworks
- Collaborate with data engineers and ML teams to establish quality gates
Requirements:
- 4+ years of relevant hands-on experience as a Data QA Engineer
- Very strong SQL skills (complex queries, data validation, deep analysis)
- Hands-on experience with Microsoft Azure (Azure Data Factory, Azure Synapse, or Azure SQL)
- Deep understanding of data pipelines and data transformations
- Experience with data transport and ETL/ELT processes
- Ability to clearly explain technical decisions and validate data logic
- 4-5+ years of relevant hands-on experience