Everforth ECS is seeking a Mid-Level Data Engineer to work remotely. This role will support the design, development, and optimization of scalable data pipelines and services for the Consumer Product Safety Commission enterprise data management environment, focusing on advanced analytics and modernization of Azure-based data infrastructure.
Responsibilities:
- Develop production-grade ETL workflows using Python and Microsoft-based frameworks
- Ingest, transform, and validate structured and unstructured data
- Implement schema enforcement, data validation, and quality checks
- Support Azure Data Lake Storage, Azure SQL, and Azure-based data services
- Design workflow orchestration using Azure Data Factory or Microsoft Fabric/Foundry
- Build Python-based data services using Pandas, PyTorch, TensorFlow, and related libraries
- Develop API endpoints and microservices to support analytics and ML platform interoperability
- Implement logging, monitoring, performance tuning, and operational reliability
- Collaborate with data scientists, analysts, architects, and governance teams
- Apply data governance best practices for compliance, reproducibility, and auditability
Requirements:
- Develop production-grade ETL workflows using Python and Microsoft-based frameworks
- Ingest, transform, and validate structured and unstructured data
- Implement schema enforcement, data validation, and quality checks
- Support Azure Data Lake Storage, Azure SQL, and Azure-based data services
- Design workflow orchestration using Azure Data Factory or Microsoft Fabric/Foundry
- Build Python-based data services using Pandas, PyTorch, TensorFlow, and related libraries
- Develop API endpoints and microservices to support analytics and ML platform interoperability
- Implement logging, monitoring, performance tuning, and operational reliability
- Collaborate with data scientists, analysts, architects, and governance teams
- Apply data governance best practices for compliance, reproducibility, and auditability