Key skills
PythonSQLAIMLETLELTData EngineeringAnalyticsBIPower BIAirflowApache AirflowAzure
About this role
Lumen Resources is seeking a Data Engineer to join a dynamic team working on cutting-edge predictive analytics and AI/ML-driven data solutions. This role involves designing, building, and optimizing scalable data pipelines while collaborating with cross-functional teams to ensure data quality and pipeline reliability.
Responsibilities:
- Design, build, and optimize scalable data pipelines for AI/ML workloads
- Develop and maintain data models to support advanced analytics
- Work with Microsoft Fabric (Lake House, Semantic Models, Materialized Lake Views)
- Implement data orchestration and scheduling workflows using Apache Airflow
- Collaborate with cross-functional teams to ensure data quality and pipeline reliability
- Leverage Azure cloud services for data processing and transformation
- Build and maintain Power BI integration for analytics reporting
Requirements:
- 7+ years of hands-on data engineering experience
- Expert-level Python programming skills
- Strong SQL proficiency
- Proven experience with Microsoft Azure (Azure Data Factory, Azure Synapse, or similar)
- Deep understanding of data pipelines and ETL/ELT processes
- Experience with data modeling and database design
- Hands-on experience with scheduling and orchestration tools (Apache Airflow strongly preferred)
- Ability to work 9am-6pm EST (if remote outside Eastern time zone)