Avenue Code is seeking a talented Data Engineer to join a strategic and innovative project in the energy and utilities industry. The role involves designing and developing data models and pipelines, while leveraging modern cloud technologies to support data-driven decision-making and scalable applications.
Responsibilities:
- Collaborate with Subject Matter Experts (SMEs) to design and develop data models (ontology) and data pipelines
- Design, build, and maintain robust data pipelines and ETL processes
- Develop and optimize cloud-based data storage and processing solutions
- Partner with data analysts and data scientists to deliver high-quality, scalable data solutions
- Ensure data integrity, security, and reliability across all workflows
- Monitor, troubleshoot, and enhance data pipelines to ensure continuous data availability
Requirements:
- Solid experience as a Data Engineer, with strong hands-on experience building data pipelines
- Strong SQL skills and experience working with large-scale and complex datasets
- Proficiency in Python and PySpark for ETL and data processing
- Experience with cloud-based data platforms and distributed data processing