Key skills
Spark notebooksDistributed data processingAzure Data FactoryEnterprise data warehouseETL design and developmentSpark SQLT-SQLSQL query optimizationSemantic data modelsSQLETLSparkAzure
About this role
Robert Half is working with a client to build out a secure and scalable data environment to support ongoing enterprise initiatives. The Senior Data Engineer Consultant will focus on hands-on development of data pipelines, ETL processes, and data integration workflows within an enterprise data warehouse environment.
Responsibilities:
- Design, build, and maintain data pipelines using modern data tools and frameworks
- Develop and optimize ETL processes to support data ingestion and transformation
- Work within enterprise data warehouse environments to ensure data reliability and performance
- Build and maintain Spark-based data processing workflows
- Write efficient and optimized SQL queries for data extraction and analysis
- Collaborate with cross-functional teams to support data modeling and reporting needs
Requirements:
- Strong hands-on experience with Spark notebooks and distributed data processing
- Experience building pipelines using Azure Data Factory
- Background working in enterprise data warehouse environments
- Strong experience with ETL design and development
- Proficiency in Spark SQL and T-SQL
- Ability to write highly efficient and optimized queries
- Experience working with semantic data models
- Prior experience within the financial services industry