Key skills
PythonJavaScalaSQLETLELTAnalyticsSnowflakeDatabricksSparkSpring BootSpringAzureServerlessAzure Functions
About this role
Programmers.io is currently looking for a Data Engineer. The ideal candidate will design and build scalable data pipelines, perform complex transformations, and manage large datasets for analytics.
Responsibilities:
- Expert-level experience in Scala Spark and Databricks, including cluster management and data transformations
- Strong hands-on experience with Azure Data Factory (ADF) for orchestration and integration with on-prem systems
- Good experience in Python scripting and Snowflake (or SQL/Teradata) for data loading and processing
- Build and optimize ETL/ELT pipelines to transform and load data into Snowflake for analytics
- Experience with Azure Functions for serverless processing
- Knowledge of Java Spring Boot for API development/customization
- Strong SQL skills for data querying and optimization
Requirements:
- Expert-level experience in Scala Spark and Databricks, including cluster management and data transformations
- Strong hands-on experience with Azure Data Factory (ADF) for orchestration and integration with on-prem systems
- Good experience in Python scripting and Snowflake (or SQL/Teradata) for data loading and processing
- Build and optimize ETL/ELT pipelines to transform and load data into Snowflake for analytics
- Experience with Azure Functions for serverless processing
- Knowledge of Java Spring Boot for API development/customization
- Strong SQL skills for data querying and optimization