Job Summary
We are looking for a Data Engineer with strong expertise in Azure data platforms and big data technologies. The candidate will be responsible for designing, developing, and optimizing scalable data pipelines, ETLELT processes, and analytics solutions using Azure Synapse, SparkPySpark, and related technologies. Key Responsibilities
Design and develop scalable data ingestion and transformation pipelines.Build and optimize ETLELT solutions using Azure Synapse, SparkPySpark, and SQL.Develop data processing frameworks using Scala and Spark.Work with Cosmos DB and ADLS for data storage and management.Create and optimize complex SQL queries for reporting and analytics.Collaborate with business and technical teams to deliver data solutions.Ensure data quality, performance tuning, and operational stability.Support production deployments and troubleshoot data platform issues. Skill Requirements
Hands-on experience with Azure Synapse Analytics.Strong programming skills in Scala and SparkPySpark.Advanced SQL development and performance tuning experience.Experience with Scope, Cosmos DB, and Azure Data Lake Storage (ADLS).Good understanding of data warehousing and big data concepts.Strong problem-solving and communication skills.Preferred Skills:Azure Data Factory (ADF)Microsoft Fabric OneLakeKusto (KQL)CICD and Azure DevOps Other Requirements
