About this role

Develop and deploy data pipelines for streaming and batch data sources
Create data models and implement business logic using required tools and languages
Collaborate with teams for performance tuning and data processing
Utilize Azure and Spark technologies in daily tasks

Experience working in Azure Databricks, Apache Spark
Proficient programming in Scala/Python/Java
Experience developing and deploying data pipelines for streaming and batch data sources getting from multiple sources
Experience creating data models and implementing business logic using tools and languages listed
Working knowledge in Kafka, Structured Streaming, DataFrame API, SQL, NoSQL Database
Comfortable with API, Azure Datalake, Git, Notebooks, Spark Cluster, Spark Jobs, Performance tuning
Must have excellent communication skills
Familiarity with Power BI, Delta Lake, Lambda Architecture, Azure Data Factory, Azure Synapse a plus
Telecom domain experience not necessary but really helpful

Data Engineer

Key skills