Key skills
Azure cloud platformDatabricksAzure Data FactoryETL/ELT toolsSQLPythondata modelingCI/CD pipelinesdata governancesecuritycomplianceAPI integrationmicroservices architectureanalytical skillsAzure certificationsAKS experienceproblem-solving skillsETLELTAnalyticsBusiness IntelligenceAzureKubernetesEKSAKSCI/CD
About this role
Yochana is seeking a highly skilled and experienced Senior Data Engineer to join their dynamic team. The role involves designing, building, and maintaining robust data pipelines within the Microsoft Azure ecosystem, focusing on ETL/ELT processes and data quality for analytics and business intelligence.
Responsibilities:
- Design, develop, and maintain cloud-based data pipelines and ETL/ELT workflows
- Build and optimize data architectures to support structured and unstructured data processing
- Collaborate with data analysts, data scientists, and business stakeholders to understand data needs
- Implement data quality, security, and governance best practices
- Monitor and troubleshoot data workflows to ensure high availability and performance
- Optimize database and data storage solutions for performance and cost efficiency
- Contribute to cloud adoption, migration, and modernization initiatives
Requirements:
- Strong expertise with Azure cloud platform
- Strong experience in Databricks
- Azure Data Factory proficiency required; building datasets, data flows, and pipelines in ADF (not just maintaining something already built)
- Hands-on experience with ETL/ELT tools and frameworks
- Proficiency in SQL, Python, and data modeling
- Knowledge of CI/CD pipelines and infrastructure-as-code tools
- Understanding of data governance, security, and compliance
- Exposure to API integration and microservices architecture
- Strong analytical and problem-solving skills
- Azure cloud certifications and/or past experience
- AKS (Azure Kubernetes Service) experience, and ETL related to applications containerized & deployed on AKS (or EKS)