Database Engineer

Jobot is a leading technology-driven recruitment firm dedicated to connecting talented professionals with innovative organizations across various industries. They are seeking an experienced Azure Databricks & Data Factory Specialist to join their team, focusing on developing, maintaining, and optimizing data pipelines and analytics solutions within the Azure cloud ecosystem.

Responsibilities:

• Design, develop, and optimize scalable data pipelines using Azure Data Factory and Databricks
• Implement data lake and lakehouse solutions to facilitate efficient data storage and retrieval
• Build and maintain data models that support analytical and operational reporting needs
• Write and optimize SQL queries, Python, and Scala scripts for data processing and transformation
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions
• Ensure data quality, security, and compliance across all data systems
• Automate deployment and integration processes through CI/CD pipelines and version control systems
• Monitor system performance, troubleshoot issues, and implement improvements to enhance data workflows
• Stay current with emerging technologies and best practices in cloud data engineering and analytics

Requirements:

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field. A master's degree is a plus
• Proven experience working with Azure Databricks and Azure Data Factory in a professional setting
• Strong knowledge of data lake and lakehouse architectures
• Expertise in data modeling, SQL, Python, and Scala
• Experience with CI/CD pipelines, Git version control, and DevOps practices
• Familiarity with data security, governance, and compliance standards
• Excellent problem-solving skills and the ability to work independently and within a team environment
• Effective communication skills to translate complex technical concepts to non-technical stakeholders