Data Engineer Azure Cloud

Diverse Lynx is seeking a Data Engineer with strong hands-on experience in Azure Cloud technologies. The ideal candidate will design, develop, and optimize scalable data pipelines and cloud-based data solutions while collaborating effectively with cross-functional teams and business stakeholders.

Responsibilities:

• Designing, developing, and optimizing scalable data pipelines and cloud-based data solutions
• Expertise in ETL/ELT processing, data modeling, performance tuning, and data governance
• Proficiency in Python, SQL, GitHub, and CI/CD practices
• Working with large-scale datasets in enterprise environments
• Strong analytical and problem-solving skills
• Ability to work independently
• Ownership of end-to-end solution delivery
• Collaborating effectively with cross-functional teams and business stakeholders

Requirements:

• strong hands-on experience in Azure Cloud
• Azure Databricks
• PySpark
• Azure Data Factory (ADF)
• Delta Lake
• Unity Catalog
• designing, developing, and optimizing scalable data pipelines and cloud-based data solutions
• expertise in ETL/ELT processing
• data modeling
• performance tuning
• data governance
• proficiency in Python
• proficiency in SQL
• proficiency in GitHub
• proficiency in CI/CD practices
• experience working with large-scale datasets in enterprise environments
• strong analytical and problem-solving skills
• ability to work independently
• ownership of end-to-end solution delivery
• collaborating effectively with cross-functional teams and business stakeholders
• strong experience building REST or GraphQL APIs
• experience with Kubernetes (AKS preferred) for API deployment
• understanding of API security, contracts, error handling, and performance
• strong understanding of data governance, security, and CI/CD practices
• experience working on large-scale, cloud-native data platforms (Azure preferred)
• exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)