Databricks Engineer

Diverse Lynx is seeking a Databricks Engineer to design and develop high quality software solutions. The role involves building scalable data engineering solutions using Databricks and Apache Spark, while also mentoring junior developers and ensuring code quality.

Responsibilities:

• Design, develop, test, and deliver high quality software solutions aligned with business requirements
• Build, optimize, and maintain scalable data engineering solutions using Databricks and Apache Spark
• Architect and manage distributed data pipelines to ensure performance, reliability, and scalability
• Troubleshoot and resolve complex application and data issues through root cause analysis
• Ensure code quality and maintainability through reviews, standards, and best practices
• Implement CI/CD, testing, monitoring, and cost optimization practices for cloud data platforms
• Mentor junior and mid level developers and drive continuous improvement in engineering processes

Requirements:

• Hands on expertise in Databricks
• Hands on expertise in Spark
• Hands on expertise in SQL
• Hands on expertise in cloud based ETL pipelines
• Hands on expertise in CI/CD
• Strong software engineering fundamentals
• Design, develop, test, and deliver high quality software solutions aligned with business requirements
• Build, optimize, and maintain scalable data engineering solutions using Databricks and Apache Spark
• Architect and manage distributed data pipelines to ensure performance, reliability, and scalability
• Troubleshoot and resolve complex application and data issues through root cause analysis
• Ensure code quality and maintainability through reviews, standards, and best practices
• Implement CI/CD, testing, monitoring, and cost optimization practices for cloud data platforms
• Mentor junior and mid level developers and drive continuous improvement in engineering processes