Senior Data Software Engineer (Databricks)

EPAM Georgia is a team of innovators united by a passion for technology, and they are seeking a Senior Data Software Engineer skilled in Databricks. This role involves designing and maintaining scalable data pipelines, optimizing data models, and ensuring data quality in a collaborative work environment.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and architectures
• Optimize data models and enhance ETL processes utilizing Databricks and related technologies
• Implement rigorous data quality checks and monitoring to guarantee high integrity
• Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools
• Troubleshoot and resolve data-related issues promptly
• Participate in code reviews ensuring adherence to high standards of code quality

Requirements:

• Hands-on experience with Databricks, including Delta Lake, workflows, Delta Live Tables, along with deployment and versioning strategies
• Solid understanding of data architectures and data modeling skills
• Expertise in Spark, using either Scala or PySpark
• Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting, and code style checks
• Engineering background in AWS, Azure, or Google Cloud Platform
• Experience with big data and performance optimization of data-intensive applications
• Proactive approach and prior client-facing experience
• Ability to navigate ambiguity and work independently
• Desire to engage in a transparent, fast-moving startup environment
• Fluent English communication skills at a B2+ level or higher