Senior Data Software Engineer with Databricks

EPAM Systems is seeking a Senior Data Software Engineer with Databricks to join an early-stage data platform initiative, playing a key role in shaping and maturing the platform while working closely with cross-functional teams to deliver robust and secure data solutions.

Responsibilities:

• Share best data engineering practices within the team and help to adopt them
• Work closely with architects to select the most optimal technical solutions
• Lead efforts to implement reusable software components to enable fast-paced data pipeline delivery
• Collaborate with cross-functional teams to ensure successful implementation and maintenance of the platform
• Ensure data security and confidentiality in the platform
• Provide technical assistance and support to stakeholders as needed
• Develop and maintain the Network Data hub platform

Requirements:

• 3+ years of experience in data engineering, with proficiency in Apache Airflow and data transformations
• Proficiency in data visualization
• Proficiency with databases, especially PostgreSQL
• Excellent communication and interpersonal skills
• English level B2 is required
• Familiarity with Apache Kafka
• Familiarity with Apache Spark
• Familiarity with Apache NiFi