Lead Data Software Engineer

EPAM Systems is seeking a Lead Data Software Engineer to build and scale big-data applications and cloud-native pipelines while advancing AI-assisted engineering practices. The role involves guiding cross-functional delivery across data and application layers and helping shape reliable, scalable architectures.

Responsibilities:

• Design scalable architectures for distributed data and application systems
• Lead technical delivery across data engineering and full-stack components
• Develop high-performance big-data applications using Scala, Databricks, Spark SQL, Spark Streaming, and Python
• Build and optimize Azure-based data pipelines including ingestion, transformation, and orchestration with Azure Data Factory
• Implement APIs and microservices that integrate marketing technology systems with client-facing platforms
• Build and maintain full-stack applications using modern frontend frameworks and backend services
• Apply design patterns to improve reliability, maintainability, and scalability
• Drive AI-assisted engineering practices including Vibe Coding and related accelerators
• Collaborate with product, marketing, and data stakeholders to align scope, priorities, and outcomes

Requirements:

• 5+ years of experience in data software engineering with Python and Scala
• 5+ years of experience with Databricks and Spark technologies including Spark SQL and Spark Streaming
• Proven leadership experience leading engineering teams in a fast-paced, cross-functional environment
• Hands-on project delivery experience translating business needs into technical solutions across data and application layers
• Strong system design skills including event-driven architectures and distributed design patterns
• Full-stack development skills with a modern frontend framework and backend services
• API design skills for RESTful and GraphQL interfaces
• Cloud engineering experience with Azure services including Azure Data Factory
• CI/CD pipeline experience supporting full-stack deployments
• Strong communication skills to align stakeholders and explain technical tradeoffs
• Upper-Intermediate English proficiency (B2)
• Availability to overlap with PST until 10 am PST
• Apache Spark
• Azure Data Factory
• Java