Design, develop, and maintain scalable data pipelines and workflows using Azure Databricks
Develop and maintain SAS programs and SSIS packages for intermediate and downstream data processing
Write, optimize, and maintain complex SQL queries to support data transformation and analytical use cases
Design and build ETL/ELT pipelines integrating data from multiple internal and external source systems
Select, implement, and support Big Data tools and frameworks for data processing and integration
Monitor, troubleshoot, and resolve complex data processing issues, applying root cause analysis and preventative fixes
Optimize data pipelines for performance, scalability, reliability, and cost efficiency
Recommend and support infrastructure improvements to meet evolving data volume and processing demands
Partner with product management and SRE teams to define requirements and translate them into actionable engineering work
Collaborate effectively with engineers, stakeholders, and cross functional teams to ensure alignment on data strategy, architecture, and outcomes

Bachelor’s degree in a science, engineering, or computing related discipline or equivalent practical experience
8+ years of experience designing and building production grade batch data pipelines for data ingestion and transformation
8+ years of overall experience in data engineering or related roles
Strong proficiency in the following technologies: SQL, Databricks, Python, Apache Spark, Git, Azure Services (Synapse, Azure ADLS Gen 2)
Strong understanding of relational database principles, data modeling, database management, and data warehousing
Strong knowledge of Big Data querying tools
Experience optimizing large-scale data pipelines and ETL workflows
Excellent communication and interpersonal skills.

Senior Data Engineer

Key skills