Key skills
SnowflakeMatillionDBTMicrosoft Data StackSQLPythonCloud platformsProblem-solvingCommunication skillsLeadership experienceAIETLData EngineeringAnalyticsdbtAWSAzureGCPAzure SQLLeadershipCommunication
About this role
Sparq is a modern product engineering partner that helps organizations modernize confidently in the age of AI. They are seeking a highly skilled Senior Data Engineer to design, implement, and maintain scalable data pipelines and ETL processes while providing technical leadership and mentorship to junior team members.
Responsibilities:
- Design and implement scalable and high-performance data pipelines using Snowflake or Matillion, DBT, and the Microsoft Data Stack (Azure SQL Database, Azure Data Factory, Azure Synapse Analytics)
- Collaborate with cross-functional teams to gather requirements, define project scope, and develop data models
- Provide technical leadership and mentorship to junior data engineers, guiding them in best practices and coding standards
- Conduct code reviews to ensure quality, performance, and adherence to best practices
- Serve as a subject matter expert in Snowflake or Matillion, DBT, and the Microsoft Data Stack, staying abreast of industry trends and advancements
- Troubleshoot and optimize existing data pipelines and processes to improve performance and reliability
- Create and maintain technical documentation, including architecture diagrams, design documents, and implementation guides
Requirements:
- 5+ years of experience in data engineering, with a focus on cloud-based data platforms
- Extensive hands-on experience with either Snowflake or Matillion, DBT, and the Microsoft Data Stack (Azure SQL Database, Azure Data Factory, Azure Synapse Analytics)
- Proficiency in SQL and Python for data manipulation and transformation
- Strong problem-solving skills and the ability to troubleshoot and optimize data pipelines and processes
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with both technical and non-technical stakeholders
- Demonstrated ability to thrive in a fast-paced, dynamic environment and manage multiple priorities effectively
- Experience with other cloud platforms such as AWS, GCP, or Azure is a plus
- Prior experience in a leadership or mentorship role is highly desirable