Data Engineer II, Snowflake, Databricks, Ab Initio

Role Overview

• Build and operationalize complex data solutions, correct problems, apply transformations, and recommending data cleansing/quality solutions.
• Design complex data solutions.
• Perform analysis of complex sources to determine value and use and recommend data to include in analytical processes.
• Incorporate core data management competencies including data governance, data security and data quality.
• Collaborate within and across teams to support delivery and educate end users on complex data products/analytic environment.
• Perform data and system analysis, assessment and resolution for complex defects and incidents and correct as appropriate.
• Test data movement, transformation code, and data components.
• Perform other duties as assigned.

Requirements

• Bachelor’s Degree in STEM related field or equivalent.
• Eight years of related experience.
• Exhibited expert-level experience designing, developing, and maintaining scalable data pipelines and ETL/ELT workflows using Snowflake, Databricks, and Ab Initio platforms.
• Strong programming skills in Python, SQL, and Spark with experience optimizing complex queries and data transformations for performance and cost efficiency.
• Experience with data quality frameworks, data governance practices, and implementing monitoring and alerting solutions for data pipelines.
• Highly proficient use of tools, techniques, and manipulation including Cloud platforms, programming languages, and a full understanding of modern software engineering practices.
• The ability to deliver work at a steady, predictable pace to achieve commitments, deliver complete solutions but release them in small batches, and identify and negotiate important tradeoffs.
• Demonstrated track record of domain expertise including understanding technical concepts necessary and industry trends, and possess in-depth knowledge of immediate systems worked on and some knowledge of adjacent systems.
• Strong problem solver who ensures systems are built with longevity and creates innovative ways to resolve issues.
• Strong written and verbal communication skills with the ability to work collaborate well with team members and business partners.
• Ability to lead team members and help create a safe environment for others to learn and grow as engineers. and a proven track record of self-motivation in identifying opportunities and tracking team efforts.
• Bachelor’s degree in computer science, related STEM field, or its equivalent in education and/or work experience.
• 4 additional years of data engineering experience.

Tech Stack

• Cloud
• ETL
• Python
• Spark
• SQL

Benefits

• Health Insurance : Employees and their eligible family members – including spouses, domestic partners, and children – are eligible for coverage from the first day of employment.
• Retirement: Travelers matches your 401(k) contributions dollar-for-dollar up to your first 5% of eligible pay, subject to an annual maximum. If you have student loan debt, you can enroll in the Paying it Forward Savings Program. When you make a payment toward your student loan, Travelers will make an annual contribution into your 401(k) account. You are also eligible for a Pension Plan that is 100% funded by Travelers.
• Paid Time Off: Start your career at Travelers with a minimum of 20 days Paid Time Off annually, plus nine paid company Holidays.
• Wellness Program: The Travelers wellness program is comprised of tools, discounts and resources that empower you to achieve your wellness goals and caregiving needs. In addition, our mental health program provides access to free professional counseling services, health coaching and other resources to support your daily life needs.
• Volunteer Encouragement: We have a deep commitment to the communities we serve and encourage our employees to get involved. Travelers has a Matching Gift and Volunteer Rewards program that enables you to give back to the charity of your choice.