Leading 3–4 build teams, providing technical direction, coaching, mentoring, and technical governance.
May directly lead some data engineers for POCs, building coding frameworks that will be shared across teams, and other re-usable data assets.
May perform hands on designing, building, testing, and supporting analytical pipelines.
Establishing and enforcing design, engineering, and coding standards, including code reviews.
Leading CI/CD and designing reusable data tests for future releases.
Expanding your expertise into AI, ML, Lakebase, and other capabilities available in the DataBricks platform to these features are implemented as needed.
Driving Spark performance optimization and leading platform cost optimization opportunities.
Managing production monitoring, troubleshooting, and defect resolution.
Requirements
3–5 years of hands-on Databricks experience with other complementary technologies including data governance, reporting and dashboard, and source system technologies.
Proven experience in a Tech Lead role, including leading developers and distributing/decomposing work.
Strong communication skills with the ability to mentor, influence, and align cross functional stakeholders.
Ability to engage proactively with business leaders to recommend solutions aligned to strategy and support data self-service capabilities.
Solid grounding in general analytics, data warehousing, and modern data engineering practices.
Experience working in Agile frameworks and writing high-quality user stories.
Ability to navigate ambiguity and provide clarity for your team and partners.
Nice to have Azure and Fabric cloud experience.
Insurance industry business process and data knowledge.
Medical data experience.
Familiarity with data governance and data quality needs for business consumers and how they integrate with pipeline design.
Tech Stack
Azure
Cloud
Spark
Benefits
Competitive Compensation & Total Rewards Incentives
Comprehensive Healthcare Coverage
Multiple 401(k) Savings Plan Options
Auto Enrollment in Employer-Directed Retirement Account Feature (100% employer-funded!)
Generous Paid Time Off – Including 12 Paid Holidays, Volunteer Time Off and Paid Family Leave
Disability, Life, and Long Term Care Insurance
Tuition Reimbursement, Student Loan Repayment and Training & Certification Support
Wellness support including gym membership reimbursement and Employee Assistance Program resources (work/life support, financial & legal management)