Data Engineer

ExactCare Pharmacy, LLC is hiring a Data Engineer to build and support data pipelines that power analytics, reporting, and operational systems. The role focuses on Databricks pipeline development, production support, and migrating Azure Data Factory workflows and Azure Functions to Databricks.

Responsibilities:

• Pipeline Development — Design, develop, test, and maintain scalable, reliable data pipelines within Databricks, using PySpark, SQL, Delta Lake, and Databricks Workflows/Jobs
• Build ETL/ELT processes that ingest, transform, and deliver data from a variety of source systems into curated, analytics-ready datasets
• Implement data quality checks, validation logic, and monitoring/alerting to ensure pipeline reliability and data accuracy
• Escalation & Production Support — Act as a primary point of escalation for production data pipeline issues, performing root-cause analysis, troubleshooting failures, and implementing timely fixes
• Partner with support and business teams to triage incoming issues, communicate status, and drive incidents to resolution within SLA
• Document recurring issues and implement long-term fixes or process improvements to reduce future escalations
• Azure-to-Databricks Migration — Lead and execute the migration of existing Azure Data Factory pipelines and Azure Functions to the Databricks platform, re-architecting logic as needed to leverage Databricks-native capabilities
• Validate data parity and pipeline performance between legacy Azure-based solutions and their Databricks replacements, ensuring a clean, low-risk cutover
• Retire legacy Azure Data Factory/Azure Functions components once migrations are validated and stable
• Collaboration & Best Practices — Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical designs
• Follow version control, code review, and CI/CD best practices for all pipeline code and configuration
• Contribute to documentation of pipeline architecture, data flows, and operational runbooks
• Embody AnewHealth’s Core Values in all communications and interactions
• Other duties as assigned

Requirements:

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience
• Required: 3+ years of experience as a Data Engineer building and supporting production data pipelines
• Hands-on experience developing data pipelines in Databricks, including PySpark, Delta Lake, and Databricks Workflows/Jobs
• Experience with Azure Data Factory and/or Azure Functions, with the ability to interpret existing ADF pipelines/Functions and re-implement them in Databricks
• Strong SQL skills, including query optimization and experience with relational and dimensional data models
• Proficiency in Python for data engineering and pipeline automation
• Working knowledge of the broader Azure cloud ecosystem (e.g., Azure Data Lake Storage, Azure SQL Database, Azure Key Vault)
• Solid understanding of ETL/ELT design patterns, data warehousing concepts, and data quality/validation practices
• Strong troubleshooting and analytical skills, with the ability to diagnose and resolve production issues under time pressure
• Excellent communication skills, with the ability to explain technical issues clearly to both technical and non-technical stakeholders
• Applicants must be eligible to work in this country