Data Engineer – Databricks Migration

Lynn Rodens is seeking Data Engineers to support a large-scale Databricks migration in a healthcare data environment. The role focuses on building ingestion pipelines, ETL processes, and reliable silver and gold data layers, while collaborating with BI teams and addressing data privacy and security requirements.

Responsibilities:

• Design and implement Databricks ingestion pipelines from multiple source types
• Build and optimize silver and gold tables based on existing warehouse solutions
• Develop ETL processes using Azure Databricks, DBSQL, SQL Server, T-SQL, and SSIS
• Ingest data from RDBMS platforms, XML, JSON, flat files, and APIs
• Partner with BI analysts and developers on data design and reporting requirements
• Participate in design and code reviews
• Test, troubleshoot, and resolve complex data and performance issues
• Support data-model and data-warehouse development
• Ensure solutions comply with privacy and security requirements, including HIPAA

Requirements:

• 4+ years of related Data Engineering experience
• Strong SQL and T-SQL skills
• Strong Azure Databricks and ETL experience
• Experience with database performance tuning and security
• Data warehousing and data-modeling experience
• Strong communication and collaborative problem-solving skills
• This is a hands-on Data Engineer position
• Power BI, Health Catalyst, and Epic experience