Position: Senior Data Engineer
Location: Bethlehem
Work Arrangement: Hybrid Minimum 2 Days On-site
Experience: 10+ Years in Data Engineering and ETL
We are seeking a strong Databricks-focused Data Engineer with expertise in ETL design, data pipeline development, and analytics, along with advanced SQL skills. Informatica experience is preferred to support legacy integration and migration initiatives.
Key ResponsibilitiesDesign and develop scalable data pipelines using Databricks, PySpark, and Delta Lake.
Build and optimize ETL/ELT workflows in cloud data platforms.
Perform data analysis, transformation, and integration across systems.
Collaborate with business and architecture teams to translate requirements into technical solutions.
Lead ETL design, optimization, and migration initiatives from Informatica to Databricks.
Perform data quality checks, reconciliation, and performance tuning.
Support deployment, monitoring, and production support activities.
Handle production issues, incident resolution, and performance optimization.
10+ years of experience in Data Engineering and ETL.
8+ years of experience coordinating with onsite and offshore teams, business stakeholders, and delivery teams.
Strong expertise in Databricks, including:
PySpark
Databricks Notebooks
Delta Tables / Delta Lake
Advanced SQL skills, including querying, optimization, and analytics.
Strong understanding of ETL/ELT design and data warehousing concepts.
Experience in data modeling and data pipeline design.
Good exposure to cloud platforms, preferably AWS.
Experience with Unix Shell Scripting.
Experience working in a hybrid/onshore-offshore delivery model.
Informatica IDMC experience is preferred.
Databricks
PySpark
Delta Lake
SQL
ETL/ELT Development
Data Engineering
Data Pipeline Design
Informatica IDMC
AWS
Unix Shell Scripting
Data Warehousing
Data Modeling
Data Quality and Reconciliation
Performance Tuning
Production Support
Onshore-Offshore Coordination
