Data Engineer

JSG (Johnson Service Group, Inc.) is seeking a Data Engineer responsible for building, orchestrating, and optimizing Azure-based data pipelines and transformations. The role involves creating data pipelines, performing testing, and providing production support for enterprise data platforms.

Responsibilities:

• Create and enhance data pipelines leveraging existing ingestion frameworks and tools
• Orchestrate data pipelines using Azure Data Factory
• Develop/enhance data transformations to parse, transform, and load data into Enterprise Data Lake, Delta Lake, and Enterprise DWH (Synapse Analytics)
• Perform unit testing and coordinate integration testing and UAT
• Create pipeline documentation including HLD, DD, and runbooks
• Configure compute, implement data quality rules, and manage pipeline maintenance
• Conduct performance tuning and optimization
• Provide production support and operational troubleshooting

Requirements:

• Databricks (Data Engineering)
• DLT
• Azure Data Factory
• SQL
• PySpark
• Synapse (Dedicated SQL Pool)
• Azure DevOps
• Python
• Azure Function Apps
• Azure Logic Apps