Data Engineer - On-Premise Data Warehouse Support

Syren is engaging a Data Engineer to support its on-premises Data Warehouse and contribute to Cloud Data Warehouse development. The role focuses on monitoring and troubleshooting SSIS and T-SQL pipelines, resolving production issues, and developing cloud data models and pipelines with Azure Data Factory while supporting governance, documentation, and collaboration.

Responsibilities:

• Monitor and re-run failed data pipelines and workflows to ensure seamless operations on SSIS & T-SQL
• Troubleshoot and resolve production issues, focusing exclusively on bug fixes
• Maintain data accuracy and integrity across all pipelines
• Conduct root cause analysis for recurring failures and document resolutions
• Provide daily status reports on pipeline execution, highlighting failures, root causes, and applied fixes
• Collaborate with onshore teams to address critical production incidents
• Implement temporary workarounds to minimize downtime while working toward permanent solutions
• Gather and analyze business requirements for business datasets in the cloud
• Design, develop, and test data pipelines to support Cloud Data Warehouse initiatives
• Build and optimize batch processing and streaming jobs to ensure timely data refresh
• Implement Medallion Architecture and design models for structured data processing across different layers
• Collaborate with onshore teams to establish best practices and reduce technical debt
• Define data models and ETL strategies in alignment with stakeholder requirements
• Participate in regular stand-ups and discussions with onshore and offshore teams to ensure seamless collaboration
• Ensure compliance with data governance policies, security standards, and best practices
• Develop and maintain comprehensive runbooks to document cloud operations, ensuring clear, step-by-step guidance for troubleshooting and maintenance
• Standardize and optimize cloud workflows by creating detailed documentation that enhances efficiency, reduces downtime, and supports seamless knowledge transfer across teams

Requirements:

• 6 - 9 years of experience in Data Engineering
• Experience with monitoring, troubleshooting, and resolving production issues in on-premises environments
• Proficiency in SSIS & T-SQL
• Ability to maintain data accuracy and integrity across all pipelines
• Experience conducting root cause analysis for recurring failures
• Experience providing daily status reports on pipeline execution
• Ability to collaborate with onshore teams to address critical production incidents
• Experience implementing temporary workarounds to minimize downtime
• Experience gathering and analyzing business requirements for datasets in the cloud
• Experience designing, developing, and testing data pipelines for Cloud Data Warehouse initiatives
• Experience building and optimizing batch processing and streaming jobs
• Knowledge of Medallion Architecture and structured data processing
• Ability to define data models and ETL strategies
• Experience participating in regular stand-ups and discussions with teams
• Knowledge of data governance policies and security standards
• Experience developing and maintaining comprehensive runbooks for cloud operations
• Ability to standardize and optimize cloud workflows through detailed documentation