SIMARN Solutions is seeking a Lead Data Engineer to design and maintain scalable data pipelines and architectures. The role involves leading a team to deliver robust data solutions and collaborating with stakeholders to understand data requirements.
Responsibilities:
- Designs, builds, and maintains scalable data pipelines and architectures, leading a team to deliver robust data solutions
- Drive the design, architecture, and implementation of robust, scalable data pipelines (batch/streaming) and data warehouses
- Create efficient data models and manage data modeling standards for structured and unstructured data
- Optimize data systems and pipelines for performance, scalability, and cost-efficiency; resolve data-related issues
- Work with stakeholders (Data Scientists, Product Managers) to understand data requirements
- Define the strategy for adopting modern technologies and cloud platforms
Requirements:
- 5-9 years of experience
- Azure Cloud
- MS Fabric
- ADF
- Azure SQL
- Snyapse
- DBT
- Designs, builds, and maintains scalable data pipelines and architectures
- Drive the design, architecture, and implementation of robust, scalable data pipelines (batch/streaming) and data warehouses
- Create efficient data models and manage data modeling standards for structured and unstructured data
- Optimize data systems and pipelines for performance, scalability, and cost-efficiency; resolve data-related issues
- Work with stakeholders (Data Scientists, Product Managers) to understand data requirements
- Define the strategy for adopting modern technologies and cloud platforms
- Data Mesh implementation
- Insurance domain