Data Engineer

Shamrock Value Private Limited is seeking a Data Engineer to join their Data Operations team, which focuses on enhancing data usage capabilities across the company. The role involves supporting the migration of dbt models to Trino while ensuring compatibility and performance, collaborating with engineering and analytics teams to maintain high-quality data products.

Responsibilities:

• You will be responsible for supporting the migration of dbt models from Redshift and Snowflake to Trino (Iceberg) while ensuring compatibility, performance, and best practices in our evolving infrastructure
• Your role will require a deep understanding of SQL dialects, data modeling principles, and dbt best practices
• You will collaborate with both engineering and analytics teams to ensure seamless model transitions and maintain quality standards
• Specifically, you will:
• Fix Redshift and Snowflake SQL Syntax to Trino Syntax in our dbt models
• Version control dbt models via Git
• Refactor and optimize data models, ensuring they align with best practices for Iceberg
• Work with Tableau assets, ensuring data sources align with the new infrastructure
• Collaborate with workbook owners to validate and test the impact of migration work
• Engage in daily standups and work alongside engineers to execute migration priorities efficiently

Requirements:

• BS/BA in Computer Science, Information Systems, Mathematics, or a related technical field (or equivalent work experience)
• 2+ years of experience in a data engineering, BI, or analytics role
• 1+ years of experience working in financial services and/or SaaS companies
• Experience in dbt and modern data modelling best practices
• Version controlling via Git is a must
• Strong proficiency in SQL, with experience in Multiple SQL Syntaxes (Redshift, Snowflake, and Trino (Iceberg))
• Deep understanding of dbt, including model development, macros, and Jinja templating
• Experience with BI tools, such as Tableau, and a working knowledge of data source construction
• Strong stakeholder communication skills, particularly in guiding teams through infrastructure changes
• Experience refactoring SQL and dbt models to support infrastructure migrations
• Experience working in startup environments is a plus