Data Engineer IV (Senior Developer – Informatica Cloud Migration & Snowflake Optimization)

Pyramid Consulting, Inc. is a leading Food and Beverage Manufacturing company, and they are seeking a Data Engineer IV to lead the migration of ETL processes to the cloud and optimize Snowflake performance. The role involves redesigning data pipelines, ensuring data integrity, and collaborating with cross-functional teams for seamless deployment and support.

Responsibilities:

• (60%) Data Pipeline Migration & Development: Redesign and migrate existing Informatica PowerCenter mappings, workflows, and sessions to Informatica Cloud (IICS) on Azure, ensuring new cloud-based ETL pipelines are efficient, scalable, and maintain data integrity.Perform end-to-end development, testing, and validation of migrated components to guarantee quality and reliability
• (30%) Snowflake Performance Optimization: Leverage Snowflake metadata (e.g. ACCOUNT_USAGE & INFORMATION_SCHEMA views) to identify query performance bottlenecks, optimize warehouse sizing and query design, and implement tuning measures for improved efficiency and cost control.Monitor and fine-tune the Snowflake environment for optimal performance and resource utilization
• (10%) Collaboration & Support Handoff: Work closely with operations partners and cross-functional teams to plan deployment strategies, address operational issues, and ensure a seamless transition of the new data pipelines and Snowflake enhancements to the support team.Prepare necessary documentation and knowledge transfer materials for post-migration support and maintenance

Requirements:

• Must have experience in 'Informatica PowerCenter', 'Informatica IICS/IDMC', 'Snowflake', 'SQL', 'Azure'
• 5+ years of experience in data integration / ETL development, with substantial expertise in Informatica PowerCenter (v9.x or higher) for building and maintaining ETL workflows
• Hands-on experience migrating Informatica PowerCenter to Informatica Cloud (IICS/IDMC) on Azure – including redesigning ETL pipelines for a cloud-native environment, conducting unit testing, and validating migrated data flows
• Strong proficiency in Snowflake cloud data warehouse, including writing complex SnowSQL queries and using Snowflake's metadata and tools for performance tuning and optimization
• Snowflake/SnowSQL certification (e.g. SnowPro Core) or equivalent demonstrable experience with Snowflake metadata and query optimization is required
• Excellent SQL and data modeling skills for data warehouse design and metadata management, with experience in both ETL and ELT patterns
• Familiarity with performance tuning of SQL queries and ETL processes is expected
• Strong written and verbal communication skills and the ability to work effectively as an individual contributor in a collaborative, team-oriented environment
• Proven ability to coordinate with stakeholders (e.g. architects, operations/support teams) and work independently to drive projects to completion
• Experience with Azure cloud services related to data integration and analytics (such as Azure Data Factory, Azure Data Lake Storage, etc.) and general cloud solution architecture experience strongly desired
• Familiarity with DevOps practices for data pipelines, including version control (Git) and CI/CD automation for ETL deployments, is a plus
• Experience with BI/analytics tools (especially Power BI) and understanding of how ETL and data warehouse performance impacts reporting is beneficial
• Experience working in Agile development teams and comfort with iterative project delivery is preferred
• Prior experience collaborating with external service providers or globally distributed teams is a plus
• Snowflake SnowPro certification (if not already counted in required skills) is a bonus