NR Consulting is embarking on the modernization of its core data platforms and is seeking a Data Movement Engineer. This role will involve providing production support for ETL environments, translating stakeholder requirements into Snowflake-specific solutions, and optimizing data pipelines and models for performance and reliability.
Responsibilities:
- Translate stakeholder requirements into Snowflake-specific solutions for data movement
- Develop and optimize SQL queries, warehouse configurations, and data models for performance, reliability, and scalability
- Design, develop, and optimize Snowflake data pipelines and models
- Support advanced features like Change Data Capture (CDC) and Slowly Changing Dimensions (SCD Type 2)
- Support frameworks like Data Vault and dimensional modeling in Snowflake
- Monitor and troubleshoot data pipeline failures and performance issues in ETL and Snowflake environments
- Thoroughly test all production solutions prior to implementation
- Perform root cause analysis of data discrepancies, latency, and integrity issues
- Provide production support for IBM DB2, Snowflake, and orchestration tools (Airflow, ESP)
- Collaborate with other teams to implement fixes and preventive measures
- Perform data quality analysis, report issues, and propose solutions
Requirements:
- Minimum of 5 years of relevant experience in data warehousing, business intelligence tools, and data analysis
- Minimum of 3 years of SQL query development across multiple database platforms (Snowflake, Oracle, SQL Server, DB2)
- Strong expertise in Snowflake as well as Talend
- Strong proficiency in SQL and scripting languages (e.g., Python, Shell)
- Experience with cloud database technologies
- Familiarity with orchestration tools (ESP, Airflow) and version control systems (Git)
- Experience with incident management tools (e.g., ServiceNow, Jira) and CI/CD practices
- Expertise in CDC and SCD Type 2 implementations using SQL
- Solid understanding of data architecture, dimensional modeling, and frameworks like Data Vault