DATA ENGINEER

Diverse Lynx is a company focused on providing diverse workforce solutions, and they are seeking a Data Engineer to design and maintain scalable data pipelines. The role involves building and managing data warehouse solutions, developing ETL processes, and collaborating with various stakeholders to meet data requirements.

Responsibilities:

• Design| develop| and maintain scalable data pipelines using Python and SQL to support business and analytics requirements
• Build| optimize| and manage Snowflake data warehouse solutions| including data modeling| transformation| and performance tuning
• Develop and maintain ETL/ELT processes for integrating data from multiple source systems
• Write complex SQL queries| stored procedures| and scripts for data extraction| validation| and reporting
• Implement data quality checks and automated validation processes to ensure data accuracy and integrity
• Utilize Ruby-based test automation frameworks to validate data pipelines| data transformations| and application functionality
• Collaborate with business analysts| developers| QA teams| and stakeholders to understand and deliver data requirements
• Monitor and troubleshoot data workflows| resolving performance and production issues proactively
• Support CI/CD deployments and follow best practices for data governance| security| and compliance
• Contribute to the design of scalable| reliable| and high-performing data architecture within cloud environments

Requirements:

• Design, develop, and maintain scalable data pipelines using Python and SQL to support business and analytics requirements
• Build, optimize, and manage Snowflake data warehouse solutions, including data modeling, transformation, and performance tuning
• Develop and maintain ETL/ELT processes for integrating data from multiple source systems
• Write complex SQL queries, stored procedures, and scripts for data extraction, validation, and reporting
• Implement data quality checks and automated validation processes to ensure data accuracy and integrity
• Utilize Ruby-based test automation frameworks to validate data pipelines, data transformations, and application functionality
• Collaborate with business analysts, developers, QA teams, and stakeholders to understand and deliver data requirements
• Monitor and troubleshoot data workflows, resolving performance and production issues proactively
• Support CI/CD deployments and follow best practices for data governance, security, and compliance
• Contribute to the design of scalable, reliable, and high-performing data architecture within cloud environments