Data Engineer with Snowflake and Python

Scalence L.L.C. is seeking an experienced Senior Data Engineer with expertise in Snowflake and Python to design, develop, and maintain scalable data solutions. The role involves building ETL pipelines, collaborating with teams to deliver data solutions, and leveraging modern data engineering practices.

Responsibilities:

• Design, develop, and implement scalable ETL/ELT pipelines within and outside data warehouses using Python and Snowflake SQL
• Develop and optimize complex SQL queries for Snowflake Cloud Data Warehouse environments
• Perform data analysis, transformation, and integration activities within Snowflake
• Build and maintain Snowflake objects including:
• Stored Procedures
• Views
• Streams
• Tasks
• Snowpark applications
• Develop automation scripts using Python, Unix/Shell scripting, and other scripting technologies for data extraction, loading, and transformation
• Troubleshoot and resolve production issues related to Snowflake tables, data reloads, transformations, and data quality
• Create complex SnowSQL scripts supporting enterprise reporting and analytics requirements
• Work with databases including Oracle and Snowflake for data engineering and analytics solutions
• Explore and implement AWS cloud technologies to improve data processing capabilities and efficiency
• Participate in Agile development processes including sprint planning, stand-ups, and delivery activities
• Collaborate with cross-functional teams including data analysts, business users, and application teams

Requirements:

• 8+ years of experience in Data Engineering / IT industry
• Strong hands-on experience with Snowflake
• Strong hands-on experience with Snowpark
• Strong hands-on experience with Python
• Strong hands-on experience with PySpark
• Strong programming experience with Python libraries: Pandas, NumPy, Matplotlib
• Expertise in developing ETL pipelines and data transformation workflows
• Strong SQL skills including complex queries and performance optimization
• Experience with Snowflake features: Stored Procedures, Streams, Tasks, Views, SnowSQL
• Strong knowledge of PL/SQL and database scripting automation
• Experience working with databases such as Oracle and Snowflake
• Experience with GitHub and Jupyter Notebook
• Understanding of CI/CD concepts and tools
• Experience working in Agile/Scrum environments
• Snowflake SnowPro Data Engineer certification
• PySpark and Python certifications
• Experience with AWS cloud services
• Knowledge of Generative AI and GitHub Copilot
• Experience with modern data analytics and cloud data platforms