Lead Data Engineer

Data Based Development Systems is seeking a Lead Data Engineer with expertise in complex data solutions. The role involves designing and maintaining data pipelines in the Azure Cloud platform, with a focus on HVR, Snowflake, and Matillion.

Responsibilities:

• Design, develop, implement, and maintain data pipelines in Azure Cloud platform using HVR, Snowflake, and Matillion
• Validate results and refine solutions as needed to meet business needs

Requirements:

• Must be a US Citizen
• Expert in HVR replication of SAP data sources to Snowflake
• Strong understanding of Snowflake architecture, features, and functionalities (e.g., virtual warehouses, data sharing, Snowpipe, data storage, and compute separation). Experience in designing, developing, and optimizing Snowflake-based data solutions. Includes SQL stored procedures and views
• Experience with Matillion ELT to extract, load, and transform data into Snowflake, leveraging the medallion architecture for the Snowflake progression of data. Familiarity with Matillion components, such as orchestration jobs, transformation jobs, variables, and connectors
• Strong analytical and problem-solving skills
• Strong communication skills
• Partnership with business analysts and customers to validate results and refine solutions as needed to meet business needs
• Databricks knowledge would be a plus