Build and maintain the pipelines that move and process data from disparate sources into our data lakehouse platform
Facilitate data preparation for use cases involving internal reporting, data lakehouse integrations, and predictive analytics
Work closely with our analytics and reporting team to create and maintain curated data marts.
Leverage agile software development methods to make iterative enhancements to the data lakehouse infrastructure and ETL processes
Working with the Snowflake Platform (Horizon Catalog, Snowpark, Cortex AI, etc)
Data ingestion tools such as Fivetran, CData, AWS Glue, or Apache Kafka
Working with the full suite of AWS Services (S3, Lambda, Glue, Athena, Lake Formation , etc)
Working with relational databases such as Microsoft SQL Server and PostgreSQL
Working with version control software such as Git and Bitbucket
Working with the various business units to analyze need, recommend solutions, and work with the team to prioritize, plan, and execute on deliverables
Communicate with other Digital teams and Business Units to clearly define project goals, discuss timelines, and provide input on solutions
Become an agent of change and use your creativity and skills to implement new technology and skills
Requirements
Degree or certification in Computer Science, Mathematics, Statistics, Econometrics, Business, or equivalent
3-4+ years working proficiently with SQL, Python and DataFrames.
2+ years of experience with the Snowflake Data Cloud, preferably worked on Data Pipes, Streams, Streamlit, Dynamic Tables, and Snowpark.
Familiarity with the AWS ecosystem, preferably the Analytics services and common utilities such as S3, SNS, SQS, Lambda Functions, Cloudwatch, etc.
Good knowledge of working with semi-structured data, particularly JSON
Strong in writing complex queries that involve nested joins, derived tables and common table expressions.
Capable of performing technical root cause analysis and delivering corrective action.
Experience working with APIs a plus
A passion for learning
Great communication, note taking, and organizational skills
An ability to leverage web searches and online training to obtain new skills quickly
An ability to present to all levels of audience
Experience with Production Support and Troubleshooting
An enthusiastic and positive attitude
Experience working with external vendors a plus
Ability to take ownership and see tasks through to completion
Tech Stack
Apache
AWS
Cloud
ETL
Kafka
MS SQL Server
Postgres
Python
SQL
Benefits
Competitive compensation package
Generous 401K employer match
Employee Stock Purchase plan with employer matching
Generous Paid Time Off
Excellent benefits that go beyond health, dental & vision.
A core C&F tenet is supporting your career development, so we provide a wealth of ways for you to keep learning, which may include tuition reimbursement, industry-related certifications and professional training to keep you progressing on your chosen path
A dynamic, ambitious, fun and exciting work environment
Volunteer opportunities, and an employee-driven corporate giving program that lets you participate and support your community