Forbes Technical Consulting is seeking a Senior Data Engineer to design, build, and maintain robust data pipelines and warehouse solutions in a cloud-first environment. The role involves implementing advanced Snowflake capabilities and leading migration initiatives from legacy data warehouses to Snowflake.
Responsibilities:
- Design, build, and maintain robust data pipelines and warehouse solutions in a cloud-first environment
- Implement advanced Snowflake capabilities (Streams, Tasks, Snowpipe, data sharing) for real-time and batch processing
- Lead migration initiatives from legacy data warehouses to Snowflake with minimal disruption
- Build data applications including Streamlit apps and Snowflake Native Apps
- Hands-on work with AWS cloud architecture using S3, Lambda, API Gateway, RDS, and more
- Collaborate with Product teams in an agile/scrum environment to translate requirements into solutions
Requirements:
- Proficient in SQL, PL/SQL, relational databases, and dimensional modeling
- Experience with Python or Unix scripting
- Good experience with Snowflake; familiarity with Streams, Tasks, Snowpipe
- Experience with Kafka or other streaming data platforms
- Strong understanding of data warehousing concepts and the full SDLC
- Experience building scalable ETL/data pipelines using Informatica IICS, Alteryx, or similar tools
- Hands-on experience with AWS native technologies: Glue, Lambda, Kinesis, Lake Formation, S3, Redshift
- Experience with data cleansing, validation, and wrangling
- Strong verbal and written communication skills
- Comfortable working in ambiguous, fast-changing environments