TEKsystems is a leading provider of business and technology services, and they are seeking a Cloud Data Engineer to design, build, and maintain scalable data pipelines and systems with a focus on Snowflake and Microsoft Azure. The role involves collaborating with various stakeholders to ensure seamless data flow and enable actionable insights while supporting data development and maintenance efforts in alignment with the Enterprise Data strategy.
Responsibilities:
- Proven experience as a Cloud Data Engineer or similar role, with a strong focus on Snowflake, including architecture, performance optimization and data modeling as well as hands-on experience with Azure cloud services
- Advanced Snowflake ETL/ELT Development: Design and develop complex ETL/ELT pipelines natively in snowflake using snowflake streams, tasks, SnowPipe and other features to automate data transformation and orchestration, leveraging Azure Data services and other tools where appropriate ensuring the efficient flow of data to multiple destinations for processing, storing, analysis, and delivery to downstream external consumers
- Cloud Data Architecture: Design and implement Snowflake-based data solutions to support enterprise data platforms, integrating with Azure Data Lake Storage (ADLS), Azure SQL Data Warehouse, Azure Databricks to support data extracts, data sharing, business intelligence, analytics, and data science initiatives
- Snowflake Data Architecture: Oversee the design and optimization of Snowflake architecture, including data models, schema design, partitioning, clustering, and query optimization to ensure high performance and low cost
- Work independently on your assigned stories/tasks, work with other engineers & analysts on the team to take code all the way to Production using Change Management process
- Participate in Architectural discussions, able to understand the bigger picture & expected to provide recommendation to make better architectural decisions for specific domains
- Perform regular Code Reviews and making sure best practices are followed
- Collaborate with Stakeholders: Work closely with cross-functional teams, including business data analysts, data architects, data scientists, project managers and business units, to define data requirements and implement data solutions that support business goals
- Data Security, Governance & Compliance: Implement best practices to ensure data privacy, security, and compliance with relevant governance in the cloud environment
- Automation and Monitoring: Implement and manage automated monitoring and logging for all data workflows and pipelines to ensure data integrity and operational reliability
- Troubleshooting and Support: Troubleshoot issues with data pipelines, data integrity, and platform performance, providing timely resolutions to business-critical data needs
- Ensure that all items follow company Change Management process
- Participate in scrum, backlog grooming, refinement, planning and review sessions
- Other duties as assigned
Requirements:
- Requires at least 6-10 years of relevant technical or business work experience with demonstrated experience within healthcare industry or data and analytics
- Bachelor's degree in computer science, Information Technology, Data Engineering, Mathematics, or a related field or comparable experience
- Expertise in designing and implementing data architectures on Snowflake including Snowpipe, snowflake Tasks and Snowflake streams and Azure including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure SQL Database, Azure Synapse, and Azure Databricks
- Advanced experience with Snowflake data platform, including schema design, data sharing, internal & external marketplace, performance tuning, and cost optimization
- Proficiency in SQL and good experience with writing complex queries, stored procedures, and managing large datasets
- SME level knowledge of Data Warehouse concepts, Data Modeling, database management systems (SQL and NoSQL), and ETL/ELT frameworks, ideally in Azure Data Factory or Azure Synapse
- Experienced with DevOps practices, Repos, Snowflake, and CI/CD pipelines for data solutions
- Ability to work in a collaborative, cross-functional team environment and communicate complex technical concepts to non-technical stakeholders
- Very Good understanding of Agile and Scrum processes
- Experience & eagerness for problem solving and root cause analysis for any issues
- Passionate to learn new technologies & techniques; eagerness towards understanding data & business processes to contribute & make a difference
- Ability to work collaboratively in a team environment
- Prior knowledge or willingness to learn healthcare and analytics industries
- Preferred fundamentals certification in Azure, Snowflake, Databricks, or comparable cloud platforms or technology
- Highly prefer candidates with a healthcare background ideally on the payer side