Data Engineer - IT Research

Sanford Health is one of the largest and fastest-growing not-for-profit health systems in the United States. The Data Engineer is responsible for providing technical support for Data Pipeline implementation, monitoring, and administration, while ensuring systems are scalable, efficient, and accurate.

Responsibilities:

• Provide technical support for Data Pipeline implementation, monitoring and administration
• Work with all the data environments across the enterprise
• Ensure that the systems are scalable, efficient, and accurate
• Assemble and manage large, complex datasets that meet both non-functional and functional business requirements
• Identify, design, and implement internal process improvements to enhance scalability, optimize data delivery, and automate manual processes
• Build and maintain optimal data pipeline architecture for efficient extraction, transformation, and loading of data from various sources
• Provide technical expertise and support for data-related issues
• Partner with data and analytics experts to enhance functionality and performance of data systems
• Design and deploy frameworks and microservices to serve data assets to data consumers
• Perform root cause analysis on data and processes to identify opportunities for improvement
• Act as a trusted advisor and partner to business leads, understanding their needs, interpreting data drivers, and aligning data strategies with business goals
• Evaluate customer requirements and contribute to the development of structural necessities within the data architecture
• Ensure database implementation procedures comply with relevant regulations
• Organize data within cloud storage and implement appropriate security measures
• Collaborate cross-functionally with multiple teams within the organization
• Work independently and collaboratively in a team environment
• Exhibit excellent analytical and problem-solving abilities
• Maintain strong attention to detail to ensure accuracy and predictability of data pipelines
• Effectively communicate with engineers, product managers, and analysts to understand data needs
• Commit to building secure, resilient, and fault-tolerant architectures with clear documentation and support procedures

Requirements:

• Bachelor's degree required in data engineering, data analytics, computer engineering, or a related field
• Minimum of 3 years' experience in data engineering or database analytics
• Must have strong programming skills in Python, Scala, and SQL
• Advanced SQL knowledge and experience working with relational databases
• Experience in SAS, Python and R in a healthcare or research setting highly preferred
• Prior work with various data management technologies such as RedShift, Postgres, or Snowflake is preferred