Data Engineer, Data Platform - IntelliScript

Role Overview

• Data Platform: Creation of a Databricks Data Warehouse(s) and Lakehouse solutions for a healthcare data focused enterprise
• Data Governance: Configuring and maintaining unity catalog to enable enterprise data lineage and data quality
• Data Security: Building out Data Security protocols and best practices including the management of identified and de-identified (PHI/PII) solutions
• External Data Products: Building data solutions for clients while upholding the best standards for reliability, quality, and performance
• ETL: Building solutions within Delta Live Tables and automation of transformations
• Medallion Architecture: Building out performant enterprise-level medallion architecture(s)
• Streaming and Batch Processing: Building fit-for-purpose near real-time streaming and batch solutions
• Large Data Management: Building out performant and efficient enterprise solutions for internal and external users for both structured and unstructured healthcare data
• Platform Engineering: Building out Infrastructure as Code using Terraform and Asset Bundles Costs: Working with the business to build cost effective and cost transparent Data solutions
• Pipeline/ETL Management: You will help architect, build, and maintain robust and scalable data pipelines, monitoring, and optimizing performance
• Experience working with Migration tools i.e. Fivetran, AWS technologies and custom solutions
• Identify and implement improvements to enhance data processing efficiency
• Experience with building out effective pipeline monitoring solutions
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Delta Live Tables, Python, Scala, and cloud-based ‘big data’ technologies
• Collaboration: Partner internally and externally with key stakeholders to ensure we are providing meaningful, functional, and valuable data
• Effectively work with Data, Development, Analysts, Data Science, and Business team members to gather requirements, propose, and build solutions
• Communicate complex technical concepts to non-technical stakeholders and provide guidance on best practices
• Ensure that technology execution aligns with business strategy and provides efficient, secure solutions and systems
• Processes and Tools: Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build analytics tools that utilize the data pipeline to provide actionable insights into operational efficiency and other key business performance metrics
• Create data tools for clinical, analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader

Requirements

• 3+ years of relevant experience in design, development, and testing of Data Platform solutions, such as Data Warehouses, Data Lakes, and Data Products
• Experience working in Databricks and AWS
• Experience working in both relational and non-relational databases such as SQL Server, PostgreSQL, and MongoDB
• Experience managing and standardizing clinical data from structured and unstructured sources
• Experience building and managing solutions on AWS
• Familiarity with designing and building APIs, ETL and data ingestion processes and utilization of tools to support enterprise solutions
• Experience in performance tuning, query optimization, security, monitoring, and release management
• Experience working with and managing large, disparate, identified and de-identified data sets from multiple data sources
• Familiarity with building and deploying IAC using terraform, asset bundles and github

Tech Stack

• AWS
• Cloud
• ETL
• MongoDB
• Postgres
• Python
• Scala
• SQL
• Terraform
• Unity

Benefits

• Medical, Dental and Vision – Coverage for employees, dependents, and domestic partners
• Employee Assistance Program (EAP) – Confidential support for personal and work-related challenges
• 401(k) Plan – Includes a company matching program and profit-sharing contributions
• Discretionary Bonus Program – Recognizing employee contributions
• Flexible Spending Accounts (FSA) – Pre-tax savings for dependent care, transportation, and eligible medical expenses
• Paid Time Off (PTO) – Begins accruing on the first day of work. Full-time employees accrue 15 days per year, and employees working less than full-time accrue PTO on a prorated basis
• Holidays – A minimum of 10 paid holidays per year
• Family Building Benefits – Includes adoption and fertility assistance
• Paid Parental Leave – Up to 12 weeks of paid leave for employees who meet eligibility criteria
• Life Insurance & AD&D – 100% of premiums covered by Milliman
• Short-Term and Long-Term Disability – Fully paid by Milliman