Data Engineer II, AI Enablement
United States of America
Full Time
2 hours ago
Visa Sponsor
Key skills
SQLDatabase designSnowflakeData lakesMedallion data warehousingAWSPythonAWS GlueTerraformAIArtificial IntelligenceMLData WarehousingData LakeAnalyticsGlueCommunicationProblem Solving
About this role
Avalon Healthcare Solutions is the nation’s leader in diagnostic intelligence, focused on transforming diagnostic testing across the healthcare ecosystem. The Data Engineer, AI Enablement develops and maintains data pipelines and datasets to support analytical reporting and artificial intelligence solutions, ensuring data quality and efficiency improvements aligned with business goals.
Responsibilities:
- Evaluate data for completeness, reliability, veracity, published standards, and agreement-upon specifications coming to Avalon from external sources, including partners and clients
- Ingest lab and medical claims data and lab results into Snowflake databases for analytical use
- Extract and ingest structured data from sources such as SQL, CSV, JSON, and other formats into Snowflake and the data lake/AWS Iceberg
- Extract unstructured and semi-structured data from document- and text-based sources for ingest into Snowflake and the data lake/AWS Iceberg
- Curate data for advanced analytics, AI, and data science for use in Snowflake, Snowflake Intelligence, and Cortex toolset
- Build data systems and pipelines to generate reliable and repeatable processes to onboard data and move through our medallion environments
- Interpret data trends and patterns to support analytics and business use cases
- Assist in the development of pilot initiatives and tools using SQL, Python, AWS Glue, Snowflake, Terraform
- Explore ways to enhance data quality, integrity, and reliability
- Collaborate with team members across multiple concurrent projects
- Employ strong analytical, organizational, and problem-solving skills with acute attention to detail
Requirements:
- Strong, hands-on experience with SQL data management and database design, and preferably Snowflake data structures and best practices
- Excellent problem solving and communication skills
- Experience with data lakes and medallion data warehousing
- Ability and desire to learn new software, techniques, and methods
- Familiar with cloud service offerings such as AWS
- Healthcare experience – pharmacy, managed care, health plans, hospitals, pharmaceutical
- Experience with advanced analytics and AI and using AI/ML techniques and tools
- Ability to perform some analysis work directly