Key skills
ApacheAzureCloudETLNumpyPandasPostgresPythonSparkSQLNumPyELTData EngineeringData WarehousingData LakeSnowflakeDatabricksApache Sparkdbt
About this role
Role Overview
- Design, develop, and optimize scalable and reliable data pipelines for healthcare claims data
- Work closely with data scientists and analysts to understand data requirements
- Implement and maintain data quality checks and validation processes
- Develop and manage data schemas and documentation for claims-related data assets
- Monitor and troubleshoot data pipeline performance and implement optimizations
- Collaborate with engineering teams to integrate data solutions with applications
- Evaluate and recommend new technologies and tools for data engineering capabilities
- Ensure compliance with healthcare data regulations (e.g., HIPAA)
Requirements
- 7+ years of professional experience in data engineering with a focus on healthcare claims data
- Expert proficiency in SQL and experience with various databases (e.g., Databricks, Postgres)
- Strong programming skills in Python and experience with data manipulation libraries (e.g., Pandas, NumPy)
- Extensive experience with ETL/ELT tools and platforms (e.g. Azure Databricks, dbt, Apache Spark, Azure Data Factory, Snowflake)
- Demonstrated experience with cloud data platforms (Azure preferred)
- Strong understanding of healthcare claims data standards (e.g., X12 EDI 837, 835)
- Experience with data warehousing concepts and data lake architectures
- Knowledge of data governance principles and compliance requirements in healthcare
Tech Stack
- Apache
- Azure
- Cloud
- ETL
- Numpy
- Pandas
- Postgres
- Python
- Spark
- SQL
Benefits
- Competitive compensation package
- Health insurance
- Bonuses
- Flexible work arrangements