Key skills
SQLSnowflakeDatabricksAzure Data FactoryData governancePythonData visualizationHealthcare domainCloud-native architecturesAgile methodologiesMicrosoft DP-203Power BITableauProblem-solvingAttention to detailETLELTAnalyticsBIAzureAgile
About this role
Horizontal Talent is seeking a highly skilled Senior Data Engineer to join their team and contribute to innovative data solutions. The role involves designing and implementing scalable data architectures, developing ETL/ELT pipelines, and ensuring data security and compliance.
Responsibilities:
- Design and implement scalable data architectures and models
- Develop and maintain ETL/ELT pipelines using Azure Data Factory and Databricks
- Optimize data storage and retrieval in Snowflake and relational databases
- Ensure data security, governance, and compliance with enterprise standards
- Collaborate with cross-functional teams for data integration and analytics
- Perform data validation and regression testing for ETL processes
- Analyze existing business processes and identify improvement opportunities
- Document workflows and create standard operating procedures for data-related operations
Requirements:
- Design and implement scalable data architectures and models
- Develop and maintain ETL/ELT pipelines using Azure Data Factory and Databricks
- Optimize data storage and retrieval in Snowflake and relational databases
- Ensure data security, governance, and compliance with enterprise standards
- Collaborate with cross-functional teams for data integration and analytics
- Perform data validation and regression testing for ETL processes
- Analyze existing business processes and identify improvement opportunities
- Document workflows and create standard operating procedures for data-related operations
- Advanced proficiency in SQL for complex queries and performance tuning
- Hands-on experience with Snowflake, Databricks, and Azure Data Factory
- Strong understanding of data governance and quality assurance practices
- Excellent problem-solving skills and attention to detail
- Experience in the healthcare domain
- Familiarity with cloud-native architectures and agile methodologies
- Knowledge of Python and data visualization tools like Power BI or Tableau
- Relevant certifications such as Microsoft DP-203 or Azure Databricks