SunnyData is a company focused on data engineering and AI, seeking a Senior Data Engineer to support customers in their data engineering needs. The role involves designing complex data solutions, collaborating with teams, and ensuring data quality and governance for healthcare and life sciences clients.
Responsibilities:
- You will be part of a team responsible for supporting new and existing customers in their data engineering needs
- You will guide customers to make the best technical decisions to achieve their goals
- You will actively work across multiple customer accounts which you would need to track and report on their progress
- You will design, build, and operationalize complex data solutions, correct problems, apply transformations, and recommend data cleansing /quality solutions
- You will analyze sources to determine value and recommend data to include in analytical processes
- You will incorporate core data management competencies including data governance, data security and data quality
- You will collaborate within and across teams to support delivery and educate end users on data products / analytic environments
- You will perform data and system analysis, assessment and resolution for defects and incidents of moderate complexity and correct as appropriate
- You will test data movement, transformation code, and data components
Requirements:
- 5+ years of related experience in data engineering and data product development
- Experience in one or more of the following: Data Engineering technologies (e.g., Spark, Hadoop, Kafka)
- Experience in Databricks platform - data engineering and/or ML ops experience would be a huge bonus
- Experience in Data Science and Machine Learning technologies (e.g., pandas, scikit-learn, HPO)
- Experience in Data Warehousing (e.g., SQL, OLTP/OLAP/DSS)
- Solid understanding of the end to end data analytics workflow
- Demonstrated track record of domain expertise in healthcare (Payer/ Provider or Life Sciences) including the ability to understand technical concepts and possess in-depth knowledge of immediate systems worked on
- Proven problem solving skills including debugging skills
- Strong verbal and written communication skills
- Intermediate leadership skills with a proven track record of self-motivation in identifying personal growth opportunities
- Excellent time management and prioritization skills
- Knowledge of public cloud platforms AWS, Azure, or GCP would be a plus
- Bachelor's Degree in STEM related field or equivalent
- Databricks Certification