ComPsych is the worldwide leader in organizational mental health and well-being. They are seeking a Data Engineer to design and develop their new Data Platform, focusing on building and administering ETL pipelines to ingest data from various sources and collaborating with business owners to meet their data requirements.
Responsibilities:
- Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading (ETL) activities
- Gather requirements and business process knowledge to transform data in ways that meet end-user needs
- Create new SDLC processes as needed and maintain and improve existing processes
- Ensure data architecture is scalable and maintainable
- Collaborate with business stakeholders and colleagues to design and deliver accurate, high-quality data
- Investigate data to identify potential issues within ETL pipelines, notify end users, and propose effective solutions
- Prepare and maintain documentation for future reference
- Additional duties as assigned
Requirements:
- Advanced SQL proficiency (query performance tuning, index maintenance, etc.) and understanding of database structures
- Strong knowledge of data modeling principles
- Deep expertise in Azure Databricks (3+ years of experience required)
- Deep expertise in Python (3+ years of experience required)
- Knowledge of various SQL/NoSQL data storage mechanisms and Big Data technologies
- High attention to detail
- Strong organizational skills, including time management and planning
- Passion for complex data structures and problem-solving
- Ability to quickly learn new data tools and concepts
- Bachelor's degree or equivalent preferred
- Prior experience with Employee Assistance Programs or Leave Administration preferred