Design, develop, and maintain optimal data pipelines and workflows.
Provide technical guidance on architecture design and collaborate with Data Engineers for implementation.
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
Perform data integration, transformation, and cleaning to create insightful and actionable data for the business.
Translate business requirements into technical specifications and finished products.
Participate in code reviews and contribute to team knowledge sharing.
Lead the development and maintenance of documentation for data engineering processes and systems.
Create ad-hoc reports requested by internal and external partners.
Work as a team to support and troubleshoot errors for 100+ data pipelines.
Work closely with the application development team to update data and data structures.
Provide analysis, recommendations, and feedback to business process owners, leadership team, and the Information Technology department.
Propose automated solutions to repeated development tasks.
Requirements
Bachelor’s degree with major coursework in Computer Science or Business Administration/related field required. Equivalent work experience in a similar position may be substituted for educational requirements.
Experience in data engineering or a related field.
Strong proficiency in Python, T-SQL, SSMS, Databricks, and Azure Data Factory.
Experience with data integration, transformation, and data warehousing.
Strong understanding of data privacy and security regulations.
Ability to translate business requirements into technical specifications and finished products.
Proficiency in compiling data, creating reports, and presenting information.
Proven experience working in a fast-paced environment supporting multiple concurrent projects.
Strong written, verbal, and customer service skills.