Crunchtime is a global software development company that provides solutions for the food industry. They are seeking a highly motivated Data Engineer to join their Connex product development team, where the role involves designing and implementing scalable data pipeline solutions, ensuring data quality, and collaborating cross-functionally to deliver integration solutions.
Responsibilities:
- Own the planning, estimation, and delivery of data engineering tasks and projects, partnering with project management to track progress, milestones, and risks
- Design and implement scalable data pipeline solutions by analyzing customer data, identifying patterns, and performing data profiling to reverse engineer schemas and APIs
- Build, optimize, and maintain high-performance data pipelines, delivery networks, and bi-directional data integrations between customers and partners
- Ensure data reliability and quality through robust development of automated unit, integration, and regression tests
- Troubleshoot complex data and integration issues, providing escalated technical support and driving root cause resolution
- Collaborate cross-functionally to deliver integration solutions, and provide technical guidance, training, and documentation to internal teams and stakeholders
- Monitor data pipeline health, proactively identify performance or reliability issues, and implement improvements to ensure system stability
- Contribute to best practices in data engineering, including code quality, testing standards, and scalable architecture
Requirements:
- 3+ years of professional experience in data engineering or software development with strong proficiency in SQL and Python
- Strong analytical and problem-solving skills with attention to detail and ability to work with complex datasets
- Experience designing and building scalable ETL/ELT pipelines, including working with APIs and handling structured and semi-structured data
- Solid understanding of data structures, algorithms, and data modeling concepts
- Experience with data validation, testing strategies (manual and automated), and ensuring data quality
- Strong communication and interpersonal skills, with the ability to work across teams and explain technical concepts clearly
- Ability to take ownership of tasks end-to-end, manage priorities, and deliver in a fast-paced environment
- Experience optimizing data pipelines for performance, scalability, and reliability