Harnham is a specialist in data and analytics recruitment, connecting high-performing contractors with consulting teams. The Consulting Data Engineer role focuses on modernizing data platforms and enabling advanced analytics and ML use cases, requiring a blend of technical execution and consulting skills.
Responsibilities:
- Design cloud-native data architectures to support analytics and AI initiatives
- Build and optimise distributed data pipelines using Spark and modern data tooling
- Lead or support cloud and platform migrations, including best-practice delivery and documentation
- Implement deployment practices including CI/CD patterns and production readiness checks
- Partner with business and technical stakeholders to translate needs into delivered solutions
- Provide clear technical guidance, demos, and knowledge transfer to client teams
Requirements:
- 6+ years in data engineering, analytics engineering, or cloud data architecture
- Strong coding ability in Python or Scala
- Deep experience with Apache Spark and distributed data processing
- Experience with at least one major cloud platform (AWS, Azure, or GCP)
- Hands-on experience with a modern lakehouse platform (Databricks experience required)
- Strong communication skills and comfort working directly with clients
- CI/CD experience for data workloads and production deployments
- Working knowledge of MLOps concepts and ML lifecycle needs
- Migration experience from legacy or third-party platforms
- Experience scoping work, managing delivery timelines, and handling scope change