Data Engineer – Spark Expert
Marseille, Provence-Alpes-Côte d'Azur, France
Full Time
2 hours ago
$40,000 - $45,000 EUR
Key skills
ApacheCloudFluxKafkaKubernetesMongoDBSparkData EngineeringApache Spark
About this role
Role Overview
- Analyze, optimize and evolve the data pipeline
- Design and provide architectural recommendations for real-time processing systems
- Write target architecture and recommendation documents
- Ensure the reliability and performance of the data pipeline in production
- Oversee Kafka Connect streams and ensure correct data processing
Requirements
- At least 5 years' experience in demanding Data Engineering environments
- Advanced expertise in Apache Spark for both streaming and batch processing
- Data modeling and structuring with MongoDB
- Design and operation of data pipelines using Kafka / Kafka Connect
- Deployment of Apache Spark on Kubernetes
- Deployment and operation of cloud infrastructures (OVH Cloud)
Tech Stack
- Apache
- Cloud
- Flux
- Kafka
- Kubernetes
- MongoDB
- Spark
Benefits
- Thoughtful, people-focused onboarding
- Close, accessible management
- Continuous access to training
- Concrete commitments: inclusion, equality, solidarity
- A comprehensive HR package: health insurance, meal vouchers, works council (CSE), and supplementary insurance
- A culture of feedback and meaningful projects