Senior Big Data/Machine Learning Engineer

EPITEC is seeking an experienced Senior Big Data / Machine Learning Engineer to design, build, and support enterprise-scale data platforms and real-time processing solutions. The role will focus on developing highly reliable, scalable batch and streaming data pipelines while collaborating with cross-functional Agile teams to deliver end-to-end data solutions.

Responsibilities:

• Design, develop, and maintain large-scale batch and real-time data pipelines that support enterprise data initiatives
• Build data ingestion, transformation, orchestration, and delivery solutions with an emphasis on scalability, performance, and reliability
• Develop and support event-driven architectures and real-time streaming solutions
• Collaborate with Agile teams to design end-to-end data engineering solutions from source systems through downstream consumption layers
• Optimize data processing workflows and improve overall platform performance
• Implement data quality, monitoring, observability, and alerting capabilities to ensure data reliability and SLA compliance
• Develop and maintain cloud-based data solutions leveraging modern data warehousing technologies
• Partner with stakeholders, architects, and engineering teams to translate business requirements into technical solutions
• Support secure credential management, secrets handling, and governance best practices across production environments
• Participate in code reviews, architecture discussions, and continuous improvement initiatives

Requirements:

• Must have a Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience
• 4+ years of experience building and supporting data pipeline and orchestration systems
• 4+ years of hands-on experience with Java, Python, and SQL
• 4+ years of experience working with real-time, streaming, or event-driven data platforms
• 4+ years of experience with distributed data processing technologies such as Kafka, Spark, Hadoop, EMR, or similar platforms
• 4+ years of experience working with cloud data warehousing solutions at scale
• 4+ years of experience utilizing cloud platforms including AWS, Azure, or Google Cloud Platform (GCP)
• 3+ years of experience with workflow scheduling and orchestration tools
• 2+ years of experience with secure secrets management and credential handling in production environments
• 2+ years of experience working within Agile software development teams
• Strong understanding of data engineering best practices, performance optimization, and scalable architecture design
• Experience implementing data observability frameworks, monitoring, alerting, and data quality solutions
• Background supporting highly regulated or compliance-driven industries, including financial services
• Familiarity with enterprise-scale machine learning platforms and model deployment pipelines
• Experience with DevOps, CI/CD automation, and infrastructure-as-code practices
• Strong communication and stakeholder management skills
• Experience designing highly available, fault-tolerant data platforms