Implement and monitor data ingestion and processing pipelines across RAW, TRUSTED, and REFINED stages
Develop ingestion processes using AWS Lambda (Ingestor)
Manage data in S3 (Landing and Output) with formats: Parquet, JSON, execution metadata
Make data available for query and analysis via Amazon Athena
Develop, maintain, and evolve optimization models based on Genetic Algorithms
Evaluate model performance based on: solution quality, execution time, stability, and convergence
Continuously work to improve operational results
Integrate processing services with SQS for: triggering executions, asynchronous message consumption, returning results and metadata
Ensure efficient integration with the Planner (Front-End, Back-End, and Database)
Publish execution outputs: optimization results, logs, technical and functional metadata
Requirements
Full Stack professional with strong experience in data engineering and data science, specialized in Genetic Algorithms and operational optimization
End-to-end responsibility for the solution lifecycle: from data ingestion and processing to development, execution, monitoring, and continuous improvement of optimization models in an AWS cloud environment
Not a strict requirement but a plus: residing near Indaiatuba to attend on-site at least once per week
Leega is a company focused on efficient and innovative service for its clients
Our culture is inspiring and our values guide our day-to-day: ethics and transparency, pursuit of quality excellence, teamwork, economic, social and environmental responsibility, human relationships, and credibility
We seek innovative professionals who are driven by challenges and focused on results