Key skills
AWSCloudJavaPySparkPythonSQLAnalyticsData MiningFargateS3GlueAthena
About this role
Role Overview
- Build and maintain scalable data pipelines to process and integrate e-commerce data from multiple sources.
- Design and implement a modern cloud-based data lakehouse architecture using AWS services such as S3, Athena, Glue, Fargate, and Iceberg
- Explore tools and solutions for high-performance data transformation and analysis, such as Polars, DuckDB, and PySpark.
- Work with data analysts to deliver accessible and well-structured datasets for reporting and advanced analytics.
- Collaborate architects on designing data platforms.
- Explore ways to enhance data quality and reliability
Requirements
- Knowledge of programming languages (e.g. Java and Python)
- Hands-on experience with SQL database design
- Previous experience as a data engineer or in a similar role
- Technical expertise with data models, data mining, and segmentation techniques
- Great numerical and analytical skills
- Willingness to learn and work with new tools and technologies**
Tech Stack
- AWS
- Cloud
- Java
- PySpark
- Python
- SQL