Build and maintain systems that collect, store, process, and analyse data
Build and maintain data architectures pipelines for data transfer and processing
Design and implement data warehoused and data lakes
Develop processing and analysis algorithms
Collaborate with data scientists to build and deploy machine learning models
Lead a team performing complex tasks as an Assistant Vice President

Experience in ETL / data processing / data warehousing / data engineering / RDBMS / PySpark
Experience in Data Processing and ETL in On-prem and Cloud based systems
Preferred AWS cloud development, with a strong understanding of AWS services (e.g., EC2, S3, Lambda, RDS, DynamoDB, etc.)
Proficient in at least one Python programming language
Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform etc.
Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment
Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms
Good knowledge of monitoring, logging, and troubleshooting tools (e.g., CloudWatch, CloudTrail)
Experience with version control systems (Git, GitHub, Bitbucket)
Strong communication skills and ability to work in a collaborative team environment

Data Engineer

Key skills