Engineering and maintaining innovative, customer centric, high performance, secure and robust solutions
Producing complex and critical software rapidly and of high quality which adds value to the business
Working in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning
Collaborating to optimise our software engineering capability
Designing, producing, testing and implementing our working software solutions
Working across the life cycle, from requirements analysis and design, through coding to testing, deployment and operations

At least six years of experience working with PySpark
Experience with AWS Data Engineering eco Systems like Athena, Glue Catalog, S3, EMR Serverless, and Airflow
Experience of working with development and testing tools, bug tracking tools, and wikis
Experience in multiple programming languages or low code toolsets
Experience of DevOps and Agile methodology and associated toolsets
A background in solving highly complex, analytical and numerical problems
Experience of implementing programming best practice, especially around scalability, automation, virtualisation, optimisation, availability, and performance

AWS Pyspark Developer

Key skills