PhD Fellow, Data Engineering, Pipeline, PySpark

Role Overview

• Plan and align the project with the Androidization strategy
• Gather and validate functional and technical requirements
• Design the solution architecture and data model
• Automate the integration and processing of operational data
• Model and automate refined tables with business rules
• Implement proactive monitoring and alerts
• Publish and validate tables in the production environment
• Document the entire technical and functional structure of the platform
• Conduct training sessions and formalize the technical handover

Requirements

• Degree: PhD
• Education: Computer Engineering, Computer Science, Statistics, or related fields
• English: Intermediate
• Solid knowledge of data engineering using Python
• Basic knowledge of cloud computing platforms
• Experience with code versioning using Git
• Knowledge of PySpark
• Knowledge and experience with the Databricks platform is desirable
• Knowledge of data modeling for Power BI is desirable
• Knowledge of Information Security, Change Management, Compliance, and AI regulations is desirable

Tech Stack

• PySpark
• Python