Key skills
AzureCloudDockerETLKafkaNoSQLPostgresPySparkPythonSparkSQLAIELTDatabricksPostgreSQLSQL ServerGitCI/CD
About this role
Role Overview
- Lead the creation of innovative AI-driven solutions for client needs
- Supervise and mentor team members to secure quality outcomes
- Cultivate sturdy relationships with clients while addressing challenges
- Analyze complex problems and develop impactful strategies
- Foster a collaborative team environment to enhance performance
- Maintain adherence to project timelines and deliverables
- Utilize technology to improve processes and outcomes
- Drive continuous improvement initiatives within the team
Requirements
- Bachelor's Degree
- 7 years of experience
- Oral and written proficiency in English required
- Bachelor's Degree in Computer and Information Science, Database Administration, Management Information Systems, Software Applications, Cloud technologies preferred
- Demonstrating knowledge of data architecture and management
- Analyzing source systems for ETL/ELT components and ingestion flows for common data formats (JSON, Parquet, CSV).
- Strong programming skills in Python (mandatory), PySpark, Spark SQL, and SQL.
- Proven experience with Azure data services (ADF, Synapse, ADLS, and Databricks).
- Experience building high-volume batch and real-time pipelines using Spark and Kafka/Event Hubs.
- Solid understanding of relational databases (PostgreSQL/SQL Server) and basic NoSQL concepts.
- Familiarity with Git-based workflows, CI/CD, and containerization (Docker).
Tech Stack
- Azure
- Cloud
- Docker
- ETL
- Kafka
- NoSQL
- Postgres
- PySpark
- Python
- Spark
- SQL
Benefits
- Health insurance
- Paid time off
- Professional development opportunities