Role Overview
Key Responsibilities:
- Design and implement end-to-end data pipelines using Azure Databricks, Azure Data Factory, and ADLS Gen2.
- Build scalable and performant data models for data lakes (Medallion architecture), data warehouses, and operational systems.
- Develop ELT/ETL frameworks for ingestion from APIs, relational sources, flat files, and third-party systems (e.g., Dynamics 365, Veeva, EDC).
- Optimize data transformations, partitioning, and delta lake performance for analytics workloads.
- Leverage Python and PySpark for data ingestion, cleansing, enrichment, and advanced transformations.
- Implement CI/CD pipelines for data workflows using Azure DevOps and Git, including automated testing, deployment, and monitoring.
- Develop and integrate RESTful APIs for cross-system data exchange and automation.
Requirements
Qualifications and Requirements:
- Minimum of 5 years of experience as a Data Developer or in a similar data-focused role.
- Expert-level in Databricks, PySpark, SQL, and Azure DevOps
- Data engineering: Data modeling, Delta Lake optimization, ETL/ELT design, distributed processing.
- Integration & Automation: Azure Data Factory, REST APIs, CI/CD pipelines, Git branching strategies.
- Analytics & BI: Power BI (Tableau), semantic layer design, DAX/SQL tuning.
- Cloud & DevOps: Azure ecosystem (ADF, ADLS, Azure SQL, Synapse), Infrastructure as Code
- Data Governance & Quality: Metadata management, data validation frameworks, logging and monitoring.
Tech Stack
- Azure
- Cloud
- ETL
- PySpark
- Python
- SQL
- Tableau
Benefits
Benefits of working at Allucent include:
- Comprehensive benefits package per location
- Competitive salaries per location
- Departmental Study/Training Budget for furthering professional development
- Flexible Working hours (within reason)
- Leadership and mentoring opportunities
- Participation in our enriching Buddy Program as a new or existing employee
- Internal growth opportunities and career progression
- Financially rewarding internal employee referral program
- Access to online soft-skills and technical training via GoodHabitz and internal platforms
- Eligibility for our Spot Bonus Award Program in recognition of going above and beyond on projects
- Eligibility for our Loyalty Award Program in recognition of loyalty and commitment of longstanding employees