Key skills
AirflowApacheAzureETLPythonSparkSQLAIMLNLPLLMELTData EngineeringDatabricksApache Airflow
About this role
Role Overview
- Architect and implement high-performance data engineering solutions
- Build robust ETL/ELT pipelines
- Lead projects related to data architecture, feature engineering, and AI-driven data workflows
- Collaborate with ML teams on LLM/BERT-based data workflows
- Utilize Databricks, Apache Airflow, Spark, Delta Lake, Python, and SQL
Requirements
- Minimum 5 years
- Degree in CS/IT preferred
- Databricks
- Apache Airflow
- Spark
- Delta Lake
- Data Architecture
- ETL/ELT
- Python
- SQL
- Azure
- LLMs/NLP
Tech Stack
- Airflow
- Apache
- Azure
- ETL
- Python
- Spark
- SQL