Weekday (YC W21)Remote
Senior Databricks Engineer
India
Full Time
2 hours ago
$1,500,000 - $3,000,000 INR
No H1B
Key skills
AirflowApacheAzureCloudETLPythonSparkSQLAIMLNLPLLMELTData EngineeringDatabricksApache Airflow
About this role
Role Overview
- Design and lead the development of scalable, cloud-native data platforms
- Create high-performance pipelines using Python and SQL
- Collaborate with ML teams on LLM/BERT-based data workflows
- Architect and implement high-performance data engineering solutions
- Build robust ETL/ELT pipelines
- Lead projects related to data architecture, feature engineering, and AI-driven data workflows
Requirements
- Minimum 5 years
- Degree in CS/IT preferred
- Databricks
- Apache Airflow
- Spark
- Delta Lake
- Data Architecture
- ETL/ELT
- Python
- SQL
- Azure
- LLMs/NLP
Tech Stack
- Airflow
- Apache
- Azure
- Cloud
- ETL
- Python
- Spark
- SQL