Signature IT World IncRemote
Sr. Azure Databricks Engineer
United States
Full-time
5 hours ago
H1B Sponsor Likely
Key skills
PythonSQLMLETLELTDatabricksSparkApache SparkAzureCollaboration
About this role
Signature IT World Inc is seeking a Sr. Azure Databricks Engineer to develop and maintain robust ETL/ELT pipelines using Apache Spark and Pyspark on Databricks. The role involves collaboration with cross-functional teams to understand data requirements and deliver analytical solutions while ensuring data quality and performance tuning.
Responsibilities:
- Develop and maintain robust ETL/ELT pipelines using Apache Spark, Pyspark on Databricks
- Collaborate with cross-functional teams to understand data requirements and deliver analytical solutions
- Implement data quality checks, performance tuning, and scalable data models
- Leverage SQL, Python, and Spark to perform advanced data analysis and reporting
- Monitor and troubleshoot data workflows to ensure reliability and accuracy
Requirements:
- 10+ years of experience
- Proficiency in Databricks, Apache Spark, Pyspark and Azure data platforms
- Strong analytical and problem-solving skills with experience in data wrangling and visualization
- Expertise in SQL, Python, and data modeling techniques
- Familiarity with Delta Lake, ML flow, and notebook-based development
- Ability to interpret complex datasets and communicate insights effectively
- ADF
- DevOps
- Databricks certifications are nice to have