Data Architect/Staff Engineer - Databricks

Raval West is seeking a hands-on Data Architect / Staff Data Engineer to design and build scalable, secure, and production-grade data systems on Databricks. The role involves developing data services, optimizing ETL/ELT pipelines, and ensuring compliance with HIPAA regulations.

Responsibilities:

• Design and develop scalable data services, APIs, and microservices for ingestion, transformation, and serving layers
• Build and optimize batch and real-time ETL/ELT pipelines for large-scale healthcare data
• Implement orchestration, monitoring, error handling, and fault-tolerant architectures
• Develop data products including APIs, SDKs, catalogs, and self-service platforms
• Establish data quality frameworks, CI/CD pipelines, and test-driven development practices
• Lead code reviews and mentor engineers on software and data engineering best practices
• Ensure HIPAA-compliant, secure data systems with proper access controls and audit logging
• Collaborate with engineering, platform, and data science teams to productionize data solutions

Requirements:

• Strong experience with Databricks and modern data engineering frameworks
• Expertise in distributed systems, streaming pipelines, and performance optimization
• Proven technical leadership in designing scalable, resilient data platforms
• Experience building secure, compliant healthcare data systems (HIPAA preferred)