Lead Data Engineer
San Francisco, California, United States of America
Contract
2 weeks ago
Key skills
PythonSQLETLBIBusiness IntelligenceTableauDatabricksSparkKafkaAzure
About this role
Position: Lead Data Engineer
Location: San Francisco, CA - Hybrid
Duration: 9+Months with possible extension
Main skills: SQL, Databricks, ADF, DataStage (or other ETL tool), SSAS cubes, Cognos/other, Tableau/other, ThoughtSpot
Job Description:
We are seeking a Lead Data Engineer to design, implement, and maintain our data infrastructure and business intelligence solutions. This role requires a technical expert who can architect scalable data solutions while collaborating across teams to drive business insights.
Required Experience:
- 8-10 years of software development and deployment experience
- At least 7 years of hands-on experience with:
- SQL
- Databricks
- Azure Data Factory (ADF)
- DataStage (or other ETL tools)
- SSAS cubes
- BI tools (Cognos, Tableau, ThoughtSpot, etc.)
- Strong Database knowledge (SQL & No-SQL preferred)
- Advanced SQL and Python skills
- Experience working with APIs for data collection/ingestion
Key Responsibilities:
Technical Development:
- Write SQL for processing raw data, Kafka ingestions, ADF pipelines, data validation, and QA
- Lead, design and implement innovative analytical solutions using Tableau, SQL, and Big Data technologies
- Experience with storing, joining, filtering, and analyzing data using SQL, Spark, Hive, etc.