Lead Data Engineer

Gandiv Insights LLC is seeking a Lead Data Engineer with extensive experience in software development and data engineering. This role involves designing scalable data architectures, building robust ETL pipelines, and leading BI solutions across cloud environments.

Responsibilities:

• Design and implement scalable data architecture and data models
• Develop and optimize SQL, Python, and ETL pipelines (Kafka, ADF, APIs)
• Lead BI tool implementation, reporting, and analytics solutions
• Optimize performance, ensure data governance, security, and quality
• Collaborate with cross-functional teams and mentor engineers
• Drive cloud-based data solutions using Azure/AWS, Spark, Hive, GitHub, Jenkins

Requirements:

• 8–10 years of experience in software development and data engineering
• 7+ years of hands-on expertise in SQL
• Hands-on expertise in Databricks
• Hands-on expertise in ADF
• Hands-on expertise in DataStage (or other ETL tools)
• Hands-on expertise in SSAS
• Hands-on expertise in Cognos
• Hands-on expertise in Tableau
• Hands-on expertise in ThoughtSpot
• Experience in designing scalable data architectures
• Experience in building robust ETL pipelines
• Experience in leading BI solutions across cloud environments (Azure/AWS)
• Advanced SQL & Python skills
• Strong database (SQL/NoSQL) knowledge
• Experience with cloud platforms (Azure/AWS)
• Experience with big data technologies
• Strong data modeling skills
• Strong analytics skills
• Strong stakeholder communication skills