Served as Cloud Data Architect for implementing Azure Cloud Data platform and services.
Strong experience in extracting, transformation, and landing data from various sources into data lakes, data warehouses and data marts using ETL tools such as Azure data factory and Custom Scripts.
Define next generation CI/CD processes and support test automation framework in the Microsoft Cloud as part of the build engineering team.
Strong experience in working with data transformation tool DBT (Data Build Tool) on top of Azure Databricks.
Deploying Databricks Notebooks using programming languages spark framework.
Analyze performance bottlenecks (SQL Plans) and provide optimization techniques in Microsoft Azure Data platform and Azure databricks.
Communicates development progress to IT team and business users as needed.
Develops root cause analysis to summarize and provide recommendations on the resolution of issues permanently.
Requirements
A bachelor’s degree from an accredited educational institution in a technical discipline (computer science, engineering, information systems)
5+ years’ experience in data extraction from multiple sources and building datalakehouse solution in Microsoft platform using Azure Data Factory, Azure Databricks and DBT as data transformation tool.
Experience in building data pipelines using Azure Data factory or equivalent technology.
5+ years’ experience in working with repositories like Azure DevOps, Git Hub or Bitbucket and developing CI/CD data pipelines.
5+ years’ experience in deploying, maintaining, provisioning the infrastructure of Microsoft Azure Services like Azure DevOps, Azure databricks and Azure Data factory.
2+ years’ experience in working with data governance tools like Microsoft Purview and Azure databricks unity catalog.
5+ years’ experience in working with any of the data visualization tools like Power BI, tableau and SAP Analytics Cloud.
5+ years’ experience developing Enterprise Datawarehouse/BI Solution on Cloud platform like Azure, AWS or GCP.
2+ years’ experience in managing cloud infrastructure; like resource management, security, compliance and resource cost optimization.