Data Engineer Lead

VBeyond Corporation is seeking a Senior Data Engineering Lead to work on enterprise-scale cloud data platforms. The role involves managing data activities, leveraging ETL tools, and supporting the data lifecycle in a collaborative Agile and DevOps environment.

Responsibilities:

• Manage data activities including data requirements gathering, analysis, modeling, and issue resolution using approved technologies
• Handle data standardization, migration, transformation, validation, and quality assurance across multi-database platforms
• Leverage internal and external ETL tools for data processing and publishing
• Identify and maintain company databases, including data sources, structures, organization, and optimization
• Proactively identify complex data issues and ensure resolution by analyzing trends and data patterns
• Support client data lifecycle from discovery and implementation to ongoing maintenance
• Formulate and monitor policies, procedures, and standards for database management
• Respond to production defects and coordinate with Operations Manager for client communication
• Contribute to all phases of the data and software development lifecycle
• Create and maintain code in GitHub repositories for version and change control
• Support off-hours data processing and emergency requests when required

Requirements:

• Snowflake (Columnar MPP cloud data warehouse)
• DBT (ETL / transformation tool)
• Microsoft Azure Cloud Platform
• Azure Data Lake
• Azure Data Factory
• Azure Databricks
• SQL – strong expertise in database design, optimization, and tuning
• Python (programming and scripting)
• Shell Scripting
• Experience with CI/CD tools such as Jenkins
• Version control using GitHub
• Experience working in an Agile development environment
• Engineering Degree – BE/ME/BTech/MTech/BSc/MSc
• Pharmacy Domain
• Technical certification in multiple technologies is desirable