VBeyond Corporation is seeking a Senior Data Engineering Lead to work on enterprise-scale cloud data platforms. The role involves managing data activities, leveraging ETL tools, and supporting the data lifecycle in a collaborative Agile and DevOps environment.
Responsibilities:
- Manage data activities including data requirements gathering, analysis, modeling, and issue resolution using approved technologies
- Handle data standardization, migration, transformation, validation, and quality assurance across multi-database platforms
- Leverage internal and external ETL tools for data processing and publishing
- Identify and maintain company databases, including data sources, structures, organization, and optimization
- Proactively identify complex data issues and ensure resolution by analyzing trends and data patterns
- Support client data lifecycle from discovery and implementation to ongoing maintenance
- Formulate and monitor policies, procedures, and standards for database management
- Respond to production defects and coordinate with Operations Manager for client communication
- Contribute to all phases of the data and software development lifecycle
- Create and maintain code in GitHub repositories for version and change control
- Support off-hours data processing and emergency requests when required
Requirements:
- Snowflake (Columnar MPP cloud data warehouse)
- DBT (ETL / transformation tool)
- Microsoft Azure Cloud Platform
- Azure Data Lake
- Azure Data Factory
- Azure Databricks
- SQL – strong expertise in database design, optimization, and tuning
- Python (programming and scripting)
- Shell Scripting
- Experience with CI/CD tools such as Jenkins
- Version control using GitHub
- Experience working in an Agile development environment
- Engineering Degree – BE/ME/BTech/MTech/BSc/MSc
- Pharmacy Domain
- Technical certification in multiple technologies is desirable