Azure Data Engineer

Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. They are seeking a highly skilled Azure Data Engineer to design, build, and optimize enterprise-grade data solutions on Microsoft Azure, focusing on scalability, performance, and security.

Responsibilities:

• Data Architecture & Modeling
• Design and implement scalable data architectures using Azure Synapse Analytics, Azure SQL Database, and Azure Data Lake
• Develop logical and physical data models, ensuring normalization, dimensional modeling, and schema optimization
• Implement data governance, lineage, and cataloging using Azure Purview
• Data Integration & ETL
• Build and manage ETL/ELT pipelines using Azure Data Factory (ADF)
• Integrate structured, semi-structured, and unstructured data from multiple sources (on-prem, cloud, APIs)
• Optimize ingestion pipelines for batch and real-time streaming data using Azure Event Hub and Azure Stream Analytics
• Big Data & Analytics
• Work with distributed data processing frameworks (Databricks, Spark, Hadoop)
• Implement advanced analytics solutions, including machine learning pipelines in Azure ML
• Enable self-service BI through Power BI dashboards and semantic models
• Cloud & DevOps
• Deploy and manage data solutions using Infrastructure as Code (IaC) with ARM templates, Terraform, or Bicep
• Integrate CI/CD pipelines for data workflows using Azure DevOps or GitHub Actions
• Ensure high availability, disaster recovery, and performance tuning of data systems
• Security & Compliance
• Implement role-based access control (RBAC), encryption, and data masking
• Ensure compliance with GDPR, HIPAA, and enterprise security standards
• Monitor and audit data usage with Azure Monitor and Log Analytics
• Collaboration & Leadership
• Partner with data scientists, analysts, and business stakeholders to deliver insights
• Mentor junior engineers and enforce coding/data standards
• Drive best practices in data engineering and cloud adoption

Requirements:

• Education: Bachelor's/Master's in Computer Science, Data Engineering, or related field
• Experience: 7+ years in data engineering, with at least 4+ years on Azure cloud
• Technical Expertise: Azure Synapse, Azure SQL, Azure Data Lake, Azure Data Factory
• Technical Expertise: Databricks, Spark, Python, SQL, Scala
• Technical Expertise: Event Hub, Stream Analytics, Cosmos DB
• Technical Expertise: Power BI for visualization and reporting
• Technical Expertise: Strong knowledge of data warehousing, ETL, and big data concepts
• Soft Skills: Strong analytical and problem-solving skills
• Soft Skills: Excellent communication and stakeholder management
• Soft Skills: Ability to lead projects and work in Agile/Scrum environments
• Certifications: Microsoft Certified: Azure Security Engineer Associate (AZ-500)
• Certifications: Microsoft Certified: Azure Administrator Associate (AZ-104)
• Certifications: Databricks Certified Data Engineer Professional
• Certifications: AWS Certified Data Analytics – Specialty (for multi-cloud exposure)
• Certifications: Google Professional Data Engineer (for hybrid/multi-cloud strategies)
• Education: Bachelor's or Master's degree in Computer Science, Engineering, or related field
• Visa & Compliance: Candidates must be eligible for new H-1B filing
• Visa & Compliance: OPT, STEM OPT, CPT (with required experience), H-1B transfer, EAD
• Visa & Compliance: All filings will be handled as per USCIS and DOL compliance guidelines