Azure Data Engineer (W2 ONLY)

Novia Infotech is seeking a skilled Senior Data & Software Engineer with extensive experience in building scalable enterprise applications and developing data solutions. The role involves designing and maintaining data systems, optimizing ETL pipelines, and implementing CI/CD practices in a collaborative Agile environment.

Responsibilities:

• Design, develop, and maintain enterprise-grade application services and data solutions
• Build and optimize ETL pipelines, data models, and large-scale data processing frameworks
• Develop software solutions using Python, Scala, Spark, and C#.NET
• Implement and manage CI/CD pipelines using Azure DevOps, YAML, and Terraform
• Create unit test plans, perform code reviews, and ensure high-quality software delivery
• Collaborate within Agile teams using Azure DevOps Boards and Work Items
• Monitor application performance and implement logging and troubleshooting solutions
• Support deployment automation and continuous improvement initiatives

Requirements:

• 8+ years of experience in software development and data engineering
• Strong experience with Python, Scala, Spark, PowerShell, and C#.NET
• Hands-on experience with Azure, SQL Server, Oracle, and Microsoft technologies
• Proficiency with Git, Azure DevOps, CI/CD pipelines, and Agile methodologies
• Experience with logging frameworks and application monitoring
• Knowledge of Machine Learning concepts and tools
• Excellent communication, teamwork, problem-solving, and stakeholder management skills