Technical Lead – Cloud Data Engineering

System One is a leader in delivering outsourced services and workforce solutions across North America. They are seeking a Technical Lead for Cloud Data Engineering to lead a team in designing and implementing data engineering solutions for Azure Cloud-based platforms while ensuring effective migration from legacy systems.

Responsibilities:

• Lead a team of developers in designing and implementing data engineering solutions for Azure Cloud-based Data Lake, SQL, and NoSQL data stores
• Work directly with end users to translate business requirements into scalable cloud data solutions supporting enterprise analytics and reporting platforms
• Develop, deliver, and maintain ETL/ELT/data pipelines, data extracts, and API-based data delivery using Azure Data Lake Storage Gen2, Azure Data Factory, Synapse Pipelines, and other Azure services
• Ensure legacy EDW development and operations using Microsoft SQL Server, SSIS, SSRS, SSAS, PowerShell, and related technologies continue effectively during migration to the Azure Cloud platform
• Define and validate ETL performance testing, compare workloads against legacy baselines, and optimize throughput for scalable cloud performance
• Collaborate with IT infrastructure, DevOps, Data Engineers, Modelers, and Architects to optimize pipelines, troubleshoot issues, and tune system performance
• Design and support data models and pipelines for relational, dimensional, Lakehouse, data warehouse, data mart, SQL, and NoSQL data stores
• Prepare data for advanced analytics, visualization, reporting, and AI/ML applications
• Implement data migration, related data integrity, security, quality, and metadata management functions
• Monitor data systems, troubleshoot issues, and ensure high availability and performance of data platforms
• Support Agile DevOps practices, including program increment planning, configuration management, automation, and continuous learning

Requirements:

• Bachelor's degree in Computer Science or related field
• Minimum of 9 years of experience supporting enterprise data warehousing and cloud data solutions
• At least 5 years of leading a team supporting enterprise data warehouses using Microsoft data solutions
• Proven client engagement experience providing data engineering and reporting solutions
• Strong experience in ETL performance testing, using tools like Azure Monitor, Log Analytics, Spark UI, and Ganglia
• Extensive experience with Microsoft SQL Server, SSIS, SSRS, SSAS, and scripting languages such as SQL, T-SQL, Python, PowerShell in cloud environments
• Experience designing and building ETL/data engineering solutions utilizing Azure Data Lake, Azure Synapse Analytics, Azure Data Factory, and related cloud services
• Knowledge of data management best practices, including change management, QA, performance tuning, and security
• Experience working in Agile projects with cross-functional teams
• Strong attention to detail, multi-tasking skills, and ability to support multiple projects
• Experience in law, HR, financial management, inventory, or federal projects
• Azure DevOps or Microsoft certifications in Azure fundamentals, data engineering, AI, or analytics