System One is a leader in delivering outsourced services and workforce solutions across North America. They are seeking a Technical Lead for Cloud Data Engineering to lead a team in designing and implementing data engineering solutions for Azure Cloud-based platforms while ensuring effective migration from legacy systems.
Responsibilities:
- Lead a team of developers in designing and implementing data engineering solutions for Azure Cloud-based Data Lake, SQL, and NoSQL data stores
- Work directly with end users to translate business requirements into scalable cloud data solutions supporting enterprise analytics and reporting platforms
- Develop, deliver, and maintain ETL/ELT/data pipelines, data extracts, and API-based data delivery using Azure Data Lake Storage Gen2, Azure Data Factory, Synapse Pipelines, and other Azure services
- Ensure legacy EDW development and operations using Microsoft SQL Server, SSIS, SSRS, SSAS, PowerShell, and related technologies continue effectively during migration to the Azure Cloud platform
- Define and validate ETL performance testing, compare workloads against legacy baselines, and optimize throughput for scalable cloud performance
- Collaborate with IT infrastructure, DevOps, Data Engineers, Modelers, and Architects to optimize pipelines, troubleshoot issues, and tune system performance
- Design and support data models and pipelines for relational, dimensional, Lakehouse, data warehouse, data mart, SQL, and NoSQL data stores
- Prepare data for advanced analytics, visualization, reporting, and AI/ML applications
- Implement data migration, related data integrity, security, quality, and metadata management functions
- Monitor data systems, troubleshoot issues, and ensure high availability and performance of data platforms
- Support Agile DevOps practices, including program increment planning, configuration management, automation, and continuous learning
Requirements:
- Bachelor's degree in Computer Science or related field
- Minimum of 9 years of experience supporting enterprise data warehousing and cloud data solutions
- At least 5 years of leading a team supporting enterprise data warehouses using Microsoft data solutions
- Proven client engagement experience providing data engineering and reporting solutions
- Strong experience in ETL performance testing, using tools like Azure Monitor, Log Analytics, Spark UI, and Ganglia
- Extensive experience with Microsoft SQL Server, SSIS, SSRS, SSAS, and scripting languages such as SQL, T-SQL, Python, PowerShell in cloud environments
- Experience designing and building ETL/data engineering solutions utilizing Azure Data Lake, Azure Synapse Analytics, Azure Data Factory, and related cloud services
- Knowledge of data management best practices, including change management, QA, performance tuning, and security
- Experience working in Agile projects with cross-functional teams
- Strong attention to detail, multi-tasking skills, and ability to support multiple projects
- Experience in law, HR, financial management, inventory, or federal projects
- Azure DevOps or Microsoft certifications in Azure fundamentals, data engineering, AI, or analytics