Senior Data Engineer

Emergent Software is a fast-growing software development, cloud consulting, and data engineering company serving clients across the country. They are seeking a Senior Data Engineer who is passionate about designing, maintaining, and optimizing modern data platforms using Microsoft data solutions. The role involves leading data engineering teams, architecting data platforms, and mentoring junior engineers.

Responsibilities:

• Architect end-to-end data platforms on Azure, ensuring scalability, resilience, and future-proof design
• Lead design reviews and architectural decisions for large or complex client data projects
• Contribute to defining data engineering best practices, coding standards, and reusable frameworks across the team
• Mentor and coach junior engineers on advanced Azure services, performance tuning, and cloud-native patterns
• Collaborate with Data Architects to define data models, schemas, and integration patterns
• Drive cloud cost optimization strategies, ensuring clients use the right services at the right scale
• Evaluate and recommend new Azure tools and technologies for inclusion in Emergent Software’s offerings
• Lead client advisory on data platform modernization, migration strategies (e.g., on-prem to Azure), and data engineering maturity
• Contribute to thought leadership, such as blog posts, webinars, or speaking engagements on Azure data topics
• Design, develop, and maintain data pipelines using Azure Data Factory, Synapse Pipelines, or Azure Batch
• Build and optimize data storage layers (Azure OneLake, Azure SQL, Synapse Analytics) for structured, semi-structured, and unstructured data
• Implement data transformation logic (ETL/ELT) using Spark, Python, SQL, or Azure Data Factory
• Ensure data quality, validation, and lineage using tools like Azure Purview and integrate with governance frameworks
• Collaborate with BI teams to prepare curated data models and tables for reporting in Power BI or downstream systems
• Manage data security, privacy, and compliance (RBAC, encryption, sensitive data masking) across Azure services
• Monitor and optimize pipeline performance and cost efficiency using Azure Monitor and cost management tools
• Develop and maintain CI/CD pipelines for data projects using Azure DevOps
• Document data engineering solutions and adhere to Emergent Software’s delivery standards and Agile practices

Requirements:

• 5-10 years experience working in data-specific roles
• Advanced understanding of data modeling design patterns such as 3NF and star-schema
• Data warehouse design experience using medallion architecture
• Experience with Microsoft Fabric, Synapse or Snowflake
• ETL tools such as Azure Data Factory
• Experience using a scripting language for data transformation
• Performance tuning databases and long running queries
• Stored procedure development
• Experience working with unstructured/structured large-scale data
• Advanced SQL syntax
• Advanced Python scripting
• Experience with real-time data processing
• Holding Microsoft certification(s) in the Data & AI solutions field are a plus
• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Certified: Fabric Data Engineer Associate (DP-700)
• Microsoft Certified: Power BI Data Analyst Associate (PL-300)