Senior Data Engineer

Emergent Software is a fast-growing software development, cloud consulting, and data engineering company serving clients across the country. They are seeking a Senior Data Engineer who will be responsible for architecting end-to-end data platforms, leading design reviews, and mentoring junior engineers while collaborating with various teams to optimize data solutions.

Responsibilities:

• Architect end-to-end data platforms on Azure, ensuring scalability, resilience, and future-proof design
• Lead design reviews and architectural decisions for large or complex client data projects
• Contribute to defining data engineering best practices, coding standards, and reusable frameworks across the team
• Mentor and coach junior engineers on advanced Azure services, performance tuning, and cloud-native patterns
• Collaborate with Data Architects to define data models, schemas, and integration patterns
• Drive cloud cost optimization strategies, ensuring clients use the right services at the right scale
• Evaluate and recommend new Azure tools and technologies for inclusion in Emergent Software’s offerings
• Lead client advisory on data platform modernization, migration strategies (e.g., on-prem to Azure), and data engineering maturity
• Contribute to thought leadership, such as blog posts, webinars, or speaking engagements on Azure data topics
• Design, develop, and maintain data pipelines using Azure Data Factory, Synapse Pipelines, or Azure Batch
• Build and optimize data storage layers (Azure OneLake, Azure SQL, Synapse Analytics) for structured, semi-structured, and unstructured data
• Implement data transformation logic (ETL/ELT) using Spark, Python, SQL, or Azure Data Factory
• Ensure data quality, validation, and lineage using tools like Azure Purview and integrate with governance frameworks
• Collaborate with BI teams to prepare curated data models and tables for reporting in Power BI or downstream systems
• Manage data security, privacy, and compliance (RBAC, encryption, sensitive data masking) across Azure services
• Monitor and optimize pipeline performance and cost efficiency using Azure Monitor and cost management tools
• Develop and maintain CI/CD pipelines for data projects using Azure DevOps
• Document data engineering solutions and adhere to Emergent Software’s delivery standards and Agile practices

Requirements:

• 5-10 years experience working in data-specific roles
• Advanced understanding of data modeling design patterns such as 3NF and star-schema
• Data warehouse design experience using medallion architecture
• Experience with Microsoft Fabric, Synapse or Snowflake
• ETL tools such as Azure Data Factory
• Experience using a scripting language for data transformation
• Performance tuning databases and long running queries
• Stored procedure development
• Experience working with unstructured/structured large-scale data
• Advanced SQL syntax
• Advanced Python scripting
• Experience with real-time data processing
• Holding Microsoft certification(s) in the Data & AI solutions field are a plus
• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Certified: Fabric Data Engineer Associate (DP-700)
• Microsoft Certified: Power BI Data Analyst Associate (PL-300)