Emergent Software is a fast-growing software development, cloud consulting, and data engineering company serving clients across the country. They are seeking a Senior Data Engineer who will be responsible for architecting end-to-end data platforms, leading design reviews, and mentoring junior engineers while collaborating with various teams to optimize data solutions.
Responsibilities:
- Architect end-to-end data platforms on Azure, ensuring scalability, resilience, and future-proof design
- Lead design reviews and architectural decisions for large or complex client data projects
- Contribute to defining data engineering best practices, coding standards, and reusable frameworks across the team
- Mentor and coach junior engineers on advanced Azure services, performance tuning, and cloud-native patterns
- Collaborate with Data Architects to define data models, schemas, and integration patterns
- Drive cloud cost optimization strategies, ensuring clients use the right services at the right scale
- Evaluate and recommend new Azure tools and technologies for inclusion in Emergent Software’s offerings
- Lead client advisory on data platform modernization, migration strategies (e.g., on-prem to Azure), and data engineering maturity
- Contribute to thought leadership, such as blog posts, webinars, or speaking engagements on Azure data topics
- Design, develop, and maintain data pipelines using Azure Data Factory, Synapse Pipelines, or Azure Batch
- Build and optimize data storage layers (Azure OneLake, Azure SQL, Synapse Analytics) for structured, semi-structured, and unstructured data
- Implement data transformation logic (ETL/ELT) using Spark, Python, SQL, or Azure Data Factory
- Ensure data quality, validation, and lineage using tools like Azure Purview and integrate with governance frameworks
- Collaborate with BI teams to prepare curated data models and tables for reporting in Power BI or downstream systems
- Manage data security, privacy, and compliance (RBAC, encryption, sensitive data masking) across Azure services
- Monitor and optimize pipeline performance and cost efficiency using Azure Monitor and cost management tools
- Develop and maintain CI/CD pipelines for data projects using Azure DevOps
- Document data engineering solutions and adhere to Emergent Software’s delivery standards and Agile practices
Requirements:
- 5-10 years experience working in data-specific roles
- Advanced understanding of data modeling design patterns such as 3NF and star-schema
- Data warehouse design experience using medallion architecture
- Experience with Microsoft Fabric, Synapse or Snowflake
- ETL tools such as Azure Data Factory
- Experience using a scripting language for data transformation
- Performance tuning databases and long running queries
- Stored procedure development
- Experience working with unstructured/structured large-scale data
- Advanced SQL syntax
- Advanced Python scripting
- Experience with real-time data processing
- Holding Microsoft certification(s) in the Data & AI solutions field are a plus
- Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
- Microsoft Certified: Fabric Data Engineer Associate (DP-700)
- Microsoft Certified: Power BI Data Analyst Associate (PL-300)