Senior Data Engineer

Role Overview

• Design, implement and maintain a robust, efficient and compliant application data repository and integration architecture.
• Work with Business and IT stakeholders to assist with data-related technical issues and provide application support.
• Coordinate, direct and oversee the work of third-party engineers through solution design reviews, code reviews and process reviews.
• Identify, design, and implement internal process improvements like, automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
• Research and analyze new technologies, methodologies and architectures for viability.
• Build and maintain a service-based architecture for web and mobile applications.
• Work independently within a scrum delivery team, with oversight from domain and enterprise architects, in support of business-critical applications.
• Contribute to the development of frameworks, guidelines, best practices and examples to ensure data structures and integration processes are accurate, compliant and secure.
• Implement telemetry indicators to monitor performance, quality metrics to track accuracy and access controls to ensure compliance.

Requirements

• Commitment to maintain client confidentiality and data security
• Communicate in a clear and service-oriented manner; use appropriate, professional language and grammar to effectively exchange ideas and information
• Ability to proactively work with both external and internal clients; relate with others in a professional manner to accomplish work responsibilities and objectives
• Ability to maintain regular, predictable attendance
• 7 or more years of Data Engineering experience in an oversight capacity
• Extensive domain-specific experience in the Financial Services industry
• Experience with Microsoft cloud-based technologies in a hybrid architecture
• RDBMS expertise with Microsoft SQL Server (on prem and Azure SQL): advanced T SQL, query design, execution plans, index strategies (clustered/non clustered, filtered, included columns), partitioning, statistics, and concurrency/isolation level
• Data modeling mastery: 3NF normalization, strategic denormalization for read models, star/snowflake schemas, surrogate vs. natural keys, referential integrity, and temporal tables for auditing/history
• Experience performing operational analysis on internal and external data and processes to uncover failure points and identify opportunities for improvement
• Experience designing and implementing API-oriented schemas for web and mobile application performance and optimization
• Holistic awareness of processes supporting data preparation, metadata, dependencies, lineages, compliance and workload management
• Understanding of meta-model and metadata management requirements
• Security and governance experience: RBAC, least privilege, secrets management, PII handling, encryption at rest/in transit, row level security, auditing, and compliance (e.g., SOC2, HIPAA, GDPR) Specific skills include:
• Extensive experience with Microsoft Fabric: pipelines, notebooks, Lakehouse/Warehouse concepts, and Medalion architecture
• Experience with Azure DevOps: CI/CD pipelines for AIS and Fabric assets
• ETL/ELT and data movement: SSIS/ADF/Azure Data Factory or modern pipelines (dbt, Airflow), CDC/change tracking, bulk load (BCP, BULK INSERT), and data quality checks Experience designing metadata-driven and reusable integration patterns
• Experience with API Management (APIM): API design, security (OAuth/JWT), policies, and versioning
• Experience in reverse-engineering, refactoring and migrating legacy applications
• Experience with Service Bus / Event Grid design patterns: asynchronous and event-driven integrations
• Experience with scripting languages such as: Python
• Experience with MDM concepts (golden record, survivorship, matching, data quality)

Tech Stack

• Airflow
• Azure
• Cloud
• ETL
• MS SQL Server
• Python
• RDBMS
• SQL
• SSIS

Benefits

• Medical, Dental and Vision
• Company 401(k)and ESOP contribution
• Generous sick, vacation, and maternity/parental leave
• Paid holidays
• Professional Development Opportunities
• Tuition Reimbursement ($15,000 lifetime cap)
• Discounted personal insurance including home, auto and recreational vehicles
• Charitable gift-matching program
• Davidson Day of Giving – Our tradition of positively impacting communities in which we live and work.