Senior Data Engineer

D.A. Davidson Companies is an independent, employee-owned company with a rich history spanning 90 years. This Senior Data Engineer will be responsible for troubleshooting, expanding, and optimizing the existing data integrations and architecture, as well as refactoring and migrating legacy structures into cloud architectures.

Responsibilities:

• Design, implement and maintain a robust, efficient and compliant application data repository and integration architecture
• Work with Business and IT stakeholders to assist with data-related technical issues and provide application support
• Coordinate, direct and oversee the work of third-party engineers through solution design reviews, code reviews and process reviews
• Identify, design, and implement internal process improvements like, automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
• Research and analyze new technologies, methodologies and architectures for viability
• Build and maintain a service-based architecture for web and mobile applications
• Work independently within a scrum delivery team, with oversight from domain and enterprise architects, in support of business-critical applications
• Contribute to the development of frameworks, guidelines, best practices and examples to ensure data structures and integration processes are accurate, compliant and secure
• Implement telemetry indicators to monitor performance, quality metrics to track accuracy and access controls to ensure compliance

Requirements:

• Commitment to maintain client confidentiality and data security
• Communicate in a clear and service-oriented manner; use appropriate, professional language and grammar to effectively exchange ideas and information
• Ability to proactively work with both external and internal clients; relate with others in a professional manner to accomplish work responsibilities and objectives
• Ability to maintain regular, predictable attendance
• 7 or more years of Data Engineering experience in an oversight capacity
• Extensive domain-specific experience in the Financial Services industry
• Experience with Microsoft cloud-based technologies in a hybrid architecture
• RDBMS expertise with Microsoft SQL Server (on prem and Azure SQL): advanced T SQL, query design, execution plans, index strategies (clustered/non clustered, filtered, included columns), partitioning, statistics, and concurrency/isolation level
• Data modeling mastery: 3NF normalization, strategic denormalization for read models, star/snowflake schemas, surrogate vs. natural keys, referential integrity, and temporal tables for auditing/history
• Experience performing operational analysis on internal and external data and processes to uncover failure points and identify opportunities for improvement
• Experience designing and implementing API-oriented schemas for web and mobile application performance and optimization
• Holistic awareness of processes supporting data preparation, metadata, dependencies, lineages, compliance and workload management
• Understanding of meta-model and metadata management requirements
• Security and governance experience: RBAC, least privilege, secrets management, PII handling, encryption at rest/in transit, row level security, auditing, and compliance (e.g., SOC2, HIPAA, GDPR)
• Extensive experience with Microsoft Fabric: pipelines, notebooks, Lakehouse/Warehouse concepts, and Medalion architecture
• Experience with Azure DevOps: CI/CD pipelines for AIS and Fabric assets
• ETL/ELT and data movement: SSIS/ADF/Azure Data Factory or modern pipelines (dbt, Airflow), CDC/change tracking, bulk load (BCP, BULK INSERT), and data quality checks
• Experience designing metadata-driven and reusable integration patterns
• Experience with API Management (APIM): API design, security (OAuth/JWT), policies, and versioning
• Experience in reverse-engineering, refactoring and migrating legacy applications
• Experience with Service Bus / Event Grid design patterns: asynchronous and event-driven integrations
• Experience with scripting languages such as: Python
• Experience with MDM concepts (golden record, survivorship, matching, data quality)