Data Engineer

D.A. Davidson is hiring a Data Engineer to expand and optimize its data architecture and pipelines. The role monitors and improves data flows, collaborates with development teams, database architects, analysts, and end users, and helps ensure data delivery follows best practices.

Responsibilities:

• Design, implement and maintain a robust, efficient and compliant data pipeline architecture
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
• Build and maintain a service-based architecture for the publication of consumable data and information objects
• Work with data architects and data analysts to enhance and evolve the data environment
• Work with Business and IT stakeholders to assist with data-related technical issues and support their data and information requirements
• Define and develop frameworks, guidelines, best practices and examples to ensure data structures and integration processes are accurate, compliant and secure
• Facilitate the development and implementation of data quality standards, data protection standards and adoption requirements across the enterprise
• Define indicators of performance and quality metrics and ensure compliance with data related policies, standards, roles and responsibilities, and adoption requirements
• Work in an on-call rotation to monitor, troubleshoot and resolve data integration alerts and failures

Requirements:

• 5 or more years of Data Engineering experience in an oversight capacity
• Extensive domain-specific experience in the Financial Services industry
• Experience with Microsoft cloud-based technologies in a hybrid architecture
• Advanced working TSQL knowledge and experience working with relational databases, query authoring, stored procedure development, end-to-end data pipeline development
• Experience performing operational analysis on internal and external data and processes to uncover failure points and identify opportunities for improvement
• Strong analytic skills related to working with complex, multi-layered data pipelines and dependent datasets
• Experience facilitating calls to capture end-user requirements with technical and non-technical users
• Holistic awareness of processes supporting data preparation, metadata, dependencies, lineages, compliance and workload management
• Understanding of data modeling concepts like:
• Conceptual data modeling
• Logical data modeling
• Relational data modeling
• Dimensional and multi-dimensional data modeling
• Understanding of meta-model and metadata management requirements
• Extensive experience with SQL syntax
• Experience designing and implementing data structures and interfaces for applications and business processes
• Experience with Microsoft Fabric: pipelines, notebooks, Lakehouse/Warehouse concepts, and Medalion architecture
• Experience with relational database platforms:
• Experience with data pipeline tools such as: SSIS and Azure Integration Services
• Experience using orchestration tools such as: ActiveBatch
• Experience with web services and API integrations
• Experience with scripting languages such as: Python and Powershell
• Experience with Agile, DevOps and DataOps methods and technologies: Source Code Control, Versioning, Test Automation, Continuous Integration, Automated Deployment, Recoverability, Telemetry, etc
• Commitment to maintain client confidentiality and data security
• Communicate in a clear and service-oriented manner; use appropriate, professional language and grammar to effectively exchange ideas and information
• Ability to proactively work with both external and internal clients; relate with others in a professional manner to accomplish work responsibilities and objectives
• preferably MS SQL Server