Data Engineer

Role Overview

• SQL
• Data Visualization
• Data Analytics
• SQL performance
• SQL query tuning
• SQL monitoring
• SQL Data warehousing
• SQL Indexing
• Star Schema Design
• ETL processes
• Data modelling
• Azure Data Factory
• Azure Storage Accounts
• Blob Storage

Requirements

• Getting code into production: Ability to get code of all types—including new features, configuration changes, bug fixes, and experiments—into production, or into the hands of users, safely and quickly in a sustainable way.
• Requirement Analysis and Articulation: Ability to use relevant artifacts, approaches and processes to understand and communicate what is required and why it is required.
• Estimation: Ability to apply various estimation techniques to predict the most realistic amount of effort required to develop or maintain software based on incomplete, uncertain and noisy input.
• Continuous Integration: Ability to write code in a way that supports Continuous Integration of code, that is, frequently committing changes to a single trunk or master.
• Performance & Scalability Engineering: Ability to assess, recommend, design, implement, optimize, and troubleshoot measures to ensure systems perform as needed. This includes responsiveness, coping with traffic load, coping with large data sets, and processing times.
• Securing Applications: Ability to design and implement software which exhibits good security properties and which avoids common weaknesses and vulnerabilities.
• Legacy remediation: Ability to operate in or around older systems, and devise and execute strategies for modernizing and improving them. This includes awareness of a range of legacy architectures and the patterns and tactics for the stabilization, remediation or replacement of them.
• The ability to analyze the technical, business, and operational pain-points of applications and broader systems.
• Identifying incremental steps towards a future state architecture, including techniques for stabilizing with test harnesses, intercepting and rerouting or duplicating functional and data flows, extraction of services or tiers, wrapping with facades or adapters, refactoring, and strangulation and end-of-life.
• Emotional Intelligence: recognizes, understands and manages their own emotions and recognizes, understands, shares and influences the emotions of others.
• Collaboration: works jointly with others to co-create and achieve a common goal. This includes learning, practising and experimenting with tools, techniques and frameworks that foster collaborative working environments.

Tech Stack

• Azure
• ETL
• SQL