Involved from the early stages of drafting technical solutions tied within the Big Data team within the Data Engineering Team.
Draft architectures together with the Lead Big Data Engineer, Enterprise Data Architect and Lead BI to come up with the best possible architectures.
Use experience to size efforts of large tasks accordingly and this will be key for other key roles within the team.
Requirements
Assesses as-is the current data platform, defines future state platform together with the BDE team lead.
Performs gap analysis to drive the future state data platform (including implementation) with frequent discussions with internal parties such as the team lead, enterprise architect, data governance and data-devops.
Understands leading/emerging Big Data technologies and trends on the market and can communicate these effectively to a wide audience.
Clearly communicates any updates, new technologies or practises with the team lead and the BDE team in a clear manner.
Ensures that the BDE adheres to best practices, this ensures that coding standards and the accuracy, validity, and reusability of data is maintained.
Excellent working SQL knowledge and experience with both relational and columnar databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Collaboration with key stakeholders for specific research, work effort sizing.