Senior Data Engineer

Computomic is a rapidly growing company focused on Data & AI solutions and financial crime prevention. They are seeking a Senior Data Engineer to work on enterprise scale Data & AI projects, mentor junior consultants, and contribute to thought leadership in data management and architecture.

Responsibilities:

• Work directly with end customers on enterprise scale Data & AI projects
• Mentor our growing team of junior Consultants
• Provide input into thought leadership in the areas of master data management, data modeling, data governance, data transformations, curation and data integration
• Help develop data architecture blueprints, patterns and frameworks that will enable reuse and standardization
• Help develop reusable frameworks, accelerators and internal product development
• Help grow the Data & AI practice by assisting with scoping, solutioning and estimating project effort and running pre-sales POC’s

Requirements:

• Certified and have deep knowledge of one or more popular cloud platforms (AWS, Azure, GCP). Strong abilities to provide a firm point of view on core cloud platform capabilities, security, and best practices
• Experience in building scalable streaming and batch solutions using cloud-native components
• Hands-on technical experience, building production grade data pipelines with Apache Spark and/or Databricks
• Experience building pipelines with CICD capabilities and strong knowledge of Apache Spark and/or Databricks Internals
• Ability to identify, debug bottlenecks and significantly optimize slow running data pipelines
• Proficient in Python (preferable) or Scala. Good understanding of design principles in Object Oriented and Functional programming techniques
• Experience migrating applications from legacy Hadoop or Data Warehouses to the cloud running Apache Spark or Databricks a huge plus
• Databricks technical certifications, knowledge of the lake house architecture, highly desirable
• You will bring very strong consulting skills, are customer focused and know how to navigate through tough project situations
• You are highly motivated, creative in your approach to technical problems and know how to leverage both internal and external networks
• You spend a significant amount of time to keep your technical skills updated and are constantly looking for the next big challenge
• You will bring both broad and deep knowledge in Data Engineering and can architect a solution by mapping a customer business problem to an end-to-end solution
• You are resourceful and confident under pressure
• You instill team confidence by consistently setting and achieving goals
• You look ahead and raises complications and issues early
• You demonstrate strong presentation and communication skills