Computomic is a rapidly growing company focused on Data & AI solutions and financial crime prevention. They are seeking a Senior Data Engineer to work on enterprise scale Data & AI projects, mentor junior consultants, and contribute to thought leadership in data management and architecture.
Responsibilities:
- Work directly with end customers on enterprise scale Data & AI projects
- Mentor our growing team of junior Consultants
- Provide input into thought leadership in the areas of master data management, data modeling, data governance, data transformations, curation and data integration
- Help develop data architecture blueprints, patterns and frameworks that will enable reuse and standardization
- Help develop reusable frameworks, accelerators and internal product development
- Help grow the Data & AI practice by assisting with scoping, solutioning and estimating project effort and running pre-sales POC’s
Requirements:
- Certified and have deep knowledge of one or more popular cloud platforms (AWS, Azure, GCP). Strong abilities to provide a firm point of view on core cloud platform capabilities, security, and best practices
- Experience in building scalable streaming and batch solutions using cloud-native components
- Hands-on technical experience, building production grade data pipelines with Apache Spark and/or Databricks
- Experience building pipelines with CICD capabilities and strong knowledge of Apache Spark and/or Databricks Internals
- Ability to identify, debug bottlenecks and significantly optimize slow running data pipelines
- Proficient in Python (preferable) or Scala. Good understanding of design principles in Object Oriented and Functional programming techniques
- Experience migrating applications from legacy Hadoop or Data Warehouses to the cloud running Apache Spark or Databricks a huge plus
- Databricks technical certifications, knowledge of the lake house architecture, highly desirable
- You will bring very strong consulting skills, are customer focused and know how to navigate through tough project situations
- You are highly motivated, creative in your approach to technical problems and know how to leverage both internal and external networks
- You spend a significant amount of time to keep your technical skills updated and are constantly looking for the next big challenge
- You will bring both broad and deep knowledge in Data Engineering and can architect a solution by mapping a customer business problem to an end-to-end solution
- You are resourceful and confident under pressure
- You instill team confidence by consistently setting and achieving goals
- You look ahead and raises complications and issues early
- You demonstrate strong presentation and communication skills