Principal Software Engineer – Data Infrastructure, Data Solutions

Role Overview

• Evolve existing source data pipelines to an ELT model of data ingestion
• Cleanly separate source-aligned data products from aggregate data products
• Richly decorate your data products with metadata to support knowledge transfer, adoption, and the application of Machine Learning and LLMs.
• Architect and build AI applications and intelligent features, leveraging large language models (LLMs) to enhance data products.
• Lead the design and implementation of new data pipelines specifically to support the training, fine-tuning, and deployment of AI/ML models.
• Tag and classify your data assets to ensure they are used responsibly throughout the organization, applying masking or restricting access where appropriate
• Apply software engineering best practices to your code release process to support CI/CD and a high velocity collaboration model based on InnerSource, including MLOps principles.
• Register and maintain the catalog entries for your data products and models to support discoverability and reuse
• Ensure your data products easily join with other business data products using common identifiers and keys
• Develop automated and resilient processes that support the end-end delivery of business value
• Publish and deliver on a data product SLO for your data ‘customers’
• Responsibly share your data products with other internal consumers while balancing the core needs of security and compliance
• Contribute feedback and recommendations to the Data Platform team in order to remove friction and increase scale for all users
• Write custom adapters to integrate internal data sources into the centralized Warehouse environment
• Mentor and provide technical guidance to other team members on best practices in AI application development and data governance.

Requirements

• Exceptional software, data, and AI/ML engineering skills that lead to elegant and maintainable data products and intelligent applications.
• Deep experience in developing, deploying, and operationalizing applications utilizing Large Language Models (LLMs).
• Familiarity with leading generative AI platforms and models, such as Claude, Gemini, or other equivalent open-source or proprietary LLMs.
• Expert level proficiency in using SQL for data transformation
• Proficiency in at least one general purpose programming language, eg. Python (preferred for AI/ML), Go, Java, Rust, etc.
• Strong opinions and perspectives that you kindly debate, defend, or change to ensure that the entire team moves as one
• Sets and resets the bar on all things quality, from code through to data, and everything in between
• Deep empathy for your users of your data products, leading to a constant focus on removing friction, increasing adoption, and delivering business results
• Prunes and prioritizes work in order to maximize your contributions and impact
• Bias for action and leading by example
• Past experience in building enterprise data products that have a high level of governance and compliance requirements, including working with regulated data for AI applications.

Tech Stack

• Java
• Python
• Rust
• SQL
• Go

Benefits

• Flexible working hours
• Professional development opportunities