Senior Software Engineer, ML/AI Platform

Attentive is the AI marketing platform for 1:1 personalization redefining the way brands and people connect. The Senior Software Engineer will join the Machine Learning Platform team to build and maintain a foundational ML platform that supports the entire ML lifecycle, enabling the ML organization to enhance Attentive’s AI product suite.

Responsibilities:

• Unlock offline & real-time access to trillions of data points for our ML and Data Science teams
• Manage, expand, and optimize our feature store that enables feature engineering, multi-TB scale training jobs, and offline / real-time inferencing
• Support PB scale data operations on the feature store using Apache Spark, Spark Structured Streaming, Kafka, and Ray
• Partner with other teams and business stakeholders to deliver ML and AI initiatives

Requirements:

• You have been working in the areas of Data Engineering / MLOps for 5+ years, and have built and matured the pipelines of a PB-scale feature store
• You have deep Apache Spark, Spark Streaming, and Ray Data experience and built data pipelines for ML use cases using these tools
• You understand the correlation between data cardinality, query plans, configuration settings, and hardware and the impact of each on data pipeline performance
• You know/have created infrastructure for Training ML models/fine-tuning LLMs
• You understand the key differences between online and offline ML inferences and can voice the critical elements to be successful with each to meet business needs